There are certain things in life that you need to work on, certain daily disciplines.
The same goes for your self-esteem.
I find it amusing how some people say they don't have self-esteem, and wonder why they feel emotionally exhausted from being used by other people.
You can't expect to rely on someone outside of you to make you feel esteemed.
What happens if that "other person" leaves you?
There is no one but you that can make YOU happy.
Here is a Jack Canfield article for you, about 5 Ways To Increase Your Self-Esteem.