The roots of low self-esteem may stem from a lack of unconditional love in childhood, which can deeply affect one's self-perception. Self-esteem is essentially the reputation you have with yourself, and it can be damaged if you don't live up to your own moral code, which is the same code you hold others to.