"Sometimes people with low self-esteem will try to punish you for caring about them."