When we do good for others, it's because it makes us feel good. If we didn't feel any pride, any joy, any self-reward for doing good by others, we wouldn't do it.
It doesn't mean we're bad people, it just means we are people.
As long as you try to take others into account and don't demand anything unreasonable from the, you're not a bad person."
Credits to Miniar for this wonderful insight.