Bothersome: Oh, don't worry at all; I have this friendly exchange with people all the time, and it's not at all "bothersome" to me. We're fine.
Leo: Empathy doesn't just mean helping people through bad times. It's part of the minute-to-minute dynamic of relationships, hand in hand with respect. Pay attention to the little things as well as the big ones, in assessing your relationships and what needs to improve. And, I would add, a lot of what you're looking for is probably in your relationship with your mother and the mistakes both of you have made over the years. See if there are ways that you are subconsciously emulating her in your relationships with others. I don't remember if you've talked about your father, but that's a question too. We have a tendency to replicate dynamics from parental relations in our other relationships.