Interchangeable

From different people I've heard the phrase "I don't want him/her out of my life." I don't exactly know all the situations that give rise to this statement, but I've thought about it in terms of myself. I wonder if there are people that feel that way about me. When I'm around people day-to-day constantly I get a lot of unsolicited interaction, but once I leave it seems like I'm always the one to send the first reconnecting message. It's not that I'm not memorable, people seem to remember me, but it seems like anytime I leave, those near me feel they have had their fill and don't need to chat anymore.
I don't think I'm particularly abnormal, but I also don't think there are too many people like me, so I can't be so replaceable that I'm not needed or sought after. I've always had a love-hate relationship with people and I'm usually picky about those I get close with, so I already have a small pool of people I really like; and then they move on and I'm left wondering if people ever don't want me out of their lives. There's sort of a disconnect where people aren't speaking openly about these things and the non-verbal meanings aren't getting through.