Where ego comes in, loving kindness departs. So wherever there is ego, there is very little space for true bliss and true happiness because true bliss and true happiness isn't exclusive to the attachments the ego enjoys playing with, but rather a free state of mind that is part of loving kindness and its activities inside and outside of oneself.
When you deeply love someone from that space that is beyond attachment to certain projections or desires, when you love someone just deeply, totally, completely, without any games that the mind or emotions play, then that love remains eternal in the heavens forever, and that is what pulls you back to remembering that love.