Loving yourself is also about using other people as mirrors to see what they say about you. Why is that person pissing you off? What in this person triggers that thing in you? What does it say about you?
Always stay loving towards yourself and mentally thank that person in question for being used as a tool for your own growth