Someone's opinion of you is not about you
An opinion says more about the person who holds it than the one it's about
- Zahra (Guidance By Z)
If someone holds an opinion about you and throws it in your face, it's not about you...
If someone really cares, they'd first try to understand if their perception is accurate by bringing the topic in a healthy way and clearing things before they become a misunderstanding.
In other words, you're not responsible for others' triggers.
