"I hate the way, once you start to know someone, care about t..." — Tanith Lee quote meaning

I hate the way, once you start to know someone, care about them, their behavior can distress you, even when it's unreasonable and not your fault, even if you were really trying to be careful, tactful.