It's not, because it's nothing worth worrying about! It was just a compliment.

[He lets out a little puff of breath, but he's not genuinely bothered.]

I guess that's true, though... It being what you make of it, I mean. But people deal with their feelings in different ways, and being able to take negative ones and make them into something productive is a good skill to have. So I guess that's the difference.