I sincerely hope that no one ever says that I am a joyless person. I wouldn't mind very much being called ugly, or vain, or opinionated, or weird, because I think of myself as those things quite often. But to be called joyless? That would really hurt.
Go see what Father Dwight has to say about that.