Haifagirl, you prove once again that grammarians are kind, courteous, civilized people.
Somebody else would probably have shot him.
And to the OP, that would certainly be a way of responding without any of the negative verbal connotations that distress you.