I'm not defending the numbnuts who said it, but I've been called that before. And typically, the person saying it is trying to find the least offensive term. (They've failed, if that's what they come up with, but the intent was there.) I've found this to be true especially of older people who regularly ask me, what are you? Meaning, what race are you? It's offensive, but they're curious.