The weather/winters in NYC aren't that bad. If anything, at least in "the city," the height of the summer is worse.
I don't know if I believe you!
You're next to the ocean. That helps to regulate the winter weather. It's easy to put on a nice coat and scarf and make your way around in the winter. Really hot days in the summer are worse. No AC in the subway stations (plus lots of other places). And the smells. The smell of garbage baking in the sun, waiting to be picked up. The smell of dog piss reducing on the sidewalks, because there is no grass. You have to walk everywhere. Lots of places just aren't equipped to deal with it.
Of course, I could just be talking out of my ass.
*edit: I also just generally prefer relatively colder weather versus 90+ degree heat.