I think the real line here is between (1) people who understand the law and generally aren't bothered by the off-color remarks in this case, and (2) people who either don't understand the law or are personally offended by the judge's comments. I'd guess the conservative/liberal split is actually pretty mixed.