As for the negative stuff people like to dish out to Hummer owners, I've said this before in another thread ...
What limited hassles I got were right after I bought the truck with Lux package. Chrome was everywhere.
I'm not much on chrome so gradually removed it. Since then I haven't heard one negative peep out of anyone. Not one. Maybe it's a coincidence, I don't know.
It also seems that the dirtier the truck is the more positive feedback I get. Had a car full of businessmen pull up next to me a stoplight last week and man, you should have seen their big eyes and smiles. They were like kids (in suits).
They were asking where I'd been, how the truck rides, etc. They were especially interested in the mud and puke. People like mud and puke on a truck, especially on a Hummer. People that know nothing about offroading know enough to know that's what the Hummer's for. And they respect when the truck is used for its intended purpose. Or at least that's my shallow theory...
So my advice is: got hassles? Go play in the mud. And take your kids. They'll take care of the puke.