Whats The Deal With Unity

Why are so many people having so much trouble with Ubuntu's Unity UI? It has been around for a while and I for one think it is great. It's polished, looks good, and extremely easy to use.
Now granted 11.04 was a little sloppy but now that 11.10 has been around for a while it has been nothing but smooth sailing for me. 11.10 is by far more responsive and even easier to configure and tweak. Not to mention very stable.
I've read comments stating that it's hard to use and people don't like it, but how is that so? What is so hard about it? What is so bad about the design? Is it just people don't like change? If that's the case, then if Ubuntu would have stuck with Gnome then holy sh%t! Talk about change!

Anyways,

This is my desktop. What is so complicated?