I have a 2008 X5 4.8. I do love my X5! The annoying things, well, you figure ways around things and build something of a relationship with your vehicle. I put 40k + a year on mine, so I am damn near married to mine.
Yeah, Mine had squeaks, but I fixed them. Mine doenst have the all button, so I have to tweak one more dial to keep my OCD about congruency in check.
I do roll down the rear windo on accidnet some times, but I am not in such a hurry that I dont stop it in time and simply move my hand slightly to do mine.
The leather is what it is. I had a 7 an dit was super nice. This is a "truck" for lack of a better term an d I like haveing a bit more rugged of a material .
The rest of it, well, we just arent going to have a car where EVERY little nuance makes sense. My X5 has quirks, but I work around these little issues. You say wahts annoying, I say I love how mine PIVOTS at times around corners, the engine snarls when I accelerate and the body roll is at a minimum on a cloverleaf. That can cover a lot of leatherette and misplaced buttons in my book.

__________________
Don't bother me, I'm wasting potential.