I had the exact same symptoms. In my case, it was due to misfire on 2 cylinders. I replaced the 2 coils where the misfire was detected and I also decided to replace all the plugs. Running great so far...

__________________
2006 X5 4.4i LeMans Blue