Mine does same thing. I always thought it was due to the fact that there had been some really crappy body work done to it by previous owner and some thing was probably missing or misaligned.

__________________
1988 325is (purchased new) sold
2004 X5 3.0 2005 X3 2.5
2008 X5 3.0 (new to me)