I've got an 08' X5 and it does the same thing, I think this is just how it works.

__________________
2008 X5 4.8i Her's
2015 Denali HD DMAX Mine

2008 GMC DRW Mine (sold)
2008 X5 3.0si Her's (sold)
2004 530i 6 speed (sold)