Hi. I never had this problem with my X5 diesel, but it seems to be quite similar to what happened with my E39 with a gasoline engine. It took me one hour to replace the mass air flow sensor, the sensor was inexpensive and the problem was solved.
I you make a search on Google using the phrase "x5 replace mass air flow sensor" you will find quite a lot of useful info.