I remember Salty_Dog had a similar intermittent starting problem recently as well, and his was the ignition switch assembly also.

Cheap part and and easy to replace.
It is not the actual part that the key goes into, but the electronic bit behind it, so you don't need new keys etc.

__________________
2004 E53 X5 3.0d