Pulling the door panel off isn't difficult. I've done it often enough in a year of ownership that it only takes a couple of minutes.

__________________
2001 X5 Sport 3.0/5-speed
1998 318ti/5-speed
1988 735i/5-speed
1984 528e/5-speed (soon to be M20B25-powered 525i!)