I've had that problem on both E53's, and both times I replaced the upper control arms and that got camber back within spec.

The bushings were intact but had taken a set inward, pulling the top of the tires inward and causing negative camber.

__________________
04 X5 3.0i auto
03 X5 4.6is