Mine had a similar wobble. It was very apparent when slowing down. Control arms, bushings, shafts, and guidos were all replaced. It was still there. Eventually, new rotors and brakes fixed it. I think the rotors were way out of flatness. The set on it were old from looks of them. A new hardware brake hard too. Remove the wheels and check the rotors.

__________________
'06 X5 3.0i - bought @143,123 miles (12/26/20)