Sorry but this must be a Brisbane thing.
I've put some real good km's on my X5 and have travelled all over NSW, Victoria & SA and I can honestly say that I have NEVER experienced this issue watrob.
I can let go of my wheel at any speed including most road surfaces without my wheel wanting to take a turn on it's own.