Your situation occurred to me only once a while ago, and has never reoccurred. When it happened to me, I turned the car off, locked the car, waited 30s, then restarted, problem solved.

If it consistently happens, there is something wrong with your xDrive system likely. I would contact your dealer and have the tech ride with you, so you can demonstrate/replicate the problem.