With the actuator out of the door but plugged in, lock and unlock the door. You should see both lock levers move when locking and the first unlock press should see just the double lock lever move and then the second press you should see the primary lock lever move.

I suspect your secondary lock motor is worn out. See my repair thread: $12 to fix a $230 actuator .

__________________
2011 E70 • N55 (me)
2012 E70 • N63 (wife)