The clip on the end of cable sleeve is harder than the ball on the end of the cable. There are two grooves one is just to screw with you.

If I recall Correctly the directions to push is toward back of door so you can prob use the back of a screwdriver handle etc to push on it.

__________________
2011 E70 • N55 (me)
2012 E70 • N63 (wife)