Rear door speaker replacement

[donnyboy1]

Replacing the speakers in my X with BSW stage 1 upgrade. Front went fine; sounds bitchen! Having some issues with the rear. My car has the rear sunshades and I understand the vertical shade must be removed to allow removal of the door panel. The instructions from BSW suggest placing a small screwdriver in a notch at the top and lifting upward to release the metal latch, numerous posts on this site suggest pressing down; so far no luck.
If anyone has hands on experience removing this sunshade, I would appreciate any tips of tricks you may have. The last thing I want to do is jack up a $60.00 part.
As always, thanks in advance!
Don