They should come out easy if you pull on one of the short sides. I am thinking about replacing the bulbs with LEDs so that they can stay on for hours without harming the battery. That might solve also your problem.

Regards, H