The CD changer has an on board fuse at the rear of the unit (the purple fuse in the picture below)
It would be worth pulling it out and checking it.
It does seem odd that you've had so many problems installing the battery. I have disconnected mine a few times without issue.