Bad news. The solvent I found will affect plastic. As a matter of fact, the rep says that any other solvent/chemical would probably affect the plastic too.

So, considering all this I'm gonna drop this project for now. I'm going to re-think this some more first before deciding what to do with my old headlights.