OK, I think I have this figured out.

While on the call, press the phone's context menu button (top center). There is an option to "Use Handset". Click that, and you disconnect from the car's system.

I assume that other phones have some similar menu item.

__________________