It's fine to switch while driving. I've done it many times without issues. I usually let up on the gas while I'm doing it, but even that is probably not necessary.