I can't promise that using a hi-lo converter will solve your noise problem, but it is the correct way to do what you are attempting to accomplish, and doing it the way you are can cause problems, obviously.