Repair guide doesn't remove the oil filter housing it removes the charge pipes, and loosens the fitment of the AC compressor to move it out of the way.
I'm thinking the charge pipe flexed enough coming out that you got it to work but going in it's getting tighter as you're trying to go past.
You took the OFH off but the video below shows a trick to avoid that and it seems messing with the AC as well.
From the video it says to take the cover off the back during install/removal. That may give you the clearance you need.
https://youtube.com/shorts/536H18kekbY