Well I sorted out the problem, turned out the piston in the tensioner house was installed backwards!

I don't recall taking the new tensioner apart so I am wondering if I was unlucky and got a new one out of the box with the piston installed backwards. Good thing I did not drive car for long.

Thank you to all who contributed and I hope anyone with a similar issue finds this thread.