So I just replaced my struts (Bilsteins touring), shocks and also went with H&R sport springs (blue one) with the lowering links for the rear.

While changing, i discovered that one of my strut mount was busted... and this was the reason why it was 'loose/woobly' when going over the bumps in Queens.. lol. The other one was also very close to being ripped also.. I had to change them and... wait for it... ........ ..... the damn X handles freaking awesome now!
I also did an alignment (Hunter machine) and road force balancing ( was getting a shimmy at 60- 70 mph ) and my steering wheel was also straightened...

So - in conclusion, I am back to loving on the E53 again. lol
X handles like new... planted... accelerates better, stops better, turns better.