I know exactly what you mean. The 18's definitely provide more "cushion" than 20's. What if you compromised? > and went with a 19" wheel such as the awesome 132's.
I'm still debating on going to a larger wheel. My 18's coupled with BMW's tight suspension are already bumpy enough for me. However, I like the 132's so much I think trade off would be worth it.