There have been reports that roof rails cause a lot of drag and hurt gas mileage.
Yes, Roof Boxes And Ski Racks Really Do Cut MPGāMore Than You Might Think
I remember reading stuff on Ecomodders, etc. I didn't have mine off for very long and I don't remember if I had any mileage increases with them off, though.