I didnt change my m3 for the x5 but when I had both I felt like my needs to "burn" began to shrink. I live in a country were I can get a maximum from my m3 but after I got x5 (35d) i almost stopped driving m3. The acceleration and top speed are ofcourse slower but handling is extremly good and the higher driving position is very good thing too. They cannot replace each other its obvious but in my case I just settled for x5 flexibility. Its not a sport car but it is a very very fun car to drive on an every day basis.
Just days ago I sold my m3 and I dont feel like buying another one in the near future, maybe I ll buy bmw bike just to have it in my garage... I guess I would stiil be considered petrolhead like my friends always thought

.