Manual trans X5s, while not 'rare', are difficult to find, imo...
Our '01 is fun, runs like a freakin top, and has been nearly problem free over the past decade plus.
The 5th/top gear is shortish, however, and the highway rpms are considerable.
If the OP can find a 6 spd manual, ('04 - '06, if fading memory serves me), that 6th gear is slightly OD, and provides for lower highway rpms.
The 6 speed still has the stump puller 1st gear ratio, and same rear diff ratio, but that 6th gear 'helps'. Cool cars, not many of them out there in used car land, but worth the hunt if you want a manual trans X.
As to the OP's wonderment on owning two at the same time, while not dissuading you, my only thought is Xs are like wives; why would anyone want more than one.
GL, mD