^yup, sounds like something not related to the secondary air injection system.

As mentioned, check for air leaks at the engine air intake area between the engine air flow meter and intake manifold.

The big rubber intake elbow is a common culprit, it starts cracking at the creases and gets worse over time.

__________________
04 X5 3.0i auto
03 X5 4.6is