I've had that bearing pull out when I was changing a CV axle on the passenger side once. I just put it back in the carrier. Has been working fine since and it hasn't popped out since. I suspect I might have had an off brand axle in there that was a little tighter than normal.