Any wobble in the crank. Will wear out your bearings faster. And the crank nose mat eventually fatigue and break off. Your bearings and bearing caps may already be damaged. Unless you are going to flip it, I'd have the crank replaced and the bearing carrier crack checked.