There is a flat cut on the ball joint stud and that's where bolt no. 2 gets locked and prevent the ball joint to come out.So you may have to push or pull the ball joint little to free the bolt no. 2.
Also try to use some wedge to split open the groove.