Thanks for your replies guys.

This morning I backed the parking brake shoes off more on both sides and it drove fine again.

This leads me to believe that there is too much slack in the cable to the hand brake? Thats why it took me having the shoes really tight just to get it to grab at 6 clicks. Does this make sense? It could've been the case that my parking brake wasn't grabbing before, I never really tested. Got the car 2 years from private seller.