Why did you replace the fuel pump in the first place?

Were you experiencing these issues and then replaced the pump or did this start happening after you replaced it?

Sounds like a fuel starvation issue if it doesn't happen with a full tank