There should be a Schrader valve at the front or on top of the fuel rail.
A weak pump might not really start giving enough fuel pressure at starting voltage, but gets going enough at 13.5+v after running voltage.
Just a theory though, you're right to do diagnostics. I'm the type who enjoys using the parts cannon method of elimination.

Especially on original parts.