You're fine. My parents do this with some unfortunate frequency on every car because I'm the only one in the family that engages the handbrake every time I park the vehicle. The warning chime comes on and alerts them.