Onismor Bhasera's late strike earned nine-man Plymouth a replay in a scintillating first-round tie with Southern Premier side Stourbridge.
Warren Feeney's header put Argyle ahead before Aaron Drake headed in to level.
Ryan Rowe lobbed Romain Larrieu to put the Glassboys ahead before Carl Fletcher fired in from outside the box.
Sean Gebbis's penalty put the visitors back in front after Robbie Williams was sent off but Bhasera made it 3-3 before Conor Hourihane was also dismissed.
Williams was sent off after bringing down Rowe in the area while Hourihane left the field after receiving a second yellow card.
Stourbridge, who were beaten 1-0 by Walsall in the first round in 2009, are in the hat for the second round for the first time in their 135-year history.
But the Southern Premier promotion hopefuls came very close to causing one of the biggest upsets of the first round as they took the lead twice in the second half.
After Leon Broadhurst went close to heading them in front before the break, Rowe put the Glassboys ahead with a sublime lob from inside the area.
And after player-manager Fletcher rescued Argyle with his first FA Cup goal in 11 years, Gebbis's penalty looked to have sealed a deserved win before Bhasera struck late on.
VIEWS FROM THE DRESSING ROOM
Plymouth player-manager Carl Fletcher told BBC Radio Devon:
"It was a game that embodied the spirit of the FA Cup; full of excitement and lots going on.
"Full credit to Stourbridge, they gave us a real test today.
"Coming back twice shows the fighting spirit of the guys in the changing room."