A Lee Tomlin penalty in extra-time injury-time saw Peterborough edge past Stevenage in the Carling Cup.
David Ball headed home from close range to open the scoring for Posh before Stacy Long levelled from 18 yards out.
Ball restored Posh's lead from the edge of the box and Michael Bostwick sent the game into extra-time with a superb 25-yard effort.
George Boyd scored from range for Posh and Chris Beardsley headed a leveller before Tomlin's winner.
With the 120 minute mark approaching, Jon Ashton fouled former Stevenage player Boyd in the area and Tomlin sent Alan Julian the wrong way to seal the sides' first ever competitive meeting.
VIEWS FROM THE DRESSING ROOM
Stevenage manager Graham Westley told BBC Three Counties Radio:
"The goals were sloppy, unnecessary, really disappointing and totally uncharacteristic.
"They were a sign perhaps that we've got a lot of work to do to get our team and squad attitude back in the right place because to concede four goals at home is a real disappointment.
"We're prepared to put in the graft, we're prepared to learn and take the punches on the chin and come back stronger, it's what we do here."
Peterborough United manager Darren Ferguson told BBC Radio Cambridgeshire:
"Some of the football we played was absolutely superb but we just couldn't get the second goal ahead.
"We've got players that can produce a bit of magic to win a game.
"Lee Tomlin's played a great ball to George (Boyd) and it's a blatant penalty, and Tomlin's stuck it away."