Torquay United spurned a host of chances as they were upset by Blue Square Bet North side Harrogate Town.
Chib Chilaka was Harrogate's hero as he drove a shot in off the post from just inside the area after 19 minutes.
Rene Howe had an equaliser ruled out for offside 10 minutes after half-time.
Torquay had three second-half corners cleared off the line while teenage winger Niall Thompson missed a gilt-edged chance after an hour.
It is the first time in Harrogate's history that they have progressed beyond the first round of the FA Cup.
The closest they had previously come was against Torquay in 2005, when the Gulls beat Harrogate on penalties after a replay.
VIEWS FROM THE DRESSING ROOM
Torquay United manager Martin Ling tells BBC Radio Devon:
"For Harrogate to come here and beat us we needed to be poor and we were.
"No way do I point the finger at a lack of effort from Torquay United, but I'm massively disappointed and my players are massively disappointed.
"The supporters have every right to be disgruntled with that type of display."
Harrogate Town manager, Simon Weaver told BBC Radio York:
"Those celebrations, I've never known anything like it.
"It's taken some time at Harrogate, from getting the job in difficult circumstances.
"But I've tried to tackle everything in sight to prove I wanted to be in the game and I'm a very proud man.
"It would be great to get the pitch sorted out next week and look forward to a home tie."