Rory McAllister's penalty in first-half stoppage-time was enough for Peterhead to beat Berwick Rangers and move off the foot of the Third Division.
Darren Gribben had the first chance of the night for the visitors after four minutes but his lobbed effort from the edge of the box was easily gathered by Raymond Jellema.
The home keeper did well to push Steven Notman's header around a post shortly afterwards, before Peterhead hit back and took control.
Their best early chance came when Scott Ross sent a header over the crossbar from six yards.
Berwick goalkeeper Jamie Barclay pulled off a stunning save to deny Bryan Deasley from close in just before the break, but he was beaten from the penalty spot moments later.
Andrew McLean brought down James Redman and McAllister gave the keeper little chance with a well-placed spot-kick.
David Ross should have done better with a close-range header, while Barclay did well to keep out fierce efforts from Graeme Sharp and Ross as Peterhead had to settle for a single goal.
Peterhead: Jellema, Donald, Scott Ross, MacDonald, McBain, David Ross (Davidson 86), Redman, Strachan, Sharp (Bavidge 61), McAllister (Wyness 82), Deasley. Subs Not Used: Jarvie, Robertson.
Goals: McAllister 45 pen.
Berwick Rangers: Barclay, Elliot Smith (Deland 15),Townsley, McLean, Thompson, Notman, Greenhill (Damon Gray 70), Currie, McDonald, Gribben (McLaren 70), Noble. Subs Not Used: Wood, Ponton.
Booked: Elliot Smith.
Ref: George Salmond