Alloa Athletic's 15-match unbeaten run in Scottish Division Three came to an end as Berwick Rangers claimed victory at Recreation Park.
Ryan McCord crashed a volley against the crossbar as the hosts threatened in the first half.
The match's defining moment came just before the hour as Berwick's Damon Gray was fouled in the box by Ben Gordon and the striker converted the resulting penalty.
The visitors' Steven Notman was sent off following a second bookable offence but the 10 men held on to claim all three points.
Alloa: Bain, James Doyle, Gordon, Harding, McKinnon, Docherty (One 76), Young (Winters 82), Ryan McCord, Holmes (Ross McCord 67), May, Cawley. Subs Not Used: McDowall, McCullagh.
Booked: Ross McCord, One.
Berwick: Barclay, McLeod, Townsley, McLean, Thompson, McLaren (Ferguson 81), Notman, Ross Gray (Deland 46), Greenhill, Noble (Gribben 74), Damon Gray. Subs Not Used: Sorley, Miller.
Sent Off: Notman (84). Booked: Deland, Notman, Greenhill.
Goals: Damon Gray 59 pen.
Ref: Andrew Dallas