Ryan McStay's sixth goal of the season helped Albion come from behind to defeat Stenhousemuir and move off the bottom of the Scottish Second Division table.
Stenhousemuir had held leaders Cowdenbeath last weekend and the Ochilview side looked like they were going to follow that result up with a victory when Andy Rodgers fired them into a 25th-minute lead.
The forward smashed into the roof of the goal from Paul McHale's cross.
However, Albion replied seven minutes later when McStay's ball found Jack Werndly on the edge of the box and his cute finish was too much for goalkeeper Alistair Brown.
And four minutes after the restart McStay went from provider to scorer with a superb 25-yard free-kick after Kevin McKinlay was adjudged to have fouled Werndly.
Stenhousemuir: Brown, Lyle (Fitzharris 69), McMillan, Iain Thomson, McKinlay, Campbell, McHale, Rodgers, Murray (Gary Smith 59), Deuchar, Kean, Fitzharris (Lawson 79).Subs Not Used: Diamond, Hamilton.
Booked: McMillan, Rodgers, McHale.
Goals: Rodgers 25.
Albion: Gaston, Reid, O'Byrne, McGowan (Marriott 46), Russell, Love, Stevenson, McStay, Werndly, Gemmell, Chaplain.Subs Not Used: Fahey, Ferry, Gilmartin, McKay.Booked: Gemmell.
Goals: Werndly 33, McStay 50.
Ref: John McKendrick