Billy Brown oversaw his first win as East Fife manager as his side earned a crucial victory at Albion.
The Fifers came in to the game two points and a place behind their hosts, but started brightly with Liam Gormley applying the finish to Craig Johnstone's assist to break the deadlock after 11 minutes.
Paul Willis almost gave the away side a two-goal lead on the hour mark, but Matthew McGinley denied the Dunfermline loanee's 20-yard strike with a full-stretch save.
Brown's men were not to be denied however, as Sean Jamieson gave Robert Barr a sight of goal nine minutes later, allowing Willis' fellow loanee to notch his fourth goal of the campaign.
The Wee Rovers struggled to test their opponents, with substitute Simon Marriott's saved effort the closest the home side came to a goal.
Scott McBride then volleyed home Barr's cross three minutes later to seal a comprehensive win.
Albion Rovers: McGinley, Reid, O'Byrne, Donnelly, Russell, Crawford, Innes (Marriott 73), Anthony Stevenson, Phillips, Brannan (Tiffeny 81), Howarth (Crooks 73). Subs Not Used: McCluskey, Connor Stevenson.
East Fife: Antell, Durie, McBride, White, Johnstone, Robert Barr, Campbell, Darren Smith (Sloan 81), Willis, Jamieson, Gormley (Pollock 87). Subs Not Used: Collier, McAllister, Malcolm.
Booked: Durie, White.
Goals: Gormley 11, Robert Barr 69, McBride 86.
Ref: Andrew Dallas