Substitute James Ellison netted a last-minute winner as Alfreton came from behind to beat 10-man Barrow.
Loan man Haydn Hollis opened the scoring on his debut from 12 yards after Gavin Skelton had been sent off.
Anton Brown netted a second-half equaliser, nodding in a cross from substitute Jamie Mullan in the 73rd minute to claim his first Reds' goal.
Ellison then headed home Levi Mackin's centre in the final minute as Alfreton registered their first home league win.
Adam Boyes had headed against the bar for Barrow before 19-year-old defender Hollis, signed on loan from Notts County on the eve of the game, struck from 12 yards four minutes before half-time after being set up by sub Paul Smith.
Smith had only been on the pitch for two minutes, coming on after Barrow had been reduced to 10 men when Skelton was dismissed for violent conduct for elbowing Alfreton's Jake Moult.