Two early second-half tries from scrum-half Nicky-Griffiths helped Jersey beat Plymouth and secured first ever away win in the Championship.
Paul Roberts' penalty had put Albion in front early on before Guy Thompson crossed over for Jersey.
Griffiths then went over twice in the space of six minutes after the restart to put the islanders 19-3 up.
But they had to hang on, as Tom Cowan-Dickie, and then Tom Bowen scored tries in the left corner.
Jersey took advantage after Bevon Armitage had been sin-binned after half an hour for a deliberate offside.
But the game was halted for over 10 minutes as Jersey prop Jon Brennan was carried off on a stretcher with a neck injury.
Soon after the restart Thompson went over, and Jersey should have been further ahead but Michael le Bourgeois missed a penalty.
Referee Steve Lee played 24 minutes of stoppage-time as Jersey camped in the Albion try line, but despite numerous collapsed scrums he refused to give the islanders a penalty try.
But a minute after the restart Griffiths darted through the defence to score and he added to his tally soon after as Thompson offloaded to the former Wales Sevens international.
Jersey's front row received a further blow 10 minutes later as Dave Felton joined Brennan at Derriford hospital after leaving the field on a stretcher with a back injury.
And Albion seemed to be stronger after the delay as Cowan-Dickie capitalised on some slack defending in the 68th minute, and then Bowen went over 11 minutes later.
Despite intense Albion pressure Jersey clung on for a first-ever away win in the Championship, as Albion set a club record of nine successive losses.
"It was a very nervy finish," Jersey director of rugby Ben Harvey told BBC Radio Jersey.
"We should have had a penalty try at the end of the first half.
"But to score two tries at the start of the second half was excellent.
"They stood firm, it's a fantastic win and our first away from home this season."
Jersey are now five points clear of bottom side Doncaster, who secured a bonus point in their 25-19 defeat by Rotherham.