Match ends, Bury 2, Bristol Rovers 1.
A late Tom Soares header ensured Bury put 10 points between themselves and the League Two relegation zone.
The substitute headed home Chris Hussey's corner at the near post soon after coming onto the field.
Bury got off to a great start as on-loan Everton youngster Hallam Hope smashed the ball past Steve Mildenhall.
Bristol Rovers levelled as Kaid Mohamed deflected in Ollie Clarke's shot, while Bury keeper Brian Jensen twice saved well from Matt Harrold headers.
But Soares' winner meant Darrell Clarke suffer his first defeat since
Bury manager David Flitcroft told BBC Radio Manchester:
"Saturday's game [at Northampton] was a big win but that was even bigger.
"They've come with a 'no-fear' attitude and I was really impressed with them. We didn't get to grips with them.
"Tactically I got it wrong, but we flipped it back and in the last 20 minutes we got a foothold back in the game.
"I can't express how delighted I am with the group. Don't forget the trouble we were in and it's been testing. It's been a massive effort from everyone at the football club to turn this around."
Bristol Rovers manager Darrell Clarke told BBC Radio Bristol:
"In the first 20 minutes, we looked a little bit lost in the shape, but we grew into the game and controlled the possession.
"But how many times have we said it this season - we create opportunities, but we don't make the most of them.
"We conceded a sloppy goal from a set piece, which is unacceptable.
"It is a work in progress, but we've got to make it work quickly."
- 7JonesSubstituted forRoseat 71'minutes
- 16TutteSubstituted forSoaresat 78'minutes
- 9HopeSubstituted forProctorat 81'minutes
- 6ParkesSubstituted forSantosat 82'minutes
- 4WoodardsSubstituted forClucasat 45'minutes
- 24O ClarkeSubstituted forGillespieat 85'minutes
- Michael Naylor
- Shots on Target
Second Half ends, Bury 2, Bristol Rovers 1.
Attempt missed. Kaid Mohamed (Bristol Rovers) header from the centre of the box misses to the left.
Attempt missed. Alefe Santos (Bristol Rovers) left footed shot from outside the box misses to the right.
Pablo Mills (Bury) wins a free kick in the attacking half.
Foul by John-Joe O'Toole (Bristol Rovers).
Foul by Andrew Proctor (Bury).
Mark McChrystal (Bristol Rovers) wins a free kick in the defensive half.
Danny Rose (Bury) wins a free kick on the right wing.
Foul by Seanan Clucas (Bristol Rovers).
Substitution, Bristol Rovers. Stephen Gillespie replaces Ollie Clarke.
Attempt saved. Kaid Mohamed (Bristol Rovers) right footed shot from outside the box is saved in the centre of the goal.
Foul by Chris Sedgwick (Bury).
Matt Harrold (Bristol Rovers) wins a free kick in the attacking half.
Substitution, Bristol Rovers. Alefe Santos replaces Tom Parkes.
Substitution, Bury. Andrew Proctor replaces Hallam Hope.
Goal! Bury 2, Bristol Rovers 1. Tom Soares (Bury) header from the centre of the box to the bottom left corner. Assisted by Chris Hussey following a corner.
Corner, Bury. Conceded by Seanan Clucas.
Substitution, Bury. Tom Soares replaces Andrew Tutte.
Attempt missed. Ollie Clarke (Bristol Rovers) right footed shot from long range on the right misses to the left.