Rotherham clinched victory in an exciting encounter with strugglers Hereford at Edgar Street.
Johnny Mullins turned in Sam Wood's corner before Alex Revell doubled the Millers' lead with a low 25-yard drive.
Yoann Arquin's long-range effort was followed by Delroy Facey's equaliser from close in before the break.
The Bulls went close again through Arquin and Tom Barkhuizen but Mullins's drilled shot from 10 yards proved the decisive strike.
VIEWS FROM THE DRESSING ROOM
Hereford manager Jamie Pitman told BBC Hereford and Worcester:
"We were on top for the majority of the first half anyway - they have obviously got their goals, one from a corner and one from a strike that hit an unbelievable bobble and ended up in the top corner.
"But you can't make excuses for it as we have got to defend better from corners.
"We did ever so well to get back into it although we had a bit of luck with the first goal we scored due to a deflection but if you don't shoot, you don't score."
Rotherham boss Andy Scott told BBC Radio Sheffield:
"It's just amazing, we have a compelation of goals that we've conceded and sometimes you think that the DVD's jammed and it keeps on replaying the same thing.
"We're comfortable at 2-0 - cruising, looked good going forward when we were attacking and all of a sudden we're 2-1, then we go and attack again and it's 2-2 and the organisation at the back was very, very poor again.