Allan Jenkins bagged a hat-trick as Ballymena withstood a spirited fightback by 10-man Warrenpoint to secure victory at the Showgrounds.
Jenkins converted a first-half penalty after Stephen Moan was dismissed for handling on the line.
The Scotsman struck twice after the break to complete his hat-trick but two composed Stephen Murray finishes gave the basement team hope.
Kyle McVey prodded in from Tony Kane's corner to ease Ballymena nerves.
It was a 13th straight Premiership defeat for Warrenpoint and they sit seven points adrift at the basement.
What they said
Ballymena boss Glenn Ferguson said: "I thought when we went 3-0 up we had the game under control but again we showed our inconsistency in defending.
"Thankfully we were to strike back and see it out but I'm really disappointed to concede the two goals."
Warrenpoint manager Barry Gray criticised the handball decision which reduced his side to 10 players.
"There was one obvious turning point from my perspective and I think the referee got it wrong.
"Full credit to the players - we showed a lot of guts and character which is good."