Guernsey FC lost their first ever home game in the Combined Counties League after going down 3-2 to Eversley.
Matt Baker gave Eversley a 26th-minute lead before Jamie Frostick doubled the lead three minutes after half-time.
Ross Allen was brought down for a penalty, which he converted to bring Guernsey within touch 11 minutes later.
But Jacques Isabelle was sent off before Baker converted a controversial late penalty to make it 3-1 before Allen scored a 94th-minute spot kick.
"Our final decisions at times weren't great, but we kept going and showed some good character in difficult circumstances," boss Tony Vance told BBC Guernsey.
"We've lost a game, so what? We'll move on and it gives us another challenge and we'll see how we can respond from it.
"We counted 13 chances in the first half.
"We created chances. It's just the final decision and the final bit of luck that wasn't there. But we had a go, even with 10 men we still looked a lot stronger than them."
Vance said he was surprised at the referee's decision to award a late penalty after a challenge in the box by Sam Cochrane.
"Sometimes I couldn't understand some of his decisions but he was doing his best.
"From where I was I think he was the only one who thought it was a penalty.
"It looked like Sam had the ball at his feet, but he's made the decision and that's what happens.
"It's disappointing to lose our first game at home in front of everybody but we'll move on," he added.
Meanwhile, top scorer Allen refused to comment on .
His two spot kicks saw his tally go up to 47 league and cup goal this season.
When asked if he has been approached by any teams he said he had no comment.
"I'm loving my football and focusing on Guernsey FC," he said. "We want to get promotion and get that sorted as soon as possible."