Match ends, Norwich City 1, Manchester United 3.
Manchester United won a Premier League away game for the first time since February and would have beaten Norwich by more if not for two Tim Krul penalty saves.
United's two first-half goals came moments after outstanding Krul stops.
Scott McTominay slammed home the opener seconds after a stunning reaction save from the Canaries keeper to deny Anthony Martial from close range.
The video assistant referee (VAR) then controversially awarded United a penalty for a Ben Godfrey foul on Daniel James - with Krul stopping Marcus Rashford's kick.
But Rashford scored with United's next attack as he was left in acres of space by the Norwich defence.
United - who move up to seventh in the Premier League - were awarded a second penalty by VAR for a Todd Cantwell handball. This time Martial took it and went the other way, and again Krul guessed correctly.
The Canaries, who remain in the relegation zone, had a couple of chances but United wrapped the game up when Martial clipped the ball over Krul after a good passing move with Rashford.
Norwich scored a late consolation through substitute Onel Hernandez, who took the ball off McTominay before running at United's defence and shooting past David de Gea to becoming the first Cuban-born player to score a Premier League goal.
- Solskjaer 'hurt' by Man Utd results
- Pogba not expected back until December
- Sunday's Premier League games as they happened
- More disagreement on VAR use in the Premier League on Saturday
Krul and VAR catch the eye
In the first nine rounds of Premier League games this season no penalties were awarded by VAR with a seemingly high bar set for the "clear and obvious error" needed to overturn a referee's decision.
There have been four this weekend, including two at Carrow Road.
The first was highly controversial with Godfrey and James appearing to run into each other and referee Stuart Attwell changing his decision after consulting with the video team.
Krul appeared well off his line when he saved Martial's kick - but VAR in the Premier League does not check for goalkeepers' positions from penalties.
The second penalty was not contentious with the new handball laws with Cantwell's arms clearly high in the air as he blocked Fred's shot.
Martial became the third United player to fail from the spot in the league this season when Krul denied him.
He is the first goalkeeper to save two penalties in a Premier League game since fellow Dutchman Maarten Stekelenburg for Everton against Manchester City in October 2016.
Even United manager Solskjaer thought the first penalty should not have been given.
"I disagree with the first one, the second one is but both should be retaken, the goalkeeper is a yard off his line," he said.
"VAR is there to help but when it takes ages like the first penalty, it is not a clear and obvious error. When it took that long, it is a signal that it should not have been."
Norwich manager Daniel Farke agreed, and thought United's James fouled Godfrey for the first penalty.
"It's quite obvious it was a big mistake," he told BBC Sport. "The referee was right and it was Daniel James falling on the defender. I don't blame VAR for this defeat, we were not major enough in the first half."
Krul was brilliant throughout the game, making eight saves - including a remarkable stop to keep out Martial's header from point-blank range.
He suffered a late knee injury, although played on with Norwich having used all their subs.
"We'll have to assess it tomorrow," he said after the game. "I was worried when it happened but I feel a bit better now."
United continue improvement
This is a third decent result in a row for Manchester United as they climb away from the lower reaches of the league.
A draw against leaders Liverpool last Sunday was followed by a first away win since Paris St-Germain in March, when they beat Partizan Belgrade 1-0 on Thursday.
A Norwich team short on confidence was an ideal opponent to end their worst away run in the league since 1989.
McTominay, Aaron Wan-Bissaka, Martial and Rashford were all excellent - despite the latter two's penalty misses.
With their first chance, Andreas Pereira curled a shot just wide and then Martial thought his header was in from Rashford's flick-on - before Krul's brilliant save.
They led when Scotland midfielder McTominay curled home after Cantwell failed to clear Pereira's cross - United's 2,000th goal in the Premier League era.
Only Rashford has scored more league goals for United than McTominay's four since Solskjaer was named permanent manager in March.
Rashford and Martial's penalty misses mean United have failed to score with four of their last six Premier League spot-kicks.
But that did not dishearten them with Rashford running onto James' defence-splitting pass to stroke home a shot past Krul.
Their third was excellent. Rashford played a one-two with Martial - on his first league start since August - and then backheeled the ball back into the Frenchman's path for his deft finish over Krul.
It is far too early to read too much into one good week for United, but things are looking a lot more encouraging than they were in the preceding five-game winless run.
"This had been a good week for us," said Solskjaer. "It started with a decent performance against Liverpool and now two wins away from home. It gives the players confidence and momentum.
"The third was a very good goal and a class finish. It is great for Anthony Martial to score a goal like that. We could and should have had a few more goals."
Long season ahead for Norwich
Norwich have now gone five games without a win in the league - and are two points below 17th-placed Newcastle.
They must be credited for trying to attack teams - right-back Max Aarons in particular was excellent going forward.
They will not struggle to create chances this season - Aarons set up good opportunities for Cantwell and Teemu Pukki, who both missed the target. Pukki has now gone five Premier League games without a goal, after six in his first five.
Hernandez's late strike after a McTominay error was their 11th Premier League goal of the season - more than sixth-placed Crystal Palace or Sheffield United in eighth.
But their defence was shambolic at times, especially when Rashford was completely free from James' pass over the top.
They have conceded 24 goals in 10 league games. Only Southampton - with 25 - have let in more, including the nine they conceded against Leicester. And it would have been worse if not for Krul.
Canaries boss Farke hopes things will be better when some of their injured centre-backs - Christoph Zimmermann, Timm Klose and Grant Hanley - return.
"In general it is difficult when three centre-halves are not available," he said.
"It's important to improve. We look forward to having our centre-backs back but we have to take this as a lesson.
"You need physicality and robustness, and we missed that in the first half."
Man of the match - Scott McTominay
Rashford and Martial make history - match stats
- Norwich have lost more Premier League home games against Manchester United than they have against any other team, losing seven of nine (P9 W2 D0 L7).
- Manchester United scored as many goals in this game as in their previous six Premier League away games combined.
- Manchester United are the first team to score 2,000 Premier League goals.
- Marcus Rashford's goal was his 50th for United, with 32 coming in the Premier League
- Rashford and Anthony Martial are the first team-mates to score a goal and miss a penalty each in a Premier League game.
- Norwich's Tim Krul became the eighth different goalkeeper in Premier League history to save two penalties in a game.
- Manchester United have had three different players miss a penalty within a single Premier League season (Rashford, Martial and Paul Pogba) for only the second time, and for the first time since 2012-13 (Robin van Persie, Wayne Rooney and Javier Hernandez).
Manchester United visit Chelsea in the Carabao Cup fourth round on Wednesday, 30 October (20:05 GMT), followed by a Premier League trip to Bournemouth on Saturday (12:30).
Norwich, already out of the cup, go to Brighton on Saturday (15:00).
- 2AaronsBooked at 90mins
- 4GodfreyBooked at 27mins
- 12LewisSubstituted forByramat 66'minutes
- 10LeitnerSubstituted forStiepermannat 45'minutes
- 14CantwellSubstituted forHernándezat 45'minutes
- 1de Gea
- 29Wan-BissakaBooked at 45mins
- 18YoungBooked at 60mins
- 21JamesSubstituted forLingardat 80'minutes
- 15PereiraSubstituted forGarnerat 82'minutes
- 9MartialSubstituted forGreenwoodat 75'minutes
- Stuart Attwell
- Shots on Target
Second Half ends, Norwich City 1, Manchester United 3.
Attempt saved. Mason Greenwood (Manchester United) right footed shot from the centre of the box is saved in the bottom right corner. Assisted by Jesse Lingard.
Attempt missed. Marcus Rashford (Manchester United) right footed shot from outside the box is high and wide to the left from a direct free kick.
Max Aarons (Norwich City) is shown the yellow card.
James Garner (Manchester United) wins a free kick in the attacking half.
Foul by Max Aarons (Norwich City).
Attempt missed. Onel Hernández (Norwich City) right footed shot from outside the box is close, but misses to the left.
Goal! Norwich City 1, Manchester United 3. Onel Hernández (Norwich City) right footed shot from the centre of the box to the bottom right corner.
Foul by Fred (Manchester United).
Emiliano Buendía (Norwich City) wins a free kick in the defensive half.
Attempt missed. Jesse Lingard (Manchester United) right footed shot from outside the box is close, but misses the top right corner. Assisted by Harry Maguire.
Substitution, Manchester United. James Garner replaces Andreas Pereira.
Substitution, Manchester United. Jesse Lingard replaces Daniel James.
Scott McTominay (Manchester United) wins a free kick in the attacking half.
Foul by Onel Hernández (Norwich City).
Foul by Andreas Pereira (Manchester United).
Kenny McLean (Norwich City) wins a free kick in the defensive half.
Substitution, Manchester United. Mason Greenwood replaces Anthony Martial.
Goal! Norwich City 0, Manchester United 3. Anthony Martial (Manchester United) right footed shot from the left side of the six yard box to the centre of the goal. Assisted by Marcus Rashford.