How Pisa became the world's most important exam

Pupil in China in lesson taught by astronaut Rising star: Chinese pupil in lesson taught live from space by a Chinese astronaut

"Your education today is your economy tomorrow," says Andreas Schleicher from the Organisation for Economic Co-operation and Development, who has become one of the world's most influential figures in education.

And next week, the state of today's education standards across the developed world will be revealed with the publication of the results of the OECD's Programme for International Student Assessment, better known as the "Pisa tests".

This mammoth, three-yearly exercise, will produce international education rankings for more than 60 countries and dozens of regional administrations, based on tests in reading, maths and science taken by more than 500,000 15-year-olds.

And in the future it could get even bigger, with Mr Schleicher saying he wants to develop OECD rankings for universities.

Global league table

This latest world cup of school standards will reveal whether the Asian school systems, such as in Shanghai in China, Singapore and South Korea, remain world-beaters.

Shanghai mother meets son after gaokao exam Mother meets son after exam: Shanghai was top performer in the 2009 Pisa tests

And will the old Western powers, such as the US, the UK and France, remain stuck in the "must do better" category of this global classroom?

But what's the point of this vast piece of number crunching?

Mr Schleicher, now courted and quoted by education ministers, says the idea began in the 1990s with the simple recognition that governments were being compared on how much cash they were spending on education, rather than levels of achievement.

It was all about what was going in and nothing about what was coming out.

So the idea was launched for pupils in different countries to take pen and paper tests in core subjects and see how they compared.

And the name Pisa was chosen, not for any link to the Italian city, but because it was an acronym that was spelt the same in English and French.

Pisa topping

Mr Schleicher says that in a globalised world the key comparisons are with other countries - and this is true for education as much as economics.

Andreas Schleicher, OECD Andreas Schleicher wants to extend OECD rankings to higher education

"Your country's competitiveness and your individual job prospects are heavily influenced by what happens in other countries," he says.

"In a global economy improvement by national standards is not a measure of success. You compete globally."

Only relying on national exams, where the grades seem to keep improving, is a dishonest disservice to young people, he argues.

"It's like telling a disadvantaged student in your classroom, 'It doesn't matter how you compare with people in other schools, I'll give you a good mark because you're doing the best you can.'

"That's very nice, but once the student gets out into the labour market they're going to feel the brunt of reality."

"It is very important to know how well our students are prepared for a global economy."

Bringing bad news

This hasn't always made Pisa many friends. It can puncture the idea that everything is getting better.

The first victim of "Pisa shock" was Mr Schleicher's own country, Germany, a country that had nurtured a self-image of a high-performing education system.

US Dept of Education The US Department of Education has faced tough messages from Pisa results

But the Pisa results from 2000 suggested that it was only mediocre, causing a storm of controversy and national soul-searching. A German newspaper described the experience as an "instructive disaster".

Among the starkest revelations has been the decline of the US school system. This former education superpower has been caught up and left behind by many other countries, particularly in Asia.

This was distasteful medicine and Mr Schleicher says that the US administration was deeply unhappy with the 2006 results and was trying to apply pressure on the OECD.

The US politician who intervened to defend the importance of publishing the results was Ted Kennedy, says Mr Schleicher. Kennedy, who had chaired the senate committee on education, had become very supportive of the Pisa project.

"It was Senator Kennedy who saved my life at the OECD," he says.

In Italy, the 2009 results revealed another hidden weakness. While top grades in national exams were spread evenly across the country, the Pisa tests showed that pupils in the north were performing at a much higher level.

This meant that it was much easier to get a high grade in the south of Italy - and since public jobs depended on such grades, it represented an "incredible unfairness".

Without the external measurement of Pisa such problems would remain invisible.

There are other critics who warn against the impact of the narrow focus of Pisa - which ranks school systems on a very limited number of measures.

The influential UK head teacher, Anthony Seldon, warned of governments becoming "increasingly mesmerised and bedazzled" by the Pisa tests.

"Such tests are deeply flawed and their impact is profoundly damaging to young people," he says.

Rise of Asia

The tests have also revealed the changing face of the education world. Pisa has recorded the rise and rise of countries and cities in Asia, such as South Korea, Singapore, Hong Kong and Shanghai, where investment in education has been used as a way of fast-forwarding their economies.

Graduation ceremony in Shanghai Class of 2013: Almost seven million Chinese students graduated this summer

Looking to England, Mr Schleicher says he welcomes the readiness of Education Secretary Michael Gove to "open all the cupboards and see what's inside, see what the problems are".

"That's an essential starting point. You can debate about some of the medicine, but at least there's a serious search for the issues and challenges."

He says schools in England should move away from an "industrial mindset" and teachers should be given a "high degree of professional autonomy".

But Mr Schleicher remains unconvinced by changes to the national curriculum.

So how can international comparisons in education standards ever be really fair? Is it meaningful to compare countries as different as Finland, Peru and Vietnam?

Mr Schleicher is a robust defender of such comparisons, saying whether or not they are fair, young people from all those countries are competing with one another in a globalised economy. The skills they learn are going to be hugely important to their life chances.

"It's not about the elite, it's the poor who are affected by globalisation, they are the ones who are going to lose their jobs because they're not keeping up with the skills on the other side of the world."

In terms of the methodology, the test results are based on a representative sample of around 5,000 pupils in each school system, overseen by the OECD. Some have bigger numbers, with more than 12,000 in the UK and 38,000 in Italy.

The tests are designed by Australian researchers with the requirement that questions are culturally neutral, as relevant in Tunisia as Estonia.

The forthcoming results will also provide a much more detailed picture of regional differences. It will show how US states such as Massachusetts or regions within Spain and Italy would have scored if they were ranked as countries.

But this isn't just one giant data fest. There is a human purpose to all this, says Mr Schleicher.

These tests show the gaps in some basic skills needed by young people. And once these youngsters have left school without these skills, he says, it is "very hard to fix retrospectively".

"In the US the whole pipeline is broken and in Europe there are 80 million who can't read better than a 10-year-old child.

"What are you going to do with these people. That's the real challenge.

"The countries with good school systems have great assets."

How important are international tests? Do they give a fair comparison between schools? What else could they show?

If you are happy to be contacted by a BBC journalist please leave a telephone number that we can contact you on. In some cases a selection of your comments will be published, displaying your name as you provide it and location, unless you state otherwise. Your contact details will never be published. When sending us pictures, video or eyewitness accounts at no time should you endanger yourself or others, take any unnecessary risks or infringe any laws. Please ensure you have read the terms and conditions.

Terms and conditions

More on This Story

More Business stories

RSS

BBC Business Live

  1.  
    SOCGEN IN RUSSIA 12:48:
    Russia flags

    Societe Generale, France's second-biggest publicly-owned lender, said it won't abandon its business in Russia. It also thinks Russia will not impose restrictions on capital flows. "It is in no interest of Russia to block the flow of financing," chief executive Frederic Oudea told an investor conference, according to Reuters.

     
  2.  
    CAMERON SPEECH Via Email

    The Institute For Fiscal Studies has some quick analysis on what that tax cut means. "An important question is when the personal allowance would reach £12,500, because it is rising in line with inflation anyway. Hitting £12,500 in April 2015 (ie straight away) would cost the government £9bn a year."

     
  3.  
    Via Twitter Duncan Weldon, Economics Correspondent, BBC Newsnight

    tweets: "Assuming that tax cuts will be funded by spending cuts, then total spending cuts needed are closer to £40bn than current planned £25bn."

     
  4.  
    Via Twitter Simon Jack Business correspondent, BBC News

    tweets: "These tax threshold rises bold and sound expensive. We will get view of the IFS. Consistent with deficit reduction?"

     
  5.  
    CAMERON SPEECH 12:19:
    Prime Minister Cameron

    Prime Minister David Cameron says he will raise the income tax threshold to £12,500, which will take one million more people out of income tax, and give a tax cut to 30 million people. The threshold for the 40p tax rate will be raised to £50,000, he says.

     
  6.  
    NETWORK RAIL 12:14:

    The ORR also had a complaint about Network Rail's ability to supply information to Arup and Halcrow, firms which did independent reports on Network Rail's expenditure and performance. "Both independent reporters have identified issues with Network Rail's quality of reporting." Network Rail said the business has changed since the last five-year reporting period.

     
  7.  
    EU-UKRAINE TRADE DEAL 12:00:

    A trade agreement between the EU and Ukraine which is causing tension between Russia and the West can only be negotiated between Kiev and Brussels, said outgoing European Commission President Jose Manuel Barroso. Russian President Vladimir Putin wants more three-way negotiations to amend the EU's deal with Kiev, which Russia says will hurt its own economy.

     
  8.  
    ZALANDO SHARES 11:45:

    Shares in Zalando, Europe's biggest online fashion retailer, rose as much as 12% in its first day of trading in Frankfurt, valuing the company at about €6bn (£4.67bn). Zalando, which competes with ASOS, began in 2008 by selling shoes in Germany and now delivers 1,500 brands to customers in 15 countries.

     
  9.  
    BULLET TRAIN 11:30:
    bullet

    Japan's shinkansen train is 50 today and shows no signs of slowing with age. In 1964, it was capable of 130mph travel and now links Tokyo and Osaka in two hours 25 minutes at 168mph. The service has carried 5.6bn passengers and never had a fatal derailment or collision.

     
  10.  
    ADIDAS 11:15:
    adidas

    Adidas shares are up 3.1% in Frankfurt to €61.08. The German sportswear maker will return up to €1.5bn (£1.17bn) to shareholders in the next three years, it says. The company is having trouble keeping up with larger rival Nike and issued its third profit warning in a year in July.

     
  11.  
    SAINSBURY'S RESULTS 11:00:
    Bryan Roberts

    It's a grim, new era for supermarkets according to analyst Bryan Roberts, from Kantar Retail. He says there's no guarantee of growth due to increased competition. Online shopping is "inherently" less profitable than going to a store he says on BBC News.

     
  12.  
    Via Twitter Richard Westcott BBC transport correspondent

    tweets: "Out and about with DVLA tax disc team this morning. 1 car in every 200 popping up orange, no tax ... they had a wedding car a few weeks ago, pink Rolls, bride in back. No tax. Ambulances, buses, all sorts"

     
  13.  
    GERMAN DEBT 10:40:
    Reichstag, Berlin

    For the first time, Germany has been able to sell 10-year government debt (bunds) at an interest rate of less than 1%. So what? Well it seems investors would rather park their money in German debt earning a pittance, than invest elsewhere. It shows how feeble confidence in the European economy is right now.

     
  14.  
    BLINKBOX SALE? 10:30:
    Peter Dinklage, Game of Thrones

    Tesco is putting Blinkbox up for sale according to a report in The Times today. Blinkbox is a video streaming service, which allows customers to buy films and TV programmes, including the hit show Game of Thrones (pictured). Tesco invested hundreds of millions of pounds in the service under its former chief executive Philip Clarke, but the new boss Dave Lewis considers it a "distraction" says The Times. It might be closed if a buyer can't be found, the report says.

     
  15.  
    DVLA DELAYS Via Email Brian Milligan Personal Finance Reporter, BBC News

    emails DVLA is having major problems with the car tax website today, on the first day of the new system. They blame an "unprecendented volume of traffic". Some people have spent up to 13 hours trying to buy their car tax. DVLA is advising people who need to pay their tax today to go to a Post Office.

     
  16.  
    GERMANY DOWNTURN 10:03:
    German factory

    Activity at German factories shrank for the first time in 15 months, according to the latest survey of purchasing managers from Markit. The index fell to 49.9, which is bad because anything below 50 indicates contraction. It is "a worrying picture of the health of Germany's goods-producing sector," said Markit economist Oliver Kolodseike.

     
  17.  
    NETWORK RAIL 09:54:
    work

    The Office of Rail Regulation says Network Rail, which owns manages rail infrastructure like track, missed its target on cost savings in the five years to March 2014. It cut costs by 15.5% that was less that its target of 23.5%. That means even stiffer targets for the next five years.

     
  18.  
    ROYAL MAIL 09:44:
    Royal Mail shares

    Royal Mail shares have risen almost 4% this morning. They have been helped by a positive report from the bank UBS. It has removed its "sell" rating on the shares. Royal Mail shares are trading at 407p today but that's down by third from January when they hit a high of 615p.

     
  19.  
    LABOUR PRODUCTIVITY 09:35:

    Labour productivity was unchanged in the second quarter of 2014 compared with the previous quarter, and 0.3% lower than a year earlier, according to the Office of National Statistics. The UK has been troubled by low productivity for years and it is something that the Bank of England is watching closely as it mulls the timing of a rise in interest rates.

     
  20.  
    PARIS MOTOR SHOW 09:22:
    Paris Motor Show 2014

    This should be good. Our coverage of the Paris Motor Show starts on Thursday. The BBC's Theo Leggett and Russell Hotten will be there. Visit BBC Business for news, insight and analysis.

     
  21.  
    PARIS MOTOR SHOW 09:07: Radio 5 live
    Paris Motor Show 2014

    The Paris Motor Show opens today. Maxime Picat, chief executive of the Peugeot brand, is on Radio 5 live. He trumpets "impressive" growth in China where Peugeot is the fastest-growing car maker. But, he concedes that electric cars have been disappointing. He doesn't expect significant expansion of that market until the 2020s.

     
  22.  
    SUPERMARKETS 08:56:

    Supermarkets are now the top three losers on the FTSE 100.

     
  23.  
    SAINSBURY'S RESULTS 08:52: Via Email John Ibbotson, Director, Retail Vision

    "With these results, it's increasingly clear Mike Coupe took the hospital pass just like Philip Clarke. Who needs Sainsbury's, or Waitrose even, when you can get £9.99 Beluga Caviar at Aldi?"

     
  24.  
    MARKET UPDATE 08:33:

    London's FTSE 100 benchmark index fell 0.15% to 6,613.03 points, led lower by supermarket Morrisons, which has dipped 2.9%.

     
  25.  
    MOD CONTRACT 08:28:
    HMS Daring

    It's the second biggest defence contract placed by the government. The MoD has awarded £3.2bn of contracts to run naval bases and maintain warships and submarines. Babcock wins £2.6bn to run Devonport and Clyde, BAE Systems gets £600m to manage Portsmouth Naval Base. Around 7,500 are employed to support 56 warships.

     
  26.  
    FRANCE BUDGET 08:15:
    Michel Sapin

    France's finance minister, Michel Sapin, has been presenting the nation's 2015 budget. He says the budget deficit will meet the European Union's target by 2017. France has made such promises before and then been forced to backtrack. Mr Sapin forecast a gradual economic recovery, with growth on 1.0% next year. Mr Sapin.

     
  27.  
    MARKET UPDATE 08:02:

    After early gains, in Tokyo the Nikkei 225 index closed 0.6% lower at 16,082. Markets in China and Hong Kong are closed for a holiday. A report indicated modest expansion for China's manufacturing sector. The official purchasing managers' index for September came in at 51.1. Numbers above 50 suggest expansion.

     
  28.  
    SAINSBURY'S BOSS 07:52: Radio 5 live

    Tesco is in trouble over mis-stating its profits, how about Sainsbury's? Well Mike Coupe, Sainsbury's chief executive is "100% confident about the integrity of the accounts". He should know - he was finance director before becoming the boss.

     
  29.  
    SAINSBURY'S BOSS 07:46: Radio 5 live

    It is the most challenging environment in the supermarket industry for 30 years says Mike Coupe, Sainsbury's chief executive on Radio 5 live. There is food price deflation for the first time in a generation. Potatoes and milk are 20% cheaper from a year ago. That means customers on average are £5 a week better off he says.

     
  30.  
    CO-OP BANK ETHICS 07:34: BBC Radio 4

    Laura Carstensen, chair of Co-op Bank's Values and Ethics Committee is talking about the lender's new advertisement campaign. A man gets a tattoo about his commitment to Co-op's ethics. What does a fake tattoo say about the company's commitment to ethics, asks presenter Justin Rowlatt? Customers are savvy enough to understand the message, she says.

     
  31.  
    MINIMUM WAGE 07:26: BBC Breakfast
    BBC

    The minimum wage is most commonly paid in the hospitality, retail and care industries says Charlotte O'Brien a lawyer from York Law School on Breakfast. Many workers who think they are being paid less than minimum wage cannot afford to take their employer to an employment tribunal, she says. That's because they now have to pay £390 for a tribunal - or 60 hours work at £6.50 an hour.

     
  32.  
    SAINSBURY'S BOSS 07:21: BBC Radio 4
    CEO

    "It wouldn't be surprising in any business for us to try to sell more," says Sainsbury's chief Mike Coupe. He's talking about that gaffe earlier in the week, where a Sainsbury's store placed a motivational poster encouraging staff to get customers to spend an extra 50p in store, in the shop window. It was a simple mistake, he says.

     
  33.  
    HEADLINES
     
  34.  
    SAINSBURY'S BOSS 07:18: BBC Radio 4

    Mike Coupe is doing his first broadcast interview of the day on Today. In the last few months things have changed in the industry, he says. Customers are changing how they shop, he says. Is he worried about the fact Sainsbury's is the most short-sold (bet-against) stock on the FTSE 100, asks presenter Justin Rowlatt? "I'm a very calm individual," he says.

     
  35.  
    SAINSBURY'S RESULTS 07:11:

    Sainsbury's is not expecting sales to pick up in the rest of the financial year. Chief executive Mike Coupe says "we now expect our like-for-like sales in the second half of they year to be similar to the first half".

     
  36.  
    TESCO PROBE 07:05: Breaking News

    The Financial Conduct Authority will conduct a "full investigation" into Tesco's £250m overstatement of profits, the supermarket said.

     
  37.  
    SAINSBURY'S RESULTS 07:00: Breaking News

    Sainsbury's has reported a 2.8% decline in like-for-like sales in the second quarter, excluding fuel. That's the third consecutive quarter of falling sales.

     
  38.  
    CO-OP BANK ETHICS 06:45: Radio 5 live

    Oh dear. The chair of Co-operative Bank's ethical board, Laura Carstensen appears on Wake Up to Money. She can't name a single country with an oppressive regime that the bank has declined to do business with. She also does not want to talk about the bank's private equity owners, but says all investors realise that the bank's ethical values are what makes it different. Co-op bank launches an advertising campaign today to publicise its ethics.

     
  39.  
    SAINSBURY'S RESULTS 06:34: BBC Radio 4
    Sainsbury's store

    Sainsbury's releases results at 07:00. Sales are expected to be down 4%, says Bryan Roberts, from Kantar Retail on the Today programme. "What it reflects is we are in a zero-growth market. The pie isn't getting any bigger. Aldi and Lidl aggressively expanded in the South East and London," he says.

     
  40.  
    PENSIONS 06:28: Radio 5 live

    "People are getting it," says Tim Jones the chief executive of National Employment Savings Trust (NEST) on Wake Up to Money. It's been two years since the government launched automatic enrolment for workplace pension schemes. Only 8% of people are opting out, but a quarter of those aged between 60 and 65 are not taking up the offer. "Older folks are thinking it's too late," says Mr Jones.

     
  41.  
    DOLLAR YEN 06:19: Radio 5 live
    yen

    The dollar has hit a six-year high against the yen, trading above 110 yen. On Wake Up to Money the BBC's Rico Hizon says that there are expectations that the Bank of Japan will further ease monetary policy. Currency traders are also looking ahead to Friday's US employment report, which should give an indication of the strength of the US economy.

     
  42.  
    MINIMUM WAGE 06:11: Radio 5 live

    Mike Cherry, National Policy Chairman for the Federation of Small Businesses says the raise in the minimum wage is still "realistic". But he wants a longer-term view of the wage. On Wake Up to Money he complains that business only gets six months notice of changes. He would like to the level to be set for a whole parliament.

     
  43.  
    MINIMUM WAGE 06:03: Radio 5 live
    Hand pennies

    From today the minimum wage rises 3% to £6.50. Conor D'Arcy, Policy Analyst at Resolution Foundation welcomes the move, until this raise the minimum wage was worth the same as it was in 2005, he says on Wake Up to Money.

     
  44.  
    06:01: Ben Morris Business Reporter

    Good morning. You can email us at bizlivepage@bbc.co.uk or tweet @bbcbusiness.

     
  45.  
    06:00: Howard Mustoe Business reporter

    Good morning everyone. This morning we are expecting an update from Sainsbury's on how trading has gone for them. The National Minimum Wage annual increase also takes effect, rising by 19p an hour to £6.50. Stay with us for more breaking news and analysis.

     

Features

From BBC Capital

Programmes

  • A computer simulation showing a planned station upgrade in Hong KongClick Watch

    Simulated world - how architects are using virtual and augmented reality to transform our cities

BBC © 2014 The BBC is not responsible for the content of external sites. Read more.

This page is best viewed in an up-to-date web browser with style sheets (CSS) enabled. While you will be able to view the content of this page in your current browser, you will not be able to get the full visual experience. Please consider upgrading your browser software or enabling style sheets (CSS) if you are able to do so.