How Pisa became the world's most important exam

Pupil in China in lesson taught by astronaut Rising star: Chinese pupil in lesson taught live from space by a Chinese astronaut

"Your education today is your economy tomorrow," says Andreas Schleicher from the Organisation for Economic Co-operation and Development, who has become one of the world's most influential figures in education.

And next week, the state of today's education standards across the developed world will be revealed with the publication of the results of the OECD's Programme for International Student Assessment, better known as the "Pisa tests".

This mammoth, three-yearly exercise, will produce international education rankings for more than 60 countries and dozens of regional administrations, based on tests in reading, maths and science taken by more than 500,000 15-year-olds.

And in the future it could get even bigger, with Mr Schleicher saying he wants to develop OECD rankings for universities.

Global league table

This latest world cup of school standards will reveal whether the Asian school systems, such as in Shanghai in China, Singapore and South Korea, remain world-beaters.

Shanghai mother meets son after gaokao exam Mother meets son after exam: Shanghai was top performer in the 2009 Pisa tests

And will the old Western powers, such as the US, the UK and France, remain stuck in the "must do better" category of this global classroom?

But what's the point of this vast piece of number crunching?

Mr Schleicher, now courted and quoted by education ministers, says the idea began in the 1990s with the simple recognition that governments were being compared on how much cash they were spending on education, rather than levels of achievement.

It was all about what was going in and nothing about what was coming out.

So the idea was launched for pupils in different countries to take pen and paper tests in core subjects and see how they compared.

And the name Pisa was chosen, not for any link to the Italian city, but because it was an acronym that was spelt the same in English and French.

Pisa topping

Mr Schleicher says that in a globalised world the key comparisons are with other countries - and this is true for education as much as economics.

Andreas Schleicher, OECD Andreas Schleicher wants to extend OECD rankings to higher education

"Your country's competitiveness and your individual job prospects are heavily influenced by what happens in other countries," he says.

"In a global economy improvement by national standards is not a measure of success. You compete globally."

Only relying on national exams, where the grades seem to keep improving, is a dishonest disservice to young people, he argues.

"It's like telling a disadvantaged student in your classroom, 'It doesn't matter how you compare with people in other schools, I'll give you a good mark because you're doing the best you can.'

"That's very nice, but once the student gets out into the labour market they're going to feel the brunt of reality."

"It is very important to know how well our students are prepared for a global economy."

Bringing bad news

This hasn't always made Pisa many friends. It can puncture the idea that everything is getting better.

The first victim of "Pisa shock" was Mr Schleicher's own country, Germany, a country that had nurtured a self-image of a high-performing education system.

US Dept of Education The US Department of Education has faced tough messages from Pisa results

But the Pisa results from 2000 suggested that it was only mediocre, causing a storm of controversy and national soul-searching. A German newspaper described the experience as an "instructive disaster".

Among the starkest revelations has been the decline of the US school system. This former education superpower has been caught up and left behind by many other countries, particularly in Asia.

This was distasteful medicine and Mr Schleicher says that the US administration was deeply unhappy with the 2006 results and was trying to apply pressure on the OECD.

The US politician who intervened to defend the importance of publishing the results was Ted Kennedy, says Mr Schleicher. Kennedy, who had chaired the senate committee on education, had become very supportive of the Pisa project.

"It was Senator Kennedy who saved my life at the OECD," he says.

In Italy, the 2009 results revealed another hidden weakness. While top grades in national exams were spread evenly across the country, the Pisa tests showed that pupils in the north were performing at a much higher level.

This meant that it was much easier to get a high grade in the south of Italy - and since public jobs depended on such grades, it represented an "incredible unfairness".

Without the external measurement of Pisa such problems would remain invisible.

There are other critics who warn against the impact of the narrow focus of Pisa - which ranks school systems on a very limited number of measures.

The influential UK head teacher, Anthony Seldon, warned of governments becoming "increasingly mesmerised and bedazzled" by the Pisa tests.

"Such tests are deeply flawed and their impact is profoundly damaging to young people," he says.

Rise of Asia

The tests have also revealed the changing face of the education world. Pisa has recorded the rise and rise of countries and cities in Asia, such as South Korea, Singapore, Hong Kong and Shanghai, where investment in education has been used as a way of fast-forwarding their economies.

Graduation ceremony in Shanghai Class of 2013: Almost seven million Chinese students graduated this summer

Looking to England, Mr Schleicher says he welcomes the readiness of Education Secretary Michael Gove to "open all the cupboards and see what's inside, see what the problems are".

"That's an essential starting point. You can debate about some of the medicine, but at least there's a serious search for the issues and challenges."

He says schools in England should move away from an "industrial mindset" and teachers should be given a "high degree of professional autonomy".

But Mr Schleicher remains unconvinced by changes to the national curriculum.

So how can international comparisons in education standards ever be really fair? Is it meaningful to compare countries as different as Finland, Peru and Vietnam?

Mr Schleicher is a robust defender of such comparisons, saying whether or not they are fair, young people from all those countries are competing with one another in a globalised economy. The skills they learn are going to be hugely important to their life chances.

"It's not about the elite, it's the poor who are affected by globalisation, they are the ones who are going to lose their jobs because they're not keeping up with the skills on the other side of the world."

In terms of the methodology, the test results are based on a representative sample of around 5,000 pupils in each school system, overseen by the OECD. Some have bigger numbers, with more than 12,000 in the UK and 38,000 in Italy.

The tests are designed by Australian researchers with the requirement that questions are culturally neutral, as relevant in Tunisia as Estonia.

The forthcoming results will also provide a much more detailed picture of regional differences. It will show how US states such as Massachusetts or regions within Spain and Italy would have scored if they were ranked as countries.

But this isn't just one giant data fest. There is a human purpose to all this, says Mr Schleicher.

These tests show the gaps in some basic skills needed by young people. And once these youngsters have left school without these skills, he says, it is "very hard to fix retrospectively".

"In the US the whole pipeline is broken and in Europe there are 80 million who can't read better than a 10-year-old child.

"What are you going to do with these people. That's the real challenge.

"The countries with good school systems have great assets."

How important are international tests? Do they give a fair comparison between schools? What else could they show?

If you are happy to be contacted by a BBC journalist please leave a telephone number that we can contact you on. In some cases a selection of your comments will be published, displaying your name as you provide it and location, unless you state otherwise. Your contact details will never be published. When sending us pictures, video or eyewitness accounts at no time should you endanger yourself or others, take any unnecessary risks or infringe any laws. Please ensure you have read the terms and conditions.

Terms and conditions

More on This Story

Knowledge economy

More Business stories

RSS

Business Live

  1.  
    Tesco store closures Breaking News

    Tesco have named the 43 stores to shut: 18 express stores, 12 metro, seven superstores and six homeplus outlets. "We will continue to serve our customers through other local stores and our dotcom service," said boss Dave Lewis.

     
  2.  
    11:51: Petrol prices
    petrol

    Oh er. Petrol price drops have levelled off somewhat, according to Experian Catalyst's figures. Admittedly, these are daily numbers, so they are likely to jump around a bit. The average price for unleaded yesterday was 106.69p. The day before: 106.66p. A week ago it was 107p and 112.08p on 1 January.

     
  3.  
    11:35: Greek markets
    ase

    Greek bond yields have risen again, meaning their value in the market has dropped and investors are considering them riskier. 10-year bonds now offer investors a 10% return. Shares on Athens's main market (pictured) dropped again, with banks leading the losers. Eurobank Ergasias, National Bank of Greece and Piraeus are all down 19 to 20%.

     
  4.  
    11:20: Companies House blunder

    The High Court has order Companies House to pay £9m to Taylor & Sons Ltd, a Cardiff based engineering firm that it mistakenly reported as having been wound up, the Daily Telegraph reports. In fact, it was another, entirely unconnected, company - Taylor & Son Ltd - which had actually gone to the wall. By the time Companies House, tried to correct its mistake three days later, it was already too late to save the business.

     
  5.  
    11:04: No rush to raise interest rates
    The Bank of England

    The Bank of England is in no rush to hike interest rates and when it does, the increase could be as slow as half a percentage point a year, chief economist Andy Haldane has said."We are in no rush to raise rates, the recovery is taking hold nicely. The last thing we want to do is knock the stuffing out of that," Haldane told the Daily Post. They are historically low and they won't stay like that forever, but when that rise comes it is going to be very gradual. It could be half a percent a year for several years," he added.

     
  6.  
    10:47: Ikea profits flat
    The new IKEA store in Edmonton

    Ikea has reported flat full-year net profit as a result of a €200m contribution to an employee loyalty programme, and a growing number of staff taking part in a bonus programme, for which it booked a €98m cost. It says the European market continued to improve. Net profit was €3.3bn to the end of August 2014.

     
  7.  
    President Obama India visit Via Email Simon Atkinson Editor, India Business Report
    Mahindra

    Anand Mahindra, chairman of Indian conglomerate Mahindra Group has been telling the BBC about being in talks with US President Barack Obama and Indian Prime Minister Narendra Modi in Delhi. And he was impressed with the informality: "It was literally talking over a cup of tea," he said. "President Obama took notes and referred back to specific points people made, so I know he wasn't just doodling".

     
  8.  
    10:16: African bond risk

    A strengthening dollar could sting some African countries after a spree of bonds being issued in the currency, according to a think tank. Judith Tyson, senior researcher at the Overseas Development Institute (ODI), said the notional losses in terms of higher interest and capital repayments could total $11bn in the event of a slump of 35% in African currencies against the dollar, Reuters reports. Selling bonds in hard currencies is a popular practice to attract foreign investors.

     
  9.  
    10:00: Greece stops privatisations

    Shares of Greek energy firm PPC and Greece's biggest port, Piraeus Port Authority, have fallen by over 7% after the new government's declaration that it was freezing privatisation plans. Shares of Piraeus Port Authority were down 8.9% at €9.83. At the first cabinet meeting of the new government Greek Prime Minister Alexis Tsipras has said Greece will not default on its loans.

     
  10.  
    09:45: Greece stops privatisations

    The Greek government will freeze plans to privatise the country's dominant energy firm PPC, Energy Minister Panagiotis Lafazanis has told Greek television today. The previous government had passed legislation last year to spin off a chunk of PPC and privatise it as part of its efforts to liberalise its energy market under the terms of its IMF-EU bailout A planned sale of a 67% stake in the State owned Piraeus Port Authority has also been shelved.

     
  11.  
    09:28: Russian plan
    People walk in the Red Square

    The Russian government unveiled a 2.34 trillion-rouble ($34.8bn, £22.9bn) plan to tackle its economic and financial troubles prompted by a collapse in oil prices and Western sanctions over the Ukraine crisis. In the plan, the government said it would collect proposals for creating a 'bad bank' for problematic banking assets. It would also provide state development bank VEB with 300 billion roubles from the National Wealth Fund.

     
  12.  
    09:13: Greece euro exit? BBC Radio 4

    Greece leaving the euro wouldn't do irreparable damage to the eurozone, Carl Bildt tells Today. It is up to Greece whether it wants to stay in the eurozone or not, but the currency bloc itself is here to stay, he adds. "Leaving the eurozone is not going to sort out Greece's problems," he says.

     
  13.  
    08:58: Greece euro exit? BBC Radio 4

    "Greece evidently wants to stay in the euro," Carl Bildt, tells Today. There will be discussion and there will be division between the Greek government and the rest of Europe, he adds. "The rest of Europe already feels it has helped Greece massively and Greece has turned things around slightly, it's not a hopeless case but now, suddenly, they want to spend and go back to irresponsible policies," he says.

     
  14.  
    08:46: Newspaper review
    papers

    The Times reports doctors can now approve Eculizumab, a treatment for a rare kidney condition. It will cost the NHS £82m a year for the 200 people with Atypical hemolytic-uremic syndrome. The FT leads on Apple's performance. The Wall St Journal dissects the new Greek cabinet and the Daily Telegraph reports that the drop in petrol price is as good as a 1p tax cut.

     
  15.  
    08:32: Alibaba report
    alibaba

    Chinese regulators have accused online shop Alibaba of allowing sales of fake and poor-quality goods in a report that was withheld until now to avoid disrupting its US stock market debut. China's industrial regulator said Alibaba allowed unlicensed dealers to use its services and failed in consumer protection.

     
  16.  
    08:22: Market update

    Tokyo stocks reversed early losses to close 0.15% higher as a weak yen pushed the market into gains. The Nikkei 225 index at the Tokyo Stock Exchange, which fell 0.86% at the open, added 27.43 to end at 17,795.73. The benchmark Hang Seng Index in Hong Kong gained 54.53 or 0.22% to 24,861.81.

     
  17.  
    08:13: Nintendo
    mario

    Japanese videogame maker Nintendo said its April-December profit rose six-fold to $504m as a weaker yen boosted its bottom line and make up for slowing sales. It won't make as many sales for the full year as previously hoped, though.

     
  18.  
    08:05: Greece euro exit? BBC Radio 4

    Former Swedish prime minister Carl Bildt tells Today it is not just the Germans that oppose a renegotiation of Greece's debt repayments. He points to Finland which holds elections later this year and has some problems in its economy. He says it is very hard for Finnish MPs to tell the public they have to accept some cutbacks in public spending but Greece doesn't. "That doesn't really fly," he says.

     
  19.  
    07:48: EDF disconnects nuclear power plant
    A view of Heysham Nuclear Power Station

    EDF Energy has said it disconnected Heysham's 1-2 nuclear power plant at the Lancashire site from the electricity grid on Tuesday. "Unit 2 at Heysham 1 power station was taken offline on 27 January 2015," an EDF spokesman said in an emailed statement to the Reuters newswire. EDF tells the BBC it's an issue with a turbine. So it's a non-nuclear part of the plant. Should take "a few" days to sort.

     
  20.  
    07:34: AG Barr results
    bru

    Fizzy drink maker and manufacturer of Irn Bru said it delivered a "robust performance" and should hit analysts' targets for the year. It had 5% growth in the fourth quarter, "well ahead of the total soft drinks market."

     
  21.  
    07:26: Greece euro exit? BBC Radio 4

    Greece should tell Europe it will not pay its debt and will exit the eurozone, Lord Desai tells Today. He says the country has to decide whether it wants "misery now or misery forever". He suggests that has to be the starting point of any negotiations with the Troika - the IMF, ECB and EU. He adds no country has ever paid debts like this in the past. Germany did not pay all its reparations, he says. "The international community has to recognise you can't put such a incredible burden on a people regardless of whose fault it was," he adds.

     
  22.  
    Via Twitter Rory Cellan-Jones Technology correspondent
    apple

    tweets: Amazing Apple quarter: record $18bn profit, 74m iPhones - most profitable product in history? But iPads disappoint

     
  23.  
    06:57: Greek euro exit? BBC Radio 4

    Lord Desai says most of the debt Greece owes is to public bodies such as the European Union and IMF. Greece cannot continue to pay off its debts for the next 20 years, he adds, and Greece and Germany have to decide whether they can afford for Greece to leave the eurozone. Anne Richardson of Aberdeen Asset Management points out £8bn of bank deposits have left Greek banks since November because investors see a so-called Grexit as having come "one step closer".

     
  24.  
    Via Twitter Stephanie McGovern Breakfast business reporter
    port

    tweets: Morning from the Port of Tyne - where today I'm talking about exports. #economy

     
  25.  
    06:44: Greek euro exit? BBC Radio 4
    Greece"s Prime Minister Alexis Tsipras is accompanied by associates

    Now that the Greek election has been won by Syriza, thoughts have begun to turn to negotiations over the country's debts. Greece could request to pay no interest on those debts for about five years, Lord Desai, economist and chairman of the Official Monetary and Financial Institutions Forum, tells Today. "That would save them about 4% of GDP," he says. But, he adds, there "really is no human way that Greece can pay the debt without ruining at least one generation's future."

     
  26.  
    06:31: GDP growth Radio 5 live

    Anne Richards, chief investment officer of Aberdeen Asset Management is the markets guest on Wake Up to Money. "You have to be a wee bit careful with quarterly numbers as they are subject to a lot of revision," she says. "The overall picture for the year was reasonably positive." Low construction growth was "a bit worrying." Strong sterling is a drag on GDP growth. Reliance on services rather than making things is also a challenge, she says. More engineers are needed.

     
  27.  
    06:20: Apple profit Radio 5 live
    The Apple logo

    The biggest quarterly profit ever for a company: $18bn, has been posted by phone pedlars Apple. Daniel Eran Dilger who writes for AppleInsider tells Wake Up to Money. Apple makes a load of margin from its high-end phones. They also make a lot when you break your power cable and have to splurge £65 on a new one, as presenter Adam Parsons learned earlier this week.

     
  28.  
    06:12: Services growth Radio 5 live

    More from Greg Madigan, the boss Subway UK and Ireland on Wake Up to Money. Hospitals, service stations and forecourts, or "non-traditional locations" are a big area of growth for the firm, he says. He used to be an air traffic controller, he adds.

     
  29.  
    06:01: Services growth Radio 5 live

    Services is what's propping up GDP growth, we learned yesterday. Greg Madigan, the boss Subway UK and Ireland is on Wake Up to Money. "The price of oil has come down putting more money in peoples pocket... one of the things that benefit from more discretionary spending is food retail," he says. They have 2,000 stores in the UK and Ireland now.

     
  30.  
    06:00: Howard Mustoe Business reporter

    Good morning. Keep your thoughts on today's news rolling in via email bizlivepage@bbc.co.uk and on twitter @BBCBusiness

     
  31.  
    06:00: Matthew West Business Reporter

    Morning everyone. In case you missed it EDF became the last of the "Big Six" energy suppliers to cut its gas prices last night. And US tech giant Apple reported the largest quarterly profit in corporate history. Today sees trading updates come from Brewin Dolphin, Johnson Matthey, Sage and Anglo American. We'll bring you those numbers and more as we get them.

     

Features

From BBC Capital

Programmes

  • Virtual courtroomClick Watch

    The 'forensic holodeck’ system that recreates crime scenes as 3D virtual worlds

Copyright © 2015 BBC. The BBC is not responsible for the content of external sites. Read more.

This page is best viewed in an up-to-date web browser with style sheets (CSS) enabled. While you will be able to view the content of this page in your current browser, you will not be able to get the full visual experience. Please consider upgrading your browser software or enabling style sheets (CSS) if you are able to do so.