How Pisa became the world's most important exam

Pupil in China in lesson taught by astronaut Rising star: Chinese pupil in lesson taught live from space by a Chinese astronaut

"Your education today is your economy tomorrow," says Andreas Schleicher from the Organisation for Economic Co-operation and Development, who has become one of the world's most influential figures in education.

And next week, the state of today's education standards across the developed world will be revealed with the publication of the results of the OECD's Programme for International Student Assessment, better known as the "Pisa tests".

This mammoth, three-yearly exercise, will produce international education rankings for more than 60 countries and dozens of regional administrations, based on tests in reading, maths and science taken by more than 500,000 15-year-olds.

And in the future it could get even bigger, with Mr Schleicher saying he wants to develop OECD rankings for universities.

Global league table

This latest world cup of school standards will reveal whether the Asian school systems, such as in Shanghai in China, Singapore and South Korea, remain world-beaters.

Shanghai mother meets son after gaokao exam Mother meets son after exam: Shanghai was top performer in the 2009 Pisa tests

And will the old Western powers, such as the US, the UK and France, remain stuck in the "must do better" category of this global classroom?

But what's the point of this vast piece of number crunching?

Mr Schleicher, now courted and quoted by education ministers, says the idea began in the 1990s with the simple recognition that governments were being compared on how much cash they were spending on education, rather than levels of achievement.

It was all about what was going in and nothing about what was coming out.

So the idea was launched for pupils in different countries to take pen and paper tests in core subjects and see how they compared.

And the name Pisa was chosen, not for any link to the Italian city, but because it was an acronym that was spelt the same in English and French.

Pisa topping

Mr Schleicher says that in a globalised world the key comparisons are with other countries - and this is true for education as much as economics.

Andreas Schleicher, OECD Andreas Schleicher wants to extend OECD rankings to higher education

"Your country's competitiveness and your individual job prospects are heavily influenced by what happens in other countries," he says.

"In a global economy improvement by national standards is not a measure of success. You compete globally."

Only relying on national exams, where the grades seem to keep improving, is a dishonest disservice to young people, he argues.

"It's like telling a disadvantaged student in your classroom, 'It doesn't matter how you compare with people in other schools, I'll give you a good mark because you're doing the best you can.'

"That's very nice, but once the student gets out into the labour market they're going to feel the brunt of reality."

"It is very important to know how well our students are prepared for a global economy."

Bringing bad news

This hasn't always made Pisa many friends. It can puncture the idea that everything is getting better.

The first victim of "Pisa shock" was Mr Schleicher's own country, Germany, a country that had nurtured a self-image of a high-performing education system.

US Dept of Education The US Department of Education has faced tough messages from Pisa results

But the Pisa results from 2000 suggested that it was only mediocre, causing a storm of controversy and national soul-searching. A German newspaper described the experience as an "instructive disaster".

Among the starkest revelations has been the decline of the US school system. This former education superpower has been caught up and left behind by many other countries, particularly in Asia.

This was distasteful medicine and Mr Schleicher says that the US administration was deeply unhappy with the 2006 results and was trying to apply pressure on the OECD.

The US politician who intervened to defend the importance of publishing the results was Ted Kennedy, says Mr Schleicher. Kennedy, who had chaired the senate committee on education, had become very supportive of the Pisa project.

"It was Senator Kennedy who saved my life at the OECD," he says.

In Italy, the 2009 results revealed another hidden weakness. While top grades in national exams were spread evenly across the country, the Pisa tests showed that pupils in the north were performing at a much higher level.

This meant that it was much easier to get a high grade in the south of Italy - and since public jobs depended on such grades, it represented an "incredible unfairness".

Without the external measurement of Pisa such problems would remain invisible.

There are other critics who warn against the impact of the narrow focus of Pisa - which ranks school systems on a very limited number of measures.

The influential UK head teacher, Anthony Seldon, warned of governments becoming "increasingly mesmerised and bedazzled" by the Pisa tests.

"Such tests are deeply flawed and their impact is profoundly damaging to young people," he says.

Rise of Asia

The tests have also revealed the changing face of the education world. Pisa has recorded the rise and rise of countries and cities in Asia, such as South Korea, Singapore, Hong Kong and Shanghai, where investment in education has been used as a way of fast-forwarding their economies.

Graduation ceremony in Shanghai Class of 2013: Almost seven million Chinese students graduated this summer

Looking to England, Mr Schleicher says he welcomes the readiness of Education Secretary Michael Gove to "open all the cupboards and see what's inside, see what the problems are".

"That's an essential starting point. You can debate about some of the medicine, but at least there's a serious search for the issues and challenges."

He says schools in England should move away from an "industrial mindset" and teachers should be given a "high degree of professional autonomy".

But Mr Schleicher remains unconvinced by changes to the national curriculum.

So how can international comparisons in education standards ever be really fair? Is it meaningful to compare countries as different as Finland, Peru and Vietnam?

Mr Schleicher is a robust defender of such comparisons, saying whether or not they are fair, young people from all those countries are competing with one another in a globalised economy. The skills they learn are going to be hugely important to their life chances.

"It's not about the elite, it's the poor who are affected by globalisation, they are the ones who are going to lose their jobs because they're not keeping up with the skills on the other side of the world."

In terms of the methodology, the test results are based on a representative sample of around 5,000 pupils in each school system, overseen by the OECD. Some have bigger numbers, with more than 12,000 in the UK and 38,000 in Italy.

The tests are designed by Australian researchers with the requirement that questions are culturally neutral, as relevant in Tunisia as Estonia.

The forthcoming results will also provide a much more detailed picture of regional differences. It will show how US states such as Massachusetts or regions within Spain and Italy would have scored if they were ranked as countries.

But this isn't just one giant data fest. There is a human purpose to all this, says Mr Schleicher.

These tests show the gaps in some basic skills needed by young people. And once these youngsters have left school without these skills, he says, it is "very hard to fix retrospectively".

"In the US the whole pipeline is broken and in Europe there are 80 million who can't read better than a 10-year-old child.

"What are you going to do with these people. That's the real challenge.

"The countries with good school systems have great assets."

How important are international tests? Do they give a fair comparison between schools? What else could they show?

If you are happy to be contacted by a BBC journalist please leave a telephone number that we can contact you on. In some cases a selection of your comments will be published, displaying your name as you provide it and location, unless you state otherwise. Your contact details will never be published. When sending us pictures, video or eyewitness accounts at no time should you endanger yourself or others, take any unnecessary risks or infringe any laws. Please ensure you have read the terms and conditions.

Terms and conditions

More on This Story

More Business stories

RSS

Business Live

  1.  
    Breaking News

    Financial Reporting Council announces inquiry into Tesco's accounts for 2012, 2013, 2014

     
  2.  
    09:55: Scotland's budget
    North Sea Oil

    The lead in the Financial Times is a suggestion that Scotland may have been saved from a crisis in its public finances by voting "no" in the referendum on independence. It says projections by the Office for Budget Responsibility suggest that had Scotland voted "yes", the falling oil prices would have led to its North Sea oil revenues slumping to just one-fifth of Holyrood's preferred forecasts in the country's first year of independence.

     
  3.  
    09:40: Snow-plough parents
    Skiing

    The Times highlights what it says is a new trend for well-heeled British parents: hiring private tutors to accompany them on family skiing trips. This apparently allows teenagers to cram for forthcoming exams, while still enjoying some action on the piste. The paper says it brings fresh meaning to the term "snow-plough parents" - those over-protective parents, bent on removing every obstacle in their offspring's path.

     
  4.  
    09:25: Spanish tax
    Cristina

    A judge in Spain has ordered that Princess Cristina de Borbon, the sister of the Spanish King, be tried on charges of tax fraud. It will be the first time a member of the Spanish royal family appears in the dock.

     
  5.  
    09:10: Facebook friends Russia
    Navalny

    On its front page, The Independent reports that Facebook has been accused of giving in to censorship after it apparently blocked access to a protest page on its site - under pressure from the Kremlin. A former US ambassador to Russia describes it as a "horrible precedent". According to The Daily Telegraph, Facebook has declined to comment on the suggestion that it stopped Russian users from viewing a page, rallying support for one of President Putin's most prominent opponents.

     
  6.  
    08:55: UK jobs Radio 5 live

    The employers' organisation, the CBI, says its latest survey suggests that half of its members plan to take on more staff next year. "Skills are at a premium in lots of areas," says CBI's director for employment and skills, Neil Carberry. "In fact one of the things we found in this year's survey is the biggest worry now for companies in their broadly rosy picture is whether they can get the skills they need to keep growing."

     
  7.  
    08:45: Markets update

    The main European markets are all looking rather chirpy this morning. Gains for oil firms, including Tullow Oil, Royal Dutch Shell and BP are driving the FTSE up 1% to 6,608. That's partly because Brent Crude has risen by 2% to $62.24 a barrel. In Germany, the Dax is up 0.9% to 9872, while in France, the Cac-40 is up 1.2% to 4293.

     
  8.  
    Cranking up Lada 08:28: Via Email Tony Higgins Lada owner

    "We had a Lada Niva. We bought it when we moved to a Lancashire hill farm in 1993. It was great. The early years were bad winters but the Lada coped very well. It was like a crab both on and off road, permanent 4WD. No power steering so hard work."

     
  9.  
    08:12: Pull over, Uber
    Xiaomi

    Uber may have been valued at $40bn, but one Chinese tech firm could now be worth an estimated $45bn, despite being relatively unknown outside Asia. The WSJ reports that smartphone and tablet maker Xiaomi, whose polished branding and devoted fan base is reminiscent of Apple's, has overtaken Samsung in China, but faces several challenges in expanding into India and beyond.

     
  10.  
    07:54: Cranking up Lada

    So, on to some of those Lada jokes. What do you call a Lada with a sun roof? A skip. What do you call a Lada with a sunroof and twin exhausts? A wheelbarrow. Etc. Send us your favourite Lada jokes: bizlivepage@bbc.co.uk and we will publish the best. Or if you've driven a Lada, and think they get a bad rap, let us know.

     
  11.  
    07:49: Cranking up Lada
    Lada

    The New York Times reports that the Kremlin is seeking to revive Russia's last major Soviet brand - the carmaker Lada. It has recruited Swedish-American Bo Inge Andersson, previously a vice president at General Motors. Lada, historically the butt of many jokes, still accounts for a third of all cars in Russia, and as foreign companies like Audi and Jaguar Land Rover suspend sales in the country due to the plummeting rouble, the utilitarian company could return to strength.

     
  12.  
    07:35: B&Q China
    bnq

    Kingfisher says it will flog its controlling 70% stake in B&Q China to Wumei Holdings for £140m. It opened its first B&Q in the country in 1999.

     
  13.  
    07:25: Oil blessing?

    The Guardian's leader takes a contrarian stance on falling oil prices, which have been widely welcomed by Western consumers. "Oil has dipped 40%, pessimists fear, because the world no longer expects a return to economic full pelt," it argues. "Europe, Japan and - relative to its own vigorous standards - China, have all been looking anaemic this year. Like low blood pressure after a heart attack, then, cheap oil should arguably be regarded not as a sign of rude health, but rather as a consequence of malaise."

     
  14.  
    07:12: Budget Samsung
    Samsung

    $100 for a Samsung smartphone? CNBC reports the South Korean company is entering the increasingly competitive budget handset market, in a bid to sell more phones in India, where many people still use simple phones. The new handset will run Samsung's own Tizen software.

     
  15.  
    06:58: Rates Radio 5 live

    The Bank of England's Martin Weale adds that he is optimistic about the year ahead. More money to spend from cheaper oil will help. He's on the committee that helps decide the key interest rate. Will it rise this year? He's careful not to second-guess his colleagues on that one.

     
  16.  
    06:46: Santa rally? Radio 5 live
    santa

    Will there be a so-called Santa rally this year? A rise in markets in the days around Christmas? Brenda Kelly from IG says you see one in almost nine out of every 10 years since the '80s.

     
  17.  
    06:28: Rates Radio 5 live

    The Bank of England's Martin Weale has been telling Wake Up to Money why he's been voting for interest rates to move off the record low of 0.5%. "It isn't only that unemployment has been falling - at least until recently extremely rapidly. It's also that when I go and visit businesses throughout the country I find they're talking of pay increases in a way quite different from what I was hearing early in the year certainly this time last year."

     
  18.  
    06:16: Markets Radio 5 live

    Brenda Kelly from IG is Wake Up to Money's markets guest. They are talking about the falling oil prices. "A lot of it is down to a glut of supply and Saudi Arabia wants to keep market share," she says. Saudi's breakeven price is only a few dollars per barrel.

     
  19.  
    06:10: Christmas spending Radio 5 live

    Mark Barnett, UK & Ireland president of Mastercard, is on Wake Up to Money, talking about Christmas shopping habits. What else? People have returned to luxury goods, he said. Holidays and furniture are down a little bit though.

     
  20.  
    06:04: Hacking 2.0
    Kim Jong

    The global cyberwar that dominated headlines last week shows no signs of abating. Hackers have infiltrated South Korea's nuclear power provider, and posted schematics of nuclear reactors and private personal records online. It's not clear whether the same group that attacked Sony Pictures is responsible.

     
  21.  
    06:00: Howard Mustoe Business reporter

    Morning! Get in touch. Tell us what you think. Email bizlivepage@bbc.co.uk or on Twitter @BBCBusiness

     
  22.  
    06:00: Joe Miller Business Reporter

    Good morning, and festive greetings all round. In a week when the business world is winding down for Christmas, we'll bring you all the news that's sneaking in the back door, and much more besides.

     

Features

From BBC Capital

Programmes

  • (File photo) A man dressed as Father Christmas with a sleigh and a reindeer Click Watch

    A website which tracks Father Christmas, plus other sites and apps to keep you entertained

BBC © 2014 The BBC is not responsible for the content of external sites. Read more.

This page is best viewed in an up-to-date web browser with style sheets (CSS) enabled. While you will be able to view the content of this page in your current browser, you will not be able to get the full visual experience. Please consider upgrading your browser software or enabling style sheets (CSS) if you are able to do so.