## Stop Copying Others: TIMSS Lessons for America

TIMSS[1] has become one of the two most influential international testing programs in the world today, the other being PISA. First introduced in 1995, TIMSS is conducted every four years to assess math and science learning in fourth and eighth grade. It has had significant impact on math and science education in the world over the last 20 years. Its impact on the U.S. education policies and practices over the last two decades cannot be overstated. According to the TIMSS 2015 Encyclopedia:

In the late 1990s, when the results of the Third International Mathematics and Science Study were released, TIMSS became a standard policy citation to emphasize that US student performance in mathematics and science was not leading the world. Between 1999 and 2002, state and national educational reformers across the country regularly used the results of TIMSS 1995 and TIMSS 1999 to make this point in editorials and articles.

^{i}During these years, more than three dozen congressional statements, debates, and bills cited TIMSS results to justify passing specific education bills, or to call for reforms in education to keep the United States internationally competitive.

So after 20 years of learning from TIMSS, what has the U.S. achieved? (All data from TIMSS publications.)

**The gap in scores remains**.

In terms of test scores, the U.S. has certainly improved, but so have other countries. So the gap between U.S. students and East Asian students remain as large as 20 years ago (Figs 1 & 2).

**As test scores went up, students’ confidence and attitude toward math came down.**

While both students in the U.S. and East Asian education systems all improved over the last two decades, their confidence in math declined. Likewise, not as many students valued math in 2015 as in 1995. Figures 3, 4, and 5 capture this trend[2].

**But the U.S. still has more students reporting confidence in math and valuing math than East Asian students. **

More students in the U.S. reported having more confidence and valuing math more than students in East Asian countries in 20 years ago. It is still so despite the global decline.

**U.S. seems to have learned all lessons suggested by TIMSS but …**

Two of the biggest lessons from TIMSS for the U.S. were *curriculum *and *teachers*. It was suggested that the high performance of East Asian education systems, Singapore in particular, was the result of a much better curriculum and better teachers.

*Curriculum benchmarking*

The U.S. has been benchmarking its curriculum against the high performing systems. The Common Core is just one example, after many states tweaked their math curricula. As a result, the 2015 TIMSS results suggests that U.S. is on par with East Asian education systems in terms of the percentage of students taught the TIMSS Math topics in both 4^{th} and 8^{th} grade. In some cases, the U.S. has better coverage than its East Asian counterparts (Figures 6 & 7).

*Better teachers and teacher preparation*

It was also suggested that East Asian teachers are better prepared (with higher degrees) and more specialized (majored in math). The U.S. has been working on these two areas too. In 2015, the U.S. has more students taught by teachers holding advanced degrees than East Asian education systems (Figures 8 & 9).

In terms of majoring in math, the picture is mixed. In 4^{th} grade, for example, the U.S. had about the same percentage of students taught by teachers with both majors in education and math as Japan and Korea, but significantly lower than Singapore, Hong Kong, and Chinese Taipei. In 8^{th} grade, the U.S. had more students receiving teaching from teachers with both Math and Math Ed majors than Korea and Chinese Taipei. The U.S. had more students taught by math majors without math education major than all East Asian systems (Figures 10 &11).

But the data does not necessarily suggest majoring in math produces better scores in the students. The picture is very mixed. For example, in 4^{th} grade, students taught by teachers who majored in primary education and math actually received a lower score (537) than those whose teachers just majored in education (540), although the difference is not significant. The same pattern holds for Singapore, Japan, and Hong Kong. In 8^{th} grade, U.S. students whose teachers majored in both Math and Math Education scored higher than either those students whose teachers only majored in math but not math education as well as those only majored in math education but not math. This situation is similar in Singapore, Korea, and Chinese Taipei, but not true in Hong Kong and Japan, where teachers with math majors without math education major produced the highest scores.

**Reflections and Questions**

*Can we ever catch up? Is it necessary to catch up?*

* *

It seems clear that after tremendous efforts to catch up to the high performing education systems in test scores, the U.S. has not succeeded. Two questions arise. First, can the U.S. ever catch up? Second, is it really necessary to catch up? My answer to both questions are no. Interested readers can read my books *Catching up or Leading the Way: American Education in the Age of Globalization *and *World Class Learners: Educating Creative and Entrepreneurial Students.*

*Is it worth the cost?*

While test scores went up in math in both the U.S. and East Asian countries, more students lost confidence in math and valued math less. If it is true that whatever policies and practices that resulted in higher test scores also make students less confident and less interested in math, are these policies and practices really educationally sound? Don’t we want more people have confidence in math and value math?

*How much does curriculum matter?*

The U.S. has “fixed” its curriculum but has not narrowed the gap. All the efforts that went into fixing the curriculum did not produce the results promised by those who adamantly believed and argued that American schools have lower standard and fragmented curriculum. Was the diagnosis wrong? Does curriculum and standards really matter that much?

*Should we keep “fixing” American teachers?*

TIMSS and other international tests have resulted in waves of teacher bashing in America, suggesting that they are less qualified and less mathematically knowledgeable than their counterparts in East Asian education systems. Bashed have also been teacher education programs in the U.S.. But the data does not really support the blames. Perhaps American teachers are great at doing something more important than simply raising test scores.

*My Conclusion*

* *

I have questioned the value of international tests, and for that matter any standardized test, for improving our children’s education in many places. Test scores simply do not reflect what our children need to live in the future, let alone what they need to defend and improve a democratic society. Test scores are simply the indicator of one’s ability in taking the test. We should never read too much into it and attempt to draw conclusions that fuels actions that could affect the future of millions of children and the future of our society.

I have also raised questions on many occasions about copying policies and practices from other systems. It is not to say that we cannot learn from others. But education is both deeply rooted in and an integral part of culture, hence they mutually enhance and perpetuate, as I have argued in my book *Who’s Afraid of the Big Bad Dragon: Why China has the Best (and Worst) Education System in the World*. Different cultures impose different values and expectations on education. Different cultures also support and suppress different educational practices. Unless one is ready and able to redefine one’s culture and society, copying isolated educational policies rarely works.

The lesson from all these: **Stop copying others’ past and start inventing our own future.**

[1] TIMSS was The Third International Mathematics and Science Study in 1995 and later changed its name to Trends in International Mathematics and Science Study.

[2] No comparable data are available in 1995 and 1999.

Rob Monksaid:I still think it is the chopsticks.

In countries that do better at maths the students interest in maths is lower. Their self confidence is maths is lower.

The negative correlation in TIMSS between achievement and engagement – confidence is counter intuitive.

Is it a cultural thing? Does it still hold true for non-Asian students?

Yong Zhao: How Did the U.S. Do on the Latest International Tests? | Diane Ravitch's blogsaid:[…] He analyzes here how U.S. students in fourth and eighth grades performed on the TIMSS, which is focused on mathematics and science. Politicians like to bemoan the fact that U.S. students are not #1 in the world on this test or on PISA. As I have previous written, American students were never #1 on international tests. Back in the mid-1960s, when these tests began and fewer nations participated, we were dead last. I wrote about it here and here and also in my book Reign of Error, where I documented in detail how poorly we have always done on these tests, how little it means, and why these tests have zero predictive value for our economy. Also, see here. […]

Articles of Interest December 2nd, 2016 « National Creativity Networksaid:[…] Stop Copying Others: TIMSS Lessons for America Education in the Age of […]

Ed News, Friday, December 2, 2016 Edition | tigersteachsaid:[…] TIMSS (Trends in International Mathematics and Science Study) scores have been released. The international exams in math and science are administered every 4 years in grades 4 and 8. American pupils are making improvements but the […]

Sean Lancastersaid:“The U.S. has “fixed” its curriculum but has not narrowed the gap.” I wonder if any conclusions can be drawn about the United States with regard to the Common Core at this point. Have we fixed the curriculum? Some states are doing the Common Core and some are not. Some tried it a bit and dropped it and others have modified the Common Core. I would love to see a comparison between states that have implemented and used Common Core and those who didn’t. But if I am reading things correctly, only Florida represented that USA for the 2015 test? https://nces.ed.gov/timss/benchmark.asp

Perhaps the PISA results will have more state by state comparisons available. But even then, I don’t believe any of the 15 year old students taking the test were learning Common Core math in their early years when basic math was being introduced.

WHPsaid:In countries that do better at maths the students interest in maths is lower. Their self confidence is maths is lower.