Image: Yeah, we could probably beat them at college football. (
source)
In this blog, I try not to stray too far from topics I know enough about to comment on. Educational policy is certainly an area I do not have enough knowledge to make a meaningful contribution to. But university education is an important part of social welfare, and there is one particular point I want to emphasize, as it pertains directly to my goals in this blog. Americans are quick to assume that American universities are better than Scandinavian ones. But there's really no evidence that that's the case; a major reason is that data collection, especially across different countries, is extremely difficult.
But there is another issue. What do we mean by good? What do we want our universities to accomplish? This tension is readily apparent in the debate over the value of American higher education. As with most issues, opposing camps are having two entirely separate debates, and are just talking past each other. To see what I mean, look at what happens when researchers try to
measure student learning in at universities:
There are three basic ways of trying to measure how well colleges educate students. The most obvious is to use some form of a standardized test. That's how K-12 schools are evaluated. Given the difficulty and controversy K-12 testing has entailed, using standardized tests for college students might seem impossible at first. Elementary and secondary students are at least expected to complete similar courses, to learn the same rules of punctuation and applications of the Pythagorean theorem. Undergraduate studies are far more diverse: Some students choose to spend four years immersed in Ovid, others in organic chemistry.
But there turns out to be an answer: Instead of testing discreet pieces of knowledge, test the higher-order critical thinking, analysis, and communication skills that all college students should learn (and which employers value most). The Collegiate Learning Assessment, recently developed by a subsidiary of the RAND Corporation, does exactly that. Instead of filling in bubbles with a No. 2 pencil, CLA test-takers write lengthy essays, analyzing documents and critiquing arguments.
Unfortunately for us, the results of these tests are kept secret; we only know the results in aggregate. Nationally, using the CLA,
36% of college students
show "exceedingly small or empirically nonexistent" learning after four
years of college. Yes, over a third of college students learn nothing
or almost nothing in four years of college. It's little wonder universities fight to keep these scores secret.
But if some students are learning nothing (or next to nothing), who are they? Are they concentrated at rural Moo-U colleges? At grimy, urban, blue collar commuter colleges? Flagship research institutions? Or are the students learning nothing concentrated among bottom-shelf cocktail swilling liberal arts majors at all four-year colleges and universities?
Fortunately, we can get some idea from the University of Texas system. UT system CLA results are all public. The "best" UT university--that is, the one with the highest rank in the US News and World Report, and the one with the best reputation--is the flagship university at Austin. UT-Austin
performed abysmally. The institutions with the most student learning actually occurred at the "worst" UT schools: UT-San Antonio, UT-El Paso, and UT-Permian Basin, all of which are near the bottom of the US News and World Report college rankings.
It's not just the CLA.
Another tool
used to assess universities, the National Survey of Student Engagement,
shows basically the same results--student gains are shockingly small, and student learning is utterly uncorrelated to US News and World Report college rankings.
This begs the question: if flagship universities don't exist to teach students, what are they there for?