Showing posts with label Teach for America. Show all posts
Showing posts with label Teach for America. Show all posts

Wednesday, September 11, 2013

Lesson for Teach for America in statistical versus practical significance

Image: Teach for America founder Wendy Kopp (source)

A recent study has many touting the benefits of TFA. The most overheated has been Dylan Matthews (Teach for America is a deeply divisive program. It also works.), but Matthew Yglesias is similarly condescending (Since empirical evidence doesn't change anyone's mind about this issue...), though Yglesias is at least more reasoned in his assessment (see below). No, the study didn't show that TFA works. It showed that it works for one subject in economically disadvantaged schools versus inexperienced teachers, provided you assume that TFA volunteers weren't teaching to the test. And, just because something's statistically significant doesn't mean it has any real world value. I'll let Dana Goldstein take it from here:
TFA math teachers outperformed non-TFA math teachers in their schools by .06 standard deviations in middle school and .13 standard deviations in high school. The talking point will be that this is the equivalent of an additional 2.6 months of learning per schoolyear. But it's important to realize this represents a relatively modest improvement in student achievement. For the average child in this study, who scored in just the 27th percentile in math compared to her peers across the country, having a TFA teacher will help her move up to the 30th percentile--still a long way off from grade-level math proficiency.
Right. TFA "works," in that it can improve student performance in one subject from well below grade level to...still well below grade level. Also worth noting: