Teacher Quality Report: Lacking a Certain Quality

October flew by. I actually did a lot of writing, but not where anyone can see it. Plus, I’ve had my butt kicked, bronchially speaking. Apparently I’m asthmatic, but the only thing that means to me is that I hang on to coughs forever. So here it is October and just two posts? 20 days between? That might be a record. Even weirder, this has been my biggest month–25K+ views. Go figure. But let’s see if I can get two done in a day.

First up is a bit of a greatest hits montage occasioned by this report on Gains in Teacher Quality by Dan Goldhaber and Joe Walch.

I noticed some, er, broad claims.

Smart Teachers are Better?

From the report: And the evidence on the importance of teacher academic proficiency generally suggests that effectiveness in raising student test scores is associated with strong cognitive skills as measured by SAT or licensure test scores, or the competitiveness of the college from which teachers graduate.

Nice to see a mention of licensure test scores, although not in the right context. But as Dan Goldhaber himself observed,

..we see that Black and other minority students appear to benefit from being matched with a Black teacher regardless of how well or poorly that teacher performed on the Praxis tests, and these positive effects due to matching with Black teachers are comparable in magnitude to having the highest-performing White teachers in the classroom. Removing the lowest of performers on the exam would necessarily remove some of the teachers that appear to be most effective for this segment of the student population.

He also found that there’s no relationship between licensure scores and reading effectiveness, but that licensure test scores operate as a reasonable screening device for white teachers and math. But not black teachers, I guess.

And RAND found less than that:

The results show large differences in teacher quality across the school district, but measured teacher characteristics explain little of the difference. Teacher licensure test scores are unrelated to teacher success in the classroom. Similarly, student achievement is unaffected by whether classroom teachers have advanced degrees. Student achievement increases with teacher experience, but the linkage is weak and largely reflects poor outcomes for teachers during their first year or two in the classroom.

Is there anything relating teacher quality to SAT scores? I couldn’t find it, but (and I mean this seriously) I may have missed it. Can You Recognize an Effective Teacher When You Recruit One? says there isn’t much of a link:

some researchers have found that teachers with stronger academic backgrounds produce larger performance gains for their children (see, for example, Clotfelter et al. (2006, 2007), in addition to the reviews cited above). However, there are also a number of studies which do not find this relationship (e.g., Harris and Sass (2006) on graduate course work and Kane et al. (2006) on college selectivity). …While several early studies failed to find a significant relationship between college admissions scores and principals’ evaluations of new teachers (e.g., Maguire (1966), Ducharme (1970)), a well cited study by Ladd and Ferguson (1996) did find a link between scores on the ACT exam and student achievement growth.

I often notice a study mentioning the “consistent” or “pervasive” link between teacher cognitive ability and student achievement, but all the research I find says that no conclusive link has been found, that some studies find a relationship, some don’t. Research is no more supportive of the smarter teachers campaign than it is for stricter gun control or tougher drug laws. Sorry.

Teachers used to be smart women, but no more

Another quote:

Over the course of the next 35 years, women still made up the vast majority of the teacher workforce, but their academic credentials began to decline. Research by Sean Corcoran, William Evans, and Robert Schwab indicates that the likelihood of a female teacher having been among the highest-scoring 10 percent of high school students on standardized achievement tests fell sharply between 1971 and 2000, from 24 to 11 percent.

Corcoran, Evans, and Schwab said that, but they said a lot more:

In the results presented here we find some evidence of a slight but detectable decline in the relative ability of the average new female teacher, when ability is measured as one’s centile rank in the distribution of high school graduates on a standardized test of verbal and mathematical aptitude. The magnitude of this decline is even greater when measuring ability using standardized scores. We also find that examination of the entire distribution of new teachers is more informative than trends in central tendency alone. Over the 1964–2000 period, women near the top of the test score distribution became much less likely to enter the teaching profession than their peers near the middle of the distribution. The apparent consequence has been a much lower representation of women of very high academic ability in the pool of elementary and secondary teachers. While the sample sizes of male teachers are much smaller, we detect the opposite trend among men.

Huh. So on average, women teachers are mostly as bright. (Consider that we have a lot more special ed teachers, who are predominantly female and who have scores as low or lower than elementary teachers.) But fewer really really smart women. Count that as a big “so what”, particularly since, as the report observes, we’re getting some more bright men.

But again, we don’t even know if we need really smart teachers.

We have no data on teacher quality

Absent persuasive evidence on the impact of efforts to raise the bar, some people have speculated that the rise of test-based accountability associated with NCLB and the ongoing push to establish more-rigorous teacher evaluation systems have made teaching less attractive and thereby contributed to further decline in the quality of the teaching corps. (emphasis mine)

Oh, come on. That’s crap. ETS has been telling the world that teacher metrics, particularly in elementary and middle school, have increased dramatically. I’ve written about this extensively, but I’ll just link in #5 on the list of heavily trafficked posts, Teacher Quality Pseudofacts, Part II, which has the most linked image on this site, and a link to this ETS report on teacher quality:

In summary, the following can be said about overall licensure patterns and academic quality during the last decade, at least for the states included in this study:

• Passing rates have decreased substantially.
• The academic profile of the entire candidate pool has improved.
• The academic profile of those passing the Praxis tests has improved.
• These improvements are consistent across gender, race/ethnicity, and licensure area.
• Profiles are markedly different for secondary subject teachers in contrast to elementary, special education, and physical education teachers.
• The decrease in passing rates is likely attributable to increasingly demanding testing requirements put in place during these intervening years.

Yeah, the licensure tests! How about those?

Things that Shouldn’t Make You Go Hmmmm

After going through the many ways in which teacher metrics have improved over a seven year period, the authors scratch their heads:

What explains the apparent rise in academic competency among new teachers? As we show, the SAT scores of those seeking and finding employment in a teaching job differ in different years. It is possible that alternative pathways into the teaching profession have become an important source of academic talent for the profession. Unfortunately, we cannot explore this issue in any depth because the way in which teachers were asked about their preparation has varied over time. Regardless, alternative routes are unlikely to be the primary explanation for the changing SAT trends given that, with a few high-profile exceptions like Teach for America, alternative certification programs are not highly selective.

Wow, introduce alternative certification and before I have a chance to get huffy, walk it back. Damn skippy alternative certification programs are not highly selective. Many are set up specifically to recruit URM teachers, and in many ways “alternative certification”, outside of TFA, is a proxy for black and Hispanic teachers.

The 1998 Higher Education Act required ed schools to prove that 80% of their candidates passed all licensure tests. If I understand the politics correctly, the law was intended to force ed schools to spend more time covering content, which is absurd. Ed schools responded predictably—who the hell wants to teach 6th grade math in college?—requiring candidates pass at least one licensure test to be eligible for admission. A couple years later, NCLB’s “highly qualified teacher” criteria led to a wholesale increase in elementary and middle school content knowledge requirements, reflected in much tougher licensure tests.

So the 1998 Higher Education Act, coupled with the tougher licensure tests of the NCLB era, led to a tremendous decline in black and Hispanic teachers overall, and their virtual disappearance from education schools. Alternative certification programs sprung up as a way to bring in more URM teachers—they aren’t bound by the 1998 law, so they can bring in candidates and then spend most of the training time teaching them the content to pass the test.

Have you been paying attention? Because it’s pretty friggin’ obvious why the “academic competency” of teachers has improved. I’ve been writing about this forever. THE LICENSURE TESTS ARE HARDER. I shouted this back in March (It’s the test, Zitbrains!) and at least twice on the Clarence Mumford case, and I don’t know how to holler it any louder.

This authors mention the licensure tests twice, but never for the right reason. They never once consider whether the tests might be a source of the increase. In fact, they never seem to realize that their report is largely redundant, since ETS covered the same ground six years ago.

Meanwhile, despite this big boost in teacher “academic competency”, which I’ve been writing about for two years, we aren’t seeing a corresponding huge boost in student academic outcomes, and all research continues to show that, at best, the link between teacher cognitive ability and student outcomes is twitchy and unreliable. All research continues to play the Reverse Drinking Game and ignore student cognitive ability. Math professors assure us that the only difference between “math people” and everyone else is effort, and that anyone with an IQ of 70 can learn algebra.

So, here’s what I think, but can’t prove: our teachers are pulled roughly from the same pool as always, which is the 35-50% for elementary and special ed teachers, and 50-75% for secondary content teachers. But the bottom quintile or so is gone because of higher licensure standards, so the average has increased. This has resulted in far fewer black and Hispanic teachers, particularly black teachers. Existing black teachers are also being forced out of the profession by new requirements (hence the Mumford impersonation fraud ring).

Remember, anyone who pushes for improved teacher qualifications is saying, in effect, we need fewer black and Hispanic teachers. And, as the recent TFA study’s big takeaway shows, all you get for largely eradicating black and Hispanic teachers is, maybe, .07 of a standard deviation.

Just today Dara Zeehandelaar commented on my blog:

The point is that students might benefit if traditional certification programs were more selective in who they admitted (for example, by admitting students with higher GRE scores, higher undergraduate GPAs, undergraduate or even graduate coursework in the content area in which they want to teach, professional experience, etc. — the same things that TFA looks for). “Selectivity” in this case has nothing to do with race.

She said this with a straight face, too.

Sorry, Dara. Selectivity in this case has everything to do with race.