Saturday, April 26, 2008

RateMyProfessors.com and Student Ratings

Flypaper: Ideas that stick from the Education Gadfly team: "The website RateMyProfessors.com has been the subject of much criticism as it has grown in popularity. For instance, a professor from Central Michigan University ran some numbers and found that “the hotter and easier professors are, the more likely they’ll get rated as a good teacher.”

Inside Higher Ed reports today, however, on a couple studies that have found high correlations between RateMyProfessors.com and official university student-evaluation systems:

A new study is about to appear in the journal Assessment & Evaluation in Higher Education and it will argue that there are similarities in the rankings in RateMyProfessors.com and IDEA, a student evaluation system used at about 275 colleges nationally and run by a nonprofit group affiliated with Kansas State University.

What is notable is that while RateMyProfessors.com gives power to students, IDEA gives a lot of control over the process to faculty members. Professors identify the teaching objectives that are important to the class, and those are the measures that count the most. In addition, weighting is used so that adjustments are made for factors beyond professors’ control, such as class size, student work habits and so forth—all variables that RateMyProfessors doesn’t really account for (or try to account for)."

Comments:
I'm going to take this with a HUGE mountain of salt until the article appears and I can read it personally. Until then, we know virtually nothing about the study other than what a press release and IHE reported.

Among other things, very, very few of my 1500+ students at USF have ever put anything into my RMP page -- maybe 15 or 16.
 
Sherm - I am looking forward to a student ratings system that extracts the factors out of our control to get to the heart of truly rating our teaching effectiveness. We use an instrument from Wichita State. Given that the mentioned eval system is from Kansas State, I will check this out. This may be worth trying to push for our university to switch to if it's more accurate. Our Wichita State instruments are much along the lines of whether a student likes a professor and there is an anecdotal correlation to less demanding professors.

Can you point us to some of the valid studies of student evaluation approaches?
 
Post a Comment

Subscribe to Post Comments [Atom]





<< Home

This page is powered by Blogger. Isn't yours?

Subscribe to Posts [Atom]