Monday, September 19, 2022

Student evaluations show bias against female professors

Study finds bias is driven by backlash after students receive first exam grades

GEORGIA INSTITUTE OF TECHNOLOGY

Despite earning more than half of all doctoral degrees conferred in the U.S., women are significantly underrepresented in faculty positions at colleges and universities. This is particularly true in tenure-track and tenured positions, with women making up just over a third of all full professors. Women are also less likely to receive tenure or be promoted to full professor, a situation known as the academic “leaky pipeline,” where women’s representation continues to decline the further they advance in their careers. In male-dominated fields, like economics, the statistics are more drastic: women represent only 17.5% of economics professors but earn 35% of economics graduate degrees.

While various reasons have been suggested as to why women still trail men in academic position and prestige despite increasing levels of educational attainment, one factor may play a surprisingly big role: teaching evaluations.

In a recent study, Whitney Buser, senior academic professional and associate director of Academic Programs in the School of Economics at Georgia Tech, explores the nature and causes of gender bias in student evaluations of teaching (SETs). By drawing on social role theory to inform their hypotheses, Buser and her co-authors investigated whether bias exists at the outset of the semester and whether backlash after grading exacerbates it. Their study, “Evaluation of Women in Economics: Evidence of Gender Bias Following Behavioral Role Violations,” was published in the Springer journal Sex Roles.

“We know from the literature that female instructors fare worse in student evaluations, but with nearly all research on SETs done from end-of-semester evaluations, it’s hard to pinpoint how, when, and why gender bias arises, and how much exists. That was the goal of our study,” Buser said.

Role Expectations and Gender

According to social role theory, gender inequity arises from cultural beliefs and expectations about women and men. Women are overrepresented in low-status caretaking roles, which shapes beliefs and expectations about them being communal — helpful, kind, and concerned with others. Men, however, are overrepresented in high-status provider roles, which reinforces beliefs and expectations about men being ambitious, authoritative, and competent.

Role congruity theory shows that there are negative consequences for individuals who fail to fulfill society’s expectations either by role or by behavior, and it often comes in the form of backlash. Buser hypothesized that students would perceive grade feedback from female faculty more harshly than from male faculty due to role congruency expectations of communality in women, and that this backlash would be apparent in their SETs.

The Experiment and a New Survey

Universities use different methods for conducting teaching evaluations. To allow for direct comparisons across institutions, the researchers created their own standard survey for the study. Participants included nearly 1,200 undergraduate students, all of whom were enrolled in a Principles of Economics course. The students were taught by seven faculty members at five institutions.

The survey comprised criteria used in previous studies to detect gender bias. Students were asked to evaluate their instructors across seven areas using a 5-point scale ranging from “Strongly Disagree” to “Strongly Agree.”

The first three questions were gender neutral. Students were asked if they would (1) recommend the course, (2) recommend the instructor, and (3) whether they found their instructor interesting. Next, they were asked if they found their instructor to be (4) knowledgeable and (5) challenging, both of which are widely seen as male-like qualities. The final two criteria asked students to evaluate how (6) approachable and (7) caring their instructors are — qualities usually associated with women.

The anonymous surveys were conducted twice. The first survey was administered on the second day of class (Time 1) to assess participants’ early impressions. The second survey (Time 2) was given the day after students received their grades on the first exam, to see how impressions changed after they were given instructor feedback. 

Findings

On the second day of class (Time 1), female instructors were rated significantly lower than male instructors on all three gender-neutral criteria – recommend course, recommend instructor, and interesting – and the male-leaning criteria of challenging. There was no significant difference between male and female instructors observed for the communal qualities of caring and approachable, with women ranking only slightly higher.

Their results showed that between Time 1 and Time 2, male instructors improved on every trait. At Time 2, female instructors were still rated significantly lower than male instructors on all three gender-neutral qualities and both male-leaning qualities. Overall, female instructors stayed mostly stagnant between Time 1 and Time 2 but were rated as significantly less interesting at Time 2. At Time 2, students even rated their male instructors as slightly more caring and approachable than their female counterparts, a reversal from Time 1.

“The gender discrepancy between Time 1 and Time 2 was really driven by male instructors’ evaluations improving over time. This finding indicates that students view male instructors more favorably as time goes on, which was not at all the case for the women,” Buser said. “It was clear that exam grades made the evaluations split apart, even though there was no significant difference in exam grades between female and male instructors. As we predicted, this difference indicated a clear backlash against female faculty.”

Impact

In economics, it is usually only the statistically significant differences that are worth writing about. But in this study, there is reason to care about insignificant differences, because they are often used to make crucial decisions in practice.

For example, when department chairs and administrators look at teaching evaluations in hiring, they might have two candidates with similar scores separated by only a couple of decimal points. They could choose to interview or hire the candidate with slightly higher teaching scores without knowingly making a gender-biased decision, Buser said.

Universities currently have few formal ways of taking SET gender bias into account when it comes to performance evaluation, promotion, and tenure. Addressing the issue could help universities retain female faculty and repair the leaky pipeline.

“We hope this work will highlight the presence of gender bias and encourage the development of more objective teaching evaluation tools that take this dynamic into account,” Buser said. “Eliminating or reducing gender bias in teaching evaluations could have an enormous impact on women and their ability to thrive in academia.”

Research shows constituents ask female legislators to do more


Peer-Reviewed Publication

WASHINGTON UNIVERSITY IN ST. LOUIS

Despite the strides made in electing women to office, women are still grossly underrepresented in all levels of government. Women make up just over a quarter of all members of the 117th Congress (147 of the total 535 seats), which is more than double the number of women serving in Congress 20 years ago (72).

And those who hold elected office often are asked to do more by their constituents, according to a new study from Washington University in St. Louis.

The study, forthcoming in the Journal of Politics, found that female legislators are 10% more likely to be contacted by their constituents, and they receive 14% more issue requests per constituent they contact.

“There is a lot of evidence that women do more unpaid work than men. These findings suggest that the same patterns may apply in politics,” said Daniel Butler, professor and associate chair of political science in Arts & Sciences at Washington University in St. Louis.

To study this issue, Butler — along with Elin Naurin and Patrik Ă–hberg at the University of Gothenburg in Sweden — worked with one pair of Republican representatives and one pair of Democrat representatives who served a multimember district (like the U.S. Senate). The pairs represented the same set of constituents, belonged to the same political party, were the same race and had similar positions on the bills before their legislature. The key difference between the legislators in each pair was their gender: one man and one woman.

The legislators sent letters to their constituents, asking for input via a survey. Half of the constituents were contacted by their female representative and half were contacted by their male representative.

The survey asked constituents to list the issues that the legislator should work on. Altogether, 1,190 constituents responded with a set of issues important to them. Their responses listed many of the everyday issues that constituents care about, including education, roads and support for small businesses. 

The results showed that the increase in workload is coming on a variety of salient issues, including those that are typically considered “women’s issues” — education and health — as well as other issues — immigration and fiscal/economic matters. Moreover, women were not asked to do less on any issues.

Double-edged sword

According to Butler, previous work shows that female legislators are, on average, more active lawmakers than men. They introduce more bills, speak more during plenary sessions and expend more effort on constituency service, he said.

“It’s possible that female legislators are doing more because they’re being asked to do more by their constituents,” Butler said.

The potential upside of receiving more issue requests is that female legislators may be learning more about their constituents, allowing them to be in a stronger position to present their interests.

Political scientist Dan Butler

The current research does not explain why constituents ask more of their female representatives, but Butler has a few theories.

“Gender stereotypes are one reason that constituents might ask female legislators to do more. Voters may see women as less qualified to handle the male-dominant political work and feel the need to push them harder,” he said.

“Alternatively, voters may see women as being more willing to act on requests they receive or as caring more about others’ well-being. If constituents seek help from legislators who they think are more likely to listen and care, these stereotypes would make them more likely to contact female legislators.”

There is at least one benefit to these findings for female legislators, Butler said.

“The potential upside of receiving more issue requests is that female legislators may be learning more about their constituents, allowing them to be in a stronger position to present their interests,” he said. “However, that must be balanced against the pressures of being asked to do more.”


No comments: