Work hard, party hard!

Last week, the Chronicle of Higher Education ran a series of articles and commentaries on the discomforting relationship between colleges and alcohol. Not surprisingly, they began the first article (“A River of Booze“) with the stereotypical “beer and circus” images of a large flagship university. Although much of what I read reminded me of the struggles I observed during my time at the University of Iowa, our residence life staff reminded me that many of the student justifications for drinking noted in these articles sound just like comments made by our own Augustana students.

So instead of writing something myself, this week I’m just going to refer you to this series of articles in the Chronicle. I’ve inserted the link to the opening piece above, and I’ve added another that digs into the challenges that colleges and universities have faced in trying to address dangerous drinking behaviors here.

Although we might be a small college, we struggle with many of the same issues noted by the Chronicle reporters. I hope you’ll find some time to read some of these articles and find out more about our own students’ alcohol-related behaviors. Like a lot of things, we will only succeed in addressing these issues to the degree that we tackle them together.

Make it a good day,

Mark

Week 10 + Halloween + Slicing Data = Disengaged Zombie Students!

I suspect that the confluence of Week 10 and Halloween brings out a little crazy in each of us.  So I thought I’d share a brief response that I prepared for a recent media request regarding the potential existence of one underserved student population on our campus.

From our senior survey data, we find that students who self-report as Zombies also report statistically significantly lower levels of engagement across a wide range of important student experiences. These differences include lower levels of participation in class discussion despite higher satisfaction with faculty feedback.

Zombie students also report lower levels of co-curricular influence on understanding how one relates to others. Further qualitative study suggests a broad lack of self-awareness.

In addition, Zombie students indicate that they have fewer serious conversations with students who differ by race, ethnicity, socioeconomic status, or social values.  Instead, Zombie students seem to congregate together and rarely reach out of their comfort zone.

Interestingly, our first-to-second year retention rate of student zombies is 100%, despite the high number of PUGS and CARE reports.  Yet our six year graduation rate is 0%. While some have expressed concern over this dismal data point, a few administrators who are closely involved in managing the graduation ceremony have suggested that the graduation ceremony is long enough already without having Zombie students shuffling aimlessly across the stage to get their diploma.

Interestingly, Zombie students report an increased level of one-on-one student/faculty interaction outside of class.  We find no evidence to suggest that this correlates in any way with the substantial drop in the number of part-time and adjunct faculty from last year (108) to this year (52).

Happy Halloween and have a wonderful Week 10.

Make it a good day,

Mark

In Search of the Mysterious Muddler

On several recent occasions I have heard it said that about 25% of our students aren’t involved in anything on campus.  I am always intrigued by the way that some assertions or beliefs evolve into facts on a college campus, and this number seemed ripe for investigating.   Researchers into human behavior have found this phenomenon repeatedly and suggest that, because we want to believe our own intuition to be true, we tend to perk up at data points or anecdotes that support our beliefs.  We’ve all fallen prey to this temptation at least once – at least I have.  So I thought it might be worth testing this claim just to see if it holds up under the glare of our actual survey data.

First – to be fair, this claim isn’t totally crazy.  I can think of a particular data point that clearly nods in the direction of the 25% uninvolved claim.  For a few years, we’ve tracked the proportion of seniors who don’t use their Augie Choice money, and – although the number is steadily declining – over the last few years an average of about 25% have foregone those funds.  Others have suggested that every year we have a group of somewhere between 600 and 800 students (henceforth called “the muddlers”) who aren’t involved in anything co-curricular; athletics, music groups, or student clubs and organizations.  More ominously, some have suggested that there is a sub-population of students who are only involved in Greek organizations and that these students help to create an environment that isn’t conducive with our efforts to make Augustana a rigorous learning experience. (All of that is a wordy euphemism for “these lazy bums party too much.”).

Although the question of what should count as true involvement is a legitimate one, the question of simple participation is an empirical question that we can test.  So we looked at two sets of data – our 2013 senior survey data and our 2013 freshmen survey data – to see what proportion of students report not being involved in anything co-curricular. No athletics, no music, and no student clubs or organizations.  Then we added the question of Greek membership just to see if the aforementioned contingent of deadbeats really does exist in numbers large enough to foment demonstrable mayhem. (another wordy euphemism for “be loud and break stuff.”).

Well, I’ve got bad news for the muddlers.  Your numbers aren’t looking so hot.  From the students who graduated last spring, only 17 out of 495 said that they didn’t participate in anything (athletics, music, student groups, or Greeks).  When we took the Greek question out of the equation we only gained 5 students, ultimately finding that only about 5% (23/495) of our graduating seniors said that they didn’t participate in athletics, music, or some student group.

But what about the freshmen?  After all, the seniors are the ones who have stayed for four years.  If involvement is the magic ingredient for retention that some think it is, then we should expect this proportion to be quite a bit bigger in the freshman class.

Alas, though our muddler group appears a little bigger in the first year, it sure doesn’t approach the 25% narrative.  After eliminating freshmen who participated in athletics, music, a student group, and a Greek organization, we were left with only 15 out of 263 first year students who responded to our survey.  When we left out Greek membership, we only gained 4 students, increasing the number to 19 out of 263 (7%).  Now it’s fair to suggest that there is a limitation to this data in that we got responses from only about 45% of the freshman class.  However, even after calculating the confidence intervals (the “+/-”) in order to generalize with 95% confidence to the entire freshman class, we still end up with range in proportion of students not involved in anything co-curricular somewhere between 4 and 9 percent.

There are two other possible considerations regarding the muddler mystery.  One possibility is that there are indeed more than we know because the non-participant would also be more likely to not fill out the freshman survey.  On the other hand – as some of our faculty have observed, it’s possible that our muddlers are also the students who study more seriously; just the kind of students faculty often dream of teaching.

My reason for writing this post is NOT to suggest that we don’t have some students who need to be more involved in something outside of their classes.  We certainly have those students, and if it is almost 10% of our freshman class (as the upper bound of the confidence interval suggests), then we clearly have work to do.  Rather, it seems to me that this is another reason to think more carefully about the nature of involvement’s impact on students.  Because it appears that the students who depart after the first year are not merely uninvolved recluses (again, the limitations of the sample requires that I suggest caution in jumping to too certain a conclusion).  It seems to me that this evidence is another reason to think about involvement as a means to other outcomes that are central to our educational mission instead of an end in and of itself.

Make it a good day,

Mark

 

 

Do student’s GPA suffer when they take more classes?

One claim (given as advice) that I’ve heard ever since I was a plump, pimple-faced college freshman is that taking a heavier academic load in a given term (no matter the calendar) increases the likelihood that one’s grades will suffer.  It seems intuitive:

more classes (and thus more homework) / the same number of hours in a week =          less study time to allocate to each class and therefore potentially lower grades

At Augustana we are understandably sympathetic to this concern because of the degree to which we often try to pack an extensive amount of learning into our shortened academic terms while maintaining the comparatively higher number of hours in class that we require for a credit hour.  Many of us can weave a harrowing tale of students’ swamped by the academic requirements of a four-course term, but it would be wise to wonder whether our individual anecdotes actually represent the experiences of most students.  So a few weeks ago, we decided to empirically examine this wide-spread belief.  Since this concern is often raised by faculty and administrators when discussing the merits of potential policy changes, this hypothesis seems a compelling argument to test.

So we examined our students’ term-by-term GPAs over the last three years (nine terms from the fall of 2009 to the spring of 2012), comparing the GPAs of students who attempted between 8 and 11 credits – less than four three-credit courses – with the GPAs of students who attempted 12 or more credits – four three-credit courses or more.  Moreover, we conducted this analysis in two stages.  In the first analysis we only tested whether the number of credits attempted significantly impacted students’ end-of-term GPA.  In our second analysis, we accounted for two potentially confounding factors: (1) a student’s pre-college academic ability, and (2) a student’s year in school, to make sure that any statistically significant effect we might find wasn’t a function of another plausible explanation.

Our first set of analyses surprised us.  Because we thought we’d find one of two possible outcomes – either the reigning hypothesis would hold true or we would find no significant difference between the two groups.  So we were pretty shocked when we found that in every academic term from fall of 2009 through spring of 2012, students who attempted 12 or more credits, on average, earned a HIGHER GPA (between .05 and .12 points) than those who attempted 8-11 credits.  Huh?

In the second stage of our analyses, we held constant students’ incoming ACT score and year in school.  At this point, I was sure that we’d end up with insignificant findings.  Instead, the finding from our first analyses held throughout.  Not only do students who are taking a heavier load not suffer in terms of a lower GPA for that term, but their GPAs (no matter the year in school or their incoming academic ability) were marginally higher.  Huh.

So what does this mean?  Certainly, the obligations of a heavier credit load can adversely affect a student’s stress level or sleep patterns even if they don’t necessarily impact grades.  And unfortunately, the only data we have readily accessible is term-by-term GPA and term-by term-credits attempted.  In addition, the findings might be different if we looked at each student’s term-by-term GPAs longitudinally instead of comparing all students cross-sectionally across a given term.  However, students must pay overage fees to take more than 33 credits a year, so the chances of a substantial portion of students consistently taking 12 or more credits, earning strong grades, and compromising this finding is pretty low.  In the end it seems that a heavier credit load doesn’t impact students’ grades in the way that we might have thought.

I wonder if this finding exemplifies a disconnect between the way that we tend to think students engage college and the way that they actually manage their college experience.  For years we have lamented the difference between the amount of time we think that our students should study and the amount of time our survey data suggests that they actually study.  Yet these same students graduate with an average GPA of 3.3, an increasing number of them graduate with honors, and many of them go on to successful, challenging professional lives.  And lest some might want to resurrect the allegation that this is further evidence of the corrosive effects of grade inflation, (1) we have multiple sources of evidence that suggest our students make more than respectable gains on various learning outcomes, and (2) we tested the grade inflation claim last year and found it to be explained by increases in our students’ incoming ACT scores over the past two decades.

I wonder if this is an indication that students are more capable of prioritizing their time and effort than we might give them credit sometimes.  And while I’m not suggesting that this finding should be used to require that they take a heavier academic load every term, I wonder if we might take our feet off of the academic gas pedal a little too easily sometimes – which is easy to do in the face of a roomful of scowling students to whom you have just assigned an additional assignment.  One student experience measured in the Wabash National Study that was particularly predictive of learning gains was the degree to which students were challenged to work harder than they thought they could to meet their instructor’s expectations.  Our finding regarding grades and course load suggests a similar result.  If we push our students, they might surprise us.

Make it a good day,

Mark

 

How Greek Membership Shapes Our Students’ Experience

Listening to some faculty talk, you’d think that fraternities and sororities at Augustana are a deadly concoction of Sodom and Gomorrah, Mardi Gras, Las Vegas, and Carnival, whipped up in a blender and chugged through a fire hose from a second story beer bong.   Yet, we all know of greek organizations – at Augustana and elsewhere – that make important contributions to the local community and the development of their members.  Thankfully, we don’t have to settle for dueling anecdotes.  We have plenty of data on students in Augustana’s greek organizations that allow us to test this clash of narratives.  So, since I’m on a bit of a mythbuster’s kick lately . . . let’s see what we can find out.

When the entering class of 2008 arrived at Augustana, little did they know that they would be studied like no class before.  They provided data three times as a part of the Wabash National Study (beginning of freshman year, end of freshman year, and end of senior year).  They were also the first class to complete the new senior survey in the spring of 2012.

From the data gathered at the end of the freshmen year (spring, 2009), we found one set of troubling results among first year greek members.  Freshmen who joined greek organizations reported larger increases than their independent (non-greek member) peers on three items during the first year.

  • The number of times in a week that they drank alcohol
  • The number of times in a week that they had five or more alcoholic drinks
  • The number of days in the week that they felt sleep deprived

In addition, greek members, on average, earned a lower spring GPA – even after accounting for students’ incoming ACT score and academic motivation.  Unsurprisingly, being male exacerbated each of these differences, while being female minimized them.  Interestingly, despite these potentially negative effects, greek membership did not decrease the likelihood of retention, probably because students don’t join greek organizations until the spring term, and the primary driver of persistence or withdrawal – academic performance – has already culled the herd during the previous winter and fall terms.

Fast-forward to the end of the senior year.  At this point, what initially seemed a more negative picture becomes more complicated.  While greek members’ average GPA still trail that of non-greek members, the gap noted in the spring of the first year has shrunk by about 25%.  Again, being female mitigates further, likely making the difference in average GPA between female greek and non-greek members insignificant.

However, in numerous cases greek students’ scores on several senior survey items suggests that this experience provided some important benefits.  On average, greek members’ responded more positively (defined by differences that proved statistically significant) to these statements:

  • My co-curricular experiences provided numerous opportunities to interact with students who differed from me in race/ethnicity, sexual orientation, religious beliefs, or social/political values.
  • My co-curricular involvement helped me build a network of healthy lasting friendships.
  • My co-curricular involvement helped me develop a better understanding of my leadership skills.
  • I felt a strong sense of belonging on campus.
  • The college emphasized an atmosphere of ethnic and cross-cultural understanding.
  • Augustana faculty and staff welcomed student input on institutional policy and handbook decisions.
  • If you could relieve your college decision would you choose Augustana again?

Taken together, these findings spell out much of the good and the bad of greek life.  On one hand, during the first year it appears that some behaviors emerge among greeks that could – and sometimes do – negatively impact students’ success.  On the other hand, by the time this group of students graduates, at least one of those deficits has been legitimately reduced, and the educational efforts of the college – particularly on the co-curricular side – appear to have produced a series of benefits that match our own educational intentions.

Of course, one important question – and a longstanding one – is how we might eliminate the bad without losing the good.  Our student affairs staff continually works to counter the impact of pledging on student success, even in the face of stiff pushback from many greek members and alumni.  Might there be a role for faculty to play in this endeavor?  Probably.  Does that role include railing against a stereotype of greeks that actually perpetuates a stereotype of faculty among students and, in so doing undermines the very trust necessary to influence students’ behavior outside of class?  Probably not.

But the question that jumps out at me is slightly different.  While it’s great to see graduating seniors from greek organizations respond so positively to all of these questions, should we actually be celebrating this?  What is it about NOT belonging to greek organizations that produces systematically lower scores on so many important markers of the college experience we are trying to deliver?  For example, I’m not comfortable with finding that the greek members’ sense of belonging on campus score was more than half a point higher than non-greek members (4.26 vs. 3.71); not because I begrudge greek organizations, but because I’m not sure I see a compelling reason for greek membership on our campus to produce such a stark difference.

It’s easy to point to anecdotes of the college experience at its best; and we have many wonderful tales of students – greek and non-greek – who have changed fundamentally during their four years at Augustana.  But as I look at these findings, my concern tends toward the students who experience less than our best.  I’d be curious to figure out what we might do to minimize, or even eliminate, the statistically significant differences between greek and non-greek members across all of these senior survey experience questions.

Answers?  You wanted answers?  Oh, grasshopper . . .

Have a great Homecoming week – and let’s not leave anyone on the outside looking in.

Make it a good day,

Mark

 

 

The myth of the vanishing humanities professor

As much as I try to be a kind, sensitive, and empathetic institutional researcher (group hugs every fifth Tuesday – no, not really!), I can’t resist salivating just a little bit whenever word of a new uber-explanatory claim pops up on my radar.  Part of my interest comes merely from a persistent drive to apply evidence to better understand what we do.  Sometimes, we make decisions that produce unintended consequences – and many times the impact of those decisions rises to the surface inductively, through the observations of some who, thankfully, are uniquely predisposed to see it.  However – and I fully own up to my dark side here – the chance to test a claim that has already gotten itself a bandwagon, a theme song, and the specter of pitchforks and torches storming the Bastille is an institutional researcher’s dream chance to “speak truth to power.”  It’s bratwurst to a Bear’s fan, grog to a Viking, a soy latte to an NPR member . . . you get the picture.

For many, the recent decision to merge the German and Scandinavian programs has felt like another body blow to the core values on which Augustana was founded.  Moreover, this decision all too easily feeds into a larger narrative that Augustana, like many traditional liberal arts colleges before it, has long since abandoned its commitment to the liberal arts even as it has disingenuously held on to the relative prestige of claiming to be something that it is not.

So . . . have we gutted our commitment to the liberal arts?  I purposefully choose this inflammatory language because it is exactly the wording that was used when the claim was made to me - complete with raised intonation and eyebrows.  While there are many ways to unpack this question; I’m writing a blog, not a book.  However, there are a couple of ways that we might examine our data to test this claim.  To that end, I’d like to introduce a couple of data points and one observation that might flesh out this story just a little bit.

One way that an institution might shift its commitment away from the liberal arts would be to move faculty positions away from core liberal arts disciplines like the humanities, foreign languages, and fine arts and add faculty lines to new or existing pre-professional programs.  While this by no means should be consider “smoking gun” evidence, if this were indeed the case, it would provide strong evidence to support the claim that Augustana had given up its commitment to the liberal arts.

So I decided to look for any evidence of a shift in faculty distribution over the past ten years. (Whether we should have gone back further to the late sixties or early seventies is an entirely valid critique).  Nonetheless, we started by building a baseline from 2001.  Thanks to Sarah Horowitz and Jamie Nelson in Special Collections, we tracked down a 2000-01 college directory and manually counted the number of faculty in each discipline.  As best as we can tell (it’s possible that some faculty were not listed in the directory for some reason), there were 78 faculty FTE (full time equivalent) employed by Augustana in the humanities, foreign languages, and fine arts ten years ago.  To put that in context, these 78 faculty FTE made up 49.6% of the 157 total faculty FTE.

So how does the 2000-01 distribution compare to today?  Last year, 2011-12, 114 faculty FTE were employed in humanities, foreign languages, and fine arts disciplines – 53.3% of our 214 total faculty FTE.  In the particular case of foreign languages, in 2000-01 there were 18 faculty FTE teaching in foreign language departments.  In 2011-12, there were 20.33 faculty FTE teaching in foreign language departments (we included classics in this analysis to be sure that Latin and Greek weren’t left out).

This evidence hardly supports the assertion that Augustana is gutting the liberal arts.  Just as a reminder, I am not suggesting that this is “smoking gun” evidence to dismiss the aforementioned claim. There might be evidence that other academic departments have lost positions to the pre-professional programs or that the relative distribution of full-time and part-time instructors has shift away from the core liberal arts disciplines;  although a cursory glance suggests to me that neither of these possibilities are likely.  So, at least in terms of overall faculty distribution in the traditional liberal arts, the trend over the last ten years suggests an increased investment in the most traditional liberal arts disciplines.

But this data doesn’t mean that there hasn’t been a shift in students’ academic behavior patterns that might translate into a different distribution of majors and minors.  In this context, there certainly might be some perceived winners and losers.  Our institutional data does show some changes in student academic interests over ten years, but the totality of these shifts merely complicates the story.  While the proportion of students declaring their “primary” major in the humanities has declined, the proportion of students declaring a “secondary” major or minor in the humanities has remained strong and maybe even ticked up slightly.  Some of this is due to an overall increase in the number of second majors and additional minors that students now obtain.  So even thought this data might reflect a modest shift in student priorities, its a long way from suggesting that the college is gutting the liberal arts.

So where does this leave us?  That isn’t my question to answer.  My goal here was only to test the veracity of a claim that seems to be a popular rallying cry in some circles at the moment.  Based on this evidence, and if the degree to which our investment in and distribution of faculty lines across the college represents our educational philosophy, it’s pretty hard to make the case that Augustana has abandoned its commitment to the liberal arts.

However, this evidence doesn’t address the question of whether or not our collective emphasis on an interdisciplinary, liberal arts education has waned in the face of increasingly siloed major requirements, a growing belief in the perceived value of a double major and/or a second minor, and institutional policies that waive course requirements fundamental to the liberal arts (e.g., foreign language competency).  But that conversation is a very different one – one that probably involves an examination of our espoused values, a hard look at the ramifications of our actual curricular and co-curricular policies, and a mirror.

Make it a good day,

Mark

 

Complicating the extrinsic motivation and getting good grades narrative

Faculty often cringe when students ask, “what do I have to do to get an “A” on this assignment?”  For most educators, this question feels more like an unsolicited back alley proposition than a genuine expression of intellectual curiosity.

Yet from the student’s perspective, grades may represent a very different kind of negotiation.  Not only have grades dictated their access to future educational opportunities, extra-curricular experiences, and sometimes even cash(!) since elementary school, but the categories of “A” student, “B” student, and “C” student have all too often come to represent individual worth and long-term potential – not just the quality of one’s work on a particular assignment.  Sadly, we’ve done a pretty good job of validating this conception.  Remember the “My kid is an honor student at ____ school” bumper stickers that still adorn many a late model mini-van or SUV?

Luckily, disentangling the relationship between our students’ perception of grades and their motivational orientations can be approached as an empirical question.  Last year we began a four-year study of the experiences that shape our students’ intrinsic motivation.  As a part of this study, we included a measure of extrinsic motivational orientation and a question that asked students to indicate the importance they place on getting good grades.

This summer, we tested the relationship between extrinsic motivation and the importance of getting good grades at the end of the first year.  We assumed we’d find a significant relationship between these two variables.  So we were quite surprised to find no significant correlation between extrinsic motivation and importance of getting good grades.  However, we found a statistically significant positive – and moderately sized (.332) – correlation between students’ intrinsic motivational orientation and the importance of getting good grades.  Hmmm . . .

At the very least, this suggests that we might need to think more carefully about the assumptions we make when students ask how they can earn an ‘A’ from us.  One student inquiry about earning a high grade might be an indication of the degree to which we simply have not communicated our expectations for an assignment clearly.  Another inquiry might reflect the degree to which a student considers the entire educational enterprise to be about jumping through hoops and collecting credentials.  Still another inquiry might only mean that the student has too many irons in the fire and is simply triangulating their available time, the expectations they perceive that you hold, and the grade they can afford to live with.

There are two additional considerations about grading practices and their relationship to student motivation that are worth noting.  First, letter grades emerged during a time in which the learning expected of students was primarily about content knowledge.  But as content has shifted from an end to a means – with colleges now focused on developing more complex skills and dispositions in addition to content knowledge, we have done very little to think about whether the traditional metric for assessing student performance might benefit from some reconsideration.

In addition, at Augustana we don’t impose a single definition of what a grade represents.  Does an ‘A’ mean that a student has met an externally defined threshold of competence?   Or does it mean that a student has improve substantially over the course of a term?  Or is it some combination of the two that shifts as the course progresses?  Or maybe it should depend on the role of the course within the larger curriculum to determine whether grading should be about improvement or competence.

Faculty employ varying iterations of these conceptions across the array of courses that they offer, and all three approaches seem entirely appropriate for different situations.  But from the students’ perspective, unless they actually understand that there are different approaches to grading, and that these approaches can (and probably should) vary depending upon the course, they are likely to feel blindsided when the conception chosen by the instructor differs from that expected by the student.  Any one of us would likely be frustrated by such a realization, and in that moment it seems entirely reasonable to ask the question, “How DO I get an ‘A’ in this class?”  Moreover, I think we would have good reason to be offended if someone responded to our question by challenging our motives for learning.

Since a large proportion of our students understand the impact of grades on their future prospects for graduate school or the job market, it is likely that many place great importance on getting a high grade regardless of their motivational orientation.  So, it appears that maybe – just maybe – the implications of a student asking, “How do I get an ‘A’ on this paper?” are, let’s just say . . . complicated.

Make it a good day,

Mark

 

 

 

 

Smile! Its the end of the academic year (almost!)

At this point in the term, there isn’t a lot of time for deep, contemplative thought.  Instead, it strikes me that a good laugh is the best source of that little extra fuel to get through the last week of the academic year.  So I thought I’d supply a little higher ed humor.  Here are links to some of the best spoof news stories about higher education in the past couple of years.  If nothing else, they’ll give you one more way to procrastinate grading!

 

Bard College Named Nation’s No. 1 Dinner Party School

 

New College Graduates To Be Cryogenically Frozen Until Job Market Improves

 

Area Man First In His Family To Coast Through College

 

There are so many more, but time is of the essence.  See you next fall!

 

Make it a good day!

 

Mark

Does a double major learn more?

One of the arguments raised repeatedly throughout the calendar discussion was the importance we place on multiple majors.  While there were numerous rationales in support of double majors, one of them was that increased access to gaining a double major reflects our commitment to a fundamental principle of liberal arts education and the emphasis we place on becoming more well-rounded intellectually, culturally, and personally.

 

Although this argument sounds wonderful, I heard less data to support the core claim that a double major was somehow preferable to a single major or a major and a minor.  This might well be so in terms of employability and flexibility in an uncertain job market.  But do students who double major make larger gains on the educational outcomes of a liberal arts education than those who do not double major?  Does earning a double major somehow produce greater broad-based learning gains?

 

I examined the Wabash National Study data from the 2006 cohort.  Furthermore, I restricted my analysis to students at the eleven small liberal arts colleges in that cohort. I didn’t investigate whether certain combinations of majors were more advantageous than others primarily because I didn’t hear anyone seriously advocate for one combination over another, although there seems to be a second claim floating around that truly interdisciplinary double majors are somehow better than intra-disciplinary double majors – an assertion we can test if this first analysis holds much water.

 

The table below shows nine educational and developmental outcomes of a liberal arts education and whether being a double major correlates with a larger gain between the first year and the fourth year.

 

Double Major Status Had No Impact

Double Major Status Had An Impact

Critical Thinking

Intellectual Curiosity

Moral Reasoning

Intercultural Maturity

Attitude toward Literacy

Civic Engagement

Academic Motivation

Leadership

Psychological Well Being

Based on these findings, it initially appears that double majoring provides some educational benefit, impacting two of the nine outcomes.  However, the size of the effect on intellectual curiosity and intercultural maturity is actually quite small.  Furthermore, in the two cases where an initial significant finding appears, the impact of being a double major vanishes once I introduce student experience such as diverse interaction (in the test of intercultural maturity) and integrative learning experiences (in the test of intellectual curiosity) into the equations.

 

Based on this evidence, it’s hard to make the case that double majoring – by itself – is necessarily significantly beneficial in the context of learning outcomes.  Again, this doesn’t mean that it couldn’t be beneficial in the very important context of job acquisition.  But it appears that this cow’s sacred status may require a bit more scrutiny before we summarily celebrate our embrace of the double major.

 

Make it a good day!

 

Mark

One course just won’t do it

From time to time, Augustana lets me out of my little cave so that I can attend a conference related to higher education research or assessment of student learning outcomes.   A few weeks ago, a paper was presented at the Association for the Study of Higher Education (ASHE) that I found fascinating and particularly germane to many of the conversations we have at Augustana about the effects of particular curricular emphases on broader student learning outcomes.

This particular paper examined the influence of required diversity courses on students’ inclination toward civic engagement.  At many institutions the general education curricula is organized around a series of categories from which students choose one or two courses to meet the institution’s requirements.  This paper hypothesized that perhaps one course on diversity issues was not enough to influence substantive, lasting learning.  The authors examined data from about 500 students, gathered at the beginning of the first year and at the end of the fourth year.  The authors also had access to student transcripts that allowed them to identify which courses the students took to fulfill their general education requirements.

Students in this study had two options in fulfilling the diversity requirement.  They could take a domestic diversity course or a global diversity course.  In some cases, students took both – especially since some courses within the diversity category also fulfilled other requirements necessary for graduation.  Thus, the researchers could test the effect of taking one domestic diversity course, one global diversity course, or both courses on students’ gains in attitudes toward civic engagement.

The study found that the only students who made substantive gains in an inclination toward civic engagement were those who took both the domestic and global diversity courses.  Conversely, students who took only one course focused on either domestic or global diversity had not unique effect on attitudinal gains.

The take away from this paper, and the discussion that followed really honed in on the tendency for us to think that substantive learning can be accomplished by a single course – a “check the box” approach.   Of course, as we think about designing a new curriculum these findings might be useful to consider.  More broadly, however, I would suggest that this paper reinforces the idea that substantive learning is a function of a series of related experiences rather than any one experience.   We are the ones who can help our students engage in related experiences and help to point out those connections.

Make it a good day.

Mark