Category: Technology

Still more on the “Classroom Tech Bans are Bullshit (or not)” project, in which I go down the tangent of note-taking

I spent most of my Thanksgiving break  back in Iowa, and along the way, I chatted with my side of the family about my faculty research fellowship project, “Investigating Classroom Technology Bans Through the Lens of Writing Studies,” aka “Classroom Tech Bans are Bullshit.” It’s always interesting talking to my non-academic family-types about academic things like this.

“So, you’re on sabbatical right now?” Not exactly. I’m not teaching so I can spend more time on research, but I’m still expected to go to meetings and things like that. Though honestly, I’ve skipped some of that stuff too, and it’s generally okay.

“Is there some kind of expectation for what you are supposed to be researching? What happens if you don’t do it?” Well, it is a competitive process for getting these fellowships in the first place, and there’s of course an expectation that I’ll do what I proposed. And I have done that, more or less, and I will have to write a report about that soon. But the implications (consequences?) of not doing all of what I originally proposed are vague at best.

“So, you’re not really working right now?” No no no, that’s not true. I’m working quite a bit, actually. But I’m doing this work because I want to, though I’m doing this work mostly at home and often in pajamas and I have an extremely flexible schedule right now (which is why we’re going to Morocco in a few days, but that’s another story for later), so I can understand why you might ask that.

“Being a professor is kind of a weird job, isn’t it?” Yes, yes it is.

Anyway, since I last blogged about this project back in September, I’ve been a bit distracted by department politics (don’t ask) and by prepping for teaching in the Winter term, which for me involves some new twists on old courses and also a completely new prep. But the research continues.

Back in October, I put together and conducted a survey for students and faculty about their attitudes/beliefs on the use of laptops and cell phones in classes. Taking the advice I often give my grad students in situations like this, I did not reinvent the wheel and instead based this survey on similar work by Elena Neiterman and Christine Zaza who are both at the University of Waterloo in Ontario and who both (I think) work in that school’s Public Health program. They published two articles right up my alley for this project: “A Mixed Blessing? Students’ and Instructors’ Perspectives about Off-Task Technology Use in the Academic Classroom” and “Does Size Matter? Instructors’ and Students’ Perceptions of Students’ Use of Technology in the Classroom.” I emailed to ask if they would be willing to share their survey questions and they generously agreed, so thanks again!

I’ll be sorting through and presenting about the results of this at the CCCCs this year and hopefully in an article (or articles) eventually. But basically, I asked for participants on social media, the WPA-L mailing list (had to briefly rejoin that!), and at EMU. I ended up with 168 respondents, 57% students and 43% instructors, most of whom aren’t at EMU. The results are in the ballpark/consistent with Neiterman and Zaza (based just on percentages– I have no idea if there’s a way to legitimately claim any kind of statistically significant comparison), though I think it’s fair to say both students and instructors in my survey are more tolerant and even embracing of laptops and cellphones in the classroom. I think that’s both because these are all smaller classes (Neiterman and Zaza found that size does indeed matter and devices are more accepted in smaller classes), and also because they’re writing classes. Besides the fact that writing classes tend to be activity-heavy and lecture-light (and laptops and cell phones are important tools for writing), I think our field is a lot more accepting of these technologies and frankly a lot more progressive in its pedagogy: not “sage on the stage” but “guide on the side,” the student-centered classroom, that sort of thing. I also was able to recruit a lot of potential interviewee subjects from this survey, though I think I’m going to hold off on putting together that part of the project for the new year.

And I’ve been thinking again about note-taking, though not so much as it relates to technology. As I’ve mentioned here before, there are two basic reasons in the scholarship for banning or limiting the use of devices– particularly laptops– in college classrooms, particularly lecture halls. One reason is about the problems of distraction and multitasking, and I do think there is some legitimacy to that. The other reason (as discussed in the widely cited Mueller and Oppenheimer study) is that it’s better to take notes by longhand than by a laptop.  I think that’s complete bullshit, so I kind of set that aside.

But now I’m starting rethink/reconsider the significance of note-taking again because of the presidential impeachment hearings. Those hearings were a series of poised, intelligent, and dedicated diplomats and career federal professionals explaining how Trump essentially tried to blackmail the Ukrainian government to investigate Biden. One of the key things that made these people so credible was their continued reference to taking detailed notes where they witnessed this impeachable behavior. In contrast, EU ambassador Gordon “The Problem” Sondland seemed oddly proud that he’s never been a note-taker. As a result, a lot of Sondland’s testimony included him saying stuff like “I don’t remember the details because I don’t take notes, but if it was in that person’s notes, I have no reason to doubt it.” I thought this detail (and other things about his testimony) made Sondland look simultaneously like an extremely credible witness to events and also like a complete boob.

Anyway, this made me wonder: exactly is the definition of “good note-taking?” How do we know someone takes good (or bad) notes, and what’s the protocol for teaching/training people to take good notes?

The taking notes by hand versus on a laptop claim is shaky and (IMO) quite effectively refuted by the Kayla Morehead, John Dunlosky, and Katherine A. Rawson study, “How Much Mightier Is the Pen Than the Keyboard for Note-Taking? A Replication and Extension of Mueller and Oppenheimer (2014).” But while that study does poke at the concept of note-taking a bit (for example, they have one group of participants not take notes at all and just closely pay attention to the TED talk lecture), everything else I’ve read seems to just take note-taking as a given. There’s broad consensus in the psych/education scholarship that taking notes is an effective way to recall information later on, be it for a test or testimony before Congress, and there also seems to be consensus that trying to write everything down is a bad note-taking strategy. But I have yet to read anything about a method or criteria for evaluating the quality of notes, nor have I read anything about a pedagogy or a protocol for teaching people how to take good notes.

I find that odd. I mean, if the basic claim that Mueller and Oppenheimer (and similar studies) are trying to make is that students take “better notes” by hand than by laptop, and if the basic claim that Morehead, Dunlosky, and Rawson (and similar studies) are tying to make is students don’t take “better notes” by hand than by laptop, shouldn’t there be at least some minimal definition of “better notes?” Without that definition, can we really say that study participants who scored higher on the test measuring success did so because they took “better notes” rather than some other factor (e.g., they were smarter, they paid better attention, they had more knowledge about the subject of the lecture before the test, etc., etc.)?

I posted about this on Facebook and tagged a few friends I have who work for the federal government, asking if there was any particular official protocol or procedure for taking notes; the answers I got back were kind of vague. On the way back home at one point, Annette and I got to talking about how we were taught to take notes. I don’t remember any sort of instruction in school, though Annette said she remembered a teacher who actually collected and I guess graded student notes. There are of course some resources out there– here’s what looks like a helpful collection of links and ideas from the blog Cult of Pedagogy— but most of these strategies seem more geared for a tutoring or learning center setting. Plus a pedagogy for teaching note taking strategies is not the same thing as research, and it certainly is not the same thing as a method for measuring the effectiveness of notes.

But clearly, I digress.

So my plan for what’s next is to do even more reading (I’m working my way back through the works cited of a couple of the key articles I’ve been working with so far), some sifting through/writing about the results, and eventually some interviews, probably via email. And maybe I’ll take up as a related project more on this question of note-taking methods. But first, there’s Morocco and next semester.

It’s been an interesting research fellowship semester for me. I’ve been quite fortunate in that in the last five years I’ve had two research fellowships and a one semester sabbatical. Those previous releases from teaching involved the specific project of my book about MOOCs, More Than A Moment (on sale now!), and thus had very specific goals/outcomes. My sabbatical was mostly about conducting interviews and securing a book contract; my last FRF was all about finishing the book.

In contrast, this project/semester was much less guided, a lot more “wondering” (I think blog posts like this one demonstrate that). It’s been a surprisingly useful time for me as a scholar, especially at a time in my career and following the intensity of getting the MOOC book done where I was feeling pretty “done” with scholarship. I’ve got to give a lot of credit to EMU for the opportunity, and I hope these keep funding these fellowships, too.

 

A post about an admittedly not thought out idea: very low-bar access

The other day, I came across this post on Twitter from Derek Krissoff, who is the director of the West Virginia University Press:

I replied to Derek’s Tweet “Really good point and reminds me of a blog post I’ve been pondering for a long time on not ‘Open Access’ but something like ‘Very Low Bar Access,'” and he replied to my reply “Thanks, and I’d love to see a post along those lines. It’s always seemed to me access is best approached as a continuum instead of a binary.” (By the way, click on that embedded Twitter link and you’ll see there are lots of interesting replies to his post).

So, that’s why I’m writing this now.

Let me say three things at the outset: first, while I think I have some expertise and experience in this area, I’m not a scholar studying copyright or Open Educational Resources” (OER) or similar things. Second, this should in no way be interpreted as me saying bad things about Parlor Press or Utah State University Press. Both publishers have been delightful to work with and I’d recommend them to any academic looking for a home for a manuscript– albeit different kinds of homes. And third, my basic idea here is so simple it perhaps already exists in academic publishing and I just don’t know better, and I know this exists outside of academia with the many different self-publishing options out there.

Here’s my simple idea: instead of making OER/open-sourced publications completely free and open to anyone (or any ‘bot) with an internet connection, why not publish materials for a low cost, say somewhere between $3 and $5?

The goal is not to come up with a way for writers and publishers to “make money” exactly, though I am not against people being paid for their work nor am I against publishers and other entities being compensated for the costs of distributing “free” books. Rather, the idea is to make access easy for likely interested readers while maintaining a modest amount of control as to how a text travels and is repurposed on the internet.

I’ve been kicking this idea around ever since the book I co-edited Invasion of the MOOCs was published in 2014.  My co-editor (Charlie Lowe) and I wanted to simultaneously publish the collection in traditional print and as a free PDF, both because we believed (still do, I think) in the principles of open access academic publishing and because we frankly thought it would sell books. We also knew the force behind Parlor Press, David Blakesley (this Amazon author page has the most extensive bio, so that’s why I’m linking to that), was committed to the concept of OER and alternatives to “traditional” publishing– which is one of the reasons he started Parlor Press in the first place.

It’s also important to recognize that Invasion of the MOOCs was a quasi-DYI project. Among other things, I (along with the co-authors) managed most of the editing work of the book, and Charlie managed most of the production aspects of the book, paying a modest price for the cover art and doing the typesetting and indexing himself thanks to his knowledge of Adobe’s InDesign. In other words, the up-front costs of producing this book from Parlor Press’ point of view were small, so there was little to lose in making it available for free.

Besides being about a timely topic when it came out, I think distributing it free electronically helped sell the print version of the book. I don’t know exactly how many copies it has sold, but I know it has ended up in libraries all over the world. I’m pretty sure a lot (if not most) of the people/libraries who went ahead and bought the print book did so after checking out the free PDF. So giving away the book did help, well, sell books.

But in hindsight, I think there were two problems with the “completely free” download approach. First, when a publisher/writer puts something like a PDF up on the web for any person or any web crawling ‘bot to download, they get a skewed perspective on readership. Like I said, Invasion of the MOOCs has been downloaded thousands of times– which is great, since I can now say I edited a book that’s been downloaded thousands of times (aren’t you impressed?) But the vast majority of those downloads just sat on a user’s hard drive and then ended up in the (electronic) trash after never being read at all. (Full disclosure: I have done this many times). I don’t know if this is irony or what, but it’s worth pointing out this is exactly what happened with MOOCs: tens of thousands of would-be students signed up and then never once returned to the course.

Second and more important, putting the PDF up there as a free download means the publisher/writer loses control over how the text is redistributed. I still have a “Google alert” that sends me an email whenever it comes across a new reference to Invasion of the MOOCs on the web, and most of the alerts I have gotten over the years are harmless enough. The book gets redistributed by other OER sites, linked to on bookmarking sites like Pinterest, and embedded into SlideShare slide shows.

But sometimes the re-publishing/redistribution goes beyond the harmless and odd. I’ve gotten Google alerts to the book linked to/embedded in web sites like this page from Ebook Unlimited, which (as far as I can tell) is a very sketchy site where you can sigh up for a “free trial” to their book service.  In the last couple years, most of the Google alert notices I’ve received are links to broken links,  paper mill sites, “congratulations you won” pop-up/virus sites,  and similarly weirdo sites decidedly not about the book I edited or anything about MOOCs (despite what the Google alert says).

In contrast, the book I have coming out very soon called More Than A Moment, is being published by Utah State University Press and will not be available for a free download– at least not for a while.  On the positive side of things, working with USUP (which is an imprint of University Press of Colorado) means this book has had a more thorough (and traditional) editorial review, and the copyediting, indexing, and typesetting/jacket design have all been done by professionals. On the downside, a lack of a free to download version will mean this book will probably end up having fewer readers (thus less reach and fewer sales), and, as is the case with most academic books, I’ve had to pay for some of the production costs with grant money from EMU and/or out of my own pocket.

These two choices put writers/publishers in academia in a no-win situation. Open access publishing is a great idea, but besides the fact that nothing is “free” in the sense of having no financial costs associated with it (even maintaining a web site for distributing open access texts costs some money), it becomes problematic when a free text is repurposed by a bad actor to sell a bad service or to get users to click on a bad link. Traditional print publishing costs money and necessarily means fewer potential readers. At the same time, the money spent on publishing these more traditional print publications does show up in a “better” product, and it does offer a bit more reasonable control of the book. Maybe I’m kidding myself, but I do not expect to see a Google alert for the More than a Moment MOOC book lead me to a web site where clicking on the link will sign me up for some service I don’t want or download a virus.

So this is where I think “very low-bar access” publishing could split the difference between the “completely free and online” and the “completely not free and in print” options in academic publishing. Let’s say publishers charged as small of a fee as possible for downloading a PDF of the book. I don’t know exactly how much, but to pay the costs for running a web site capable of selling PDFs in the first place and for the publisher/writer to make at least a little bit of money for their labor, I’d guess around $3 to $5.

The disadvantage of this is (obviously) any amount of money charged is going to be more than “free,” and it is also going to require a would-be reader to pass through an additional step to pay before downloading the text. That’s going to cut down on downloads A LOT. On the other hand, I think it’s fair to say that if someone bothers to fill out the necessary online form and plunks down $5, there’s a pretty good chance that person is going to at least take a look at it. And honestly, 25-100 readers/book skimmers is worth more to me than 5,000 people who just download the PDF. It’s especially worth it if this low-bar access proves to be too much for the dubious redirect sites, virus makers, and paper mill sites.

I suppose another disadvantage of this model is if someone can download a PDF version of an academic book for $5 to avoid spending $20-30 (or, in some cases, a lot more than that) for the paper version, then that means the publisher will sell less paper books. That is entirely possible. The opposite is also possible though: the reader spends $5 on the PDF, finds the book useful/interesting, and then that reader opts to buy the print book. I do this often enough, especially with texts I want/need for teaching and scholarship.

So, there you have it, very low-bar access. It’s an idea– maybe not a particularly original one, maybe even not a viable one. But it’s an idea.

More on the “Classroom Tech Bans Are Bullshit (or not)” Project Before Corridors

This post is both notes on my research so far (for myself and anyone else who cares), and also a “teaser” for Corridors: the 2019 Great Lakes Writing and Rhetoric Conference.  I’m looking forward to this year’s event for a couple of different reasons, including the fact that I’ve never been on campus at Oakland University.

Here’s a link to my slides— nothing fancy.

Anyway: as I wrote about back in June, I am on leave right now to get started on a brand-new research project officially called “Investigating Classroom Technology Bans Through the Lens of Writing Studies,” but which is more informally known as the “Classroom Tech Bans Are Bullshit” project. I give a little more detail in that June post, but basically, I have been reading a variety of studies about the impact of devices– mostly laptops, but also cellphones– in classrooms (mostly lecture halls) and how they negatively impact students (mostly on tests). I’ve always thought these studies seemed kind of bullshitty, but I don’t know a lot of research in composition and rhetoric that refutes these arguments. So I wanted to read that scholarship and then try to do something to apply and replicate that scholarship in writing classrooms.

So far, I’ve mostly just been reading academic articles in psychology and education journals. It’s always challenging to step just a little outside my comfort zone and do some reading in a field that is not my own. If nothing else, it reminds me why it’s important to be empathetic with undergraduates who complain about reading academic articles: it’s hard to try figure out what’s going on in that Burkean parlor when pretty much all you can do is look through the window instead of being in the room. For me, that’s most evident in the descriptions of the statistics. I look at the explanations and squiggly lines of various formulas and just mutter “I’m gonna have to trust you on that.” And as a slight but important tangent: one of the reasons why we don’t do this kind of research in writing studies is because most people in the field feel the same about math and stats.

The other thing that has been quite striking for me is the assumptions in these articles on how the whole enterprise of higher education works. Almost all of these studies take it as a completely unproblematic given that education means a lecture hall with a professor delivering knowledge to students who are expected to (and who know how to) pay attention and who also are expected to (and who know how to) take notes on the content delivered by the lecturer. Success is measured by an end of the course (or end of the experiment) test. That’s that. In other words, most of this research assumes an approach to education that is more or less the opposite of what we assume in writing studies.

I have also figured out there are some important and subtle differences to the arguments about why laptops and cell phones ought to be banned (or at least limited) in classrooms. As I wrote back in June, the thing that perhaps motivated me the most to do this research is the argument that laptops ought to be banned from lecture halls because handwritten notes are “better.” This is the argument in the frequently cited Pam Mueller and Daniel Oppenheimer “The Pen is Mightier Than the Keyboard: Advantages of Longhand Over Laptop Note Taking.”  I think this is complete bullshit. This is a version of the question that used to circulate in the computers and writing world, whether it was “better” for student to write by hand or to type, a question that’s been dismissed as irrelevant for a long time. But as someone who is so bad at writing things by hand, I personally resent the implication that people who have good handwriting are somehow “better.” Fortunately, I think Kayla Morehead, John Dunlosky, and Katherine A. Rawson replication of that study, “How Much Mightier Is the Pen Than the Keyboard for Note-Taking? A Replication and Extension of Mueller and Oppenheimer (2014),” does an excellent job refuting this “handwriting is better” bullshit.

Then there’s the issue of “distraction” that results when students trying to do things right are disturbed/put off by other students fiddling around with their laptops or cellphones. This is the argument in Faria Sana, Tina Weston, Nicholas J. Cepeda “Laptop multitasking hinders classroom learning for both users and nearby peers.” They outline a clever and complicated methodology that involved arranging students so a laptop was (or wasn’t) in their line of sight and also by having some of those students acting as “confederates” in the study by purposefully doing stuff that is distracting. One issue I have with this research is it is a little dated, having been published in 2013. Maybe it’s just me, but I think laptops in classes were a little more novel (and thus distracting) a few years ago than they are now. Regardless though, one of the concluding points these folks make is that laptops shouldn’t be banned because the benefits outweigh the problems.

There are a lot of studies focusing on the multitasking and divided attention issues: that is, devices and the things students look at on those devices distract them from the class, which again typically means paying attention to the lecture. I find the subtly different degrees of multitasking kind of interesting, and there is a long history in psychology of research about attention, distraction, and multitasking. For example, Arnold L. Glass and Mengxue Kang in “Dividing attention in the classroom reduces exam performance” argue (among other things) that there’s a kind of delayed effect with students multitasking/dividing attention in a lecture hall setting. Students seem to be able to comprehend a lecture or whatever in the midst of their multitasking, but they don’t perform as well on tests at the end of the semester. 

Interestingly– and I have a feeling this is more because of what I haven’t read/studied yet– most of these studies I’ve seen on the multitasking/dividing attention angle don’t separate tasks like email or texting from social media apps. That’s something I want to read about/study more because it seems to me that there is a qualitative difference in how applications like Facebook and Twitter distract since these platforms are specifically designed to grab attention from other tasks.

And then there’s the category of research I wasn’t even aware was happening, and I guess I’d describe that as the different perceptions/attitudes about classroom technology. This is mostly based on surveys and interviews, and (maybe not surprising) students tend to believe the use of devices is no big deal and/or “a matter of personal autonomy,” while instructors have a more complex view. Interestingly, the recommendation a lot of these studies make is students and teachers ought to talk about this as a way of addressing the problem.

So, that’s what I “know” so far. Where I’m going next, I think:

  • I think the first tangible (not just reading) research part of this project is going to be to design a survey of both faculty and instructors– probably just for first year writing, but maybe beyond that– about their attitudes on using these devices. If I dig a bit, I might be able to use some of the same questions that come up in the research I’ve read.
  • We’ll see what kind of feedback/participation I get from those surveys, but my hope is also to use a survey as a way of recruiting some instructors to participate in something a little more case study/observational in the winter term, maybe even trying to replicate some of the “experimental” research on note taking in a small class setting. That would happen in Winter 2020.
  • I need to keep reading, especially about the ways in which social media specifically functions here. It’s one thing for a student (or really anyone) to be bored in a badly run lecture hall and thus allowing themselves to drift into checking their messages, email, working on homework for other classes, checking sports, etc. I think it’s a different thing for a student/any user to feel the need to check Facebook or Twitter or Instagram or whatever.
  • I can see a need to dive more deeply into thinking/writing about the ways in which this research circulates in MSM and then back into the classroom. As I wrote in my proposal and back in June, I think there are a lot of studies– done with lecture hall students in very specific experimental settings– that get badly translated into MSM articles about why people should put their laptops and cell phones away in classrooms or meetings.  Those MSM articles get read by well-meaning faculty who then apply the MSM’s misunderstanding of the original study as a justification for banning devices even though the original research doesn’t support that. Oh, and perhaps not surprising, but the tendency of the vast majority of the MSM pieces I’ve seen on tech bans is basically reinforcing the very worn theme of “the problem with the kids today.”
  • I also wonder about this attitude difference and maybe students have a point: maybe these technologies are a matter of personal autonomy and personal choice. This was an idea put into my head while chatting about all this with Derek Mueller over not very good Chinese food this summer, and I still haven’t thought it through yet, but if students have a right to their own language use in writing classrooms, do they also have a right to their own technology use? When and when not?
  • And even though this is kind of where I began this project (so I guess I’m once again showing my bias here), a lot of the solution that motivates faculty to ban laptops and devices from their classrooms in the first place really comes back to better pedagogy. Teaching students how to take notes with a laptop immediately comes to mind. I’m also reading (slowly but surly) James M. Lang’s Small Teaching: Everyday Lessons From the Science of Teaching right now, and there’s a clear connection to his advice and this project too. So much of the complaints about students being distracted by their devices really comes back to bad teaching.

Classroom Tech Bans Are Bullshit (or are they?): My next/current project

I was away from work stuff this past May– too busy with Will’s graduation from U of M followed quickly by China, plus I’m not teaching or involved in any quasi-administrative work this summer. As I have written about before,  I am no longer apologetic for taking the summer off, so mostly that’s what I’ve been doing. But now I need to get back to “the work–” at least a leisurely summer schedule of “the work.”

Along with waiting for the next step in the MOOC book (proofreading and indexing, for example), I’m also getting started on a new project. The proposal I submitted for funding (I have a “faculty research fellowship” for the fall term, which means I’m not teaching though I’m still supposed to do service and go to meetings and such) is officially called “Investigating Classroom Technology Bans Through the Lens of Writing Studies.” Unofficially, it’s called “Classroom Tech Bans are Bullshit.” 

To paraphrase: there have been a lot of studies (mostly in Education and/or Psychology) on the student use of mobile devices in learning settings (mostly lecture halls– more on that in a moment). Broadly speaking, most of these studies have concluded these technologies are bad because students take worse notes than they would with just paper and pen, and these tools make it difficult for students to pay attention.  Many of these studies have been picked up in mainstream media articles, and the conclusions of these studies are inevitably simplified with headlines like “Students are Better Off Without a Laptop In the Classroom.”

I think there are couple of different problems with this– beyond the fact that MSM misinterprets academic studies all the time. First, these simplifications trickle back into academia when those faculty who do not want these devices in their classrooms use these articles to support laptop/mobile device bans. Second, the methodologies and assumptions behind these studies are very different from the methodologies and assumptions in writing studies. We tend to study writing– particularly pedagogy– with observational, non-experimental, and mixed-method research designs, things like case studies, ethnographies, interviews, observations, etc., and also with text-based work that actually looks at what a writer did.

Now, I think it’s fair to say that those of us in Composition and Rhetoric generally and in the “subfield/specialization” of Computers and Writing (or Digital Humanities, or whatever we’re calling this nowadays) think tech bans are bad pedagogy. At the same time, I’m not aware of any scholarship that directly challenges the premise of the Education/Psychology scholarship calling for bans or restrictions on laptops and mobile devices in classrooms. There is scholarship that’s more descriptive about how students use technologies in their writing process, though not necessarily in classrooms– I’m thinking of the essay by Jessie Moore and a ton of other people called “Revisualizing Composition” and the chapter by Brian McNely and Christa Teston “Tactical and Strategic: Qualitative approaches to the digital humanities” (in Bill Hart-Davidson and Jim Ridolfo’s collection Rhetoric and the Digital Humanities.) But I’m not aware of any study that researches why it is better (or worse) for students to use things like laptops and cell phones while actually in the midst of a writing class.

So, my proposal is to spend this fall (or so) developing a study that would attempt to do this– not exactly a replication of one or more of the experimentally-driven studies done about devices and their impact on note taking, retention, and distraction, but a study that is designed to examine similar questions in writing courses using methodologies more appropriate for studying writing. For this summer and fall, my plan is to read up on the studies that have been done so far (particularly in Education and Psych), use those to design a study that’s more qualitative and observational, and recruit subjects and deal with the IRB paperwork. I’ll begin some version of a study in earnest beginning in the winter term, January 2020.

I have no idea how this is going to work out.

For one thing, I feel like I have a lot of reading to do. I think I’m right about the lack of good scholarship within the computers and writing world about this, but maybe not. As I typed that sentence in fact, I recalled a distant memory of a book Mike Palmquist, Kate Kiefer, Jake Hartvigsen, and Barbara Godlew wrote called Transitions: Teaching Writing in Computer-Supported and Traditional Classrooms. It’s been a long time since I read that (it was written in 1998), but I recall it as being a comparison between writing classes taught in a computer lab and not. Beyond reading in my own field of course, I am slowly making my way through these studies in Education and Psych, which present their own kinds of problems. For example, my math ignorance means I have to slip into  “I’m just going to have to trust you on that one” mode in the discussions about statistical significance.

One article I came across and read (thanks to this post from the Tattooed Prof, Kevin Gannon) was “How Much Mightier Is the Pen Than the Keyboard for Note-Taking? A Replication and Extension of Mueller and Oppenheimer (2014).” As the title suggests, this study by Kayla Morehead, John Dunlosky, and Katherine A. Rawson replicates a 2014 (which is kind of the “gold standard” in the ban laptops genre) study by Pam Mueller and Daniel Oppenheimer “The Pen is Mightier Than the Keyboard: Advantages of Longhand Over Laptop Note Taking.” The gist of these two articles is all in the titles: Mueller and Oppenheimer’s conclusions were that it was much better to take notes by hand, while Morehead, Dunlosky, and Rawson’s conclusions were not so much. Interestingly enough, the more recent study also questioned the premise of the value of note taking generally since one of their control groups didn’t take notes and did about as well on the post-test of the study.

Reading these two studies has been a quite useful way for me to start this work. Maybe I should have already known this, but there are actually two fundamentally different issues at stake with these classroom tech bans (setting aside assumptions about the lecture hall format and the value of taking notes as a way of learning).  Mueller and Oppenheimer claimed with their study handwriting was simply “better.” That’s a claim that I have always thought was complete and utter bullshit, and it’s one that I think was debunked a long time ago. Way back in the 1990s when I first got into this work, there were serious people in English and in writing studies pondering what was “better,” a writing class equipped with computers or not, students writing by hand or on computers. We don’t ask that question anymore because it doesn’t really matter which is “better;” writers use computers to write and that’s that. Happily, I think Morehead, Dunlowsky, and Rawson counter Mueller and Oppenheimer’s study rather persuasively. It’s worth noting that so far, MSM hasn’t quite gotten the word out on this.

But the other major argument for classroom tech bans– which neither of these studies addresses– is about distraction, and that’s where the “or are they?” part of my post title comes from. I still have a lot more reading to do on this (see above!), but it’s clear to me that the distraction issue deserves more attention since social media applications are specifically designed to distract and demand attention from their users. They’re like slot machines, and it’s clear that “the kids today” are not the only ones easily taken in. When I sit in the back of the room during a faculty meeting and I glance at the screens of my colleagues’ laptops in front of me, it’s pretty typical to see Facebook or Twitter or Instagram open, along with a window for checking email, grading papers– or, on rare occasion, taking notes.

Anyway, it’s a start. And if you’ve read this far and you’ve got any ideas on more research/reading or how to design a study into this, feel free to comment or email or what-have-you.

Three thoughts on the “Essay,” assessing, and using “robo-grading” for good

NPR had a story on Weekend Edition last week, “More States Opting to ‘Robo-Grade” Student Essays By Computer,” that got some attention from other comp/rhet folks though not as much as I thought it might. Essentially, the story is about the use of computers to “assess” (really “rate,” but I’ll get to that in a second) student writing on standardized tests. Most composition and rhetoric scholars think this software is a bad idea. I think this is not not true, though I do have three thoughts.

First, I agree with what my friend and colleague Bill Hart-Davidson writes here about essays, though this is not what most people think “essay” means. Bill draws on the classic French origins of the word, noting that an essay is supposed to be a “try,” an attempt and often a wandering one at that. Read any of the quite old classics (de Montaigne comes to mind, though I don’t know his work as well as I should) or even the more modern ones (E.B. White or Joan Didion or the very contemporary David Sedaris) and you get more of a sense of this classic meaning. Sure, these writers’ essays are organized and have a point, but they wander to them and they are presented (presumably after much revision) as if the writer was discovering their point along with the reader.

In my own teaching, I tend to use the term project to describe what I assign students to do because I think it’s a term that can include a variety of different kinds of texts (including essays) and other deliverables. I hate the far too common term paper because it suggests writing that is static, boring, routine, uninteresting, and bureaucratic. It’s policing, as in “show me your papers” when trying to pass through a boarder. No one likes completing “paperwork,” but it is one of those necessary things grown-ups have to do.

Nonetheless, for most people— including most writing teachers–  the term “essay” and “paper” are synonymous. The original meaning of essay has been replaced by the school meaning of essay (or paper– same thing).  Thus we have the five paragraph form, or even this comparably enlightened advice from the Bow Valley College Library and Learning Commons, one of the first links that came up in a simple Google search. It’s a list (five steps, too!) for creating an essay (or paper) driven by a thesis and research.  For most college students, papers (or essays) are training for white collar careers to learn how to complete required office paperwork.

Second, while it is true that robo-grading standardized tests does not help anyone learn how to write, the most visible aspect of writing pedagogy to people who have no expertise in teaching (beyond experience as a student, of course) is not the teaching but the assessment. So in that sense, it’s not surprising this article focuses on assessment at the expense of teaching.

Besides, composition and rhetoric as a field is very into assessment, sometimes (IMO) at the expense of teaching and learning about writing. Much of the work of Writing Program Administration and scholarship in the field is tied to assessment– and a lot (most?) comp/rhet specialists end up involved in WPA work at some point in their careers. WPAs have to consider large-scale assessment issues to measure outcomes across many different sections of first year writing, and they usually have to mentor instructors on small-scale assessment– that is, how to grade and comment all these student essays papers in a way that is both useful to students and that does not take an enormous amount of time.  There is a ton of scholarship on assessment– how to do it, what works or doesn’t, the pros and cons of portfolios, etc. There are books and journals and conferences devoted to assessment. Plenty of comp/rhet types have had very good careers as assessment specialists. Our field loves this stuff.

Don’t get me wrong– I think assessment is important, too. There is stuff to be learned (and to be shown to administrators) from these large scale program assessments, and while the grades we give to students aren’t always an accurate measure of what they learned or how well they can write, grades are critical to making the system of higher education work. Plus students themselves are too often a major part of the problem of over-assessing. I am not one to speak about the “kids today” because I’ve been teaching long enough to know students now are not a whole lot different than they were 30 years ago. But one thing I’ve noticed in recent years– I think because of “No Child Left Behind” and similar efforts– is the extent to which students nowadays seem puzzled about embarking on almost any writing assignment without a detailed rubric to follow.

But again, assessing writing is not the same thing as fostering an environment where students can learn more about writing, and it certainly is not how writing worth reading is created. I have never read an essay which mattered to me written by someone closely following the guidance of a typical  assignment rubric. It’s really easy as a teacher to forget that, especially while trying to make the wheels of a class continue to turn smoothly with the help of tools like rubrics. As a teacher, I have to remind myself about that all the time.

The third thing: as long as writing teachers believe more in essays than in papers and as long as they are more concerned with creating learning opportunities rather than sites for assessment, “robo-grader” technology of the soft described in this NPR story are kind of irrelevant– and it might even be helpful.

I blogged about this several years ago here as well, but it needs to be emphasized again: this software is actually pretty limited. As I understand it, software like this can rate/grade the response to a specific essay question– “in what ways did the cinematic techniques of Citizen Kane revolutionize the way we watch and understand movies today”– but it is not very good at more qualitative questions– “did you think Citizen Kane was a good movie?”– and it is not very good at all at rating/grading pieces of writing with almost no constraints, as in “what’s your favorite movie?”

Furthermore, as the NPR story points out, this software can be tricked. Les Perleman has been demonstrating for years how these robo-graders can be fooled, though I have to say I am a lot more impressed with the ingenuity shown by some students in Utah who found ways to “game” the system: “One year… a student who wrote a whole page of the letter “b” ended up with a good score. Other students have figured out that they could do well writing one really good paragraph and just copying that four times to make a five-paragraph essay that scores well. Others have pulled one over on the computer by padding their essays with long quotes from the text they’re supposed to analyze, or from the question they’re supposed to answer.” The raters keep “tweaking” the code to present these tricks, but of course, students will keep trying new tricks.

I have to say I have some sympathy with one of the arguments made in this article that if a student is smart enough to trick the software, then maybe they deserve a high rating anyway. We are living in an age in which it is an increasingly important and useful skill for humans to write texts in a way that can be “understood” both by other people and machines– or maybe just machines. So maybe mastering the robo-grader is worth something, even if it isn’t exactly what most of us mean by “writing.”

Anyway, my point is it really should not be difficult at all for composition and rhetoric folks to push back against the use of tools like this in writing classes because robo-graders can’t replicate what human teachers and students can do as readers: to be an actual audience. In that sense, this technology is not really all that much different than stuff like spell-checkers and grammar-checkers I have been doing this work long enough to know that there were plenty of writing teachers who thought those tools were the beginning of the end, too.

Or, another way of putting it: I think the kind of teaching (and teachers) that can be replaced by software like this is pretty bad teaching.

Instead of banning laptops, what if we mandated them?

Oy. Laptops are evil. Again.

This time, it comes from “Leave It in the Bag,” an article in Inside Higher Ed, reporting on a study done by Susan Payne Carter, Kyle Greenberg, and Michael S. Walker, all economists at West Point (PDF). This has shown up on the WPA-L mailing list and in my various social medias as yet another example of why technology in the classrooms is bad, but I think it’s more complicated than that.

Mind you, I only skimmed this and all of the economics math is literally a foreign language to me. But there are a couple of passages here that I find interesting and not exactly convincing to me that me and my students should indeed “leave it in the bag.”

For example:

Permitting laptops or computers appears to reduce multiple choice and short answer scores, but has no effect on essay scores, as seen in Panel D. Our finding of a zero effect for essay questions, which are conceptual in nature, stands in contrast to previous research by Mueller and Oppenheimer (2014), who demonstrate that laptop note-taking negatively affects performance on both factual and conceptual questions. One potential explanation for this effect could be the predominant use of graphical and analytical explanations in economics courses, which might dissuade the verbatim note-taking practices that harmed students in Mueller and Oppenheimer’s study. However, considering the substantial impact professors have on essay scores, as discussed above, the results in panel D should be interpreted with considerable caution. (page 17)

The way I’m reading this is for classes where students are expected to take multiple choice tests as a result of listening to a lecture from a sage on the stage, laptops might be bad. But in classes where students are supposed to write essays (or at least more conceptual essay questions), laptops do no harm. So if it’s a course where students are supposed to do more than take multiple choice tests….

After describing the overall effects of students performing worse when computing technology is available, Carter, Greenberg, and Walker write:

It is quite possible that these harmful effects could be magnified in settings outside of West Point. In a learning environment with lower incentives for performance, fewer disciplinary restrictions on distracting behavior, and larger class sizes, the effects of Internet-enabled technology on achievement may be larger due to professors’ decreased ability to monitor and correct irrelevant usage.” (page 26)

Hmmm…. nothing self-congratulatory about that passage, is there?

Besides the fact that there is no decent evidence that the students at West Point (or any other elite institution for that matter) are on the whole such special snowflakes that they are more immune from the “harm” of technology/distraction compared to the rest of us simpletons, I think one could just as easily make the exact opposite argument. It seems to me that is is “quite possible” that the harmful effects are more magnified in a setting like West Point because of the strict adherence to “THE RULES” and authority for all involved. I mean, it is the Army after all. Perhaps in settings where students have more freedom and are used to the more “real life” world of distractions, large class sizes, the need to self-regulate, etc., maybe those students are actually better able to control themselves.

And am I the only one who is noticing the extent to which laptop/tablet/technology use really seems to be about a professor’s “ability to monitor and correct” in a classroom? Is that actually “teaching?”

And then there’s this last paragraph in the text of the study:

We want to be clear that we cannot relate our results to a class where the laptop or tablet is used deliberately in classroom instruction, as these exercises may boost a student’s ability to retain the material. Rather, our results relate only to classes where students have the option to use computer devices to take notes.   We further cannot test whether the laptop or tablet leads to worse note taking, whether the increased availability of distractions for computer users (email, facebook, twitter, news, other classes, etc.) leads to lower grades, or whether professors teach differently when students are on their computers. Given the magnitude of our results, and the increasing emphasis of using technology in the classroom, additional research aimed at distinguishing between these channels is clearly warranted.(page 28)

First, laptops might or might not be useful for taking notes. This is at odds with a lot of these “laptops are bad” studies. And as a slight tangent, I really don’t know how easy it is to generalize about note taking and knowledge across large groups. Speaking only for myself: I’ve been experimenting lately with taking notes (sometimes) with paper and pen, and I’m not sure it makes much difference. I also have noticed that my ability to take notes on what someone else is saying — that is, as opposed to taking notes on something I want to say in a short speech or something– is now pretty poor. I suppose that’s the difference between being a student and being a teacher, and maybe I need to relearn how to do this from my students.

This paragraph also hints at another issue with all of these “laptops are bad” pieces, of “whether professors teach differently when students are on their computers.” Well, maybe that is the problem, isn’t it? Maybe it isn’t so much that students are spending all of this time being distracted by laptops, tablets, and cell-phones– that is, students are NOT giving professor the UNDIVIDED ATTENTION they believe (nay, KNOWS) they deserve. Maybe the problem is professors haven’t figured out that the presence of computers in classrooms means we have to indeed “teach differently.”

But the other thing this paragraph got me to thinking about the role of technology in the courses I teach, where laptops/tablets are “used deliberately in classroom instruction.” This paragraph suggests that the opposite of banning laptops might also be as true: in other words, what if, instead of banning laptops from a classroom, the professor mandated that students each have a laptop open at all times in order to take notes, to respond to on-the-fly quizzes from the professor, and look stuff up that comes up in the discussions?

It’s the kind of interesting mini-teaching experiment I might be able to pull off this summer. Of course, if we extend this kind of experiment to the realm of online teaching– and one of my upcoming courses will indeed be online– then we can see that in one sense, this isn’t an experiment at all. We’ve been offering courses where the only way students communicate with the instructor and with other students has been through a computer for a long time now. But the other course I’ll be teaching is a face to face section of first year writing, and thus ripe for this kind of experiment. Complicating things more (or perhaps making this experiment more justifiable?) is the likelihood that a significant percentage of the students I will have in this section are in some fashion “not typical” of first year writing at EMU– that is, almost all of them are transfer students and/or juniors or seniors. Maybe making them have those laptops open all the time could help– and bonus points if they’re able multitask with both their laptop and their cell phones!

Hmm, I see a course developing….

A “Modest Proposal” Revisited: Adjuncts, First Year Composition, and MOOCs

I’m posting this at 37,000 or so feet, on my way back from Italy from an international conference on MOOCs sponsored by the University of Naples (more accurately, Federica WebLearning). Normally, I wouldn’t pay as much as I’m paying for wifi on a plane, but I wanted to stay awake as much as possible to get back on USA time by Tuesday morning and because I had some school/teaching work to do. Plus there’s a weird extra seat next to me because my row with three chairs has a row of four chairs right in front of it.

Anyway, I’ll be blogging about that in the next few days once I go through my notes and collect my thoughts about the conference and about Italy. In the meantime though, I wanted to post this. I was trying to place this as a “thought piece” in something like Inside Higher Ed and/or The Atlantic, which is why there is more “apparatus” explaining the field and the state of adjunct labor in fycomp than is typical of things I write about that here. But nobody else wanted it/wanted to pay me to publish it, so it will find a home here.

Continue reading “A “Modest Proposal” Revisited: Adjuncts, First Year Composition, and MOOCs”

“Rhetoric and the Digital Humanities,” Edited by Jim Ridolfo and Bill Hart-Davidson

I’ve blogged about “the Digital Humanities” several times before. Back in 2012, I took some offense at the MLA’s “discovery” of “digital scholarship” because they essentially ignored the work of anyone other than literature scholars– in other words, comp/rhet folks who do things with technology need not apply. Cheryl Ball had an editorial comment in Kairos back then I thought was pretty accurate– though it’s also worth noting in the very same issue of Kairos, Ball also praised the MLA conference for its many “digital humanities” presentations.

Almost exactly a year ago, I had a post here called “If you can’t beat ’em and/or embracing my DH overlords and colleagues,” in which I was responding to a critique by Adam Kirsch that Marc Bousquet had written about. Here’s a long quote from myself that I think is all the more relevant now:

I’ve had my issues with the DH movement in the past, especially as it’s been discussed by folks in the MLA– see here and especially here.  I have often thought that a lot of the scholars in digital humanities are really literary period folks trying to make themselves somehow “marketable,” and I’ve seen a lot of DH projects that don’t seem to be a whole lot more complicated than putting stuff up on the web. And I guess I resent and/or am annoyed with the rise of digital humanities in the same way I have to assume the folks who first thought up MOOCs (I’m thinking of the Stephen Downes and George Siemens of the world) way before Coursera and Udacity and EdX came along are annoyed with the rise of MOOCs now. All the stuff that DH-ers talk about as new has been going on in the “computers and writing”/”computers and composition” world for decades and for these folks to come along now and to coin these new terms for old practices– well, it feels like a whole bunch of work of others has been ignored and/or ripped off in this move.

But like I said, if you can’t beat ’em, join ’em. The “computers and writing” world– especially vis a vis its conference and lack of any sort of unifying “organization”– seems to me to be fragmenting and/or drifting into nothingness at the same time that DH is strengthening to the point of eliciting backlash pieces in a middle-brow publication like the New Republic. Plenty of comp/rhet folk have already made the transition, at least in part. Cheryl Ball has been doing DH stuff at MLA lately and had an NEH startup grant on multimedia publication editing; Alex Reid has had a foot in this for a few years now; Collin Brooke taught what was probably a fantastic course this past spring/winter, “Rhetoric, Composition, and Digital Humanities;” and Bill Hart-Davidson and Jim Ridolfo are editing a book of essays that will come out in the fall (I think) called Rhetoric and the Digital Humanities. There’s an obvious trend here.

And this year, I’m going to HASTAC instead of the C&W conference (though this mostly has to do with the geographic reality that HASTAC is being hosted just up the road from me at Michigan State University) and I’ll be serving as the moderator/host of a roundtable session about what the computers and writing crowd can contribute to the DH movement.

In other words, I went into reading Jim and Bill’s edited collection Rhetoric and the Digital Humanities with a realization/understanding that “Digital Humanities” has more or less become the accepted term of art for everyone outside of computers and writing, and if the C&W crowd wants to have any interdisciplinary connection/relevance to the rest of academia, then we’re going to have to make connections with these DH people. In the nutshell, that’s what I think Jim and Bill’s book is about. (BTW and “full disclosure,” as they say: Jim and Bill are both friends of mine, particularly Bill, who I’ve known from courses taken together, conferences, project collaborations, dinners, golf outings, etc., etc., etc. for about 23 or so years).

Continue reading ““Rhetoric and the Digital Humanities,” Edited by Jim Ridolfo and Bill Hart-Davidson”

My iPad and “killer apps” for academics, almost four years later

I was checking out some of the statistics on hits and such to this site a week or so ago, and one thing that surprised me is that the most popular “all time” post I have on the site (at least since the WordPress plugin Jetpack started keeping track of things) is not about MOOCs, academic life, teaching, cooking, etc. Rather, the most popular single post on this site is “iPad “killer apps” for Academics (maybe),” which I posted on April 10, 2010.

Of course, it’s also important to point out out that no post on this site is really all that popular. I average about 50 or so views a day, sometimes up to 100 when I post something that people find interesting. The most views this site ever received in a single day was 737, and even this most popular of posts on iPads has only received (as of this writing) “all time” 4,794 views. Sure, that’s more people than have ever attended all of the conference presentations I’ve ever given and it’s probably more “views” than any print piece of scholarship I’ve published. But these are still not exactly the kind of traffic numbers that are going to allow me to quit the day job and just blog full-time.

(Oh, and as another thought/tangent: the archives for this site goes back eleven years now. I’ve slowed down quite a bit, but damn, that’s a lot of blogging. Another sabbatical project might involve going back to read through all that and/or “mine” it a bit for text/writing I can repurpose.)

Anyway, a few years later and after I bought my first iPad, what do I think now of what I said then?

Continue reading “My iPad and “killer apps” for academics, almost four years later”

The Comcast Strikes Back

Complaining about Comcast is sort of like complaining about death or taxes and about as common.  I know that. But because of a Twitter exchange I had, I thought I’d add to the genre generally and specifically to my latest Twitter follower, @ComcastLisa. This is more for her than anything else, so if you have had your fill of internet posts complaining about Comcast, feel free to move along. If you’re a glutton for punishment, read on.

Continue reading “The Comcast Strikes Back”