Showing posts with label Plug and Play. Show all posts
Showing posts with label Plug and Play. Show all posts

Sunday, March 3, 2024

Plug and Play Miniseries Lesson Spotting with AI: Designing Prompts (but not like that)

Old fashioned television with flowers.
Photo by Işıl via Pexels.

In my last feature in this series, I talked about using GPTs to help in the process and clarification of your writing. This entry is a bit of a cheat in this series, since it doesn't actually involve prompting a GPT at all. 

Good UX always inspires me to think about how to use some of these strategies more broadly. I remember being mildly affronted during the CITL reading group I attended when I first became interested in better teaching-- did I spend that whole several weeks affronted? Apparently! Clearly it was challenging me in some useful ways-- because one of the resources we read discussed using advertising principles to make learning "stick."  Advertising? That soulless capitalist enterprise? Could help me teach the intellectually rigorous discipline of history? Pish-posh! 

Of course, the only thing we do if we eschew these strategies is ensure that what they're learning in our class presently doesn't seem quite as memorable as literally any reasonably well-crafted local commercial they saw roughly a decade ago, which is what I eventually realized as I considered the concepts that were "sticky" in my brain and why.

With that in mind, you might reflect on ways that new tools introduce themselves to you, and see if that sparks an idea about how you might in turn introduce a concept that is very familiar to you in a way that seems approachable to a new learner. I'll use the original starting page for ChatGPT as an inspiration to explain something, such as instructions or expectations for an assignment. One thing that is inherently challenging is to explain something you know very well to someone else. It can be more challenging than explaining something you only know kind of well., as you have to identify the most significant information out of all the information you know and explain it clearly.

Let's take a look at how ChatGPT introduced itself when I encountered it (this has since changed as public familiarity with the tool has increased):

Introduces the tool in three sections: Examples, Capabilities, Limitations
Original ChatGPT intro screen. Image via Datamation.

This screen introduces the tool by offering a breakdown of examples of things you could ask it ("Explain quantum computing in simple terms"), capabilities the tool has ("Remembers what user said earlier in the conversation"), and limitations the tool has ("May occasionally generate incorrect information.")

What if you tried a Examples, Capabilities, Limitations breakdown for assignment instructions?  I've seen many, many pagelong or multipage prompts for a paper that's only 3-5 pages long. Rather than paragraphs of context and/or admonitions based on past experiences ("12 point font and 1.5 inch margins this time-- I'm talking to you, Bradley"), what might it look like to organize a prompt arount the following structure: 

  1. Examples (of excellent work or strong approaches to the work),
  2. Needed Capabilities (of the deliverable students will produce), 
  3. Limitations (or parameters they need to work within to produce this work)

Obviously a prompt doesn't have to stay in this format-- I'm not suggesting that the original ChatGPT welcome page cracked some kind of fundamental educational code. But instructions that you find clear or helpful in introducing you to a new topic may be useful in turn to incorporate into your own teaching strategies. 

Tuesday, December 12, 2023

Plug and Play Miniseries Lesson Spotting with AI: Talking to Write

Old fashioned television with flowers.
Photo by Işıl via Pexels.

Despite widespread enthusiasm about having AI help generate content, that's not in my experience the best way to use it. One, it's doubtful it knows as much about what you want to convey on your topic as you do. Two, conversely, you're probably better at the content than you are at communicating it clearly. In this post, I'll offer a few suggestions for how to use AI to help with writing and clarity, which could be useful for both instructors trying to create educational/assignment content and students attempting to frame their ideas for coursework.

I tend to think as I talk-- the talking is the thinking, and talking through a topic helps me write it down. When I'm preparing to lead a workshop or give a presentation, I often begin by recording myself trying to give it off the cuff based on the ideas I have right now before I start outlining or writing things down. Then, I use the talk-through as the basis for the outline or script or notes. Sometimes I do this in the opposite direction; a brief and sketchy outline that I talk through and then edit based on what I said. In the past, I've always done this using Zoom and then watching back the recording.

More recently, I've started using a combination of two technologies to begin creating written work. First, I speak the ideas into text-to-speech, like dictation.io. Then, I take that text and ask ChatGPT to make it grammatically correct and separate it into sensible paragraphs. This is so much easier for me than fully typing out all the same ideas-- I can talk just about as fast as I think, while I am a decidedly slower typer despite years of practice at Typing Tutor. This strategy works best if you speak in small chunks and confirm that dictation.io is absorbing it all; I've noticed dictation.io does not capture everything I say if I speak for a long time. It's also important to communicate clearly with ChatGPT or your AI chatbot of choice-- it will attempt to smooth the language and potentially add (too many) adjectives by default, so if you want language adjustments, give clear parameters; if you just want the text to be given appropriate puncutation and capitalization, say so.

Most recently, I'm intrigued by some of the AI offerings within Zoom to transcript and summarize meetings; in theory, this could mean that a recorded first draft could have a relatively coherent text component to work from. If you have a paid Zoom account, it's worth playing with these features and seeing if they do anything for your process.

Saturday, November 25, 2023

Plug and Play Miniseries: Lesson Spotting with AI - Think Pair Share

Old fashioned television with flowers.
Photo by Işıl via Pexels.

Think-pair-share-- it's the easiest, most go-to way to get a conversation going in a room of people. It works well in rooms that don't have flexible seating for gathering into larger groups, it's a low amount of investment in setup and explanation, and it gives literally everyone in the room a chance to talk (unless one half of the pair is either real shameless or charmingly enthusiastic). And if done well, it's an "activity" that makes such intuitive sense it doesn't have to feel like an "activity."

If you haven't done think-pair-share before as a leader or participant, this description of the activity and FAQ about it is a nice introduction.

Normally, think-pair-share is conducted by humans (for NOW), but an AI chatbot can be one half of your pair or a supplement to a human pair. This was one of the first uses of ChatGPT I wondered about when it became a popular subject of conversation, and I wasn't alone! Several pieces offer ideas about incorporating AI into your Think-Pair-Share time (for example, it's one of Ditch that Textbook's 20 Ways to Use [Chatbots and Artificial Intelligence] as a Tool for Teaching and Learning). Most treatments of this idea I've seen are riffing off of this widely shared tweet by Sarah Dillard.

[An aside: one of the really funny things to me about the surge in conversations about AI in teaching is how often I now see people talking, writing about, and sharing tweets as though they're academic articles in circles where that might never have been the case before. When something is very new, many standard expectations of what kinds of things are acceptable or useful to cite shift; I imagine this is less wondrous to folks doing more present-focused work, who have frequently encountered the wonderful world of citing social media before, than to those of us who spent seven years citing while fighting microfilm-induced nausea.]

For some real zaniness, and for more insight into the tools themselves, you could have students fire up two chatbots and give them instructions, then feed their responses to one another. This can take careful prompting that will depend on the topic of discussion; it also may shed some light on the boundaries of the chatbots-- it's likely that their conversation will become a bit circular, as they tend to declare everything up front rather than have an evolving conversation (similar to some of the worst human small group activities I've been part of, really).

For more complex use of a Think-Pair-Share type framework, I love this set of options from Acadly, which suggest alternatives to insert into the process like think-write-pair-share, which encourages fuller consideration of the issue before the pair stage, and think-vote-pair-vote-share, which would work well for a question on which minds are likely to change after some collaboration or conversation on the topic. Generative AI could easily be incorporated into these steps to provide some real value; for example, comparing the written thoughts in think-write-pair-share with how ChatGPT might respond to the prompt, or asking the chatbot for reasons why someone might disagree with one's original vote in the think-vote-pair-vote-share framework.

Tuesday, October 31, 2023

Plug and Play Miniseries: Lesson Spotting with AI

Old fashioned television with flowers.
Photo by Işıl via Pexels.
If you're part of the educational space, you've probably noticed the tumult about artificial intelligence and AI chatbots and what they mean for how we teach. I'm not going to round it all up here because there's lots of other places to read about it, but suffice it to say there's a lot of chat about what the surge in AI tools and their availability, particularly natural language processing tools like ChatGPT, means for things like academic integrity, assessment, and what it means to be well-educated, or to produce good and ethical writing. 

Naturally, nobody is more into AI than historians! Just kidding, they hate it. At least, that's what I've observed in an entirely unscientific study in which I read an article about this issue and observe what people with "History" in their job titles tend to say. Obviously this is not true across the board, but it does feel as though the novelty of the past several months has been recieved as a harbinger of doom rather than anything at all helpful. 

Undoubtedly skepticism is justified, even beyond the issues of plagiarism and equity and  scary future dystopiae (ChatGPT told me the correct word here is "dystopias," which I agree with and have also rejected for reasons of vibes). For example, I gave ChatGPT-3 Jourdan Anderson's letter a while back, and it's not great at understanding satire-- it read Anderson as deeply sincere, which is, as you may know, not the best reading of this source. Read it yourself if it's new to you and see what you think the author intends! Moreover, it also makes stuff up, which as you might have guessed, can be a problem. It's great at assembling a bibliography, for example-- I tried it for sources about one of my main subjects of my disserations, Joe F. Sullivan, and it came up with a handy list. However, as Aaron Welborn notes on the Duke University Libraries blog, it's also wildly capable of making up sources out of thin air! So, great at making a bibliography, not so great at making a bibliography of sources guaranteed to actually exist. It also can't always be trusted even just with making a list-- for example, of presidents. That's just how it works. So it's only really a starting point you then need to guess and check. And let's not forget "Historical Figures Chat", which attempted to make AI chatbots of notable historical figures based on ChatGPT, thus incorporating some ahistorical and incredibly odd "PR nonsense" into responses from multiple architects of historical atrocities. (This tool would have been an interesting concept to ponder in my iteration of the Fiction and the Historical Imagination class, in that  many of the less valuable approaches to historical fiction that we looked at dealt with a cultural penchant for believing we can know a person in the past, and mythologizing them based on the image we've created of them, and also in that this thing is effectively creating very specific little historical fictions). 

But! As you probably know, my wheelhouse is less locking down and preventing people from using stuff and writing dramatic take-downs of concepts and more about poking into and exploring what things can be good for, even if I, you, and/or the profession in general isn't psyched about them immediately. So, throughout the rest of the year, I'll be releasing a grab bag of AI-related options-- things teachers can do with the current AI tools without either totally forbidding them or making them central to your course creation. Some will help you plan to teach or create teaching materials, while others will be ways you can assign AI usage as part of the learning process. Some I've come up with, while others I'll feature have been suggested by others. 

I'll note here that due to my own biases as a trained humanist, I've avoided options that mostly boil down to "have the thing create a thing"-- I tend to find that the writing that text-focused AI tools produce is a little uninspired; many of them literally work by stringing together words in the manner and order that they are frequently strung together, so that's not terribly surprising. It's also the opposite of what I'm usually trying to accomplish in my classes. I've always tried to teach and to get students to find new connections, words that haven't been put together that often, ideas not commonly associated. As a result, the more the tool is creating something toward some sort of final product, the less the options for creating material are interesting to me, though there are undoubtedly uses in that line you can find recommended elsewhere.

Finally, if you have an AI usage for teaching you'd like to share, I'd love to hear from you! This series will be percolated on and added to periodically for as long as I keep thinking of or coming across uses that seem useful and exciting to me. 

Saturday, November 5, 2022

Enough About Me: Putting Your Source Analysis Template to Work

 So, you’ve created a source analysis activity using this template– congratulations! Now you’re ready to make it available to others so they can, you know, analyze the source. 

Regardless of which method you choose, the first step is the same: From the story view, you’ll click the title of your activity at the bottom left, then click “Publish to File” in the menu that appears. This will bring up a window where you can confirm what you’d like to name the file and where it should be saved; an HTML file will then be created.


The menu that appears when clicking the title of your Twine story. 

The nifty thing about an HTML file is that, if you open it in a browser like Google Chrome or Safari, it will open as your game, playable and looking just as you designed it to look. If you open it in Notepad or something similar, however, it will be code– code that you can use! 







This possibility gives us a lot of options for how we might wish to share our activity. I’ve talked about mechanisms for doing this a bit previously, but it’s worth revisiting here to address one of the spaces almost all teachers already have access to: an LMS space. If you don’t already have one, you can usually create one for free, and many receive these spaces from their institutions automatically.












Here is a quick walkthrough on how to incorporate a Twine activity into the Canvas LMS, with concept and code courtesy of Laura Gibbs:

  1. Create your HTML file. 

  2. Pop that file into the Files space. You could make that file visible to your class, but would probably rather hide it from students.

  3. In a new tab, open the Edit view of the Assignment or Page you’d like to add an activity to. 

  4. Click the </> button at the bottom right hand side of the Rich Content Editor in order to open the HTML view. 

  5. Copy and paste this code into the text entry field:

<iframe src="https://___/courses/___/files/___/download" width="100%" height="600"></iframe>

  1. Go back to the tab in which you have Files open. Right click on the HTML file you just uploaded and select “Copy Link Address” from the dropdown menu that appears. 

  2. Go back to the tab in which you have the Edit view of your assignment open. Select the bold text, right click, and paste the link you’ve just copied. 

  3. Save and publish. 


To see this in action, enroll in this demo Canvas space and experiment with the items available in the Source Analysis Activity module (feel free to use a pseudonym). Into this space, I’ve added some examples of what the Source Analysis Activity can look like incorporated into an LMS as a page or an assignment. In the process, I’ve taken the opportunity to update things that were or have broken (for example, the link to the Arbella Speech that I used in the first iteration of the Source Analysis Activity has since become defunct). More significantly, I edited some of the language to apply more clearly to the Canvas environment– students no longer need either so many or so vague instructions about how to turn in their answers if the activity is embedded within an assignment, for example; the activity also no longer needs to collect their name to associate with their answers, but it does still need to instruct students on how to collect and turn in their answers into a format that can be delivered to the instructor by Canvas. 


One of the beautiful things about distributing your activity via an iframe in an LMS is that it works well on mobile– even the process of copying and pasting my answers into the text box was relatively straightforward when testing this on my iPhone.

 

I hope this inspires you to try this out in your own courses, even if only on an unpublished demo page. If you need a Canvas space to experiment in, you can create a Free-for-Teacher account


If you have questions or get stuck at any of these steps, feel free to reach out in comments, or schedule a quick chat with me via my Calendly

Sunday, August 7, 2022

Enough About Me: Source Analysis Template Walkthrough

As promised when I introduced the Source Analysis Template, I have also created a walkthrough to using it. If these steps seem like a lot, don’t worry! This is a pretty granular breakdown, and some of these steps are repeats from the download process in the first post.

Setting Up

  1. Download the Twine desktop app from Twinery.org and the HTML file for the template. 
  2. Once you reach the Story Listing in Twine, click “Import from File” on the Side Menu. Click “Choose File,” then select the template file. 
  3. The template will appear as a story in the Story Listing view. 
  4. This is a good point to do the following two actions: 
    • Duplicate the file so that you have the template for safekeeping, and a work file for your new activity. That way, you can go back to the template if needed, or duplicate it for other uses in future.
    • Click the Settings (gear) icon next to the duplicate and select “Rename Story.” Give your activity a descriptive title, as this will appear in the activity once it is complete.
  5. Click on the template to open it.

Welcome

  1. Double click on the “Welcome” passage to open it. 
  2. Replace the all caps text in between the two sets of tildes, as well as the tildes themselves, with text relevant to your activity. (example: ~~ THIS ENTIRE THING ~~ would become Your Text)
Screenshot of demo view of Source Analysis Template info page. Title and Title of Text are rendered in blocky, all-caps formatting.
    Leaving the tildes will result in your text looking like "Title" and "Title of Text" in this 
    image in the finished product-- which, if you like it, great! If not, take out the tildes.
  1. You should also, of course, feel free to edit or omit other text that may not apply to your use of the activity-- for example, if you don't want your students to turn in the answers at all, or if you want them to complete the activity in one sitting, some of the instructions may not apply. 
  2. If you’d like to link to a copy of the source or excerpt, edit the link text given in the Welcome passage in the paragraph beginning “If you’d like, you can pull up a copy of…” Put the URL link itself in the first set of quotation marks, and the text you’d like to link (usually the title of the source) in place of ~~LINK TEXT WITH TITLE OF SOURCE~~. 
    • For example, this:
      <a href="https://avalon.law.yale.edu/ancient/hamframe.asp" target="_blank">Code of Hammurabi</a>
    • Becomes this:
      Code of Hammurabi
  3. This version of the story asks for the student’s name in the Welcome passage , so that their answers at the end will have a name associated with them. If you don’t need this feature, you can delete the question and the code for the input box ({text input: 'studentName'})
  4. Close the passage by clicking the x at the top right. You’re done with this one! 

Source

Okay, this is the fiddliest bit, but I promise it’s not so bad. There’s even a nice visual walkthrough to help you out. Ready?
  1. Replace “~~TITLE OF TEXT~~” with the title of your source or excerpt. 
  2. Replace “~~ADD YOUR TEXT HERE. PUT TEXT YOU'D LIKE TO LINK INSIDE ONE OF THE FOLLOWING:” with the full text of your source or excerpt. 
  3. Identify the words within the source that you would like to link to another passage. Copy ‘em.
  4. Go down to the link list. Replace “~~LINK TEXT 1~~” with the copied text. 
  5. Highlight the entire line. Cut. 
  6. Highlight the words you copied earlier in the passage. Paste. You’re done with the first one!
    • Here's what that process looks like. Every little yellow flash in this clip is a CTRL+C (Copy) or a CTRL+V (Paste). 

  1. Repeat this process with each selection of text you want to link. Delete any links you do not use.

Items

There’s lots of code-looking stuff here, but never fear! Each of these lines that begin with "{text input for:" simply creates an input box where students can write their answers, one input box per line. 
  1. Add any questions or comments you’d like to the Item 1 box corresponding with the text you linked to this passage. 

  2. If you’d like a text input option for students to respond to your questions:

    • Cut and paste the first line of code from the list beneath the relevant question.
    • Repeat for all questions in that Item. Delete any you do not use (or else you’ll have a list of extra input boxes in your passage).
    • Each input option can each only be used once in your story. So, if you used ‘inputA’ and ‘inputB’ in the Item 1 passage, you’ll need to remove these two from the next slide and use 'inputC,' 'inputD,' etcetera. 
  3. If you don't want a text input option, simply delete all text before {back link, label: 'Save and go back to excerpt'}.

Submission Instructions

Okay, home stretch! There’s so little you need to do here, it almost doesn’t seem fair. 
  1. Choose one or both sets of instructions for submitting answers. Delete any irrelevant instructions. 
    • If you did not use any text inputs in your activity, you can delete this passage entirely or replace everything before the {back link} with any concluding text you like. 
  2. Replace “~~YOUR PREFERRED SUBMISSION INFO~~” in the instructions you choose with the email, LMS assignment submission link, or other details needed for students to submit any work they’ve created. 
That’s it! You’ve got a Source Analysis Activity of your own. If you have questions or get stuck at any of these steps, feel free to reach out in comments, or schedule a quick chat with me via my Calendly

P.S: Now that you’ve made this lovely thing, how do you put it out into the world? We’ll talk more about that in the next post. 


Saturday, June 4, 2022

Plug and Play: Source Analysis Template

Editing View of Source Analysis Template in Twine

Ever since I created the Source Analysis I activity, I've been wondering if there was a way to reduce the friction of creating a close reading exercise like this even further than just providing an example. Twine is a fairly low investment technology to pick up, but to start from scratch can be intimidating, and there can be a high barrier to trying new things for teachers who simply don't have much time to argue with technology. 

To help with this goal, I've created a template for making a source analysis activity similar to Source Analysis I. I have tried to make it as self-explanatory as possible to use (at least, if you’ve read the previous posts and/or demoed the Source Analysis I Activity), so feel free to download it and jump right in yourself! However, if you’d like a more detailed walkthrough to using it, one is coming. 


This template is good for activities like: 

  • Close reading of a fiction or nonfiction text guided by questions
  • Encouraging annotation of specific passages
  • Creating notes about a source that will inform a paper or exam question

For the particularly imaginative, you could also use it for:

  • Having students read and dissect the key requirements of a paper or project prompt
  • Reflecting on the different formats of a text (what different things did students pick up reading the piece in its original format versus within Twine?)

To start working with the template:

  1. Download the Twine desktop app from Twinery.org and the HTML file for the template.
  2. Once you reach the Story Listing in Twine, click “Import from File” on the Side Menu. Click “Choose File,” then select the template file.
  3. The template will appear as a story in the Story Listing view.
  4. Optional: This is a good point to do the following two actions:
    • Click the gear icon and click “Duplicate Story.” This will make a copy of the file so that you have the template for safekeeping, and a work file for your new activity. That way, you can go back to the template if needed, or duplicate it for other uses in future.
    • Click the Settings (gear) icon next to the file you plan to work in and select “Rename Story.” Give your activity a descriptive title, as this will appear in the activity once it is complete.
  5. Click on your work file to open it.

In creating the template, I worked out a couple of irritations of the original:

  • If using a link to an external site, placing it into the template as provided will now automatically open it in a new tab, rather than either opening in the existing tab (thus navigating away from the activity) or requiring users to right click and select "Open in a new tab" manually (which is annoying to have to remember). This update is thanks to this question and answer in the Twinery forum!
  • The original activity required players to make a slightly unnecessary choice between whether they were going to write down their answers separately or in the input boxes. Although this was useful for the purposes of demonstrating two different approaches, it really wasn’t necessary for a template– if not using the input boxes, the creator can delete them, or the players can ignore them.

You may have noticed it’s been a while since my last post, and that’s primarily because every time I sit down to publish this template post, I come up with a new way to make the template or the instructions better which requires an additional hour of Googling, fiddling, and fighting with Blogger. I then created a bunch of content which felt like too much for one post; I like to keep these somewhat bite-sized. So, I’ve created a lot and split it into smaller, time-released bits, like those pain reliever capsules with the little spheres inside. (Is that what those do? Not sure, but they look fancy, so I’m going with it.)

Now, finally, I’m releasing the template out into the world, with the promise of additional supportive content to come, including a walkthrough (with a helpful video demo or two) and some upgrades to this template that you may like to experiment with. I’m also offering some small-group or one-on-one meetings for anyone who wants support or ideas for using this template; feel free to schedule an open time on my Calendly. And, if you decide to use it to create your own resource, I’d love to see the final product or hear about how you used it!

Monday, February 28, 2022

Plug and Play: My Much-Anticipated Proclamation of Love for Rubrics

A hand holding colored pencils.
Grab your colorful writing implements! It's rubric time! Photo by @alyssasieb.

In the Spring of 2017, long before I ever thought about becoming a CITL grad affiliate or even particularly understood my own interest in teaching, I participated in the "Four Friends and a Book" reading group hosted by a CITL grad affiliate. We read parts of Ken Bain's What the Best College Teachers Do and discussed how Bain's ideas related to our own practices and disciplines. I recently rediscovered the discussion questions and my answers that we each prepared in advance of these sessions, and realized with a start that this was the beginning of the story I promised to tell you so long ago, about how I became a rubric enthusiast.

In the Beginning: A Skeptic

A selected excerpt from my notes on the Pre-Meeting Assignment for Meeting 3, in response to a question about whether rubrics were the tools of excellent teachers or merely time-consuming busywork:


  • I’m struck by “Students focus on grades. Sad, but true” (7)

  • I think this could have potential usefulness for conveying some of those learning aspirations that Bain references repeatedly, though the rubric’s obsessive focus on the grade is why I have shied away from using them before. They always seem to be something that promises to make the subjective objective by putting it in a chart—“mastery of material” or “effective use of evidence” is now clear and undeniably interpretable because it’s in a table!

  • I do like the idea of students helping to create these—that would give me a sense also of not only what they expect but what they know and what I could work on explaining.


This list of reactions struck me as interesting for a few reasons.


  • First, I am notorious (with myself, at least) for taking notes that have no content other than the quotation I thought was "interesting." Can you elaborate, past Leanna? No, I could, apparently, not.

  • Next, wow, was I skeptical! Rubrics "could have potential usefulness"-- that's Leanna-speak for "I guess you may have a small point and I don't like it."


My referenced qualm about the concept of rubrics, meanwhile, now strikes me as being a super-real critique of many rubrics I'd seen as a student and in teaching workshop examples, which I found impenetrable and not very specific, likely because they were trying to be all things to all graders--vague enough you could use them for many different projects or pieces of writing.

What is a rubric?

There are a few different styles of rubric, the most common three of which are well-described in Know Your Terms: Holistic, Analytic, and Single Point Rubrics. I tend to be most comfortable with an analytic rubric, which breaks down criteria of an assignment and helps the grader look at each in isolation to arrive at a total score. For example, the rubrics I’ve featured here previously in posts about teaching The Underground Railroad and The Crucible have been analytic rubrics. 

However, rubrics don’t have to be so detailed to be useful. My simplest "rubric" was one I scribbled quickly on every one of the weekly reflection papers for my Fiction and the Historical Imagination class. It began from the instructions from a document called Weekly Response Expectations:

 


  • Comment thoughtfully on reading.

  • Use evidence from reading.

  • Tie readings together, either within week or with previous weeks.



Which turned into a little abbreviated list that I added to the bottom of each paper with a brief comment about each:

 


  • Content

  • Analysis

  • Connections


 

If you had all three, you had full points. If you missed one or two, I noted they were missing. If you could have done more, I noted which needed a little attention. It's not that this is an example or perfect or ideal rubric making-- this could have been a lot better! But for a frequent and low-stakes assignment, it made life quite a bit easier to organize my thoughts in this way, and it seems to lead students toward some quite intriguing and freeform thinking, which was my hope and my goal.

What Changed?: Why I Like Rubrics

As you can probably tell, my feelings about rubrics changed from the time I was writing about their “potential usefulness” to the time I was creating a new and tailored rubric for every assignment I graded. This moment of reflecting on and talking about rubrics in concert with other teachers set off a chain reaction– I tried it, I liked it, and I didn’t want to go back. So, here's the verbs that rubrics help to do:

Refining

One of the critically helpful things about getting into rubric construction was how it forced me to refine how I was conceptualizing the assignment before grading it-- indeed, before I even assigned it. I wanted students to know how they were going to be graded before they started working on their assignments so that they knew how to prioritize their time and attention, what I was looking for, and so that they had the best chance of actually succeeding at that assignment's goals. So, I needed to figure that out, and often breaking things down into the rubric forced me to clarify my instructions and reflect on what was actually important-- every single one of four criteria cannot be fifty percent of the grade, so how much, exactly, should each be worth in the final score? How can I best express success in each criterion via words on a page to actually make them specific and helpful, rather than leaning on a vagueness like "mastery of material"-- what will showcase that they have mastered the material well, and can I just straight-up tell them to do that in the instructions and isolate it in the rubric?

Prioritizing

Past Leanna was affronted by how rubrics focused on the grade, whereas I apparently saw the process as being more about the mystical process of providing tailored feedback, with the grade hinging upon it but incidental to "the point." I now tend to see "the grade" and "the feedback" as two aspects of the process of grading (which is, obviously, not universal-- if you are ungrading or teaching in an ungraded context, great!). If you can simplify "getting to the grade," you have more time to tailor your feedback. This is something I mention frequently in my current role-- it's not that you are skimping on grading by doing it more quickly; rather, you're making more efficient the parts that are not personalized so that you can spend your time tailoring the more individualized feedback to the student, instead of just writing "Remember to proofread your paper before submitting" on thirty-seven separate papers and trying to ascertain after reading whether this feels like a B+ or an A- paper. 

Guiding and Aligning

When I was a teaching assistant, there was quite a bit of uncertainty regarding the role of the teaching assistant. In many ways, our sections were like our own class, and we ran them in fairly individualized ways. In others, we had little power to craft the class in our own image. The result was quite a lot of inconsistency, as an assignment you interpreted as being "about" one skill or content area might be interpreted by another teaching assistant for the same course to be "about'' a different skill or content area, and the professor leading the course might have still another take. Now that many of the folks reading my blog are likely professors or teachers of some type themselves (hooray!), you have the power to help the folks you are supervising or may one day supervise in your courses figure out how the heck to grade student assignments by creating a rubric and collaborating on minor edits as each assignment approaches in order to align assignment expectations between sections. In an individual way, making rubrics also helped me create consistency across assignments-- is there a reason why I think organization should be thirty percent of this project but only ten percent of the last one? If so, I should make that clear; if not, I should try to figure out how important organization should be to this type of project.


If you have strong feelings about rubrics (positive or negative), you’re obviously not alone. If you want to share them with me, feel free to drop them in the comments! 


Monday, January 31, 2022

Take My Advice: Four Tech-Fueled Efficiency Tips I Wish I'd Known Four Years Earlier

Front cover for the video game Civilization V.
If you'd like a tech-fueled inefficiency tip, this image should serve. 

I have always been technologically curious, but as one grows and changes, perhaps it is inevitable that one realizes what they didn't previously know or appreciate; so too have I realized that there were lots of technological possibilities that I was slow to take up. There seems to be an undertone of skepticism among folks in academic humanities circles about using technology, systems, or techniques for efficiency and an even greater fear of admitting one has engaged in such behavior, and so I perhaps unnecessarily developed an aversion to using it to support my research; though I was keen on incorporating tech into teaching, my process of doing so was admittedly prone to making my preparations more time-intensive rather than less (implied, I think, by my observation in this 2018 reflection on preparing my Fiction and the Historical Imagination course). Part of this, I think, was a symptom of a peculiarly humanistic tendency (or so it seems to me) to feel that to save time is to be cheating in some way; that if our work is valuable it is valuable because we agonized over it at great length, and can be said to have depended upon no one but ourselves and our incredible intellects. Ultimately, however, both students and the work, not to mention my own well-being, have been better served by embracing ways to make life a little easier and a little more collaborative. As a result, in this post, I'm reflecting on four things I came to appreciate in the last two years or so that I really, really wish I'd been doing the whole dang time.

Use OCR

Optical Character Recognition (OCR) is much better than it used to be, and it doesn't have to be perfect to be helpful. I think I became hesitant to try again with OCR after an ill-fated attempt at digitizing a single issue of Cosmopolitan magazine so I could "perform Digital Humanities" on it as an undergraduate. However, toward the end of my dissertation writing process and into my current work I've seen how improved the technology is and how much I now take it for granted. If you have archival photos or scans, try using Adobe Acrobat or a free OCR tool to recognize the text. This will not only make it more accessible if you are distributing it to students, but also make it easier for you to search for terms within it (which would have come in very handy had I figured this out earlier in my dissertation research process, as I worked almost entirely from archive photos and scans while writing).

Use Excel

You know you can use Excel for whatever you want? You don't even have to be a card-carrying "quantitative researcher." Here's one thing I now use all the time and which would have worked well in conjunction with the idea of OCRing things: the UNIQUE function, which can take a list of items and strip out all the repeats, leaving only one iteration of each name, number, list item, etcetera. Imagine how much more easily I could have answered questions about how many disabled children were represented in an issue of a periodical if I'd known this.

Use the Internet

You don't have to do everything yourself. Some subjects have existing resources, whether entry-level memorization and practice activities on tools like Quizlet or Kahoot or mid- to higher-level activities created by other instructors and distributed on educational resource sites like MERLOT or the Zinn Education Project or through affinity groups like the Reacting Faculty Lounge or via personal blogs (hi!). Some activities pitched to high school learners can be employed usefully in a higher education setting with a few tweaks. Some materials can also be created by students as part of their learning process; instead of making a Quizlet for students to practice with, ask groups to create their own Quizlets of the top five or ten topics / terms / concepts and compare their results. 

In short, I wish that I had appreciated earlier how many other things existed that I could use rather than reinventing the wheel every time. Sometimes it seemed like it would have been harder to find and enact an idea elsewhere than creating it myself, but looking a little harder could have paid off-- not only would this have saved me time, but it would have been useful to me to see how other people were approaching teaching various topics to inspire the activities and assessments that I created.

Use a Repetition-Mitigator

Relatedly: If you do have to do something yourself (making an activity, grading), you don't have to create everything from scratch every time. It's great to make something new! As I've mentioned in a previous post on career preparation, if you are an early career teacher, it's in fact essential to make some new things if you'd like to be able to fruitfully reflect on those experiences in later job interviews or teaching statements. However, if you save time on some of the more rote requirements and/or incorporate already existing resources, you'll have more time for creating novel activities and giving meaningful feedback. 

Efficiency in grading is one example of this. Rubrics and comment libraries (either technological ones, like within LMS systems, or low-tech numbered lists you can show to students in conjuction with papers marked with corresponding numbers) can allow you to skip writing "Needs to use at least three sources" in paper comments seventeen times, leaving additional time to write more specific and useful comments like "Your paper's argument might benefit from a closer read of Source A" or "If your goals are X, you should focus on Y aspect of the homework for next week." I only started appreciating what a time-saver this could be late in the game, and I wish I'd used it more thoughtfully and more often.

What tips, strategies, or tools do you wish you'd appreciated and used earlier? Feel free to let me know in the comments-- I just may have to start adopting them myself.

Related Links: 

One of my favorite activities supported by an existing resource: after being asked to deliver a short lesson to a group of epidemiology students on the fly during my time at the Johns Hopkins Center for Talented Youth, I followed a brief lecture on the history of polio with asking students to play the Smithsonian National Museum of American History's Got Ramps? Architectural Barriers Game and compare notes on which endings they achieved. 

If you're interested in the NMAH's work on polio, or thoughts on incorporating museum resources and exhibits into teaching, you may be interested in revisiting this 2017 post on the curator's interview with David Serlin.

Sunday, January 31, 2021

Flashback Post: My Approach to the Lesson Plan

Next month, I'll be delivering a workshop on Lesson Planning for Discussion Sections (which UIUC folks should feel free to join me for--register here!) This post from early 2019 was the jumping-off point for me thinking about this topic, so I'm reposting it in preparation; I'd love to hear about which aspects of lesson planning for discussion sections you think should be included, or want to know more about, in the comments. 

A slide reading :Objectives!Or, by the end of this workshop you will be able to…Understand the benefits of lesson planning for teaching assistants leading discussion sections; Evaluate potential aspects of a lesson plan to determine which are applicable to your courses; Create a lesson plan that will streamline your sections
A sneak peek of the objectives for February 8th's workshop.

Here is a confession from me: I am repeatedly skeptical of things and then, eventually, adopt them wholeheartedly. Here is a partial list:
  • Asparagus
  • Exercise
  • Southwest Airlines
  • Budgeting
  • Casual gaming
  • Savings accounts
  • E-books
  • Looking at the weather before you leave the house
  • Bran
  • Going for walks
  • Rubrics (more on this another day)

So it should come as no surprise that I have come to appreciate the wonders of the lesson plan. Because there’s a variety of approaches to lesson planning, I had trouble figuring out what the point was in my early days of teaching, especially while TAing, in which many of the decisions about readings and course structure have already been made for you. So although I dabbled in the creation of lesson plans while I was a teaching assistant, they were generally brief lists of questions and activities scribbled on a piece of scrap paper on the way into my section. We read the reading; now let’s talk about it! Simple.

The year I taught two Reacting to the Past courses was similar in some ways— the structure of the games is either planned for you in the book or run by the students, so there are comparatively few days for which a lesson plan is useful. It wasn’t until my Fiction and the Historical Imagination course that I became infatuated with the lesson plan, and although I fell off the wagon a few times as the semester stretched on, I used a particular strategy to great effect. 

Here’s an example of a week of lesson plans from the middle of this course:





Let's take a walk through their components.



Up top: the week and day, to stay on track. Then, the purpose: what is the goal of the day? I’ll admit to being less than enamored with too much agonizing over long lists of objectives, but I find it really useful to have a straightforward statement of what we should be aiming for by the end of the period.

Then, a time breakdown of each step, beginning always with five minutes at beginning and end for hellos, roll, housekeeping, etcetera. This is great for reminding you that in fact, a fifty minute class often ends up being much less because of the small tasks that have to be done before one can start the film, begin the quizzes, or instigate group discussion. Likewise, it encourages you to think about the real factors that may delay your plans. If you are going from a lecture to assigned groups, how long will it take the class to move from A to B? If you allow for that in your plan you’ll save yourself some grief.

As I lay out each segment of class, I like to include both the length of time allotted to each and the time of day it should be at the beginning and end of that segment. I don’t follow this exactly while in class, of course— there are a million reasons why you might choose to follow a rabbit trail of discussion or allow a bit of time to review a reading that will throw you off of this path. But including both allows you the flexibility to go off path and then to see exactly how far off you are and make quick decisions about how to handle it.

As I mentioned above, I always end with at least five minutes for reminders and other housekeeping. This is useful to both students and instructor because it allows for checking in about ongoing or upcoming assignments; it also encourages you to end class on time, which I consider a mark of respect and professionalism.

Perhaps the most important thing about the lesson plan is that I print the plans for the week — even if unfinished— at the beginning of the week and carry them around. Then as I am leading class, working on other things, or reviewing course readings, I can write in changes or additions to future days. I also sometimes annotate them while class is ongoing, noting how I diverged from the plan. I still have a stack of lesson plans from last semester; I plan at some point to update the files using my annotations to use again for future courses.



Do you lesson plan? What things do you include or leave out?



Related links:

Some other approaches to lesson planning at The Chronicle of Higher Education and Algonquin College.

If you're interested in learning outcomes and objectives, check out the National Institute for Learning Outcomes Assessment.

New addition: If you want to talk about lesson planning or anything else with other UIUC TAs and grad instructors, I also host an informal TA Talks Virtual Happy Hour for CITL the first Wednesday of every month. Shoot me a message for the registration link!