On Episode 569, I welcome Mike Perkins, Head of the Center for Research and Innovation at British University Vietnam, and Jasper Roe, Assistant Professor in Digital Literacies and Pedagogies at Durham University, to Teaching in Higher Ed. We explore the complexities and opportunities of integrating generative AI into educational assessment, focusing on the AI Assessment Scale—a five-level framework designed to help educators ethically, transparently, and flexibly leverage AI in their classrooms.

Mike and Jasper share the origins of the framework, emphasizing the importance of moving beyond binary “ban or embrace” approaches to AI and instead fostering nuanced, context-sensitive discussions around academic integrity, equity, and AI literacy. We discuss real-world examples from their own teaching experience, including ways to engage students in critiquing AI-generated content and addressing challenges of access and equity with institutional strategies. The conversation highlights the importance of critical reflection, cultural context, and the evolving role of both students and educators as AI becomes increasingly ubiquitous in educational environments.

Resources from the episode:

• Updating the AI Assessment Scale, by Leon Furze
• The Artificial Intelligence Assessment Scale (AIAS): A Framework for Ethical Integration of Generative AI in Educational Assessment, by Mike Perkins, Leon Furze, Jasper Roe, & Jason MacVaugh
• Nick McIntosh
• Artificial intelligence and illusions of understanding in scientific research, by Lisa Messeri & M. J. Crockett
• Amelia King
• Jane Rosenzweig’s Bluesky post: Schitts Creek: The Sequel (Bluesky login required to view)
• Jane Rosenzweig’s Breakfast Club Ai generated photos mixed with real ones (login required)
• SIFT Toolbox for Claude (and ChatGPT) Released, by Mike Caulfield
• Strava
• Garmin
• AI and the Future of Higher Ed, by Nick McIntosh
• The Residence

Episode topics:

• Origins of the AI Assessment Scale
• Beyond Binary: Shifting Academic Misconduct Narratives
• Addressing Equity in AI Access and Usage
• Institutional Approaches to AI Integration
• Five Levels of the AI Assessment Scale
• Moving from Prohibition to Critical AI Reflection
• Cultural Relativism and Contextual Adaptation
• Fostering AI Literacy and Critical Thinking
• Human Creativity vs. Generative AI Outputs
• Navigating Trust, Accuracy, and Limitations in AI
• Flexible Assessment Design in the Age of AI

Discussion questions:

1. What are the main motivations behind developing the AI assessment scale, and how does it address gaps or challenges in current approaches to AI in education?
2. How does the five-level AI assessment scale help educators and students move beyond a binary view of AI usage (i.e., “never use” vs. “always use”)?
3. Discuss strategies for ensuring equity when integrating generative AI tools into assessment, especially when some students may have more advanced or paid access than others.
4. What are the ethical considerations educators must weigh when designing assessments that allow or encourage AI usage?
5. How can educators foster AI literacy while helping students critically evaluate, rather than simply accept, AI-generated outputs?
6. In what ways might AI integration in assessment affect the development of students’ unique human skills, such as creativity and critical thinking?
7. Can you think of examples from your own discipline where critiquing or reflecting on AI-generated content (as described by Jasper Roe) could enhance learning outcomes?
8. How might cultural context and local educational values influence the adoption or adaptation of frameworks like the AI assessment scale?

Related Episodes

Here are some related episodes from the Teaching in Higher Ed podcast that explore AI and assessment:

The Myth of the AI First Draft

Leon Furze challenges the notion of AI-generated content on Episode 521 as a mere starting point, emphasizing the importance of human creativity and critical thinking in the drafting process.

Assignment Makeovers in the AI Age

Derek Bruff discusses redesigning assignments to deepen learning and minimize the temptation of AI misuse on Episode 481, advocating for authentic assessment strategies.

Cultivating Critical AI Literacies

Maha Bali emphasizes the development of critical AI literacies on Episode 545, advocating for educational practices that empower students to navigate and question AI technologies thoughtfully.

Toward a More Critical Framework for AI Use

Jon Ippolito explores the need for a critical approach to AI integration in education on Episode 524, encouraging educators to question and understand the implications of AI tools.

Assessment Reform for the Age of Artificial Intelligence

Jason Lodge examines how AI is reshaping assessment practices on Episode 528, urging a shift from traditional methods to approaches that prioritize learning evidence over detection.

Teaching for Integrity in the Age of AI

Tricia Bertram Gallant and David Rettinger discuss fostering academic integrity on Episode 568, by designing assessments that promote ethical decision-making in an AI-influenced landscape.

A Big Picture Look at AI Detection Tools

Christopher Ostro provides an overview of AI detection technologies on Episode 555, highlighting their limitations and the importance of trust and transparency in their application.

Feel free to explore these episodes to deepen your understanding of AI’s impact on assessment and pedagogy.

Recommended

I recommended the Bend App on Episode 569 and indicated that I had stretched five days in a row at that time. Welp, as of this morning when I’m writing to you, I’m on a 37 day streak. Life is better with stretching, I’m convinced. Check out the Bend app on iOS and on Google Play.

A friend who may not wish to be identified shared the following McSweeney’s article on our group chat: Our University is Replacing DEI with Vibes and Vaguely Diverse Stock Photos.

Quotable Words

Jason Reynolds, young adult writer, on On Being:

If your fight for change is convenient, then it’s not a fight.

Next Week’s Episode

On the upcoming episode of Teaching in Higher Ed, Laura Gibbs shares about how to get started with interactive storytelling (aka choose your own adventure type stories). If you want a sneak peek, we did a Bonus Video After Pod Party, which is already available for your viewing pleasure.

Support

The money gathered via the TiHE virtual 'tip jar' helps to defray some of the costs of producing the podcast.

Read

My book: The Productive Online and Offline Professor: A Practical Guide, provides approaches to help you turn your intentions into action. I also write an advice column for EdSurge: Toward Better Teaching: Office Hours With Bonni Stachowiak

Listen

Subscribe to the Teaching in Higher Ed podcast and listen on Apple Podcasts, Google Podcasts, Overcast, Stitcher, TuneIn, or Spotify.

Share

Update: If you enjoy reading these weekly updates and would like to share them with a friend, they can sign up on the Teaching in Higher Ed updates subscribe page.

Disclosures

Affiliate income disclosure: Books that are recommended on the podcast link to the Teaching in Higher Ed bookstore on Bookshop.org. All affiliate income gets donated to the LibroMobile Arts Cooperative (LMAC), established in 2016 by Sara Rafael Garcia.”

Notice: Portions of these weekly updates are produced using CastMagic.io, which uses AI to produce a draft of the transcript, identify key quotes, highlight themes, etc.