Assessing Student-AI Collaboration: Innovative Grading & Rubric Strategies

Kiera Allison is an assistant professor of commerce and 2024-2025 Faculty AI Guide at UVA. In this assignment for a management communication course, she asks students to take on a persuasive task that feels impossible and explore how AI might help them accomplish that task.

What does academic integrity look like in a hybrid human-AI world? Rather than calling for stricter regulation or monitoring of AI, Sarah Eaton offers a provocative alternative: assume that work will be jointly produced by humans and technology, and reimagine what responsible, ethical writing looks like in this new reality.

Chang offers an IT angle on measuring human-AI collaboration, arguing that where LLMs are typically evaluated on autonomous tasks, the better question is how they perform in the hands of human users. Her study reveals how humans elevate or derail AI performance depending on the task, offering practical methods for analyzing the collaboration.

In addition to collaborating with AI and developing rubrics, our students were invited to participate in a pre/post survey about their experience. In this presentation of our study findings, we explore key student insights about what they think deserves to be graded when humans and AI collaborate.