Multiparty Co-Learning and Transdisciplinary Collaboration: Cultivating Critical AI Literacy in the Development of Automated High-Stakes Speaking Assessment – Dr Nick Wong (Hong Kong University of Science and Technology)

GAVIS is a government-funded AI speaking assessment tool for Hong Kong’s high-stakes HKDSE secondary school examinations. Getting the AI to replicate human judgment persistently failed due to AI and humans approaching assessment in fundamentally different ways. A breakthrough was reached with a sequential pipeline mimicking the order in which human examiners assess which required team members to think and act beyond their traditional roles in a trans-disciplinary approach. This session maps out the specific concepts and trajectory of this project as a model for successful, sustainable AI-enabled assessment development in this field. 

Key words: AI-assisted speaking assessment; Sequential pipeline architecture; Transpositioning; Multi-to-trans-disciplinary collaboration; Human-in-the-loop; Critical AI literacy. 

Presentation recording

Presentation slides