SQAM
An SQL automarker that grades queries by what they return, with partial credit, plus scaffolded schema and data tasks.
Database courses often reduce to writing SELECT queries, graded all-or-nothing by string matching. Students who are nearly right get nothing and learn little from the mark, and they rarely practise defining schemas or managing data, the skills industry says it needs most.
SQAM, the SQL AutoMarker, grades a query by what it returns rather than how it is written, awarding partial credit and personalized feedback. Across five course offerings its marks matched TA marks wherever TAs gave partial credit, and averaged 14.5 points above a binary automarker.
Weekly scaffolded schema and data exercises with immediate feedback now make data definition and manipulation a core, assessed part of a third-year database course. Across three offerings (669 students, 9,071 submissions), students needed fewer attempts on schema and data tasks than on queries, and early schema performance predicted later SQL performance.
People
CORE Lab
- Naaz SibiaPh.D. Candidate, Computer Science, University of Toronto
- Jessica WenUndergraduate Researcher, University of Toronto Mississauga
- Zeling (Zoey) ZhangFormer Undergraduate Researcher, CORE Lab
- Harry (Runlong) YePh.D. Student, Computer Science, University of Toronto
- Ilya MusabirovFormer Ph.D. Student, CORE Lab
- Angela Zavaleta BernuyCo-Director, CORE Lab; Assistant Professor, Computing and Software, McMaster University
- Michael LiutCo-Director, CORE Lab; Associate Professor, Teaching Stream, University of Toronto Mississauga
Collaborators
Papers
- Naaz Sibia, Jessica Wen, Zeling Zhang, Runlong Ye, Joshua D. A. Jung, Ilya Musabirov, Bogdan Simion, Carlos Aníbal Suárez, Paul Vrbik, Andrew Petersen, Angela Zavaleta Bernuy, Michael Liut."SQL Beyond Querying: Enhancing SQL Learning with Schema and Data Management" Proceedings of the 31st ACM Conference on Innovation and Technology in Computer Science Education V. 1. (2026).[doi][]
- Muyu Wang, Naaz Sibia, Ilir Dema, Michael Liut, Carlos Aníbal Suárez."Building a Better SQL Automarker for Database Courses" Proceedings of the 21st Koli Calling International Conference on Computing Education Research. (2021).[doi][]










