Quant Hub seminar: Scaling personalized learning: Optimising teacher engagement and implementation fidelity through A/B Tests
This study examines the scalability of A/B testing in educational settings, focusing on its application to improve the implementation and engagement of Mindspark, a computer-aided learning platform by Educational Initiatives in India. Mindspark, which serves grades 1–10 with personalized learning paths, has demonstrated efficacy through randomized controlled trials showing significant gains in Math (0.37 SD) over short periods and is currently being scaled in several states in India. However, challenges persist in sustaining teacher engagement and fidelity during large-scale implementation. Using a sample of over 20,000 students across 170 schools, we conducted iterative A/B tests to address critical implementation issues. Test rounds included report card-based interventions and phone-based calls to action, randomized at the school and teacher levels. Our results highlight A/B testing as a resilient and cost-effective method for optimising implementation at scale.

Teams link: teams.microsoft.com/l/meetup-join/19%3ameeting_N2UwMDk1OTYtOGNlYy00ZjYzLWFiNjAtZWMzYmQ0N2Y3M2Rl%40thread.v2/0?context=%7b%22Tid%22%3a%22cc95de1b-97f5-4f93-b4ba-fe68b852cf91%22%2c%22Oid%22%3a%224003529c-f252-47aa-8e83-ce1eff28df4a%22%7d

Meeting ID: 368 849 075 232
Passcode: xX3p6Ar2
Date: 27 January 2025, 12:45
Venue: 15 Norham Gardens, 15 Norham Gardens OX2 6PY
Venue Details: Seminar Room D and Teams
Speaker: Dr Sharnic Djaker (Blavatnik Business School, University of Oxford)
Organising department: Department of Education
Organisers: Professor Steve Strand, Professor Robert Klassen
Part of: Quantitative Methods Hub Seminars
Booking required?: Not required
Cost: Free
Audience: Public
Editors: Hannah Freeman, Heather Sherkunov, Kristina Khoo