Starting in Melbourne earlier this week and wrapping up in Sydney today, the Duolingo Masterclass series brought together senior team members from the USA to showcase the robust security and validity measures behind the Duolingo English Test (DET).
The Koala was fortunate to attend the second masterclass held in Sydney.
Brett Blacker, Managing Director of Duolingo in Australia and New Zealand, opened the day alongside James Holden, Head of Institutional Engagement for Australia and New Zealand, introducing the test and its technology foundations: AI, machine learning, and deep learning—and their evolution.
The first masterclass, led by Basim Baig, Head of Security, focused on test integrity and the critical security elements of the DET. Basim guided the audience through threat models, starting with simple concepts and building into more sophisticated ones, engaging the audience along the way. This included using AI models to differentiate between typing from thought versus typing from reading, and keystroke profiling to detect plagiarism.
The session also explored the motivations behind cheating, with participants creating profiles of increasingly sophisticated “cheaters,” adding a light-hearted element to a serious topic.
In the second session, Dr. Ramsey Cardwell, Assessment Specialist, broke down test validity, presenting a theoretical framework on what makes an English test valid. Participants were encouraged to suggest properties of a valid test and provide evidence of those properties. Themes of reliability, fairness, integrity, predictive validity, and test concordance were thoroughly discussed.
Dr. Cardwell also delved into adaptive testing, demonstrating how AI dynamically adjusts the difficulty of questions in real-time based on a test-taker’s responses. Participants were even tasked with designing their own adaptive tests, sparking lively discussions on best practices.
Reflecting on Duolingo’s visit to Australia, Rogelio Alvarez, VP and General Manager of DET, said, “Australia is a key market for Duolingo and the Duolingo English Test (DET), and we are excited to support Australian institutions in finding the right talent for their programs. The enthusiasm and engagement at our masterclasses highlight the importance of understanding the test’s integrity, validity, and security. I’m truly inspired by the interest and commitment of everyone involved!”
Jen Dewar, Senior Director of Strategic Engagement, added, “Despite current market fluctuations, we remain steadfast in our commitment to Australia, which we believe will continue to be a leading destination for international students. A key insight from our Masterclass events in Melbourne and Sydney is the sector’s strong appetite for innovation in English language testing, with a demand for solutions that are more accessible, secure, and efficient.”
As Duolingo continues to familiarise Australian audiences with the Duolingo English Test, it’s clear that technology security forms the test’s foundation, with integrity at the heart of its mission. After all, Luis von Ahn, the founder of Duolingo, was the inventor of CAPTCHA, reCAPTCHA, and early iterations of Google Lens—a strong track record to draw upon.
What did participants think?
Ben Doran, Manager of Pathway Programs (ELICOS and Foundation) at Swinburne University of Technology, shared, “Both sessions were great, and Dr. Cardwell’s breakdown of assessment design was the clearest I’ve ever seen on this topic, with practical examples and answers to common questions.”
The Koala thanks Duolingo English Test for the invitation to join the masterclass.
