Item Writing with Artificial Intelligence        

This practical three-day online course provides language testing professionals with hands-on experience in designing high-quality test tasks and items for CEFR-aligned language proficiency assessments. Focusing on commonly assessed proficiency levels and general language testing contexts, participants will explore the principles underlying effective assessment of receptive and productive skills, analyse authentic test materials, and develop their own tasks and items through guided workshops and peer discussion.

Item Writing for language tests has become one of the fields where generative AI proves to be a very useful companion. This course also focuses both on the general characteristics of working with generative LLMs (pros and cons) and a very hands-on practical approach to safeguarding your data and advanced prompting.

What knowledge and/or skills will I gain from this course?

By the end of Day 1 participants will be able to: 

• Link receptive tasks to CEFR constructs.

• Identify characteristics of effective reading and listening items.

• Evaluate item quality against agreed criteria.

• Produce and review draft receptive-skill items.

By the end of Day 2 participants will be able to:

• Design productive tasks linked to CEFR outcomes.

• Create task specifications for speaking and writing.

• Develop assessment criteria aligned with constructs.

• Produce draft speaking and writing tasks suitable for later AI-supported development.

By the end of Day 3 participants will be able to:

• Explain the role of AI in assessment task and item development.

• Safely protect the shared data in the LLM tools used.

• Use prompting techniques to generate test tasks and items.

• Make sure the AI system uses the CEFR framework correctly and properly in link with the generated items.

• Evaluate AI-generated materials against assessment principles and CEFR requirements.

• Produce draft assessment materials for subsequent review and refinement.

How is this course delivered?

The course combines three live online training days with an extended practical task-development project. Participants will draft, review, refine and discuss assessment tasks, receiving both tutor and peer feedback throughout the process.

Who are the course tutors?

The tutors are Jane Lloyd and Bert Wylin. 

Jane Lloyd is a Senior Research Manager at Cambridge University Press and Assessment. Her main responsibilities are researching integrated learning and assessment practices in the classroom, working on large-scale educational reform projects with ministries and NGOs, and working for ALTE. Her work for ALTE is to support other national language test providers. This includes advising and training in standard setting, statistical analysis of items, analysis of rater performance, delivering pre-conference and online courses and training in assessment, and supporting exam boards with bespoke training and mentoring.  She has a degree in Linguistics, a DELTA, MAs in Linguistics and TESOL, and in Language Testing, and is completing her PhD in Language Testing from CRELLA. 

Bert Wylin has both an academic and a business profile. He has worked at the KU Leuven since 1993, leading the Education Innovation Centre (integrating EdTech in education). In 2001, he founded a KU Leuven university spin-off, now Televic Education, developing and servicing an e-assessment platform. Bert has delivered various courses for ALTE such as Developing Digital Assessments and Developing Digital Testing with Artificial Intelligence.  

Testimonial

"The Item Writing course with AI integration was outstanding. The tutors’ deep expertise and engaging delivery made complex concepts accessible. The content was practical, insightful, and perfectly paced—an essential foundation for anyone serious about exam item creation."

When is the next course?

The date for the next course is 13 - 15 October and 30 October 2026 (wrap-up session).

How can I register?

You can register for the next course here.

Expression of Interest

If you would like to express your interest in this course, or any other ALTE course, please click here.

Can several people from the same organisation join this course?

For group bookings, ALTE advises to book a maximum of three places per organisation.

How can I pay?

Full payment is required on registration. We strongly recommend that payment is made online using a Visa, MasterCard or American Express. However, if it is not possible to pay with a credit/debit card when registering, please contact the ALTE Services Unit (servicesunit@alte.org) to request an invoice with bank transfer payment instructions.

Course Terms and Conditions

1. Attendance

• Participants must attend at least 80% of live sessions to receive a Certificate of Completion.
• Attendance will be recorded for each session.
• Those who do not meet the attendance requirement will not be eligible for the certificate.
• Missed sessions may be made up in a later edition of the course, subject to availability and the organiser’s approval.

• Each course registration is valid for one individual participant only.

• Registrations may not be shared, transferred, or used by multiple participants, unless agreed with ALTE.

• Group viewing (for example, several people attending from the same organisation in a meeting room or via a shared connection) is not permitted unless explicitly agreed in writing with ALTE. 

2. Recordings and Course Materials

• Recording, copying or sharing any part of the live sessions is not permitted.
• All course materials, including slides, recordings and handouts, are the property of the course organiser and are provided for personal educational use only.
• Materials may not be shared, reproduced or distributed without permission.

3. Technology and Course Changes

• Participants are responsible for ensuring they have a reliable internet connection and appropriate technology to join the sessions.
• The course organiser may make reasonable changes to the schedule, content or tutors if necessary, and will communicate any updates in advance.

4. Agreement

By enrolling on and participating in this course, you confirm that you have read and agree to these Terms and Conditions.