Examination System

Setting and Pretesting

1.1 Selection of Materials

Test materials, based on test specifications and syllabi, are supplied by  external consultants and staff of the Language Centre. Materials are selected from a range of sources, including newspapers and magazines, radio and television.  Some new materials are developed.

The choice of materials is guided by the following criteria:

• skills to be assessed
• linguistic complexity
• subject matter
• item and task types
• cultural and dialectal considerations

In the lower level examinations, Bonnleibhéal 1 and Bonnleibhéal 2, authentic materials are adapted for use in the tests. Some authentic materials, in their original form, are used in the intermediate level examinations, Meánleibhéal 1 and Meánleibhéal 2.

1.2 Test Item Writing

Item writers are experienced teachers and examiners. Extensive use is made of the Item Writer Guidelines while training item writers. An initial review of the materials is carried out by the University Testing Committee, which is made up of Irish-language experts, teachers with experience of teaching Irish to adults and testing experts. Following detailed discussions, the Committee may propose certain modifications, after which the first draft of the test is compiled.

1.3 Pretesting

Due to security isues and the limited number of candidates available for pretesting, no formal pretesting of materials is carried out at present. However, each test is piloted using a small number of candidates, which allows us to revise and rewrite any poor items, distractors, etc. Feedback on the items and tasks is also obtained from experienced teachers.

2.1 Marking

All aspects of the examinations are marked centrally at the Language Centre. Marking is carried out by experienced raters. At the oral examination, all candidates are assessed individually by two examiners (an examiner and an interlocutor). All oral interviews are recorded and all are assessed by trained Language Centre examiners. Raters are provided with comprehensive scoring keys for the various components.

2.2 Training

All interviewers and interlocutors must attend training workshops provided by the Language Centre. These sessions are held at the Language Centre. Dedicated sessions are provided for each level.

2.3 Checking

Random checks are carried out on the scripts relating to the Bonnleibhéal 1, Bonnleibhéal 2 and Meánleibhéal 1 examinations. All scripts at Meánleibhéal 2 are double marked and, if grades differ, are marked a third time before a final grade is arrived at. Clerical checks are also carried out to ensure reliability.

Results

Results are sent directly to each candidate approximately six to eight weeks after the date of the examination. Certificates are sent to each candidate approximately ten weeks after the date of the examination. Candidates who take Bonnleibhéal 1, Bonnleibhéal 2 and Meánleibhéal 1 are awarded an overall grade. Those who sit the Meánleibhéal 2 examination are awarded an overall grade and a breakdown of marks for each component (speaking, listening, reading and writing).

Security

Strict procedures are in place to ensure that each stage of the examination is secure.  Where examinations take place at centres outside the University, the Language Centre appoints a senior member of staff to oversee all procedures relating to the administration and conduct of the examinations, including the receipt and return of scripts and oral test results. Examination dates are carefully selected and all examination papers are printed at NUI Maynooth.