Skip to main content
EUROCONTROL
ELPAC

About this page. This validity documentation is maintained by the ELPAC team at EUROCONTROL as a living methodological record. It is not an ICAO endorsement and does not by itself constitute a regulatory determination. The ICAO Doc 9835 and Doc 10197 pages in this section are ELPAC's own self-assessments and have not been reviewed or endorsed by ICAO. National civil aviation authorities remain responsible for licensing decisions and for determining whether ELPAC results satisfy the ICAO language-proficiency requirements in their jurisdiction.

Last reviewed: 11 November 2026.

Aviation language testing criteria

ELPAC and the ICAO Doc 9835 checklist

Last reviewed: 11 November 2026

Notice: Re-evaluation in progress

A formal documentation dossier for the re-evaluation of ELPAC ATC and ELPAC Pilot has been submitted to the ICAO Aviation English Language Test Service (AELTS) for the 2027–2029 cycle.

While the evaluation is underway, the self-assessment answers remain unpublished to respect the integrity of the formal ICAO AELTS assessment process. The standard ICAO Doc 9835 checklist criteria are listed below for reference.

ICAO Doc 9835, Manual on the Implementation of ICAO Language Proficiency Requirements (Second Edition, 2010), sets out recommended criteria for aviation language testing in Chapter 6, paragraph 3, and restates them as a checklist in Appendix C, Checklist for aviation language testing. Appendix C asks test service providers to answer each item and to submit evidence against the criterion item number.

These are the criteria used when a test is reviewed for conformity with the ICAO language proficiency requirements. ICAO's Aviation English Language Test Service applies them as well: they require that a test submitted for recognition conforms with the criteria set out in Doc 9835. ELPAC's recognition status is described on the ICAO AELTS recognition page.

The 49 checklist items are listed below in ICAO's own order. ICAO's recognition of ELPAC under the Aviation English Language Test Service (AELTS) is a separate statement, described on ICAO AELTS recognition and verifiable on the ICAO AELTS website.

Overview

The eight checklist sections

The eight sections of the ICAO Doc 9835 Appendix C checklist, the number of items in each, and their status.
SectionItemsStatus
6.3.2 Test design and construct11Under evaluation
6.3.3 Test validity and reliability3Under evaluation
6.3.4 Rating4Under evaluation
6.3.5 Test administration and security11Under evaluation
6.3.6 Record-keeping5Under evaluation
6.3.7 Organizational information and infrastructure4Under evaluation
6.3.8 Testing-team qualifications11Under evaluation
Section 6.3.2

Test design and construct

Under evaluation

6.3.2.1

Is the test is designed to assess speaking and listening proficiency in accordance with each component of the ICAO Language Proficiency Rating Scale and the holistic descriptors in Annex 1?

Response and documentation submitted to ICAO AELTS.

6.3.2.2

Is a definition of the test purpose that describes both the aims of the test and the target population accessible to all decision-makers?

Response and documentation submitted to ICAO AELTS.

6.3.2.3

Is a description of and rationale for test construct and how it corresponds to the ICAO language proficiency requirements accessible to all decision-makers in plain, layperson language?

Response and documentation submitted to ICAO AELTS.

6.3.2.4

Does the test comply with principles of good practice and a code of ethics as described in Chapter 6 of ICAO Doc 9835?

Response and documentation submitted to ICAO AELTS.

6.3.2.5

Does the test focus on discrete-point items, on grammar explicitly or on discrete vocabulary items?

Response and documentation submitted to ICAO AELTS.

6.3.2.6

Is a specific listening section with individual items included?

Response and documentation submitted to ICAO AELTS.

6.3.2.7

Does the test include voice-only interaction?

Response and documentation submitted to ICAO AELTS.

6.3.2.8

Is the test is specific to aviation operations?

Response and documentation submitted to ICAO AELTS.

6.3.2.9

Does the test assess plain language proficiency in an aviation context?

Response and documentation submitted to ICAO AELTS.

6.3.2.10

Does the test avoid items that are designed to elicit highly technical or very context-specific language?

Response and documentation submitted to ICAO AELTS.

6.3.2.11

Is the final score for each test-taker the lowest of the scores in each of the six ICAO language proficiency skills?

Response and documentation submitted to ICAO AELTS.

Section 6.3.3

Test validity and reliability

Under evaluation

6.3.3.1

Is a statement of evidence for test validity and reliability accessible to all decision-makers in plain, layperson language?

Response and documentation submitted to ICAO AELTS.

6.3.3.2

Is a description of the development process that includes the following information accessible to all decision-makers: a) a summary of the development calendar? b) a report on each development phase?

Response and documentation submitted to ICAO AELTS.

6.3.3.3

Is an appraisal of the expected test washback effect on training accessible to all decision-makers?

Response and documentation submitted to ICAO AELTS.

Section 6.3.4

Rating

Under evaluation

6.3.4.1

Is the rating process documented?

Response and documentation submitted to ICAO AELTS.

6.3.4.2

To fulfil licensing requirements, do at least two assessors participate in the rating of tests, with a third expert rater consulted in case of divergent scores?

Response and documentation submitted to ICAO AELTS.

6.3.4.3

a) Are initial and recurrent rater training documented? b) Are rater training records maintained? c) Are assessors audited periodically and reports documented?

Response and documentation submitted to ICAO AELTS.

6.3.4.4

If rating is conducted using new technology, including speech recognition technology, is the correspondence of such rating to human rating, on all aspects of the Rating Scale, clearly demonstrated in layperson language?

Response and documentation submitted to ICAO AELTS.

Section 6.3.5

Test administration and security

Under evaluation

ICAO divides this section into test administration (6.3.5.1 to 6.3.5.7) and test security (6.3.5.8 to 6.3.5.11).

6.3.5.1

Is a complete sample of the test published, including the following: a) test-taker documents (paper instructions, screen display, etc.)? b) interlocutor instructions or prompts? c) rater documentation (answer key, rating scale, instructions)? d) one complete sample of audio recordings (for listening sections or semi-direct prompts)? e) a demonstration of test-taker/interlocutor interaction?

Response and documentation submitted to ICAO AELTS.

6.3.5.2

Is the test rating process documented, including instructions on the extent and nature of evidence that assessors should collect?

Response and documentation submitted to ICAO AELTS.

6.3.5.3

Are the test instructions to the test-taker, the test administration team and test assessors clearly documented?

Response and documentation submitted to ICAO AELTS.

6.3.5.4

Are the requirements for equipment, human resources and facilities necessary for the test included in the instructions?

Response and documentation submitted to ICAO AELTS.

6.3.5.5

Is the testing location moderately comfortable, private and quiet?

Response and documentation submitted to ICAO AELTS.

6.3.5.6

Is a full description of test administration policies and procedures available to all decision-makers? Does it include the following: a) policies and procedures for retaking the test? b) score reporting procedures? c) record-keeping arrangements? d) plans for quality control, test maintenance and ongoing test development? e) purchasing conditions?

Response and documentation submitted to ICAO AELTS.

6.3.5.7

Has a documented appeals process been established and made available to test-takers and decision-makers at the beginning of the testing process?

Response and documentation submitted to ICAO AELTS.

6.3.5.8

Is a full description of security measures required to ensure the integrity of the testing process documented and available to all decision-makers?

Response and documentation submitted to ICAO AELTS.

6.3.5.9

In the case of semi-direct prompts, are there adequate versions of the test to meet the needs of the population to be tested with respect to its size and diversity?

Response and documentation submitted to ICAO AELTS.

6.3.5.10

Are test questions and prompts held in confidence and not published or in any way provided to test-takers prior to the test event?

Response and documentation submitted to ICAO AELTS.

6.3.5.11

Is a documented policy for all aspects of test security accessible to all decision-makers?

Response and documentation submitted to ICAO AELTS.

Section 6.3.6

Record-keeping

Under evaluation

6.3.6.1

Are all proficiency tests of speaking ability involving interaction between the test-taker and interlocutor recorded on audio or video media?

Response and documentation submitted to ICAO AELTS.

6.3.6.2

Are evaluation sheets and supporting documentation filed for a predetermined and documented period of time of sufficient duration to ensure that rating decisions can no longer be appealed?

Response and documentation submitted to ICAO AELTS.

6.3.6.3

Is the record-keeping process adequate for the scope of the testing and documented?

Response and documentation submitted to ICAO AELTS.

6.3.6.4

Is the score-reporting process documented, and are scores retained for the duration of the licence?

Response and documentation submitted to ICAO AELTS.

6.3.6.5

Are results of testing held in strict confidence and released only to test-takers, their sponsors or employers, and the civil aviation authority, unless test-takers provide written permission to release their results to another person or organization?

Response and documentation submitted to ICAO AELTS.

Section 6.3.7

Organizational information and infrastructure

Under evaluation

6.3.7.1

Has an aviation language TSP provided clear information about its organization and its relationships with other organizations?

Response and documentation submitted to ICAO AELTS.

6.3.7.2

If a TSP is also a training provider, is there a clear and documented separation between the two activities?

Response and documentation submitted to ICAO AELTS.

6.3.7.3

Does the TSP employ sufficient numbers of qualified interlocutors and assessors to administer the required tests?

Response and documentation submitted to ICAO AELTS.

6.3.7.4

Has the TSP provided an explanation of how the test is maintained, including an explanation of how ongoing test development is conducted?

Response and documentation submitted to ICAO AELTS.

Section 6.3.8

Testing-team qualifications

Under evaluation

ICAO groups this section under familiarity with ICAO documentation, the test design and development team, the test administration team (administrators and interlocutors), and the rater team. In ELPAC, the two accredited assessors act as both interlocutor and rater in Paper 2.

6.3.8.2

Are all testing team members familiar with the following ICAO publications? a) the relevant SARPS and Recommended Practices of Annex 1? b) holistic descriptors (Appendix 1 to Annex 1) and the ICAO Rating Scale (Attachment A to Annex 1)? c) Manual on the Implementation of ICAO Language Proficiency Requirements (Doc 9835)? d) ICAO Rated Speech Samples CD?

Response and documentation submitted to ICAO AELTS.

6.3.8.3

Does the test design and development team include individuals with aviation operational, language test development, and linguistic expertise?

Response and documentation submitted to ICAO AELTS.

6.3.8.4

Do test administrators and interlocutors have a working knowledge of the test administration guidelines published by the test organization?

Response and documentation submitted to ICAO AELTS.

6.3.8.5

Do interlocutors demonstrate language proficiency of at least ICAO Extended level 5 in the language to be tested and proficiency at Expert level 6 if the test is designed to assess ICAO level 6 proficiency?

Response and documentation submitted to ICAO AELTS.

6.3.8.6

Have interlocutors successfully completed initial interlocutor training?

Response and documentation submitted to ICAO AELTS.

6.3.8.7

Have interlocutors successfully completed recurrent interlocutor training at least once each year?

Response and documentation submitted to ICAO AELTS.

6.3.8.8

Do interlocutors have appropriate aviation operational or language testing expertise, or both?

Response and documentation submitted to ICAO AELTS.

6.3.8.9

Do assessors demonstrate language proficiency of at least ICAO Extended level 5 in the language to be tested, and Expert level 6 if the test is designed to assess ICAO level 6 proficiency?

Response and documentation submitted to ICAO AELTS.

6.3.8.10

Are assessors familiar with aviation English and with any vocabulary and structures that will likely be elicited by the test prompts and interactions?

Response and documentation submitted to ICAO AELTS.

6.3.8.11

Have assessors successfully completed initial rater training?

Response and documentation submitted to ICAO AELTS.

6.3.8.12

Have assessors successfully completed recurrent rater training at least once each year?

Response and documentation submitted to ICAO AELTS.

Reference: ICAO Doc 9835, Manual on the Implementation of ICAO Language Proficiency Requirements, Second Edition, 2010, Appendix C, Checklist for aviation language testing, which restates the criteria of Chapter 6, paragraph 3. Checklist items are quoted from that document for the purpose of this self-assessment; the document itself is published by ICAO and is not reproduced here. Item 6.3.8.1 does not appear in the Appendix C table.

Related pages

Continue reading