Assessing Advanced Listening: Find the Problem Before Choosing the Practice

By Mark Zolotar · Beyond English

Last updated: October 1, 2026

A learner says, “The recording was too fast.” Perhaps it was. Perhaps the words were unfamiliar. Perhaps the words were familiar on a page but disappeared when joined together in speech. Perhaps the learner heard the sentences and lost the argument connecting them.

Those problems can produce the same wrong answer. They do not call for exactly the same practice. Giving the learner another full listening test may confirm that there is a problem without telling either of you what to do about it.

In my earlier manuscript on assessing advanced learners, I distinguished knowing word meanings, catching what was said, and handling both together. Here I develop that teaching idea into a classroom investigation. These are working questions for a teacher, not a validated classification of learners or examinations.

Decide what the assessment is for

A certificate may be needed for admission. A teacher may need to plan the next lesson. A learner may need to follow a seminar well enough to ask a question. These purposes overlap, but they are not interchangeable.

For admission or another formal requirement, check the receiving institution’s accepted test, version, required scores and conditions. For preparation, use the test provider’s current material. My earlier manuscript included a survey of examinations; the more durable teaching question is what evidence each task gives us about this learner.

“Advanced” also needs a purpose. The Council of Europe’s CEFR Companion Volume describes C1 oral comprehension in terms that include following extended, complex discourse and recognising implied relationships. It also allows for clarification of occasional details, especially with an unfamiliar variety. Advanced listening is more than accumulating difficult words, and needing clarification does not automatically disqualify someone from being advanced.

Three questions to investigate

More than one problem can occur in the same passage. A transcript is a useful clue, not a laboratory instrument: it removes the audio, allows rereading and may make a sentence easier in several ways at once. Check the interpretation with another example.

My original third category combined demanding vocabulary with fluent speech. For lesson planning, it helps to ask an additional question inside that combination: once the words are understood, has the learner followed the speaker’s reasoning?

Use one short task to make the reasoning visible

The following is an original fictional briefing for classroom use. It is not an official examination question or a CEFR placement test. A teacher can read it aloud or record it, keeping the text hidden on the first attempt.

We had planned to start the pilot on Monday. The equipment has arrived, but the safety review is still open. Unless it is signed off by Friday afternoon, we will move the start to Wednesday. Please send the volunteer briefing today; it should describe the procedure without promising a start date. We will confirm that separately once the review is complete.

Ask the learner to identify the original start date, the condition for keeping it, the fallback date and the action required today. Then ask: “What start date, if any, can we confirm now?”

The intended interpretation is that Monday was planned; keeping it depends on sign-off by Friday afternoon; Wednesday is the stated fallback; and the briefing should be sent today without a promised date. A definite start date cannot yet be confirmed. The apparent tension between naming a fallback and withholding confirmation is part of what the listener must preserve.

If the learner says, “The pilot starts on Wednesday,” ask what in the recording makes that definite. If they understand signed off only after reading it, investigate recognition in speech. If it is unfamiliar even in print, investigate the expression’s meaning. If they know every word but miss unless, a list of rarer nouns is unlikely to address this particular error.

Keep the first attempt separate from supported practice

1. Record the first response. Use a short passage relevant to the learner’s goal. Note what was understood, missed or added.
2. Replay a relevant section. Ask where the evidence for the answer occurs. Record the effect of replay separately.
3. Show the transcript. Check vocabulary and sentence meaning. Compare these with what the learner heard.
4. Teach one obstacle. Work on an expression, a sound sequence or a relationship between ideas.
5. Try a different passage later. Use a comparable demand with new details to check whether the learning extends beyond the practised text.

Choose a response format that suits the question you are investigating. If you mainly want evidence of comprehension, concise notes or an explanation in a shared language may reveal more than insisting on polished English. If the goal is an English seminar response, assess that response too, while distinguishing what was understood from how it was expressed.

Replaying, pausing and using a transcript are teaching supports. Success with them should not be reported as success under the original listening conditions. Council of Europe guidance on listening assessment emphasises that both the text and the task affect difficulty. Keep those conditions in the record.

Match the practice to the obstacle

When meaning is missing

Build a small set of useful expressions from the learner’s target situations. Include a definition, a sentence and an audio example where available. Ask the learner to use the expression and later recognise it in a different passage. A long vocabulary list can be comforting to own and remarkably undemanding to ignore.

When familiar words disappear in speech

Work with a short segment. Ask what the learner heard before revealing the transcript. Locate the mismatch, listen again, and try another example with a similar feature. Choose speakers and varieties relevant to the learner’s likely encounters. The aim is comprehension, not imitation of a single preferred accent.

When the argument disappears

Have the learner reconstruct the relationship: proposal, reason, objection, condition, decision. In the briefing above, but, unless and the instruction to confirm separately are consequential. Advice to “just catch the key words” needs care when a small word controls the meaning.

One extension of the debate exercise in my manuscript is to ask learners to paraphrase an opponent’s position before replying. A listener checks whether the paraphrase preserves the claim and its qualification. This makes attentive listening necessary for the speaking task. It is a proposed exercise, not a claim that debate has been shown here to raise test scores.

Write a useful assessment note

An illustrative note might read: “First listen: identified the planned date and the action due today; treated the fallback as confirmed. After replay: noticed that confirmation was pending. Transcript: understood all expressions. Next task: another short briefing with a conditional decision, using different vocabulary.”

That note is more actionable than “weak listening.” It describes the evidence and the support provided without diagnosing a permanent trait. Use several tasks and occasions before making a broad judgment; topic knowledge, fatigue, recording quality and the response task may also affect performance.

For examination preparation, combine this work with current official practice and the provider’s scoring guidance. For academic or professional use, add the response the setting requires: a question, a summary, a decision or a written confirmation.

The assessment has earned its place in the lesson when it helps us choose the next piece of teaching. A number may still be required. It should arrive with an explanation of what it measures and what we will do with it.

Sources and adaptation note

Adapted from my supplied manuscript, Assessing Advanced Learners (2025 draft). This web edition develops the listening framework, adds the fictional briefing and assessment note, and omits the older catalogue of test specifications. It does not claim that the original manuscript was published or peer reviewed. Prepared with AI-assisted editing.

• Council of Europe (2020). CEFR Companion Volume, oral comprehension.
• Council of Europe. Listening comprehension, on the text and task conditions of assessment.
• He, L., & Jiang, Z. (2020). Assessing Second Language Listening Over the Past Twenty Years: A Review Within the Socio-Cognitive Framework. Frontiers in Psychology, 11, 2123. Further reading from the manuscript; it does not validate the classroom framework proposed here.

Related guides: IELTS preparation · the current TOEFL iBT · English in academic work · more writing by Mark Zolotar.