The Five Techniques Diagnostic Assessment Actually Runs On

This is the education commute. Both voices on this show are synthesized. The judgment isn't. So imagine walking into your classroom and you are teaching this just flawless 40 minute lesson on fractions. Oh, setting the scene. Right. The pacing is great. The kids are quiet and you just feel like an absolute champion. But then at the very end of the period, you ask a wrap up question and you realize that like 80 % of the room didn't know what a numerator was to begin with. Oh, brutal.

Yeah, that is the worst feeling. It really is. That sinking feeling that is the exact nightmare diagnostic assessment is supposed to prevent. But when I went looking for the data on exactly how effective this practice is, I hit a massive... A completely blank wall, honestly. Totally blank. Today we are looking at two new blogs from the Education Endowment Foundation to figure out what diagnostic assessment actually looks like when the headline numbers completely vanish. It is a really fascinating absence to explore. Because, you know, you are absolutely right that months of progress figure is the gold standard we have all come to expect in education research.

Yeah, we look for it everywhere. Exactly. It is comfortable, it is binary, and it gives teachers and school leaders this sense of immediate actionable clarity. That is the routine, isn't it? You look at physical activity and the data clearly says plus two months progress. You look at social and emotional learning, SEL, and there it is, plus three months. Nice and tidy. Right. It feels like engineering. You implement X, you get Y months of progress. So going into today's prep on diagnostic assessment, I went straight to the Education Endowment Foundation materials, fully expecting it to be just like all those previous topics.

Looking for the magic number. I was so ready to bring you the grand reveal, you know, like, diagnostic assessment equals plus however many months. And that is precisely where the roadblock appears, because, well, there is no number. Not at all, just zero. There is no effect size, and there is no months of progress figure for diagnostic assessment. It simply does not exist in the data. Okay, let's untack this because my first reaction was complete confusion. I mean we've looked at so many interventions that have these crisp clear numbers.

Tons of them, yeah. Why on earth is diagnostic assessment standing out in the cold without a single metric to its name? To understand the reason behind that, we have to look at the structural root of what the teaching and learning toolkit actually is. Okay. When you look at physical activity or SEL, Those are very specific named entries in the toolkit. They are evaluated as isolated interventions. Like they are their own distinct thing. Right, they have their own dedicated evidence reviews. Diagnostic assessment on the other hand is not a numbered strand in the toolkit at all.

So it's not even its own category. No, it was never tested as an isolated intervention with its own independent evidence review. because diagnostic assessment isn't a single standalone program you can just, you know, buy in a box and drop into a school. Oh, I see. It is a formative practice. It is this thread that cuts across a dozen different strands rather than sitting there as its own distinct line item on a spreadsheet. I think we need to pause on that term for a second. Formative practice is one of those phrases that gets thrown around a lot in education.

It definitely does. But what does it actually mean in this context? It means It is about checking understanding while the learning is still happening, so you can change course in the moment. OK, right. It is the complete opposite of summative assessment, where you test them at the very end of a unit when it is already too late to fix the misunderstandings. Formative practice is ongoing. It is a continuous gathering of feedback. OK, that helps. So. Trying to put a single number on that. Is this like looking for the nutritional calories of stir -frying instead of the actual ingredients?

Oh, that is a great way to put it. Because it's the technique, not the food itself. The pan is the tool you use to cook the meal, but it doesn't have calories of its own. It's the mechanism you use to prepare the ingredients. Yes, that is a much more accurate way to visualize it. You measure the chicken, the vegetables, the oil. Diagnostic assessment is the frying pan. It is the technique used within other subjects and interventions, whether that is reading mathematics or science, to figure out where the gaps are.

Which means the honest absence of this number isn't a flaw in the research. Not at all. It isn't a sign that diagnostic assessment isn't evidence -based. It's just a fundamental misunderstanding of what it actually is. It is the vehicle, not the destination. Exactly. And our mission today... isn't to paper over that gap. We are not going to invent a number to make things sound cleaner. Definitely not. And we are certainly not going to borrow a number from an adjacent strand, like feedback or metacognition, and pretend it belongs here.

We need to explore this honest absence and figure out what the evidence actually gives us instead. So if we can't measure diagnostic assessment as a macro intervention, how do we know it's actually working on the ground? Let's look at the micro level. Yeah. What happens when a school tailors this to a specific problem? Exactly. The first of the two blogs from the Education Endowment Foundation focuses on case studies. How do they define this practice when it actually hits the classroom? Well, the core definition they provide is that diagnostic assessment is about identifying learning gaps.

But the crucial part is how you identify them. The guidance points to proactive techniques. It involves low stakes, retrieval quizzes, examining students' prior knowledge before you even start a new topic, and deliberately anticipating common misconceptions. The blog breaks this down into two distinct purposes, which I think is a really helpful framework for you listening right now as you think about your lesson planning. Yeah, it clarifies things a lot. First, you have the class level. This is the macro view. It's about identifying whole topics that need reteaching.

You do a quick assessment, realize a massive chunk of the room didn't grasp the concept, and you pivot your entire lesson plan. Right. Then you have the micro view. the individual level. This is where you are pinpointing specific pupils who would benefit from targeted intervention. The ones falling through the cracks. Precisely. The majority of the class might be fine, but you have a small handful of students who are completely lost, and now you know exactly who they are and what specific hurdle they are facing. To bring this out of the abstract, the blog highlights three specific case study schools.

And they are all utilizing different versions of this practice tailored entirely to their own contexts. The variation is what makes it really instructive. The first school is South Shore Academy up in Blackpool. Okay. They're focusing their diagnostic assessment specifically on reading. Instead of just noting that a student is a poor reader, What does diagnostic assessment actually look like in that scenario? How are they breaking that down? It is about moving past the symptom to find the disease. Right. Instead of a blanket label, they use specific diagnostic phonic checks to see where the breakdown is actually happening.

Is it at the decoding level, meaning the student is struggling to sound out the letters on the page? Or is it at the comprehension level? Exactly, meaning they can read the words fluently but have no idea what the sentence actually means. That makes total sense because the intervention for a decoding issue is completely different from the intervention for a comprehension issue. Worlds apart. If you just guess, you might spend six weeks treating the wrong problem. What about the second school? That is Walton High School down in Staffordshire.

Their focus is entirely on retrieval practice. Oh, interesting. Yeah. They're using diagnostic assessment to systematically pull information back to the front of students' minds and check what has actually stuck over time. So they aren't just assuming that because they taught it in September, the kids still know it in November, they are actively interrogating that retention. Yes. And the third school. The third is Burton and Primary Academy in Suffolk. They're using low -stakes quizzing, but they're specifically focusing on mapping the cognitive gaps for pupils with education, health, and care plans.

Ah, EHCPs. Yes, to provide highly targeted support for those EHCP pupils. Okay, so you have diagnostic phonic checks in Blackpool, systematic retrieval practice in Staffordshire, and low -stakes quizzing for EHCP pupils in Suffolk. Very different approaches. Three completely different applications of the exact same underlying concept. But here is my issue. As someone who naturally looks for the data to back up the story, I kept reading through these case studies waiting for the payoff. You wanted the numbers. I was looking for the outcome data, and there isn't any.

The blog does not report any test score bumps, no percentages of improvement, nothing. It states that these schools are, quote, monitoring and evaluating their own strategies impact. Wait, if there's no data to show this actually works, why are we even talking about these schools? Are we just guessing that South Shore and Walton are doing a good job? It is a fair challenge. But we have to remember what kind of data is valuable when we are talking about a formative practice. The absence of a neat statistical conclusion doesn't invalidate the practice.

Qualitative contextual evaluation is still validator for a school. Formative practice is highly dependent on the environment. So it's context heavy. Very. A strategy that brilliantly maps cognitive gaps in Suffolk might need tweaking before it works in Blackpool. Monitoring and evaluating means the schools are looking at the immediate daily impact on student understanding rather than waiting for a standardized test at the end of the year to tell them if the frying pan worked. I see. So we aren't going to get a neat little percentage. And the integrity of the findings is what matters on this commute.

Exactly. If the schools are still just monitoring and evaluating, then that is the truth of the situation. And we aren't going to invent an outcome just to make the narrative more satisfying for you guys listening. Which brings us to an important pivot. Because if we don't have a singular outcome data point to rely on, and we don't have a headline figure, how do we actually make use of this research? That's where the second blog from the Education Endowment Foundation comes in. It's focused on the mathematics classroom, but the concepts apply everywhere.

Yeah, across any subject. Honestly, it shifts the value of this entire conversation because it replaces that vague plus two months figure we were looking for with something infinitely more useful. Highly concrete, actionable techniques. A single number can sometimes trick a person into thinking a concept is just a magic wand, like you just do diagnostic assessment and the dial moves. Right, like slipping a switch. But this second piece outlines five tangible techniques. These are specific, checkable methods you can literally pick up and use in your classroom this afternoon.

And specific techniques you can use at 2 p .m. are arguably more useful than a statistical abstraction anyway. Let's walk through these five methods. The first one is quizzing, but specifically, brief retrieval at the very start of a lesson. The phrase low -stace is the critical element there. This is not a formal test that goes into a gradebook and causes anxiety. Nobody likes those. Right. It is a quick temperature check the moment students sit down. What do they remember from yesterday or last week? It primes the pump and gives you immediate data on the room before you introduce new material.

The second technique is the use of mini whiteboards. And many whiteboards are interesting because they solve a very specific visibility problem in the classroom. They really do. You don't just hear from the loudest kid in the front row who always raises their hand. It's mass participation. You ask a question, 30 boards go up in the air, and in two seconds you can see that 20 kids have the right answer, five have a specific variation of a wrong answer, and five are completely blank. It makes thinking visible in real time.

You have diagnosed the room's understanding without anyone feeling singled out or left behind. Yeah, it's brilliant. The third technique involves targeted questioning stems. This is about moving beyond asking, does everyone understand? Which we know is a practically useless question. They will all just nod. Always. Moving to highly specific framing instead. The guidance gives two examples of these stems. Asking pupils, give me an example of, or asking them, is this always, sometimes, or never true? I think that second one is fascinating. Always, sometimes, or never. Why does that particular stem stand out to you?

Because it forces the student to interrogate the boundaries of a concept. Right. If you just ask a standard yes or no question, they have a 50 -50 shot of guessing it right without actually understanding the material. Exactly. But always, sometimes, or never forces them to look for the ex - If you are teaching a rule in grammar or principle in physics, and they say the rule always applies when it only sometimes applies, you have just diagnosed a massive misconception in how they understand the architecture of the lesson.

It reveals the depth of their thinking rather than just their ability to recall a fact. The fourth technique listed in the blog is the use of online question banks. Oh, these are incredibly helpful because the algorithms do the heavy lifting for you. They really do. They flag exactly where a pupil is stuck. If a student misses five questions in a row on a digital platform, the system can often tell you the breakdown is happening right here at step two of this equation. That is just gold for a teacher.

It is. It provides that micro -level targeted intervention data we talked about earlier. It isolates the specific hurdle. But it is the fifth technique that I think requires the deepest look because it completely redefines how we think about multiple -choice questions. The hinge questions. Yes. If you take away nothing else from this commute today, let it be the mechanics of hinge questions. A hinge question is essentially a multiple -choice question placed at a critical point in the lesson, the hinge, where you need to know if the class is ready to move on to the next concept or if you need to stop and go back.

But the crucial detail is how you design the wrong answers. The wrong option's in a hinge question. The distractors aren't just random made -up mistakes. They shouldn't be, no. They aren't just silly numbers thrown in to fill out options B, C, and D. They are built from actual common misconceptions. What's fascinating here is how building wrong answers from real historical misconceptions completely changes the diagnostic power of the question. Let's slow down and really walk through the cognitive process of this because it's the ultimate aha moment for this practice.

Okay, let's do it. Imagine you are teaching a math concept. If the correct answer to your question is 25, And you make the wrong answers, 1004 and 99. Well, a student might guess 25 just because the other numbers look weird and out of place. Right. Or if they pick 99, you have no idea why they picked it. It was just a random guess. You know they are wrong, but you don't know how to help them. But if you design the distractors based on the exact mechanical errors students make year after year.

Exactly. Let's say option B is the exact answer a student gets if they forget to carry the one. Classic mistake. Right. Option C is the exact answer they get if they multiply instead of add. And option D is the exact answer they get if they apply the rule for fractions to decimals. So specific. Suddenly, it's not just a wrong answer. It is a diagnostic beacon. If a student selects option C, you don't just know that they failed to find the right answer. You know precisely why they are wrong.

Exactly. You know that in their mind they looked at the equation and their cognitive process led them to multiply. Which means your reteaching isn't just a generic, uh, let's try that again, guys. Watch me do it on the board. Right, which doesn't help the kids who add it. No. Your reteaching becomes incredibly laser focused. You can say, ah, I see a lot of you chose C. Let's talk about why we don't multiply in this specific step. It is brilliant. It brings us right back to the frying pan analogy.

You are using the tool to find the exact ingredient that is missing or the exact step in the recipe that went wrong. It shifts the intensity. paradigm of the classroom. Yeah. You are no longer guessing what they don't know. You are looking at a clear map of their cognitive missteps. Yeah. And you are doing this efficiently in real time. allowing the lesson to hinge on the actual understanding of the room rather than the rigid pacing of the syllabus. So if we look back at the journey we've been on this morning, we started out expecting a simple number, a shiny plus two months that we could pin to a notice board and feel good about.

And what we uncovered instead is a rich, detailed toolkit of daily structural practices. Which brings us to what we might call the honest staff room line. When you walk into your building today and a colleague asks what you've been reading up on, what is the ultimate takeaway? Here is the honest staff room line, exactly as it stands. Diagnostic assessment doesn't have its own headline figure because it is in its own strand, but the five techniques underneath it are specific, evidenced elsewhere, and free to try today.

Yes, exactly. It lacks a quantified entry in the toolkit, but it absolutely does not lack an evidential basis. Retrieval practice, formative assessment, these are heavily supported across the wider evidence base. They just don't sit under one singular umbrella term with a neat little bow on top. Precisely. So, as we wrap up, let's get you ready for the day. Here are three things off the drive for you to take into the building. Number one... There is no headline figure. None. Diagnostic assessment is not a toolkit strand in its own right, and we aren't going to pretend it is.

Number two. What does exist are five specific, highly usable techniques. This is not some vague, abstract educational concept. It is quizzing, mini whiteboards, targeted questioning stems, online question banks, and hinge questions. And number three. The honest truth is a longer sentence than a simple number. Plus, two months is incredibly easy to say. It is. Explaining that diagnostic assessment is a cross -cutting formative practice takes a little more breath. But it is worth saying properly, rather than borrowing a fake figure from somewhere else just to sound authoritative.

Accuracy over simplicity. It serves the students better in the long run. So here is a specific provocative thought for you to mull over and a task for tomorrow, or even today if you have a prep period. Oh, I like this. I want you to pick one hinge question for your next lesson. Just one. Make it a multiple choice question, but make absolutely sure that the wrong answers are built from a mistake you have actually seen your pupils make in the past. Yes, real mistakes. Don't make up random distractors.

Use their real historical misconceptions. Ask that question cold, right at the hinge of your lesson, and see exactly what those wrong answers tell you before the bell rings. Observe if the diagnostic power of that one question shifts how you teach the remaining 20 minutes of the class. Right. When a student chooses the Distractor built on multiplication instead of addition, watch how it changes your immediate feedback. I suspect you will find it far more illuminating than a broad, standardized test score. It will change the way you see their wrong answers forever.

They aren't failures, they are data points. A map of exactly what you need to do next. Very well said. Remember, all the sources we talked about today, the Education Endowment Foundation blogs, the specific case studies, they're all linked right there on the show notes. We're the trailer, not the film. Go read the full reports when you have the time. Safe trip in. Yeah. See you at the gates.