Making mastery observable in Decoding the Code — the instructor's Unit 5 feedback, answered as one SAM design loop. Outcomes held; the evidence path tightened.
Tenneh C. Freeman · LDTC 605 · Learning Design & Technology · University of Maryland Global Campus
The reviewer read the Unit 5 prototype and flagged that some mastery evidence rests on judgment, not observation, and that nothing yet proves a teacher can perform the skills once the hints come off. Fixing that is a SAM design-loop pass: the six course learning outcomes do not move — that is Understanding by Design's job, the locked target — while the evidence path to each outcome gets tighter (Wiggins & McTighe, 2005; Allen & Sites, 2012). Adding observable criteria and one unassisted case narrows what counts as proof. That is iteration. Widening the course or adding a seventh outcome would have been scope drift; this does the opposite.
| Reviewer's point | Change in this iteration |
|---|---|
| Mastery criteria are too subjective — e.g., whether a routine "works." | Every Activity 3–6 criterion is rewritten as an observable look-for with a stated met/not-yet threshold. |
| Add a short rubric or checklist for Activities 3–6. | Four compact criterion-referenced checklists below, one per activity. |
| Clarify how learners show independent mastery after hints and feedback. | A new Cold Read final case: a fresh, unseen learner with every scaffold removed. |
The rest of the submission the reviewer praised — the CLO-to-activity alignment, the authentic tasks, the Lit Bit performance assessment, the UDL and non-punitive design — stays as built. This iteration touches evidence, not architecture.
Each checklist is criterion-referenced, not ranked. A teacher meets the criterion or does not yet; all criteria met is the gate. A near-miss returns one specific note and a single revision — the same mastery-gate logic already running in Activity 1, now written down for the activities that were carrying subjective language.
Before (Unit 5 alignment table): "The routine is subject-specific and classroom-ready — it either works in their room or it does not." This is the exact line the reviewer named. "Works" is unobservable to anyone but the teacher, weeks later.
After — Word-Study Routine Checklist (4/4 to pass):
| Look-for | Met when… |
|---|---|
| Own-unit terms | 5–8 terms are pulled from a unit the teacher is teaching in the next two weeks, not a generic list. |
| Accurate morphology | Each term is segmented into correct morphemes (root + at least one affix), with the meaning of each part named. |
| Runnable routine | The routine states the teacher move, a time box in minutes, and where it sits in a lesson. |
| Content, not just spelling | At least one term shows the morphology unlocking the term's concept (e.g., photo- + -synthesis → light-made), not only its decoding. |
"Works" is now replaced by three things another person can see: correct morphemes, classroom-ready specificity, and a morpheme-to-meaning link.
Before: a before-and-after with "a rationale for what stayed rigorous." Strong task, but "rigor" was left to the eye of the reader.
After — Lit Bit Rubric (4/4 to pass):
| Look-for | Met when… |
|---|---|
| Explicit, named support | The literacy support names the structured-literacy component it targets (from CLO 1) and its modality — no generic "scaffolding." |
| Rigor held, defined | The same grade-level standard and the same cognitive-demand verb appear on both sides of the before-and-after. Analyze stays analyze; it is not quietly reduced to identify. |
| Barrier → support link | The rationale names what would have blocked a struggling reader in the original and how the support removes that barrier without removing the thinking. |
| Deliverable by another teacher | Materials, timing, and teacher moves are specified closely enough that a colleague could run it cold. |
The "rigor held" row is the fix: rigor is now defined as same standard + unchanged demand verb, which is observable rather than felt.
Before: the justification "must tie to that student's specific barrier, not a generic checklist." Right instinct, no criteria.
After — Match Justification Checklist (4/4 to pass):
| Look-for | Met when… |
|---|---|
| Named barrier | The specific skill breakdown in the profile is named (e.g., "slow, accurate decoding that taxes working memory"), not "struggles with reading." |
| Tool → mechanism → barrier | Each tool is tied to what it does to that barrier, stated as a mechanism, not a feature list. |
| Discrimination | The teacher rejects at least one plausible-but-wrong tool and says why it does not fit this learner. |
| Access, not substitution | The tool supports access without performing the academic task for the student. |
The rejection criterion is the discriminator. Anyone can select from a list; naming why a reasonable tool is wrong for this learner is what proves the choice was diagnostic.
Before: the goal "must be measurable and evidence-based." True, but a teacher can call almost anything measurable.
After — Goal Quality Checklist (4/4 to pass):
| Look-for | Met when… |
|---|---|
| Specific practice | The goal names one structured-literacy practice the teacher will change, drawn from a marked item on the audit — not a general intention. |
| Observable indicator + date | The goal states what success will look like and when it will be checked. |
| Grounded in diagnosis | The goal names the student breakdown it addresses, resting on the diagnostic habit built in Activity 2. |
| Sized to a unit | It is one goal scoped to the coming unit, not a list of resolutions. |
The gap the reviewer named. Activities 1 and 2 give guided hints and feedback branches; the builds give templates and worked examples. That is the "I do" and the "we do." Nothing yet is a clean "you do." Gradual release of responsibility is only complete when the scaffold is withdrawn and the learner performs alone (Pearson & Gallagher, 1983). Without that step, the course demonstrates coached performance, not independent mastery — precisely the reviewer's concern.
The fix — Activity 07: Cold Read (final gate, spans CLO 1–6). A previously unseen learner profile and a small stack of that learner's real work: a decoding sample and a content-area text the learner has to access. No hints. No feedback branch. No template. No model answer shown until after the teacher commits.
In one pass, with nothing to lean on, the teacher:
1. Diagnoses the breakdown — decoding, fluency, or comprehension (CLO 2).
2. Names the structured-literacy component behind it (CLO 1).
3. Designs one literacy-embedded move that holds content rigor (CLO 4), using morphology where it fits (CLO 3).
4. Selects one accommodation matched to the barrier (CLO 5).
5. States the one goal they would track for this learner (CLO 6).
Pass criteria are the four checklists above, applied to a case the teacher was never coached through, with no revision loop on the first submission. A near-miss earns one feedback pass and then a second, different cold case — mastery is shown on a fresh learner, not on the one the course walked them through. That second-case rule is what separates transfer from memory of the guided example.
Cold Read is where the whole course converges: same six outcomes, every scaffold gone.
The six CLOs did not move. What moved is the proof: subjective "works" language became observable look-fors, and a guided course gained an unassisted demonstration. UbD fixed the target; SAM iterated the evidence path to it (Wiggins & McTighe, 2005; Allen & Sites, 2012). The tell that this is legitimate iteration and not scope-drift-by-prototype is direction — the course got narrower and more testable, not broader. A drift-by-prototype version would have bolted on a new outcome or a new content strand in response to the same feedback. This tightened what already existed.
Allen, M. W., & Sites, R. (2012). Leaving ADDIE for SAM: An agile model for developing the best learning experiences. ASTD Press.
CAST. (2018). Universal design for learning guidelines version 2.2. https://udlguidelines.cast.org
Moats, L. C. (2020). Speech to print: Language essentials for teachers (3rd ed.). Paul H. Brookes Publishing.
Pearson, P. D., & Gallagher, M. C. (1983). The instruction of reading comprehension. Contemporary Educational Psychology, 8(3), 317–344.
Wiggins, G., & McTighe, J. (2005). Understanding by design (2nd ed.). Association for Supervision and Curriculum Development.