apply answerability-audit repair queue: ACCEPT variants, derivability fixes, rubric rewrites (46 masters)
- MISSING_ALTERNATIVES (63/64 applied): uncontracted/contracted forms, digit variants (05|5), synonyms and full-sentence variants, via ACCEPT lines and inline gap alternatives; skipped 'better/fine' for the Opposites drill (not opposites of "sick"). - NOT_DERIVABLE (16 fixed, 10 false alarms, 1 skipped): item-level fixes (visible word hints, missing premise, speaker clarifications "Joe (to Jim):", emphasis/cue corrections, un-gapped unguessable words, rounded-number accepts); converted the two book-10 paragraph clozes (Mary / The Mall) from CHECK: exact to CHECK: llm with logical-completion rubrics; cross-book recycled vocab (pilot, teller, barber, variety store, ...) left alone. - UNCLEAR_TARGET (10): instruction/intro corrections (Food "Type the word for the food.", Explain-with-Too intro), cue/emphasis fixes. - Rubric rewrites (57): applied audit-suggested grader rubrics (now effective with the pre-item RUBRIC parser fix); moved the two per-item rubrics of book-11 "Write the Main Idea" inside their items. No clip-bearing line changed; all masters validate (0 errors, 0 new warnings) and pass stage-master clip-identity checks. Full decision log: reactor-module-tools module-convert/answerability-audit/APPLIED.md Co-authored-by: Cursor <cursoragent@cursor.com>
This commit is contained in:
@@ -160,7 +160,7 @@ ID: 3a-f2-b
|
||||
INPUT: type
|
||||
CHECK: exact
|
||||
INTRO: Same eight foods, now as questions. Listen and type the word for the food you see.
|
||||
INSTRUCTION: Type the word you hear.
|
||||
INSTRUCTION: Type the word for the food.
|
||||
|
||||
TEMPLATE: Number 1
|
||||
PROMPT: What's number 1? {page_054_001.jpg} {bk02-l3a-f2-09-q.mp3}
|
||||
@@ -1180,10 +1180,12 @@ REPEAT
|
||||
PROMPT: right {bk02-l3c-f7-01.mp3}
|
||||
TEMPLATE: w____ite
|
||||
RESPONSE: write {bk02-l3c-f7-01b.mp3}
|
||||
ACCEPT: r
|
||||
|
||||
PROMPT: dinner {bk02-l3c-f7-02.mp3}
|
||||
TEMPLATE: dinne____
|
||||
RESPONSE: dinner {bk02-l3c-f7-02.mp3}
|
||||
ACCEPT: r
|
||||
|
||||
PROMPT: breakfast {bk02-l3c-f7-03.mp3}
|
||||
TEMPLATE: br____eakfast
|
||||
@@ -1192,26 +1194,32 @@ RESPONSE: breakfast {bk02-l3c-f7-03.mp3}
|
||||
PROMPT: orange {bk02-l3c-f7-04.mp3}
|
||||
TEMPLATE: o____ange
|
||||
RESPONSE: orange {bk02-l3c-f7-04.mp3}
|
||||
ACCEPT: r
|
||||
|
||||
PROMPT: drink {bk02-l3c-f7-05.mp3}
|
||||
TEMPLATE: d____ink
|
||||
RESPONSE: drink {bk02-l3c-f7-05.mp3}
|
||||
ACCEPT: r
|
||||
|
||||
PROMPT: pear {bk02-l3c-f7-06.mp3}
|
||||
TEMPLATE: pea____
|
||||
RESPONSE: pear {bk02-l3c-f7-06.mp3}
|
||||
ACCEPT: r
|
||||
|
||||
PROMPT: water {bk02-l3c-f7-07.mp3}
|
||||
TEMPLATE: wate____
|
||||
RESPONSE: water {bk02-l3c-f7-07.mp3}
|
||||
ACCEPT: r
|
||||
|
||||
PROMPT: fruit {bk02-l3c-f7-08.mp3}
|
||||
TEMPLATE: f____uit
|
||||
RESPONSE: fruit {bk02-l3c-f7-08.mp3}
|
||||
ACCEPT: r
|
||||
|
||||
PROMPT: pork {bk02-l3c-f7-09.mp3}
|
||||
TEMPLATE: po____k
|
||||
RESPONSE: pork {bk02-l3c-f7-09.mp3}
|
||||
ACCEPT: r
|
||||
|
||||
PROMPT: rice {bk02-l3c-f7-10.mp3}
|
||||
TEMPLATE: ____ice
|
||||
@@ -1496,7 +1504,7 @@ INPUT: type
|
||||
CHECK: llm
|
||||
INTRO: Look at each picture, read the question, and type a short answer — "Yes, she is." or "No, they aren't."
|
||||
INSTRUCTION: Type the short answer.
|
||||
RUBRIC: Treat the model short answer as the key; accept equivalent contractions of the same answer (e.g. "No, they're not." for "No, they aren't."). The yes/no polarity of the model is the point — the opposite polarity fails.
|
||||
RUBRIC: Treat the model short answer as the key; accept full uncontracted forms (e.g. "No, they are not.") as well as equivalent contractions (e.g. "No, they're not."). The yes/no polarity of the model is the point — the opposite polarity fails.
|
||||
|
||||
TEMPLATE: Is she buying food? {st-page_102_001.jpg}
|
||||
RESPONSE: Yes, she is.
|
||||
@@ -1586,6 +1594,7 @@ RESPONSE: Yes, she is. {bk02-l3d-f2-ex-a.mp3}
|
||||
|
||||
PROMPT: Is Tom studying? {page_068_002.jpg} {bk02-l3d-f2-01-q.mp3}
|
||||
RESPONSE: No, he isn't. {bk02-l3d-f2-01-a.mp3}
|
||||
ACCEPT: No, he is not.
|
||||
|
||||
PROMPT: Is Jan Wilson buying food? {page_068_003.jpg} {bk02-l3d-f2-02-q.mp3}
|
||||
RESPONSE: Yes, she is. {bk02-l3d-f2-02-a.mp3}
|
||||
@@ -1595,9 +1604,11 @@ RESPONSE: Yes, he is. {bk02-l3d-f2-03-a.mp3}
|
||||
|
||||
PROMPT: Is Jan watching television? {page_068_005.jpg} {bk02-l3d-f2-04-q.mp3}
|
||||
RESPONSE: No, she isn't. {bk02-l3d-f2-04-a.mp3}
|
||||
ACCEPT: No, she is not.
|
||||
|
||||
PROMPT: Is Mrs. Wilson eating dinner? {page_068_006.jpg} {bk02-l3d-f2-05-q.mp3}
|
||||
RESPONSE: No, she isn't. {bk02-l3d-f2-05-a.mp3}
|
||||
ACCEPT: No, she is not.
|
||||
|
||||
$LESSON 3-6: Putting It All Together
|
||||
|
||||
|
||||
Reference in New Issue
Block a user