apply answerability-audit repair queue: ACCEPT variants, derivability fixes, rubric rewrites (46 masters)

- MISSING_ALTERNATIVES (63/64 applied): uncontracted/contracted forms, digit
  variants (05|5), synonyms and full-sentence variants, via ACCEPT lines and
  inline gap alternatives; skipped 'better/fine' for the Opposites drill (not
  opposites of "sick").
- NOT_DERIVABLE (16 fixed, 10 false alarms, 1 skipped): item-level fixes
  (visible word hints, missing premise, speaker clarifications "Joe (to Jim):",
  emphasis/cue corrections, un-gapped unguessable words, rounded-number
  accepts); converted the two book-10 paragraph clozes (Mary / The Mall) from
  CHECK: exact to CHECK: llm with logical-completion rubrics; cross-book
  recycled vocab (pilot, teller, barber, variety store, ...) left alone.
- UNCLEAR_TARGET (10): instruction/intro corrections (Food "Type the word for
  the food.", Explain-with-Too intro), cue/emphasis fixes.
- Rubric rewrites (57): applied audit-suggested grader rubrics (now effective
  with the pre-item RUBRIC parser fix); moved the two per-item rubrics of
  book-11 "Write the Main Idea" inside their items.

No clip-bearing line changed; all masters validate (0 errors, 0 new warnings)
and pass stage-master clip-identity checks. Full decision log:
reactor-module-tools module-convert/answerability-audit/APPLIED.md

Co-authored-by: Cursor <cursoragent@cursor.com>
This commit is contained in:
2026-08-05 12:08:14 +08:00
parent 2d90d05bc5
commit 61234fe36b
46 changed files with 154 additions and 128 deletions

View File

@@ -90,35 +90,35 @@ REPEAT
PROMPT: Who's doing his homework? {bk03-l2a-f2-09-q.mp3}
RESPONSE: John {bk03-l2a-f2-09-a.mp3}
ACCEPT: John's doing his homework.
ACCEPT: John's doing his homework. | John is doing his homework.
PROMPT: Who's eating dinner? {bk03-l2a-f2-10-q.mp3}
RESPONSE: Linda {bk03-l2a-f2-10-a.mp3}
ACCEPT: Linda's eating dinner.
ACCEPT: Linda's eating dinner. | Linda is eating dinner.
PROMPT: Who's reading a book? {bk03-l2a-f2-11-q.mp3}
RESPONSE: Tom {bk03-l2a-f2-11-a.mp3}
ACCEPT: Tom's reading a book.
ACCEPT: Tom's reading a book. | Tom is reading a book.
PROMPT: Who's drinking coffee? {bk03-l2a-f2-12-q.mp3}
RESPONSE: a doctor {bk03-l2a-f2-12-a.mp3}
ACCEPT: A doctor's drinking coffee.
ACCEPT: A doctor's drinking coffee. | A doctor is drinking coffee. | the doctor | The doctor's drinking coffee. | The doctor is drinking coffee.
PROMPT: Who's buying a book? {bk03-l2a-f2-13-q.mp3}
RESPONSE: Mr. Wilson {bk03-l2a-f2-13-a.mp3}
ACCEPT: Mr. Wilson's buying a book.
ACCEPT: Mr. Wilson's buying a book. | Mr. Wilson is buying a book.
PROMPT: Who's looking at pictures? {bk03-l2a-f2-14-q.mp3}
RESPONSE: Mrs. Wilson {bk03-l2a-f2-14-a.mp3}
ACCEPT: Mrs. Wilson's looking at pictures.
ACCEPT: Mrs. Wilson's looking at pictures. | Mrs. Wilson is looking at pictures.
PROMPT: Who's going to the mess hall? {bk03-l2a-f2-15-q.mp3}
RESPONSE: a pilot {bk03-l2a-f2-15-a.mp3}
ACCEPT: A pilot's going to the mess hall.
ACCEPT: A pilot's going to the mess hall. | A pilot is going to the mess hall. | the pilot | The pilot's going to the mess hall. | The pilot is going to the mess hall.
PROMPT: Who's standing outside? {bk03-l2a-f2-16-q.mp3}
RESPONSE: Bob {bk03-l2a-f2-16-a.mp3}
ACCEPT: Bob is standing outside.
ACCEPT: Bob is standing outside. | Bob's standing outside.
# Source: ST §Who Writes on the Chalkboard?
$DIALOGUE Who Questions and Answers
@@ -421,7 +421,7 @@ INSTRUCTION: Say what you want.
INPUT: speak
CHECK: llm
SHOW_PROMPT
RUBRIC: Accept any natural "I want ..." sentence naming at least one food or drink; the choice of items is the learner's.
RUBRIC: Accept any natural sentence ordering food or drink, including expressions like "I want ...", "I'd like ...", "I would like ...", or "Can I have ...". The choice of items is the learner's.
EXAMPLE
PROMPT: What do you want to eat and drink?
@@ -463,7 +463,7 @@ INTRO: Look at each picture, ask a yes/no question about the vehicle, and answer
INSTRUCTION: Ask and answer aloud about the picture.
INPUT: speak
CHECK: llm
RUBRIC: Treat the model answer's vehicle as the factual key. Accept any yes/no question about the vehicle followed by a short answer naming that same vehicle, in any natural phrasing.
RUBRIC: Treat the model answer's vehicle as the factual key. Accept any yes/no question about the vehicle followed by a correct short answer — either naming that vehicle (e.g. "No, it's a plane.") or a plain "Yes, it is." / "No, it isn't." whose polarity matches the model.
EXAMPLE
PROMPT: {st-page_048_004.jpg}
@@ -773,7 +773,7 @@ INTRO: Tom again, hour by hour. For each picture, ask what Tom does at that time
INSTRUCTION: Ask and answer aloud about the picture.
INPUT: speak
CHECK: llm
RUBRIC: Treat the model answer as the factual key. Accept a "What does Tom do at [time]?" question plus an answer describing the same action as the model, in any phrasing.
RUBRIC: Treat the model answer as the factual key. Accept a question asking what Tom does or is doing (with or without the exact time), plus an answer describing the same action as the model in simple present or present continuous, in any phrasing (e.g. "goes out of the lab" for "leaves the lab").
PROMPT: {st-page_052_001.jpg}
RESPONSE: What does Tom do at 7:30? He opens the window.