apply answerability-audit repair queue: ACCEPT variants, derivability fixes, rubric rewrites (46 masters)

- MISSING_ALTERNATIVES (63/64 applied): uncontracted/contracted forms, digit
  variants (05|5), synonyms and full-sentence variants, via ACCEPT lines and
  inline gap alternatives; skipped 'better/fine' for the Opposites drill (not
  opposites of "sick").
- NOT_DERIVABLE (16 fixed, 10 false alarms, 1 skipped): item-level fixes
  (visible word hints, missing premise, speaker clarifications "Joe (to Jim):",
  emphasis/cue corrections, un-gapped unguessable words, rounded-number
  accepts); converted the two book-10 paragraph clozes (Mary / The Mall) from
  CHECK: exact to CHECK: llm with logical-completion rubrics; cross-book
  recycled vocab (pilot, teller, barber, variety store, ...) left alone.
- UNCLEAR_TARGET (10): instruction/intro corrections (Food "Type the word for
  the food.", Explain-with-Too intro), cue/emphasis fixes.
- Rubric rewrites (57): applied audit-suggested grader rubrics (now effective
  with the pre-item RUBRIC parser fix); moved the two per-item rubrics of
  book-11 "Write the Main Idea" inside their items.

No clip-bearing line changed; all masters validate (0 errors, 0 new warnings)
and pass stage-master clip-identity checks. Full decision log:
reactor-module-tools module-convert/answerability-audit/APPLIED.md

Co-authored-by: Cursor <cursoragent@cursor.com>
This commit is contained in:
2026-08-05 12:08:14 +08:00
parent 2d90d05bc5
commit 61234fe36b
46 changed files with 154 additions and 128 deletions

View File

@@ -667,7 +667,7 @@ INSTRUCTION: Ask the question and answer yes or no.
INPUT: speak
CHECK: llm
SHOW_PROMPT
RUBRIC: Accept a question using everyone or everybody with a singular verb, and a logical Yes/No answer matching the grammar of the example.
RUBRIC: Accept a question using everyone or everybody with a singular verb, followed by a logical yes/no answer — complete or short, with either "everyone" or "everybody".
EXAMPLE
PROMPT: like to go to the mall
@@ -995,7 +995,7 @@ INSTRUCTION: Ask and answer based on the cues.
INPUT: speak
CHECK: llm
SHOW_PROMPT
RUBRIC: The learner must form a question from the first cue and answer it correctly based on the second cue, following the pattern of the examples.
RUBRIC: The learner must form a simple-present question from the first cue and answer it correctly based on the second cue. Either "the" or "your" is fine in the question, and the answer may be full or short (e.g. "Yes, it does.").
EXAMPLE
PROMPT: plane/leave/tonight (yes)
@@ -1522,25 +1522,27 @@ ANSWER: 5
# Source: ST §Writing Skill: Mary
$PRODUCE Complete the Paragraph: Mary
ID: l2-s26
INTRO: A short paragraph about Mary and her test score. Type the missing words to complete it.
INTRO: A short paragraph about Mary and her test score. Type the missing words to complete it. More than one good answer is possible, so just be logical.
INSTRUCTION: Type the missing words to complete the paragraph.
INPUT: type
CHECK: exact
CHECK: llm
LONGFORM
RUBRIC: Treat the model answer as a guide, not the only key. Accept any words that complete the paragraph logically and grammatically, whether the learner types only the missing words or the full paragraph; reject completions that make a sentence nonsensical or ungrammatical.
TEMPLATE: Mary is a ____{happy} girl because she made a ____{high} score on her test. Now she can ____{enjoy} her weekend. She knows she will ____{graduate}.
TEMPLATE: Mary is a ____ girl because she made a ____ score on her test. Now she can ____ her weekend. She knows she will ____.
RESPONSE: Mary is a happy girl because she made a high score on her test. Now she can enjoy her weekend. She knows she will graduate.
# Source: ST §Writing Skill: The Mall
$PRODUCE Complete the Paragraph: The Mall
ID: l2-s27
INTRO: One more paragraph — everything you know about malls, with gaps. Type the missing words.
INTRO: One more paragraph — everything you know about malls, with gaps. Type the missing words. More than one good answer is possible, so just be logical.
INSTRUCTION: Type the missing words to complete the paragraph.
INPUT: type
CHECK: exact
CHECK: llm
LONGFORM
RUBRIC: Treat the model answer as a guide, not the only key. Accept any words that complete the paragraph logically and grammatically, whether the learner types only the missing words or the full paragraph; reject completions that make a sentence nonsensical or ungrammatical.
TEMPLATE: People like to shop at a ____{mall}. They can park in the ____{parking lot}. There are ____{department stores} and many other kinds of stores. Often there are many places to ____{eat} at while you shop. It's ____{nice} to ____{go shopping} at a ____{shopping center}.
TEMPLATE: People like to shop at a ____. They can park in the ____. There are ____ and many other kinds of stores. Often there are many places to ____ at while you shop. It's ____ to ____ at a ____.
RESPONSE: People like to shop at a mall. They can park in the parking lot. There are department stores and many other kinds of stores. Often there are many places to eat at while you shop. It's nice to go shopping at a shopping center.
# Source: LLA 2B Figure 7