apply answerability-audit repair queue: ACCEPT variants, derivability fixes, rubric rewrites (46 masters)
- MISSING_ALTERNATIVES (63/64 applied): uncontracted/contracted forms, digit variants (05|5), synonyms and full-sentence variants, via ACCEPT lines and inline gap alternatives; skipped 'better/fine' for the Opposites drill (not opposites of "sick"). - NOT_DERIVABLE (16 fixed, 10 false alarms, 1 skipped): item-level fixes (visible word hints, missing premise, speaker clarifications "Joe (to Jim):", emphasis/cue corrections, un-gapped unguessable words, rounded-number accepts); converted the two book-10 paragraph clozes (Mary / The Mall) from CHECK: exact to CHECK: llm with logical-completion rubrics; cross-book recycled vocab (pilot, teller, barber, variety store, ...) left alone. - UNCLEAR_TARGET (10): instruction/intro corrections (Food "Type the word for the food.", Explain-with-Too intro), cue/emphasis fixes. - Rubric rewrites (57): applied audit-suggested grader rubrics (now effective with the pre-item RUBRIC parser fix); moved the two per-item rubrics of book-11 "Write the Main Idea" inside their items. No clip-bearing line changed; all masters validate (0 errors, 0 new warnings) and pass stage-master clip-identity checks. Full decision log: reactor-module-tools module-convert/answerability-audit/APPLIED.md Co-authored-by: Cursor <cursoragent@cursor.com>
This commit is contained in:
@@ -620,7 +620,7 @@ INSTRUCTION: Use the word in parentheses and make a new sentence.
|
||||
INPUT: speak
|
||||
CHECK: llm
|
||||
SHOW_PROMPT
|
||||
RUBRIC: The learner must form a new sentence incorporating the cue word into a "how to" structure. Usually this involves making the original sentence negative and stating the new action.
|
||||
RUBRIC: Require a negative sentence using "how to" with the cued action. Accept simple negative sentences as well as contrastive sentences using "but not" (e.g. "Pele showed Jimmy how to play soccer, but not baseball.").
|
||||
|
||||
EXAMPLE
|
||||
PROMPT: Pele showed Jimmy how to play soccer. (baseball)
|
||||
@@ -1503,7 +1503,7 @@ INSTRUCTION: Use the cues to answer the questions in complete sentences.
|
||||
INPUT: speak
|
||||
CHECK: llm
|
||||
SHOW_PROMPT
|
||||
RUBRIC: Accept a complete sentence answering the question with the cued information, including the time clause.
|
||||
RUBRIC: Accept any complete, grammatical sentence answering the question with the cued information, including the time clause. The time clause may come at the beginning or the end of the sentence.
|
||||
|
||||
EXAMPLE
|
||||
PROMPT: Did you see Harvey when you came in? (no, Mike)
|
||||
@@ -1540,7 +1540,7 @@ INTRO: Now you ask the questions. Read the sentence and ask a question about its
|
||||
INSTRUCTION: Ask a question about the underlined part of the sentence.
|
||||
INPUT: speak
|
||||
CHECK: llm
|
||||
RUBRIC: The learner must form a question that targets the emphasized part of the sentence.
|
||||
RUBRIC: The learner must form a question that targets the emphasized part of the sentence. Accept valid questions whether or not they include the non-emphasized time clause.
|
||||
|
||||
EXAMPLE
|
||||
TEMPLATE: Michael saw *Captain Jackson* while he was working.
|
||||
|
||||
Reference in New Issue
Block a user