apply answerability-audit repair queue: ACCEPT variants, derivability fixes, rubric rewrites (46 masters)
- MISSING_ALTERNATIVES (63/64 applied): uncontracted/contracted forms, digit variants (05|5), synonyms and full-sentence variants, via ACCEPT lines and inline gap alternatives; skipped 'better/fine' for the Opposites drill (not opposites of "sick"). - NOT_DERIVABLE (16 fixed, 10 false alarms, 1 skipped): item-level fixes (visible word hints, missing premise, speaker clarifications "Joe (to Jim):", emphasis/cue corrections, un-gapped unguessable words, rounded-number accepts); converted the two book-10 paragraph clozes (Mary / The Mall) from CHECK: exact to CHECK: llm with logical-completion rubrics; cross-book recycled vocab (pilot, teller, barber, variety store, ...) left alone. - UNCLEAR_TARGET (10): instruction/intro corrections (Food "Type the word for the food.", Explain-with-Too intro), cue/emphasis fixes. - Rubric rewrites (57): applied audit-suggested grader rubrics (now effective with the pre-item RUBRIC parser fix); moved the two per-item rubrics of book-11 "Write the Main Idea" inside their items. No clip-bearing line changed; all masters validate (0 errors, 0 new warnings) and pass stage-master clip-identity checks. Full decision log: reactor-module-tools module-convert/answerability-audit/APPLIED.md Co-authored-by: Cursor <cursoragent@cursor.com>
This commit is contained in:
@@ -347,7 +347,7 @@ INTRO: Your turn to build both sides of the exchange. Use the cue lines to ask a
|
||||
INSTRUCTION: Ask and answer aloud, using a gerund in both.
|
||||
INPUT: speak
|
||||
CHECK: llm
|
||||
RUBRIC: Accept a correctly formed question and answer that both use gerunds and incorporate the cue words (e.g. "When did you begin playing soccer? I began playing soccer five years ago.").
|
||||
RUBRIC: Accept any correctly formed question and answer that both use gerunds and incorporate the cue information (e.g. "When did you begin playing soccer? I began playing soccer five years ago."). Synonyms like "start" for "begin", flexible pronouns, and varied time/age expressions are fine.
|
||||
|
||||
EXAMPLE
|
||||
TEMPLATE: when / did begin / play tennis / ?
|
||||
@@ -739,7 +739,7 @@ INTRO: Read each command or request, then do both jobs: ask what was said, and r
|
||||
INSTRUCTION: Ask and answer aloud about the sentence.
|
||||
INPUT: speak
|
||||
CHECK: llm
|
||||
RUBRIC: Accept a "What did he/she say?" or "What did he/she ask?" question followed by the correctly reported command using an infinitive (e.g. "He said to pick up Capt Walker at 1300.").
|
||||
RUBRIC: Accept a "What did he/she say?" or "What did he/she ask?" question followed by the correctly reported command using an infinitive — "said to", "told me to", or "asked me to" (e.g. "He said to pick up Capt Walker at 1300.").
|
||||
|
||||
EXAMPLE
|
||||
TEMPLATE: Report to the colonel at 1300.
|
||||
@@ -780,7 +780,7 @@ INTRO: Same idea, by ear this time. Listen to the request, then ask and report i
|
||||
INSTRUCTION: Listen, then ask and answer the reported question aloud.
|
||||
INPUT: speak
|
||||
CHECK: llm
|
||||
RUBRIC: The learner must form a question ("What did he ask you?") and answer it with the reported command using an infinitive ("He asked me to..."); for negative requests the answer must use "not to".
|
||||
RUBRIC: The learner must form a question ("What did he/she ask (you)?" or "What did he/she say?") and answer it with the reported command using an infinitive ("He/She asked/told me to..."); for negative requests the answer must use "not to".
|
||||
|
||||
EXAMPLE
|
||||
PROMPT: Will you pick up my clothes at the laundry?
|
||||
|
||||
Reference in New Issue
Block a user