apply answerability-audit repair queue: ACCEPT variants, derivability fixes, rubric rewrites (46 masters)
- MISSING_ALTERNATIVES (63/64 applied): uncontracted/contracted forms, digit variants (05|5), synonyms and full-sentence variants, via ACCEPT lines and inline gap alternatives; skipped 'better/fine' for the Opposites drill (not opposites of "sick"). - NOT_DERIVABLE (16 fixed, 10 false alarms, 1 skipped): item-level fixes (visible word hints, missing premise, speaker clarifications "Joe (to Jim):", emphasis/cue corrections, un-gapped unguessable words, rounded-number accepts); converted the two book-10 paragraph clozes (Mary / The Mall) from CHECK: exact to CHECK: llm with logical-completion rubrics; cross-book recycled vocab (pilot, teller, barber, variety store, ...) left alone. - UNCLEAR_TARGET (10): instruction/intro corrections (Food "Type the word for the food.", Explain-with-Too intro), cue/emphasis fixes. - Rubric rewrites (57): applied audit-suggested grader rubrics (now effective with the pre-item RUBRIC parser fix); moved the two per-item rubrics of book-11 "Write the Main Idea" inside their items. No clip-bearing line changed; all masters validate (0 errors, 0 new warnings) and pass stage-master clip-identity checks. Full decision log: reactor-module-tools module-convert/answerability-audit/APPLIED.md Co-authored-by: Cursor <cursoragent@cursor.com>
This commit is contained in:
@@ -46,7 +46,7 @@ INTRO: Now for giving instructions, step by step — locking doors, making sandw
|
||||
INSTRUCTION: Type words that complete each step logically.
|
||||
INPUT: type
|
||||
CHECK: llm
|
||||
RUBRIC: Treat the model answer as a guide, not the only key. Accept any verbs and nouns that make each step logical and grammatical for the stated task; reject completions that make a step impossible or nonsensical.
|
||||
RUBRIC: Treat the model answer as a guide, not the only key. Accept any verbs and nouns that make each step logical and grammatical for the stated task, whether the learner types only the missing words or retypes the full step sentences; reject completions that make a step impossible or nonsensical.
|
||||
|
||||
TEMPLATE: To lock the door
|
||||
TEMPLATE: 1st: Walk to ____.
|
||||
@@ -119,6 +119,7 @@ RESPONSE: They have a Spanish test tomorrow.
|
||||
|
||||
TEMPLATE: linda didnt study for the test
|
||||
RESPONSE: Linda didn't study for the test.
|
||||
ACCEPT: Linda did not study for the test.
|
||||
|
||||
# SKIPPED (book): "DATES" — instructor-read dictation of dates with no printed stimuli. Dropped.
|
||||
|
||||
@@ -381,7 +382,7 @@ RESPONSE: The teacher's desk is large.
|
||||
TEMPLATE: Mary has *a lot of* homework. Susan has ____{a little} homework.
|
||||
RESPONSE: Susan has a little homework.
|
||||
|
||||
TEMPLATE: I bought a *one-way* ticket to my country. Helen bought a ____{round-trip} ticket.
|
||||
TEMPLATE: I bought a *one-way* ticket to my country. Helen bought a ____{round-trip|round trip} ticket.
|
||||
RESPONSE: Helen bought a round-trip ticket.
|
||||
|
||||
TEMPLATE: The radio is *on*. The television is ____{off}.
|
||||
|
||||
Reference in New Issue
Block a user