apply answerability-audit repair queue: ACCEPT variants, derivability fixes, rubric rewrites (46 masters)
- MISSING_ALTERNATIVES (63/64 applied): uncontracted/contracted forms, digit variants (05|5), synonyms and full-sentence variants, via ACCEPT lines and inline gap alternatives; skipped 'better/fine' for the Opposites drill (not opposites of "sick"). - NOT_DERIVABLE (16 fixed, 10 false alarms, 1 skipped): item-level fixes (visible word hints, missing premise, speaker clarifications "Joe (to Jim):", emphasis/cue corrections, un-gapped unguessable words, rounded-number accepts); converted the two book-10 paragraph clozes (Mary / The Mall) from CHECK: exact to CHECK: llm with logical-completion rubrics; cross-book recycled vocab (pilot, teller, barber, variety store, ...) left alone. - UNCLEAR_TARGET (10): instruction/intro corrections (Food "Type the word for the food.", Explain-with-Too intro), cue/emphasis fixes. - Rubric rewrites (57): applied audit-suggested grader rubrics (now effective with the pre-item RUBRIC parser fix); moved the two per-item rubrics of book-11 "Write the Main Idea" inside their items. No clip-bearing line changed; all masters validate (0 errors, 0 new warnings) and pass stage-master clip-identity checks. Full decision log: reactor-module-tools module-convert/answerability-audit/APPLIED.md Co-authored-by: Cursor <cursoragent@cursor.com>
This commit is contained in:
@@ -667,7 +667,7 @@ INSTRUCTION: Ask the question and answer yes or no.
|
||||
INPUT: speak
|
||||
CHECK: llm
|
||||
SHOW_PROMPT
|
||||
RUBRIC: Accept a question using everyone or everybody with a singular verb, and a logical Yes/No answer matching the grammar of the example.
|
||||
RUBRIC: Accept a question using everyone or everybody with a singular verb, followed by a logical yes/no answer — complete or short, with either "everyone" or "everybody".
|
||||
|
||||
EXAMPLE
|
||||
PROMPT: like to go to the mall
|
||||
@@ -995,7 +995,7 @@ INSTRUCTION: Ask and answer based on the cues.
|
||||
INPUT: speak
|
||||
CHECK: llm
|
||||
SHOW_PROMPT
|
||||
RUBRIC: The learner must form a question from the first cue and answer it correctly based on the second cue, following the pattern of the examples.
|
||||
RUBRIC: The learner must form a simple-present question from the first cue and answer it correctly based on the second cue. Either "the" or "your" is fine in the question, and the answer may be full or short (e.g. "Yes, it does.").
|
||||
|
||||
EXAMPLE
|
||||
PROMPT: plane/leave/tonight (yes)
|
||||
@@ -1522,25 +1522,27 @@ ANSWER: 5
|
||||
# Source: ST §Writing Skill: Mary
|
||||
$PRODUCE Complete the Paragraph: Mary
|
||||
ID: l2-s26
|
||||
INTRO: A short paragraph about Mary and her test score. Type the missing words to complete it.
|
||||
INTRO: A short paragraph about Mary and her test score. Type the missing words to complete it. More than one good answer is possible, so just be logical.
|
||||
INSTRUCTION: Type the missing words to complete the paragraph.
|
||||
INPUT: type
|
||||
CHECK: exact
|
||||
CHECK: llm
|
||||
LONGFORM
|
||||
RUBRIC: Treat the model answer as a guide, not the only key. Accept any words that complete the paragraph logically and grammatically, whether the learner types only the missing words or the full paragraph; reject completions that make a sentence nonsensical or ungrammatical.
|
||||
|
||||
TEMPLATE: Mary is a ____{happy} girl because she made a ____{high} score on her test. Now she can ____{enjoy} her weekend. She knows she will ____{graduate}.
|
||||
TEMPLATE: Mary is a ____ girl because she made a ____ score on her test. Now she can ____ her weekend. She knows she will ____.
|
||||
RESPONSE: Mary is a happy girl because she made a high score on her test. Now she can enjoy her weekend. She knows she will graduate.
|
||||
|
||||
# Source: ST §Writing Skill: The Mall
|
||||
$PRODUCE Complete the Paragraph: The Mall
|
||||
ID: l2-s27
|
||||
INTRO: One more paragraph — everything you know about malls, with gaps. Type the missing words.
|
||||
INTRO: One more paragraph — everything you know about malls, with gaps. Type the missing words. More than one good answer is possible, so just be logical.
|
||||
INSTRUCTION: Type the missing words to complete the paragraph.
|
||||
INPUT: type
|
||||
CHECK: exact
|
||||
CHECK: llm
|
||||
LONGFORM
|
||||
RUBRIC: Treat the model answer as a guide, not the only key. Accept any words that complete the paragraph logically and grammatically, whether the learner types only the missing words or the full paragraph; reject completions that make a sentence nonsensical or ungrammatical.
|
||||
|
||||
TEMPLATE: People like to shop at a ____{mall}. They can park in the ____{parking lot}. There are ____{department stores} and many other kinds of stores. Often there are many places to ____{eat} at while you shop. It's ____{nice} to ____{go shopping} at a ____{shopping center}.
|
||||
TEMPLATE: People like to shop at a ____. They can park in the ____. There are ____ and many other kinds of stores. Often there are many places to ____ at while you shop. It's ____ to ____ at a ____.
|
||||
RESPONSE: People like to shop at a mall. They can park in the parking lot. There are department stores and many other kinds of stores. Often there are many places to eat at while you shop. It's nice to go shopping at a shopping center.
|
||||
|
||||
# Source: LLA 2B Figure 7
|
||||
|
||||
Reference in New Issue
Block a user