apply answerability-audit repair queue: ACCEPT variants, derivability fixes, rubric rewrites (46 masters)
- MISSING_ALTERNATIVES (63/64 applied): uncontracted/contracted forms, digit variants (05|5), synonyms and full-sentence variants, via ACCEPT lines and inline gap alternatives; skipped 'better/fine' for the Opposites drill (not opposites of "sick"). - NOT_DERIVABLE (16 fixed, 10 false alarms, 1 skipped): item-level fixes (visible word hints, missing premise, speaker clarifications "Joe (to Jim):", emphasis/cue corrections, un-gapped unguessable words, rounded-number accepts); converted the two book-10 paragraph clozes (Mary / The Mall) from CHECK: exact to CHECK: llm with logical-completion rubrics; cross-book recycled vocab (pilot, teller, barber, variety store, ...) left alone. - UNCLEAR_TARGET (10): instruction/intro corrections (Food "Type the word for the food.", Explain-with-Too intro), cue/emphasis fixes. - Rubric rewrites (57): applied audit-suggested grader rubrics (now effective with the pre-item RUBRIC parser fix); moved the two per-item rubrics of book-11 "Write the Main Idea" inside their items. No clip-bearing line changed; all masters validate (0 errors, 0 new warnings) and pass stage-master clip-identity checks. Full decision log: reactor-module-tools module-convert/answerability-audit/APPLIED.md Co-authored-by: Cursor <cursoragent@cursor.com>
This commit is contained in:
@@ -350,7 +350,7 @@ INTRO: People move on — jobs change, letters stop, Aunt Virginia is suddenly i
|
||||
INSTRUCTION: Ask a question about the underlined person, then answer it using the remaining information.
|
||||
INPUT: speak
|
||||
CHECK: llm
|
||||
RUBRIC: The learner must form a question like "What ever happened to X?" followed by an answer stating "he/she no longer..." and the new situation from the cue.
|
||||
RUBRIC: The learner must ask "What (ever) happened to [person]?" and answer that the person no longer does the original activity (either "no longer" or "doesn't ... any longer"), followed by the new situation from the cue. Conversational fillers like "Well" or "Now" are fine.
|
||||
|
||||
EXAMPLE
|
||||
TEMPLATE: *Aunt Virginia* doesn't live in New York any longer. She moved to Texas last year.
|
||||
@@ -957,7 +957,7 @@ INTRO: You'll see pictures of people about to make questionable decisions. Ask w
|
||||
INSTRUCTION: Ask and answer questions about the pictures. Use the underlined words and "if".
|
||||
INPUT: speak
|
||||
CHECK: llm
|
||||
RUBRIC: The learner must ask "What will happen if...?" using the first phrase, and answer using the second phrase.
|
||||
RUBRIC: The learner must ask "What will happen if...?" using the first phrase, and answer using the second phrase. Accept answers with or without the repeated "if" clause, either clause order, and standard contractions.
|
||||
|
||||
EXAMPLE
|
||||
TEMPLATE: Ken wants to *try to pass the truck*. He can't see over the hill. *He'll hit the other car.* {st-page_025_001.jpg}
|
||||
@@ -1287,7 +1287,7 @@ INTRO: Read each little exchange, then ask a yes/no question about the underline
|
||||
INSTRUCTION: Ask and answer a question about the dialog using the underlined word.
|
||||
INPUT: speak
|
||||
CHECK: llm
|
||||
RUBRIC: The learner must form a yes/no question in the present perfect tense based on the dialog, and answer it correctly.
|
||||
RUBRIC: The learner must form a yes/no question in the present perfect tense based on the dialog, and answer it correctly — a short answer (e.g. "Yes, he has.") or a full sentence, with or without extra detail.
|
||||
|
||||
EXAMPLE
|
||||
TEMPLATE: Ted: How do you like Houston? Lee: I'm not sure. I've just *lived* here since May.
|
||||
@@ -1340,7 +1340,7 @@ INSTRUCTION: Ask a question about the story using the cue word, then answer it u
|
||||
INPUT: speak
|
||||
CHECK: llm
|
||||
SHOW_PROMPT
|
||||
RUBRIC: The learner must form a question starting with the cue word in the present perfect tense, and answer it accurately according to the story.
|
||||
RUBRIC: The learner must form a question starting with the cue word in the present perfect tense, and answer it accurately according to the story — a short fragment answer or a complete sentence both count.
|
||||
|
||||
EXAMPLE
|
||||
PROMPT: Donald has needed a new car for many years. (who)
|
||||
|
||||
Reference in New Issue
Block a user