apply answerability-audit repair queue: ACCEPT variants, derivability fixes, rubric rewrites (46 masters)
- MISSING_ALTERNATIVES (63/64 applied): uncontracted/contracted forms, digit variants (05|5), synonyms and full-sentence variants, via ACCEPT lines and inline gap alternatives; skipped 'better/fine' for the Opposites drill (not opposites of "sick"). - NOT_DERIVABLE (16 fixed, 10 false alarms, 1 skipped): item-level fixes (visible word hints, missing premise, speaker clarifications "Joe (to Jim):", emphasis/cue corrections, un-gapped unguessable words, rounded-number accepts); converted the two book-10 paragraph clozes (Mary / The Mall) from CHECK: exact to CHECK: llm with logical-completion rubrics; cross-book recycled vocab (pilot, teller, barber, variety store, ...) left alone. - UNCLEAR_TARGET (10): instruction/intro corrections (Food "Type the word for the food.", Explain-with-Too intro), cue/emphasis fixes. - Rubric rewrites (57): applied audit-suggested grader rubrics (now effective with the pre-item RUBRIC parser fix); moved the two per-item rubrics of book-11 "Write the Main Idea" inside their items. No clip-bearing line changed; all masters validate (0 errors, 0 new warnings) and pass stage-master clip-identity checks. Full decision log: reactor-module-tools module-convert/answerability-audit/APPLIED.md Co-authored-by: Cursor <cursoragent@cursor.com>
This commit is contained in:
@@ -605,7 +605,7 @@ INTRO: Your turn to be the clock. For each picture, ask "What time is it?" and a
|
||||
INSTRUCTION: Ask and answer about the time on the clock.
|
||||
INPUT: speak
|
||||
CHECK: llm
|
||||
RUBRIC: Accept a "What time is it?" question followed by a correct reading of the time shown on the clock face using after/past/to/till/quarter/half phrasing.
|
||||
RUBRIC: Accept a correct reading of the time shown on the clock face using after/past/to/till/quarter/half phrasing, with or without the preliminary "What time is it?" question.
|
||||
|
||||
EXAMPLE
|
||||
TEMPLATE: {st-page_134_005.jpg}
|
||||
@@ -1616,6 +1616,7 @@ RESPONSE: He looked at his desk.
|
||||
|
||||
TEMPLATE: his pens pencils and calendar were there but his phone wasnt on his desk
|
||||
RESPONSE: His pens, pencils, and calendar were there, but his phone wasn't on his desk.
|
||||
ACCEPT: His pens, pencils and calendar were there, but his phone wasn't on his desk.
|
||||
|
||||
TEMPLATE: wheres my phone he asked
|
||||
RESPONSE: "Where's my phone?" he asked.
|
||||
@@ -1930,7 +1931,7 @@ INSTRUCTION: Write a short topic for the paragraph.
|
||||
INPUT: type
|
||||
CHECK: llm
|
||||
SHOW_PROMPT
|
||||
RUBRIC: Accept any short noun phrase that correctly identifies the subject of the paragraph (e.g. "Thermometers" for the first, "Tom's vacation" or "A trip to Mexico" for the second).
|
||||
RUBRIC: Accept any short topic description — a noun phrase, verb phrase, or short sentence — that correctly identifies the subject of the paragraph (e.g. "Thermometers" for the first, "Tom's vacation" or "A trip to Mexico" for the second).
|
||||
|
||||
PROMPT: Paragraph 1: We have two thermometers at home...
|
||||
RESPONSE: Thermometers
|
||||
|
||||
Reference in New Issue
Block a user