apply answerability-audit repair queue: ACCEPT variants, derivability fixes, rubric rewrites (46 masters)
- MISSING_ALTERNATIVES (63/64 applied): uncontracted/contracted forms, digit variants (05|5), synonyms and full-sentence variants, via ACCEPT lines and inline gap alternatives; skipped 'better/fine' for the Opposites drill (not opposites of "sick"). - NOT_DERIVABLE (16 fixed, 10 false alarms, 1 skipped): item-level fixes (visible word hints, missing premise, speaker clarifications "Joe (to Jim):", emphasis/cue corrections, un-gapped unguessable words, rounded-number accepts); converted the two book-10 paragraph clozes (Mary / The Mall) from CHECK: exact to CHECK: llm with logical-completion rubrics; cross-book recycled vocab (pilot, teller, barber, variety store, ...) left alone. - UNCLEAR_TARGET (10): instruction/intro corrections (Food "Type the word for the food.", Explain-with-Too intro), cue/emphasis fixes. - Rubric rewrites (57): applied audit-suggested grader rubrics (now effective with the pre-item RUBRIC parser fix); moved the two per-item rubrics of book-11 "Write the Main Idea" inside their items. No clip-bearing line changed; all masters validate (0 errors, 0 new warnings) and pass stage-master clip-identity checks. Full decision log: reactor-module-tools module-convert/answerability-audit/APPLIED.md Co-authored-by: Cursor <cursoragent@cursor.com>
This commit is contained in:
@@ -96,7 +96,7 @@ INTRO: Back to gerunds — the -ing forms after verbs like begin, enjoy, and fin
|
||||
INSTRUCTION: Make a question from the cues, then answer with the second cue. Use a gerund.
|
||||
INPUT: speak
|
||||
CHECK: llm
|
||||
RUBRIC: The verb + gerund pattern is the point — the second verb must appear as a gerund (working, studying, reading, washing); a missing -ing form fails. The question's tense should match the model answer. Otherwise accept any natural phrasing of the question and full-sentence answer.
|
||||
RUBRIC: Require both the question and the full-sentence answer — reject if either part is omitted. The verb + gerund pattern is the point: the second verb must appear as a gerund (working, studying, reading, washing) in both parts; a missing -ing form fails. The question's tense should match the model answer. Otherwise accept any natural phrasing.
|
||||
|
||||
EXAMPLE
|
||||
TEMPLATE: when / begin work / restaurant — last month
|
||||
@@ -137,7 +137,7 @@ INSTRUCTION: Answer aloud, using "be able to".
|
||||
INPUT: speak
|
||||
CHECK: llm
|
||||
SHOW_PROMPT
|
||||
RUBRIC: Treat the model answer as the factual key; accept any phrasing of the same fact, as long as it uses "was able to", "wasn't able to", or "be able to" as appropriate — that pattern is the point.
|
||||
RUBRIC: Treat the model answer as the factual key; accept any phrasing of the same fact, as long as it uses "was able to", "wasn't able to" (or "was not able to"), or "be able to" as appropriate — that pattern is the point.
|
||||
|
||||
PROMPT: Where was Jim able to go on his vacation last year?
|
||||
RESPONSE: He was able to go to London.
|
||||
@@ -457,16 +457,16 @@ INSTRUCTION: Type the missing words.
|
||||
INPUT: type
|
||||
CHECK: exact
|
||||
|
||||
TEMPLATE: Mary works for the family ____{company}. The store sells towels, sheets, bed ____{covers} and pillows. Her dad is the ____{boss}. When he's ____{out of} town, she does his job.
|
||||
TEMPLATE: Mary works for the family ____{company|store|business}. The store sells towels, sheets, bed ____{covers} and pillows. Her dad is the ____{boss}. When he's ____{out of} town, she does his job.
|
||||
RESPONSE: Mary works for the family company. The store sells towels, sheets, bed covers and pillows. Her dad is the boss. When he's out of town, she does his job.
|
||||
|
||||
TEMPLATE: Next Saturday Mary is going to marry a ____{famous} writer. The ____{marriage} will be in another town. ____{It takes} two hours to get there from the store.
|
||||
TEMPLATE: Next Saturday Mary is going to marry a famous writer. The ____{marriage|wedding} will be in another town. ____{It takes} two hours to get there from the store.
|
||||
RESPONSE: Next Saturday Mary is going to marry a famous writer. The marriage will be in another town. It takes two hours to get there from the store.
|
||||
|
||||
TEMPLATE: All the people in the store want to go to the wedding, but the store ____{is supposed to} stay open until nine o'clock on Saturday night. They won't ____{be able to} go.
|
||||
TEMPLATE: All the people in the store want to go to the wedding, but the store ____{is supposed to|has to|must|needs to} stay open until nine o'clock on Saturday night. They won't ____{be able to} go.
|
||||
RESPONSE: All the people in the store want to go to the wedding, but the store is supposed to stay open until nine o'clock on Saturday night. They won't be able to go.
|
||||
|
||||
TEMPLATE: It's not a ____{common} thing, but this week Mary's father is ____{out of} town. Mary's the ____{boss}! She said to the people, "Next Saturday the store will close. Everyone can go to my wedding."
|
||||
TEMPLATE: It's not a ____{common|usual|normal} thing, but this week Mary's father is ____{out of} town. Mary's the ____{boss}! She said to the people, "Next Saturday the store will close. Everyone can go to my wedding."
|
||||
RESPONSE: It's not a common thing, but this week Mary's father is out of town. Mary's the boss! She said to the people, "Next Saturday the store will close. Everyone can go to my wedding."
|
||||
|
||||
# Source: ST §He Can't Go!
|
||||
@@ -480,13 +480,13 @@ CHECK: exact
|
||||
TEMPLATE: Mark ____{leaves} for Rome tomorrow. He ____{is supposed to} pick up his tickets at the airport today, but he ____{is} not ____{able to} do it. His boss won't ____{let} him.
|
||||
RESPONSE: Mark leaves for Rome tomorrow. He is supposed to pick up his tickets at the airport today, but he is not able to do it. His boss won't let him.
|
||||
|
||||
TEMPLATE: He asked Jack, "____{Would} you please pick my tickets up for me?" Jack said, "I'm sorry, but I ____{can't}. ____{Would} you ____{mind} asking Jane?" "OK, ____{I'll} ask Jane."
|
||||
TEMPLATE: He asked Jack, "____{Would|Could|Can} you please pick my tickets up for me?" Jack said, "I'm sorry, but I ____{can't}. ____{Would|Do} you ____{mind} asking Jane?" "OK, ____{I'll|I will} ask Jane."
|
||||
RESPONSE: He asked Jack, "Would you please pick my tickets up for me?" Jack said, "I'm sorry, but I can't. Would you mind asking Jane?" "OK, I'll ask Jane."
|
||||
|
||||
TEMPLATE: Jane said, "I'll be happy ____{to go}, but you'll have to tell me ____{how to} get there. Do you think ____{it} will ____{take} a long time?" "No, ____{it takes} only ____{about} 15 minutes."
|
||||
TEMPLATE: Jane said, "I'll be happy ____{to go|to help}, but you'll have to tell me ____{how to} get there. Do you think ____{it|this|that} will ____{take} a long time?" "No, ____{it takes} only ____{about} 15 minutes."
|
||||
RESPONSE: Jane said, "I'll be happy to go, but you'll have to tell me how to get there. Do you think it will take a long time?" "No, it takes only about 15 minutes."
|
||||
|
||||
TEMPLATE: "Okay. What time is it now?" "____{It} is 4 o'clock." "Good! I can leave now and return before ____{supper}."
|
||||
TEMPLATE: "Okay. What time is it now?" "____{It} is 4 o'clock." "Good! I can leave now and return before ____{supper|dinner|5 o'clock|5}."
|
||||
RESPONSE: "Okay. What time is it now?" "It is 4 o'clock." "Good! I can leave now and return before supper."
|
||||
|
||||
# Source: ST §The Show Begins at 8 O'Clock Tomorrow
|
||||
|
||||
Reference in New Issue
Block a user