apply answerability-audit repair queue: ACCEPT variants, derivability fixes, rubric rewrites (46 masters)
- MISSING_ALTERNATIVES (63/64 applied): uncontracted/contracted forms, digit variants (05|5), synonyms and full-sentence variants, via ACCEPT lines and inline gap alternatives; skipped 'better/fine' for the Opposites drill (not opposites of "sick"). - NOT_DERIVABLE (16 fixed, 10 false alarms, 1 skipped): item-level fixes (visible word hints, missing premise, speaker clarifications "Joe (to Jim):", emphasis/cue corrections, un-gapped unguessable words, rounded-number accepts); converted the two book-10 paragraph clozes (Mary / The Mall) from CHECK: exact to CHECK: llm with logical-completion rubrics; cross-book recycled vocab (pilot, teller, barber, variety store, ...) left alone. - UNCLEAR_TARGET (10): instruction/intro corrections (Food "Type the word for the food.", Explain-with-Too intro), cue/emphasis fixes. - Rubric rewrites (57): applied audit-suggested grader rubrics (now effective with the pre-item RUBRIC parser fix); moved the two per-item rubrics of book-11 "Write the Main Idea" inside their items. No clip-bearing line changed; all masters validate (0 errors, 0 new warnings) and pass stage-master clip-identity checks. Full decision log: reactor-module-tools module-convert/answerability-audit/APPLIED.md Co-authored-by: Cursor <cursoragent@cursor.com>
This commit is contained in:
@@ -1001,11 +1001,12 @@ RESPONSE: No, I haven't finished it yet. {bk12-l2c-f2-ex-a2.mp3}
|
||||
TEMPLATE: yes, already
|
||||
PROMPT: Has Janet graduated from college yet? {bk12-l2c-f2-01-q1.mp3}
|
||||
RESPONSE: Yes, she has already graduated. {bk12-l2c-f2-01-a1.mp3}
|
||||
ACCEPT: Yes, she's already graduated.
|
||||
ACCEPT: Yes, she's already graduated. | Yes, she has already graduated from college. | Yes, she's already graduated from college.
|
||||
|
||||
TEMPLATE: no, yet
|
||||
PROMPT: Has Janet graduated from college yet? {bk12-l2c-f2-01-q2.mp3}
|
||||
RESPONSE: No, she hasn't graduated yet. {bk12-l2c-f2-01-a2.mp3}
|
||||
ACCEPT: No, she has not graduated yet.
|
||||
|
||||
TEMPLATE: yes, already
|
||||
PROMPT: Have you seen Mike's daughter yet? {bk12-l2c-f2-02-q1.mp3}
|
||||
@@ -1015,6 +1016,7 @@ ACCEPT: Yes, I have already seen her.
|
||||
TEMPLATE: no, yet
|
||||
PROMPT: Have you seen Mike's daughter yet? {bk12-l2c-f2-02-q2.mp3}
|
||||
RESPONSE: No, I haven't seen her yet. {bk12-l2c-f2-02-a2.mp3}
|
||||
ACCEPT: No, I have not seen her yet.
|
||||
|
||||
TEMPLATE: yes, already
|
||||
PROMPT: Has your son learned Spanish yet? {bk12-l2c-f2-03-q1.mp3}
|
||||
@@ -1024,6 +1026,7 @@ ACCEPT: Yes, he's already learned Spanish.
|
||||
TEMPLATE: no, yet
|
||||
PROMPT: Has your son learned Spanish yet? {bk12-l2c-f2-03-q2.mp3}
|
||||
RESPONSE: No, he hasn't learned Spanish yet. {bk12-l2c-f2-03-a2.mp3}
|
||||
ACCEPT: No, he has not learned Spanish yet.
|
||||
|
||||
TEMPLATE: yes, already
|
||||
PROMPT: Have the Johnsons realized that they are rich yet? {bk12-l2c-f2-04-q1.mp3}
|
||||
@@ -1033,15 +1036,17 @@ ACCEPT: Yes, they've already realized it.
|
||||
TEMPLATE: no, yet
|
||||
PROMPT: Have the Johnsons realized that they are rich yet? {bk12-l2c-f2-04-q2.mp3}
|
||||
RESPONSE: No, they haven't realized it yet. {bk12-l2c-f2-04-a2.mp3}
|
||||
ACCEPT: No, they have not realized it yet.
|
||||
|
||||
TEMPLATE: yes, already
|
||||
PROMPT: Has Henry picked up the laundry yet? {bk12-l2c-f2-05-q1.mp3}
|
||||
RESPONSE: Yes, he's already picked it up. {bk12-l2c-f2-05-a1.mp3}
|
||||
ACCEPT: Yes, he has already picked it up.
|
||||
ACCEPT: Yes, he has already picked it up. | Yes, he's already picked up the laundry. | Yes, he has already picked up the laundry.
|
||||
|
||||
TEMPLATE: no, yet
|
||||
PROMPT: Has Henry picked up the laundry yet? {bk12-l2c-f2-05-q2.mp3}
|
||||
RESPONSE: No, he hasn't picked it up yet. {bk12-l2c-f2-05-a2.mp3}
|
||||
ACCEPT: No, he has not picked it up yet.
|
||||
|
||||
# Source: ST §Marsha Has Forgiven John
|
||||
|
||||
@@ -1128,7 +1133,7 @@ INSTRUCTION: Ask a present perfect question from the cue, then answer it for you
|
||||
INPUT: speak
|
||||
CHECK: llm
|
||||
SHOW_PROMPT
|
||||
RUBRIC: The learner must form a present perfect question using the cue (e.g. "Have you ever played soccer?") and give a matching short answer ("Yes, I have" or "No, I haven't"). The answer may truthfully be yes or no — learner's choice.
|
||||
RUBRIC: The learner must form a present perfect question using the cue (e.g. "Have you ever played soccer?") and give a matching short or full-sentence answer ("Yes, I have" or "Yes, I have played soccer"). The answer may truthfully be yes or no — learner's choice.
|
||||
|
||||
EXAMPLE
|
||||
PROMPT: play/baseball
|
||||
@@ -1165,7 +1170,7 @@ INSTRUCTION: Ask a present perfect question with "how many" using the cue, then
|
||||
INPUT: speak
|
||||
CHECK: llm
|
||||
SHOW_PROMPT
|
||||
RUBRIC: The learner must ask a present perfect question starting with "how many" using the cue words, and then provide a plausible answer in the present perfect. Any plausible quantity is acceptable.
|
||||
RUBRIC: The learner must ask a present perfect question starting with "how many" using the cue words, and then provide a plausible answer — a short phrase (e.g. "Three.") or a full present perfect sentence. Any plausible quantity is acceptable.
|
||||
|
||||
EXAMPLE
|
||||
PROMPT: letters/get (this week)
|
||||
|
||||
Reference in New Issue
Block a user