apply answerability-audit repair queue: ACCEPT variants, derivability fixes, rubric rewrites (46 masters)
- MISSING_ALTERNATIVES (63/64 applied): uncontracted/contracted forms, digit variants (05|5), synonyms and full-sentence variants, via ACCEPT lines and inline gap alternatives; skipped 'better/fine' for the Opposites drill (not opposites of "sick"). - NOT_DERIVABLE (16 fixed, 10 false alarms, 1 skipped): item-level fixes (visible word hints, missing premise, speaker clarifications "Joe (to Jim):", emphasis/cue corrections, un-gapped unguessable words, rounded-number accepts); converted the two book-10 paragraph clozes (Mary / The Mall) from CHECK: exact to CHECK: llm with logical-completion rubrics; cross-book recycled vocab (pilot, teller, barber, variety store, ...) left alone. - UNCLEAR_TARGET (10): instruction/intro corrections (Food "Type the word for the food.", Explain-with-Too intro), cue/emphasis fixes. - Rubric rewrites (57): applied audit-suggested grader rubrics (now effective with the pre-item RUBRIC parser fix); moved the two per-item rubrics of book-11 "Write the Main Idea" inside their items. No clip-bearing line changed; all masters validate (0 errors, 0 new warnings) and pass stage-master clip-identity checks. Full decision log: reactor-module-tools module-convert/answerability-audit/APPLIED.md Co-authored-by: Cursor <cursoragent@cursor.com>
This commit is contained in:
@@ -90,35 +90,35 @@ REPEAT
|
||||
|
||||
PROMPT: Who's doing his homework? {bk03-l2a-f2-09-q.mp3}
|
||||
RESPONSE: John {bk03-l2a-f2-09-a.mp3}
|
||||
ACCEPT: John's doing his homework.
|
||||
ACCEPT: John's doing his homework. | John is doing his homework.
|
||||
|
||||
PROMPT: Who's eating dinner? {bk03-l2a-f2-10-q.mp3}
|
||||
RESPONSE: Linda {bk03-l2a-f2-10-a.mp3}
|
||||
ACCEPT: Linda's eating dinner.
|
||||
ACCEPT: Linda's eating dinner. | Linda is eating dinner.
|
||||
|
||||
PROMPT: Who's reading a book? {bk03-l2a-f2-11-q.mp3}
|
||||
RESPONSE: Tom {bk03-l2a-f2-11-a.mp3}
|
||||
ACCEPT: Tom's reading a book.
|
||||
ACCEPT: Tom's reading a book. | Tom is reading a book.
|
||||
|
||||
PROMPT: Who's drinking coffee? {bk03-l2a-f2-12-q.mp3}
|
||||
RESPONSE: a doctor {bk03-l2a-f2-12-a.mp3}
|
||||
ACCEPT: A doctor's drinking coffee.
|
||||
ACCEPT: A doctor's drinking coffee. | A doctor is drinking coffee. | the doctor | The doctor's drinking coffee. | The doctor is drinking coffee.
|
||||
|
||||
PROMPT: Who's buying a book? {bk03-l2a-f2-13-q.mp3}
|
||||
RESPONSE: Mr. Wilson {bk03-l2a-f2-13-a.mp3}
|
||||
ACCEPT: Mr. Wilson's buying a book.
|
||||
ACCEPT: Mr. Wilson's buying a book. | Mr. Wilson is buying a book.
|
||||
|
||||
PROMPT: Who's looking at pictures? {bk03-l2a-f2-14-q.mp3}
|
||||
RESPONSE: Mrs. Wilson {bk03-l2a-f2-14-a.mp3}
|
||||
ACCEPT: Mrs. Wilson's looking at pictures.
|
||||
ACCEPT: Mrs. Wilson's looking at pictures. | Mrs. Wilson is looking at pictures.
|
||||
|
||||
PROMPT: Who's going to the mess hall? {bk03-l2a-f2-15-q.mp3}
|
||||
RESPONSE: a pilot {bk03-l2a-f2-15-a.mp3}
|
||||
ACCEPT: A pilot's going to the mess hall.
|
||||
ACCEPT: A pilot's going to the mess hall. | A pilot is going to the mess hall. | the pilot | The pilot's going to the mess hall. | The pilot is going to the mess hall.
|
||||
|
||||
PROMPT: Who's standing outside? {bk03-l2a-f2-16-q.mp3}
|
||||
RESPONSE: Bob {bk03-l2a-f2-16-a.mp3}
|
||||
ACCEPT: Bob is standing outside.
|
||||
ACCEPT: Bob is standing outside. | Bob's standing outside.
|
||||
|
||||
# Source: ST §Who Writes on the Chalkboard?
|
||||
$DIALOGUE Who Questions and Answers
|
||||
@@ -421,7 +421,7 @@ INSTRUCTION: Say what you want.
|
||||
INPUT: speak
|
||||
CHECK: llm
|
||||
SHOW_PROMPT
|
||||
RUBRIC: Accept any natural "I want ..." sentence naming at least one food or drink; the choice of items is the learner's.
|
||||
RUBRIC: Accept any natural sentence ordering food or drink, including expressions like "I want ...", "I'd like ...", "I would like ...", or "Can I have ...". The choice of items is the learner's.
|
||||
|
||||
EXAMPLE
|
||||
PROMPT: What do you want to eat and drink?
|
||||
@@ -463,7 +463,7 @@ INTRO: Look at each picture, ask a yes/no question about the vehicle, and answer
|
||||
INSTRUCTION: Ask and answer aloud about the picture.
|
||||
INPUT: speak
|
||||
CHECK: llm
|
||||
RUBRIC: Treat the model answer's vehicle as the factual key. Accept any yes/no question about the vehicle followed by a short answer naming that same vehicle, in any natural phrasing.
|
||||
RUBRIC: Treat the model answer's vehicle as the factual key. Accept any yes/no question about the vehicle followed by a correct short answer — either naming that vehicle (e.g. "No, it's a plane.") or a plain "Yes, it is." / "No, it isn't." whose polarity matches the model.
|
||||
|
||||
EXAMPLE
|
||||
PROMPT: {st-page_048_004.jpg}
|
||||
@@ -773,7 +773,7 @@ INTRO: Tom again, hour by hour. For each picture, ask what Tom does at that time
|
||||
INSTRUCTION: Ask and answer aloud about the picture.
|
||||
INPUT: speak
|
||||
CHECK: llm
|
||||
RUBRIC: Treat the model answer as the factual key. Accept a "What does Tom do at [time]?" question plus an answer describing the same action as the model, in any phrasing.
|
||||
RUBRIC: Treat the model answer as the factual key. Accept a question asking what Tom does or is doing (with or without the exact time), plus an answer describing the same action as the model in simple present or present continuous, in any phrasing (e.g. "goes out of the lab" for "leaves the lab").
|
||||
|
||||
PROMPT: {st-page_052_001.jpg}
|
||||
RESPONSE: What does Tom do at 7:30? He opens the window.
|
||||
|
||||
Reference in New Issue
Block a user