apply answerability-audit repair queue: ACCEPT variants, derivability fixes, rubric rewrites (46 masters)
- MISSING_ALTERNATIVES (63/64 applied): uncontracted/contracted forms, digit variants (05|5), synonyms and full-sentence variants, via ACCEPT lines and inline gap alternatives; skipped 'better/fine' for the Opposites drill (not opposites of "sick"). - NOT_DERIVABLE (16 fixed, 10 false alarms, 1 skipped): item-level fixes (visible word hints, missing premise, speaker clarifications "Joe (to Jim):", emphasis/cue corrections, un-gapped unguessable words, rounded-number accepts); converted the two book-10 paragraph clozes (Mary / The Mall) from CHECK: exact to CHECK: llm with logical-completion rubrics; cross-book recycled vocab (pilot, teller, barber, variety store, ...) left alone. - UNCLEAR_TARGET (10): instruction/intro corrections (Food "Type the word for the food.", Explain-with-Too intro), cue/emphasis fixes. - Rubric rewrites (57): applied audit-suggested grader rubrics (now effective with the pre-item RUBRIC parser fix); moved the two per-item rubrics of book-11 "Write the Main Idea" inside their items. No clip-bearing line changed; all masters validate (0 errors, 0 new warnings) and pass stage-master clip-identity checks. Full decision log: reactor-module-tools module-convert/answerability-audit/APPLIED.md Co-authored-by: Cursor <cursoragent@cursor.com>
This commit is contained in:
@@ -669,7 +669,7 @@ INTRO: You'll see a statement with one part underlined. Ask the question that as
|
||||
INSTRUCTION: Change the sentence to a question about the underlined part.
|
||||
INPUT: speak
|
||||
CHECK: llm
|
||||
RUBRIC: Treat the model RESPONSE as the key. Require a question with "be going to" that uses the same question word and asks about the same information as the model; wording may vary slightly.
|
||||
RUBRIC: Treat the model RESPONSE as the key. Require a question with an appropriate question word that asks about the same information as the model, using "be going to" or the present continuous; pronoun substitutions for names are fine, and wording may vary slightly.
|
||||
|
||||
EXAMPLE
|
||||
TEMPLATE: I am going to buy *a car*.
|
||||
@@ -889,19 +889,19 @@ INTRO: Look at the map. You're at the Oak Road Information Center. Listen to eac
|
||||
INSTRUCTION: Type the missing words.
|
||||
|
||||
PROMPT: Excuse me, please. How do I get to the Uptown Cinema? {bk08-l1a-f4-01-q.mp3}
|
||||
TEMPLATE: Go east ____{on Oak Road} to ____{3rd Street}. Turn to ____{the left} and ____{go 2} blocks. It's ____{on your right}, north of ____{the Wise Owl Bookstore}.
|
||||
TEMPLATE: Go east ____{on Oak Road|Oak Road} to ____{3rd Street}. Turn to ____{the left|left} and ____{go 2|go two|2} blocks. It's ____{on your right}, north of ____{the Wise Owl Bookstore}.
|
||||
RESPONSE: Go east on Oak Road to 3rd Street. Turn to the left and go 2 blocks. It's on your right, north of the Wise Owl Bookstore. {bk08-l1a-f4-01-a.mp3}
|
||||
|
||||
PROMPT: Excuse me, please. How can I get to the Park Café? {bk08-l1a-f4-02-q.mp3}
|
||||
TEMPLATE: Go south on ____{Main Street} for one block. Turn ____{left on Pine} and ____{go 2} blocks. It's ____{on your left}, between ____{2nd and 3rd Street}.
|
||||
TEMPLATE: Go south on ____{Main Street} for one block. Turn ____{left on Pine} and ____{go 2|go two|2} blocks. It's ____{on your left}, between ____{2nd and 3rd Street|2nd and 3rd Streets|Second and Third Street}.
|
||||
RESPONSE: Go south on Main Street for 1 block. Turn left on Pine and go 2 blocks. It's on your left, between 2nd and 3rd Street. {bk08-l1a-f4-02-a.mp3}
|
||||
|
||||
PROMPT: Excuse me, please. How do I get to the post office? {bk08-l1a-f4-03-q.mp3}
|
||||
TEMPLATE: First, go east ____{on Oak Road} to ____{5th Street}. Turn ____{left}. Then, go straight ahead ____{for 1} block. It's ____{on your right}.
|
||||
TEMPLATE: First, go east ____{on Oak Road|Oak Road} to ____{5th Street}. Turn ____{left}. Then, go straight ahead ____{for 1|for one|1|one} block. It's ____{on your right}.
|
||||
RESPONSE: First, go east on Oak Road to 5th Street. Turn left. Then, go straight ahead for 1 block. It's on your right. {bk08-l1a-f4-03-a.mp3}
|
||||
|
||||
PROMPT: Excuse me, please. How do I get to the Wise Owl Bookstore? {bk08-l1a-f4-04-q.mp3}
|
||||
TEMPLATE: Go east ____{on Oak Road} to ____{3rd Street}. Turn ____{left on 3rd}. Then, go straight ahead ____{to Pecan}. It's ____{on Pecan}, between ____{3rd and 4th}.
|
||||
TEMPLATE: Go east ____{on Oak Road|Oak Road} to ____{3rd Street}. Turn ____{left on 3rd|left}. Then, go straight ahead ____{to Pecan}. It's ____{on Pecan}, between ____{3rd and 4th|3rd and 4th Streets|Third and Fourth}.
|
||||
RESPONSE: Go east on Oak Road to 3rd Street. Turn left on 3rd. Then, go straight ahead to Pecan. It's on Pecan, between 3rd and 4th. {bk08-l1a-f4-04-a.mp3}
|
||||
|
||||
# Source: ST §Excuse Me, Please
|
||||
|
||||
Reference in New Issue
Block a user