apply answerability-audit repair queue: ACCEPT variants, derivability fixes, rubric rewrites (46 masters)
- MISSING_ALTERNATIVES (63/64 applied): uncontracted/contracted forms, digit variants (05|5), synonyms and full-sentence variants, via ACCEPT lines and inline gap alternatives; skipped 'better/fine' for the Opposites drill (not opposites of "sick"). - NOT_DERIVABLE (16 fixed, 10 false alarms, 1 skipped): item-level fixes (visible word hints, missing premise, speaker clarifications "Joe (to Jim):", emphasis/cue corrections, un-gapped unguessable words, rounded-number accepts); converted the two book-10 paragraph clozes (Mary / The Mall) from CHECK: exact to CHECK: llm with logical-completion rubrics; cross-book recycled vocab (pilot, teller, barber, variety store, ...) left alone. - UNCLEAR_TARGET (10): instruction/intro corrections (Food "Type the word for the food.", Explain-with-Too intro), cue/emphasis fixes. - Rubric rewrites (57): applied audit-suggested grader rubrics (now effective with the pre-item RUBRIC parser fix); moved the two per-item rubrics of book-11 "Write the Main Idea" inside their items. No clip-bearing line changed; all masters validate (0 errors, 0 new warnings) and pass stage-master clip-identity checks. Full decision log: reactor-module-tools module-convert/answerability-audit/APPLIED.md Co-authored-by: Cursor <cursoragent@cursor.com>
This commit is contained in:
@@ -741,7 +741,7 @@ RESPONSE: You made an error on number eight. That's the wrong answer.
|
||||
TEMPLATE: The math problems are not alike. ____{Each} one is different.
|
||||
RESPONSE: The math problems are not alike. Each one is different.
|
||||
|
||||
TEMPLATE: Linda ____{understood} the homework, but Mark didn't understand it.
|
||||
TEMPLATE: Linda ____{understood|explained} the homework, but Mark didn't understand it.
|
||||
RESPONSE: Linda understood the homework, but Mark didn't understand it.
|
||||
|
||||
TEMPLATE: The teacher gave the students 25 ____{problems} for homework.
|
||||
@@ -1149,7 +1149,7 @@ EXAMPLE
|
||||
TEMPLATE: The radius of the circle is short. The radius is ____{shorter than the diameter}.
|
||||
RESPONSE: The radius is shorter than the diameter.
|
||||
|
||||
TEMPLATE: The top of the hill is high. The top of the hill is ____{higher than the bottom}.
|
||||
TEMPLATE: The top of the hill is high. The bottom of the hill is low. The top of the hill is ____{higher than the bottom}.
|
||||
RESPONSE: The top of the hill is higher than the bottom.
|
||||
ACCEPT: higher than the bottom
|
||||
|
||||
@@ -1159,7 +1159,7 @@ ACCEPT: harder than this problem
|
||||
|
||||
TEMPLATE: Line A is straight. Line B is not very straight. Line A is ____{straighter than line B}.
|
||||
RESPONSE: Line A is straighter than line B.
|
||||
ACCEPT: straighter than line B
|
||||
ACCEPT: straighter than line B | straighter than B
|
||||
|
||||
TEMPLATE: Yesterday wasn't warm. Today is warm. Today is ____{warmer than yesterday}.
|
||||
RESPONSE: Today is warmer than yesterday.
|
||||
@@ -1199,7 +1199,7 @@ INSTRUCTION: Look at the pictures and answer the questions.
|
||||
INPUT: speak
|
||||
CHECK: llm
|
||||
SHOW_PROMPT
|
||||
RUBRIC: Accept a short answer followed by a full sentence stating the comparison, similar to the model.
|
||||
RUBRIC: Accept a short answer (e.g. "No" or "No, she isn't") followed by a full sentence stating the comparison. Standard pronouns like "she" or "him" are fine.
|
||||
|
||||
TEMPLATE: The girl is taller than the boy. The boy is shorter than the girl. {st-page_068_001.jpg}
|
||||
PROMPT: Is the girl shorter than the boy?
|
||||
@@ -1280,7 +1280,7 @@ INTRO: Now you make the questions. Look at the pictures and the cue word, then a
|
||||
INSTRUCTION: Look at the pictures and make a question and answer for each pair.
|
||||
INPUT: speak
|
||||
CHECK: llm
|
||||
RUBRIC: Accept a question using the cued adjective to compare the two items, followed by a matching answer. The items and meaning must match the visual cues.
|
||||
RUBRIC: Accept a question using the cued adjective or its opposite comparative to compare the two items, followed by a matching answer. The items and meaning must match the visual cues.
|
||||
|
||||
EXAMPLE
|
||||
TEMPLATE: slow {st-page_069_001.jpg}
|
||||
@@ -1910,7 +1910,7 @@ INSTRUCTION: Type the answer.
|
||||
|
||||
PROMPT: Which apples did they buy? {bk07-l2d-f5-10-q.mp3}
|
||||
RESPONSE: the larger ones
|
||||
ACCEPT: larger ones | the larger apples | larger apples
|
||||
ACCEPT: larger ones | the larger apples | larger apples | the large ones | they bought the larger ones | they bought the larger apples | the bigger ones | bigger ones
|
||||
|
||||
# Source: LLA 2D Figure 4
|
||||
$PRODUCE Strong Words
|
||||
|
||||
Reference in New Issue
Block a user