book 12: restore audit regressions — conditional scroll (18 phrases), typed grading on write-the-answer tasks, suppose drill rebuilt with exclusion keys, cue-word production restored, locker examples, answer clips, strict/quiet/SHOW_PROMPT trims

Co-authored-by: Cursor <cursoragent@cursor.com>
This commit is contained in:
2026-08-22 08:25:12 +08:00
parent 76620d2324
commit 6524ca6df4
10 changed files with 138 additions and 95 deletions

View File

@@ -265,41 +265,49 @@ PROMPT: Fred shot only one time.
ANSWER: F
# Source: ST §Make a Sentence (recast: bare cue-word production → story-grounded Q&A)
$PRODUCE Questions About Fred and Pete
$PRODUCE Make a Sentence About the Story
ID: l4-s4
REFERENCE: l4-s2
INTRO: Now answer questions about the story in full sentences. The new words will come back in your answers — that's the plan. Open the story if you need it.
INSTRUCTION: Answer aloud in a full sentence.
INTRO: For each cue word, say one sentence about Fred and Pete — say what the story said. Open the story if you need it; it hasn't gone anywhere.
INSTRUCTION: Say a sentence about Fred and Pete using the cue word.
INPUT: speak
CHECK: llm
RUBRIC: Treat the model answer as the factual key; accept any phrasing or short form of the same fact.
SHOW_PROMPT
RUBRIC: Accept any sentence that uses the cue word and states a fact from the story about Fred and Pete. The model answer shows one correct fact; other true story facts using the cue word are also correct.
EXAMPLE
PROMPT: Where do Fred and Pete like to spend their time?
RESPONSE: They like to be out-of-doors.
PROMPT: out-of-doors
RESPONSE: Fred and Pete like to be out-of-doors.
PROMPT: How often do Fred and Pete go hunting?
RESPONSE: They go hunting once every year, during deer season.
PROMPT: once
RESPONSE: Once every year they spend two weeks hunting.
PROMPT: What are they preparing for the trip?
PROMPT: deer season
RESPONSE: Deer season will begin next week.
PROMPT: prepare
RESPONSE: They're preparing their weapons.
PROMPT: Why did Fred and Pete drive out to the country?
RESPONSE: They drove to the country to practice with Fred's new rifle.
PROMPT: country
RESPONSE: They have driven to the country.
PROMPT: What is Fred going to shoot at?
RESPONSE: He's going to shoot at some empty soda cans.
PROMPT: practice
RESPONSE: Fred is going to practice with his new rifle.
PROMPT: Who had to hunt for the truck keys?
RESPONSE: Pete had to hunt for the keys.
PROMPT: shoot at
RESPONSE: Fred is going to shoot at some empty soda cans.
PROMPT: What was wrong with Fred's first shots?
RESPONSE: They were too high. He had to shoot lower.
PROMPT: lower
RESPONSE: Fred has to shoot lower.
PROMPT: several
RESPONSE: After several shots, Pete thought Fred was ready.
PROMPT: How many shots did it take before Fred got it right?
RESPONSE: It took several shots.
RUBRIC: Accept "several shots", "many shots", or "eight shots" (the story's Bang! count adds up to eight) — any of these is correct.
$SESSION 4-2: What You Used to Do
# Source: LLA 4A Figure 2 (Part 2)