book 12: restore audit regressions — conditional scroll (18 phrases), typed grading on write-the-answer tasks, suppose drill rebuilt with exclusion keys, cue-word production restored, locker examples, answer clips, strict/quiet/SHOW_PROMPT trims
Co-authored-by: Cursor <cursoragent@cursor.com>
This commit is contained in:
@@ -265,41 +265,49 @@ PROMPT: Fred shot only one time.
|
||||
ANSWER: F
|
||||
|
||||
# Source: ST §Make a Sentence (recast: bare cue-word production → story-grounded Q&A)
|
||||
$PRODUCE Questions About Fred and Pete
|
||||
$PRODUCE Make a Sentence About the Story
|
||||
ID: l4-s4
|
||||
REFERENCE: l4-s2
|
||||
INTRO: Now answer questions about the story in full sentences. The new words will come back in your answers — that's the plan. Open the story if you need it.
|
||||
INSTRUCTION: Answer aloud in a full sentence.
|
||||
INTRO: For each cue word, say one sentence about Fred and Pete — say what the story said. Open the story if you need it; it hasn't gone anywhere.
|
||||
INSTRUCTION: Say a sentence about Fred and Pete using the cue word.
|
||||
INPUT: speak
|
||||
CHECK: llm
|
||||
RUBRIC: Treat the model answer as the factual key; accept any phrasing or short form of the same fact.
|
||||
SHOW_PROMPT
|
||||
RUBRIC: Accept any sentence that uses the cue word and states a fact from the story about Fred and Pete. The model answer shows one correct fact; other true story facts using the cue word are also correct.
|
||||
|
||||
EXAMPLE
|
||||
PROMPT: Where do Fred and Pete like to spend their time?
|
||||
RESPONSE: They like to be out-of-doors.
|
||||
PROMPT: out-of-doors
|
||||
RESPONSE: Fred and Pete like to be out-of-doors.
|
||||
|
||||
PROMPT: How often do Fred and Pete go hunting?
|
||||
RESPONSE: They go hunting once every year, during deer season.
|
||||
PROMPT: once
|
||||
RESPONSE: Once every year they spend two weeks hunting.
|
||||
|
||||
PROMPT: What are they preparing for the trip?
|
||||
PROMPT: deer season
|
||||
RESPONSE: Deer season will begin next week.
|
||||
|
||||
PROMPT: prepare
|
||||
RESPONSE: They're preparing their weapons.
|
||||
|
||||
PROMPT: Why did Fred and Pete drive out to the country?
|
||||
RESPONSE: They drove to the country to practice with Fred's new rifle.
|
||||
PROMPT: country
|
||||
RESPONSE: They have driven to the country.
|
||||
|
||||
PROMPT: What is Fred going to shoot at?
|
||||
RESPONSE: He's going to shoot at some empty soda cans.
|
||||
PROMPT: practice
|
||||
RESPONSE: Fred is going to practice with his new rifle.
|
||||
|
||||
PROMPT: Who had to hunt for the truck keys?
|
||||
RESPONSE: Pete had to hunt for the keys.
|
||||
PROMPT: shoot at
|
||||
RESPONSE: Fred is going to shoot at some empty soda cans.
|
||||
|
||||
PROMPT: What was wrong with Fred's first shots?
|
||||
RESPONSE: They were too high. He had to shoot lower.
|
||||
PROMPT: lower
|
||||
RESPONSE: Fred has to shoot lower.
|
||||
|
||||
PROMPT: several
|
||||
RESPONSE: After several shots, Pete thought Fred was ready.
|
||||
|
||||
PROMPT: How many shots did it take before Fred got it right?
|
||||
RESPONSE: It took several shots.
|
||||
RUBRIC: Accept "several shots", "many shots", or "eight shots" (the story's Bang! count adds up to eight) — any of these is correct.
|
||||
|
||||
|
||||
$SESSION 4-2: What You Used to Do
|
||||
|
||||
# Source: LLA 4A Figure 2 (Part 2)
|
||||
|
||||
Reference in New Issue
Block a user