book 8: audit+sim repairs — 3D f4 stimulus clips restored, What Are They Trying to Do? back (8 items), map-verified route keys, 13-clock adjudication (10 redrawn, 3 re-keyed to print), answer-pass clips on 5 figures, comparison pictures reattached, thermometer references, accepts sweep
Co-authored-by: Cursor <cursoragent@cursor.com>
This commit is contained in:
@@ -223,13 +223,13 @@ INTRO: Time to look at some pictures — gyms, pay phones, and people exercising
|
||||
INSTRUCTION: Look at the picture and answer aloud in a complete sentence.
|
||||
INPUT: speak
|
||||
CHECK: llm
|
||||
RUBRIC: Treat the model answer as the factual key; accept any complete sentence expressing the same fact(s), in any phrasing.
|
||||
RUBRIC: Treat the model answer as the factual key; accept any complete sentence expressing the same fact(s), in any phrasing. Do not demand details the question didn't ask for (e.g. "from a pay phone" is optional); for the glass item, any answer mentioning ice, water, or a cold drink is correct.
|
||||
|
||||
PROMPT: Where does Mark play volleyball? {st-page_166_001.jpg|Entrance to a building with a sign that reads "HEALTH AND FITNESS GYM"}
|
||||
RESPONSE: Mark plays volleyball at the health and fitness gym.
|
||||
|
||||
PROMPT: What is Bob going to do? {st-page_166_002.jpg|A man holding a telephone receiver to his ear while reaching to insert a coin into a pay phone}
|
||||
RESPONSE: Bob is going to make a phone call from a pay phone.
|
||||
RESPONSE: Bob is going to make a phone call.
|
||||
|
||||
PROMPT: What is Jan looking at? {st-page_166_003.jpg|An outdoor/indoor thermometer with temperature markings mounted on a wall}
|
||||
RESPONSE: Jan is looking at a thermometer.
|
||||
@@ -250,7 +250,7 @@ PROMPT: What is he doing? {st-page_167_003.jpg|A man playing tennis, swinging a
|
||||
RESPONSE: He is playing tennis.
|
||||
|
||||
PROMPT: What's in the glass? {st-page_167_004.jpg|A tall glass filled with iced drink and a lemon slice garnish}
|
||||
RESPONSE: There is an iced drink with lemon in the glass.
|
||||
RESPONSE: There is an iced drink in the glass.
|
||||
|
||||
PROMPT: What's she doing? {st-page_167_005.jpg|A woman doing sit-ups on the floor}
|
||||
RESPONSE: She is doing sit-ups.
|
||||
@@ -302,7 +302,7 @@ INSTRUCTION: Look at the map and give clear directions aloud.
|
||||
INPUT: speak
|
||||
CHECK: llm
|
||||
SHOW_PROMPT
|
||||
RUBRIC: Treat the model answer as one good route, not the only one; accept any coherent set of directions that uses direction-giving language (go, turn, block, corner, street names) to reach the named destination. Do not fail an answer for choosing a different plausible route.
|
||||
RUBRIC: Treat the model answer as one good route, not the only one; accept any coherent set of directions that uses direction-giving language (go, turn, block, corner, street names) to reach the named destination. Do not fail an answer for choosing a different plausible route. For the cafe item, directions to either Nan's Cafe (2) or the Black Cat Cafe (9) are correct.
|
||||
|
||||
PROMPT: You are at the school (7). Give a friend directions to the public library (14).
|
||||
RESPONSE: Go west on Front Street for two blocks to Houston Avenue. Turn left and go south for one block. The library is on the corner of Houston and Colorado.
|
||||
@@ -310,7 +310,7 @@ RESPONSE: Go west on Front Street for two blocks to Houston Avenue. Turn left an
|
||||
PROMPT: You are in the Lowest Price Bookstore (5). Tell someone how to find the post office (11).
|
||||
RESPONSE: Go out of the bookstore and walk east on Texas Avenue for one block. Turn right on Pacific Avenue. The post office is on your left.
|
||||
|
||||
PROMPT: You are visiting a friend in the hospital (16). Someone asks for directions to a cafe.
|
||||
PROMPT: You are visiting a friend in the hospital (16). Someone asks for directions to a cafe — Nan's Cafe (2) or the Black Cat Cafe (9) on the map.
|
||||
RESPONSE: Go north on California Street to Front Street. Turn left and walk one block to Houston Avenue. Nan's Cafe is on the corner.
|
||||
|
||||
PROMPT: You are in the Anthony Hotel (1). Give someone directions to the Blue Moon Restaurant (4).
|
||||
@@ -433,9 +433,9 @@ PROMPT: {st-page_175_003.jpg|A square clock showing the time three o'clock (3:00
|
||||
RESPONSE: It's three o'clock.
|
||||
ACCEPT: It's three o'clock. | It's 3:00. | It's three.
|
||||
|
||||
PROMPT: {st-page_175_004.jpg|A square clock showing the time twenty-five to eight (7:35)}
|
||||
RESPONSE: It's twenty-five to eight.
|
||||
ACCEPT: It's twenty-five to eight. | It's twenty-five to 8. | It's seven thirty-five. | It's 7:35.
|
||||
PROMPT: {st-page_175_004.jpg|A square clock showing the time quarter to six (5:45)}
|
||||
RESPONSE: It's a quarter to six.
|
||||
ACCEPT: It's a quarter to six. | It's quarter to six. | It's a quarter to 6. | It's five forty-five. | It's 5:45.
|
||||
|
||||
PROMPT: {st-page_175_005.jpg|A square clock showing the time quarter past six (6:15)}
|
||||
RESPONSE: It's a quarter past six.
|
||||
|
||||
Reference in New Issue
Block a user