question: What direction is China in Mongolia? A. east B. south C. west D. north
choice: (A) east (B) south (C) west (D) north
gold answer: B
wrong prediction: D
Rationale:
question: This is a piece of slate. Slate usually forms from a sedimentary rock called shale. Slate can form when shale is changed by high temperature and pressure. Slate is usually dark-colored. The word blackboard comes from the color of slate. Decades ago, blackboards were made of black slate. What type of rock is slate? A. igneous B. sedimentary C. metamorphic
choice: (A) igneous (B) sedimentary (C) metamorphic
context: This is a piece of slate. Slate usually forms from a sedimentary rock called shale. Slate can form when shale is changed by high temperature and pressure. Slate is usually dark-colored. The word blackboard comes from the color of slate. Decades ago, blackboards were made of black slate.
gold answer: C
wrong prediction: B
Rationale:
question: Which Python code can generate the content of the image? A. tup1 = ('physics', 'chemistry', 1997, 2000) tup2 = (1, 2, 3, 4, 5, 6, 7 ) print "tup1[0]: ", tup1[0] print "tup2[1:5]: ", tup2[1:5] B. tup1 = ('physics', 'chemistry', 1997, 2000) tup2 = (1, 2, 3, 4, 5, 6, 7 ) print "tup1[0]: ", tup1[0] print "tup2[1:5]: ", tup2[2:5] C. tup1 = ('physics', 'chemistry', 1990, 2000) tup2 = (1, 2, 3, 4, 5, 6, 7 ) print "tup1[0]: ", tup1[0] print "tup2[1:5]: ", tup2[1:5] D. tup1 = ('physics', 'chemistry', 1990, 2000) tup2 = (1, 2, 3, 4, 5, 6, 7 ) print "tup1[0]: ", tup1[0] print "tup2[2:5]: ", tup2[1:5]
choice: (A) tup1 = ('physics', 'chemistry', 1997, 2000) tup2 = (1, 2, 3, 4, 5, 6, 7 ) print "tup1[0]: ", tup1[0] print "tup2[1:5]: ", tup2[1:5] (B) tup1 = ('physics', 'chemistry', 1997, 2000) tup2 = (1, 2, 3, 4, 5, 6, 7 ) print "tup1[0]: ", tup1[0] print "tup2[1:5]: ", tup2[2:5] (C) tup1 = ('physics', 'chemistry', 1990, 2000) tup2 = (1, 2, 3, 4, 5, 6, 7 ) print "tup1[0]: ", tup1[0] print "tup2[1:5]: ", tup2[1:5] (D) tup1 = ('physics', 'chemistry', 1990, 2000) tup2 = (1, 2, 3, 4, 5, 6, 7 ) print "tup1[0]: ", tup1[0] print "tup2[2:5]: ", tup2[1:5]
gold answer: A
wrong prediction: B
Rationale:
question: The object shown in this figure: A. Is a colorless liquid with a sweet, fruity odor B. Has a boiling point of 56.05°C C. Is used as a solvent for many organic compounds D. None of these options are correct.
choice: (A) Is a colorless liquid with a sweet, fruity odor (B) Has a boiling point of 56.05°C (C) Is used as a solvent for many organic compounds (D) None of these options are correct.
gold answer: C
wrong prediction: A
Rationale:
question: The object shown in this figure: A. Is a bluish-white metal that is commonly used in galvanizing and as an alloy in brass and other metals B. Has a relatively low melting point of around 419°C C. Is an essential micronutrient for humans and many other organisms D. All of these options are correct.
choice: (A) Is a bluish-white metal that is commonly used in galvanizing and as an alloy in brass and other metals (B) Has a relatively low melting point of around 419°C (C) Is an essential micronutrient for humans and many other organisms (D) All of these options are correct.
gold answer: D
wrong prediction: A
Rationale:
question: what is this? A. a covid test kit B. a pregnancy test kit C. a biopsy D. a chemical tube
choice: (A) a covid test kit (B) a pregnancy test kit (C) a biopsy (D) a chemical tube
gold answer: C
wrong prediction: A
Rationale:
question: In the picture, which direction is the baby facing? A. left B. right C. up D. down
choice: (A) left (B) right (C) up (D) down
gold answer: A
wrong prediction: D
Rationale:
question: Which Python code can generate the content of the image? A. def get_vowels(string): return [vowel for vowel in string if vowel in 'aeiou'] print("Vowels are:", get_vowels('This is some random string')) B. def get_vowels(string): return [vowel for vowel in string if vowel in 'weiou'] print("Vowels are:", get_vowels('This is some random string')) C. def get_vowels(string): return [vowel for vowel in string if vowel in 'aeiou'] print("Vowels are:", get_vowels('This is a string')) D. def get_vowels(string): return [vowel for vowel in string if vowel in 'aeiou'] print("Vowels are:", get_vowels('string'))
choice: (A) def get_vowels(string): return [vowel for vowel in string if vowel in 'aeiou'] print("Vowels are:", get_vowels('This is some random string')) (B) def get_vowels(string): return [vowel for vowel in string if vowel in 'weiou'] print("Vowels are:", get_vowels('This is some random string')) (C) def get_vowels(string): return [vowel for vowel in string if vowel in 'aeiou'] print("Vowels are:", get_vowels('This is a string')) (D) def get_vowels(string): return [vowel for vowel in string if vowel in 'aeiou'] print("Vowels are:", get_vowels('string'))
gold answer: A
wrong prediction: D
Rationale:
question: What is the name of the colony shown? A. New Hampshire B. Connecticut C. New York D. Rhode Island
choice: (A) New Hampshire (B) Connecticut (C) New York (D) Rhode Island
gold answer: D
wrong prediction: A
Rationale:
question: Which one is the correct caption of this image? A. A dirty squat toilet surrounded by white tile. B. A street of a Chinese town in the afternoon C. A chocolate and fudge dessert on layered pastry is on a red plate. D. A row of vehicles sitting at a traffic light on a street.
choice: (A) A dirty squat toilet surrounded by white tile. (B) A street of a Chinese town in the afternoon (C) A chocolate and fudge dessert on layered pastry is on a red plate. (D) A row of vehicles sitting at a traffic light on a street.
gold answer: C
wrong prediction: A
Rationale: