id: 1857

question: What direction is China in Mongolia? A. east B. south C. west D. north

choice: (A) east (B) south (C) west (D) north

gold answer: B


wrong prediction: D

Rationale:




id: 374

question: This is a piece of slate. Slate usually forms from a sedimentary rock called shale. Slate can form when shale is changed by high temperature and pressure. Slate is usually dark-colored. The word blackboard comes from the color of slate. Decades ago, blackboards were made of black slate. What type of rock is slate? A. igneous B. sedimentary C. metamorphic

choice: (A) igneous (B) sedimentary (C) metamorphic

context: This is a piece of slate. Slate usually forms from a sedimentary rock called shale. Slate can form when shale is changed by high temperature and pressure. Slate is usually dark-colored. The word blackboard comes from the color of slate. Decades ago, blackboards were made of black slate.

gold answer: C


wrong prediction: B

Rationale:




id: 1664

question: Which Python code can generate the content of the image? A. tup1 = ('physics', 'chemistry', 1997, 2000) tup2 = (1, 2, 3, 4, 5, 6, 7 ) print "tup1[0]: ", tup1[0] print "tup2[1:5]: ", tup2[1:5] B. tup1 = ('physics', 'chemistry', 1997, 2000) tup2 = (1, 2, 3, 4, 5, 6, 7 ) print "tup1[0]: ", tup1[0] print "tup2[1:5]: ", tup2[2:5] C. tup1 = ('physics', 'chemistry', 1990, 2000) tup2 = (1, 2, 3, 4, 5, 6, 7 ) print "tup1[0]: ", tup1[0] print "tup2[1:5]: ", tup2[1:5] D. tup1 = ('physics', 'chemistry', 1990, 2000) tup2 = (1, 2, 3, 4, 5, 6, 7 ) print "tup1[0]: ", tup1[0] print "tup2[2:5]: ", tup2[1:5]

choice: (A) tup1 = ('physics', 'chemistry', 1997, 2000) tup2 = (1, 2, 3, 4, 5, 6, 7 ) print "tup1[0]: ", tup1[0] print "tup2[1:5]: ", tup2[1:5] (B) tup1 = ('physics', 'chemistry', 1997, 2000) tup2 = (1, 2, 3, 4, 5, 6, 7 ) print "tup1[0]: ", tup1[0] print "tup2[1:5]: ", tup2[2:5] (C) tup1 = ('physics', 'chemistry', 1990, 2000) tup2 = (1, 2, 3, 4, 5, 6, 7 ) print "tup1[0]: ", tup1[0] print "tup2[1:5]: ", tup2[1:5] (D) tup1 = ('physics', 'chemistry', 1990, 2000) tup2 = (1, 2, 3, 4, 5, 6, 7 ) print "tup1[0]: ", tup1[0] print "tup2[2:5]: ", tup2[1:5]

gold answer: A


wrong prediction: B

Rationale:




id: 1547

question: The object shown in this figure: A. Is a colorless liquid with a sweet, fruity odor B. Has a boiling point of 56.05°C C. Is used as a solvent for many organic compounds D. None of these options are correct.

choice: (A) Is a colorless liquid with a sweet, fruity odor (B) Has a boiling point of 56.05°C (C) Is used as a solvent for many organic compounds (D) None of these options are correct.

gold answer: C


wrong prediction: A

Rationale:




id: 1567

question: The object shown in this figure: A. Is a bluish-white metal that is commonly used in galvanizing and as an alloy in brass and other metals B. Has a relatively low melting point of around 419°C C. Is an essential micronutrient for humans and many other organisms D. All of these options are correct.

choice: (A) Is a bluish-white metal that is commonly used in galvanizing and as an alloy in brass and other metals (B) Has a relatively low melting point of around 419°C (C) Is an essential micronutrient for humans and many other organisms (D) All of these options are correct.

gold answer: D


wrong prediction: A

Rationale:




id: 1479

question: what is this? A. a covid test kit B. a pregnancy test kit C. a biopsy D. a chemical tube

choice: (A) a covid test kit (B) a pregnancy test kit (C) a biopsy (D) a chemical tube

gold answer: C


wrong prediction: A

Rationale:




id: 651

question: In the picture, which direction is the baby facing? A. left B. right C. up D. down

choice: (A) left (B) right (C) up (D) down

gold answer: A


wrong prediction: D

Rationale:




id: 1680

question: Which Python code can generate the content of the image? A. def get_vowels(string): return [vowel for vowel in string if vowel in 'aeiou'] print("Vowels are:", get_vowels('This is some random string')) B. def get_vowels(string): return [vowel for vowel in string if vowel in 'weiou'] print("Vowels are:", get_vowels('This is some random string')) C. def get_vowels(string): return [vowel for vowel in string if vowel in 'aeiou'] print("Vowels are:", get_vowels('This is a string')) D. def get_vowels(string): return [vowel for vowel in string if vowel in 'aeiou'] print("Vowels are:", get_vowels('string'))

choice: (A) def get_vowels(string): return [vowel for vowel in string if vowel in 'aeiou'] print("Vowels are:", get_vowels('This is some random string')) (B) def get_vowels(string): return [vowel for vowel in string if vowel in 'weiou'] print("Vowels are:", get_vowels('This is some random string')) (C) def get_vowels(string): return [vowel for vowel in string if vowel in 'aeiou'] print("Vowels are:", get_vowels('This is a string')) (D) def get_vowels(string): return [vowel for vowel in string if vowel in 'aeiou'] print("Vowels are:", get_vowels('string'))

gold answer: A


wrong prediction: D

Rationale:




id: 346

question: What is the name of the colony shown? A. New Hampshire B. Connecticut C. New York D. Rhode Island

choice: (A) New Hampshire (B) Connecticut (C) New York (D) Rhode Island

gold answer: D


wrong prediction: A

Rationale:




id: 114

question: Which one is the correct caption of this image? A. A dirty squat toilet surrounded by white tile. B. A street of a Chinese town in the afternoon C. A chocolate and fudge dessert on layered pastry is on a red plate. D. A row of vehicles sitting at a traffic light on a street.

choice: (A) A dirty squat toilet surrounded by white tile. (B) A street of a Chinese town in the afternoon (C) A chocolate and fudge dessert on layered pastry is on a red plate. (D) A row of vehicles sitting at a traffic light on a street.

gold answer: C


wrong prediction: A

Rationale: