21  ROAR-Written Vocabulary Appendix

num	target	(a) Model Underfit	(b) Low Pt-Bsrl	(c) Old Version	(d) Difficult for Sec.
1	quotation	yes	yes
2	familiar	yes
3	technology	yes
4	critical	yes		yes
5	report	yes	yes	yes
6	principles		yes
7	associated			yes
8	attitude			yes
9	frequently			yes
10	frequently			yes
11	technology			yes
12	illustration				yes

Note. Students were asked to select a synonym for the target word out of four options.
a = Model Underfit: Responses were too random against the model expectation.
b = Low Pt-Bsrl: Low point-biserial correlation.
c = Old Version: Replaced with a new version of the item.
d = Difficult for Sec.: Item found to be more difficult for secondary students.

Table 21.1: List of CVA Items Excluded.Words in between asterisks indicate decorated words. Students were asked to select the target word that best replaces the decorated word out of four options.