Item Review Sheets produced using conquestr

Leigh Patterson

2025-02-19

A number of libraries are required. This is becasue we will format some objects with our own R markdown.

## 
## Attaching package: 'kableExtra'
## The following object is masked from 'package:dplyr':
## 
##     group_rows

Item Review Sheets produced using RMarkdown

This is an example of implementation of Item Review Sheets using RMarkdown and conquestr. We will use the default system file, analysis, and plots from the conquestr library. First we can read in the system file (output by ACER ConQuest). Item analysis (itanal) and iteration history are stored in the system file.

## no system file provided, loading the example system file instead

Output from plot files are stored separately in Rout files.

## no rout file provided, loading the example rout file instead

There are also helper functions to plot iteration history and Rout files.

Test Summary Information

Summary Statistics:

x
item:1 (item one) group:All Cases
Category Score Count Percent Pt Bis Pt Bis t stat. Pt Bis sig. Ability mean (D1) Ability SD (D1)
M 0 6 0.60 -0.11 -3.40 0.00 -0.98 1.01
a 1 644 64.46 0.46 16.14 0.00 0.33 0.82
b 0 23 2.30 -0.08 -2.68 0.01 -0.54 1.00
c 0 47 4.70 -0.20 -6.40 0.00 -0.75 0.79
d 0 104 10.41 -0.24 -7.76 0.00 -0.68 0.70
e 0 175 17.52 -0.22 -6.97 0.00 -0.47 0.71
x
item-total 0.61
item-rest 0.46
obs_mean 0.64
exp_mean 0.65
adj_mean 0.65
delta_dot -0.70
x
item:2 (item two) group:All Cases
Category Score Count Percent Pt Bis Pt Bis t stat. Pt Bis sig. Ability mean (D1) Ability SD (D1)
M 0 5 0.50 -0.08 -2.51 0.01 -0.91 1.06
a 0 59 5.91 -0.17 -5.29 0.00 -0.54 0.75
b 0 151 15.12 -0.20 -6.36 0.00 -0.53 0.86
c 1 743 74.37 0.31 10.25 0.00 0.20 0.85
d 0 41 4.10 -0.10 -3.11 0.00 -0.59 0.92
x
item-total 0.47
item-rest 0.31
obs_mean 0.74
exp_mean 0.75
adj_mean 0.75
delta_dot -1.25
x
item:3 (item three) group:All Cases
Category Score Count Percent Pt Bis Pt Bis t stat. Pt Bis sig. Ability mean (D1) Ability SD (D1)
M 0 9 0.90 -0.11 -3.46 0 -0.98 0.97
a 0 117 11.71 -0.26 -8.59 0 -0.69 0.70
b 0 119 11.91 -0.21 -6.65 0 -0.62 0.79
c 0 38 3.80 -0.11 -3.53 0 -0.54 0.77
d 1 716 71.67 0.41 14.01 0 0.27 0.83
x
item-total 0.56
item-rest 0.41
obs_mean 0.72
exp_mean 0.72
adj_mean 0.72
delta_dot -1.09
x
item:4 (item four) group:All Cases
Category Score Count Percent Pt Bis Pt Bis t stat. Pt Bis sig. Ability mean (D1) Ability SD (D1)
M 0 3 0.30 -0.07 -2.29 0.02 -1.09 1.42
a 0 151 15.12 0.06 1.77 0.08 -0.07 0.76
b 0 73 7.31 -0.20 -6.39 0.00 -0.64 0.76
c 0 224 22.42 -0.32 -10.59 0.00 -0.51 0.79
d 1 548 54.85 0.34 11.33 0.00 0.33 0.85
x
item-total 0.51
item-rest 0.34
obs_mean 0.55
exp_mean 0.55
adj_mean 0.55
delta_dot -0.23
x
item:5 (item five) group:All Cases
Category Score Count Percent Pt Bis Pt Bis t stat. Pt Bis sig. Ability mean (D1) Ability SD (D1)
M 0 34 3.40 -0.10 -3.31 0.00 -0.46 0.86
a 0 102 10.21 -0.03 -1.11 0.27 -0.31 0.89
b 1 476 47.65 0.18 5.90 0.00 0.29 0.89
c 0 226 22.62 -0.12 -3.77 0.00 -0.26 0.84
d 0 161 16.12 -0.03 -1.09 0.28 -0.14 0.85
x
item-total 0.38
item-rest 0.18
obs_mean 0.48
exp_mean 0.48
adj_mean 0.48
delta_dot 0.11
x
item:6 (item six) group:All Cases
Category Score Count Percent Pt Bis Pt Bis t stat. Pt Bis sig. Ability mean (D1) Ability SD (D1)
M 0 13 1.30 -0.11 -3.46 0.00 -0.87 0.98
a 0 21 2.10 -0.05 -1.68 0.09 -0.41 0.76
b 0 44 4.40 -0.07 -2.31 0.02 -0.29 0.84
c 1 764 76.48 0.28 9.37 0.00 0.17 0.87
d 0 85 8.51 -0.18 -5.80 0.00 -0.62 0.84
e 0 72 7.21 -0.14 -4.36 0.00 -0.46 0.82
x
item-total 0.44
item-rest 0.28
obs_mean 0.76
exp_mean 0.77
adj_mean 0.77
delta_dot -1.38
x
item:7 (item seven) group:All Cases
Category Score Count Percent Pt Bis Pt Bis t stat. Pt Bis sig. Ability mean (D1) Ability SD (D1)
M 0 18 1.80 -0.03 -1.03 0.30 -0.39 0.90
a 0 17 1.70 -0.07 -2.28 0.02 -0.51 0.78
b 0 41 4.10 -0.09 -2.74 0.01 -0.41 0.90
c 0 41 4.10 -0.17 -5.33 0.00 -0.78 0.87
d 0 106 10.61 -0.09 -2.85 0.00 -0.40 0.81
e 1 776 77.68 0.22 7.11 0.00 0.15 0.88
x
item-total 0.38
item-rest 0.22
obs_mean 0.78
exp_mean 0.78
adj_mean 0.78
delta_dot -1.46
x
item:8 (item eight) group:All Cases
Category Score Count Percent Pt Bis Pt Bis t stat. Pt Bis sig. Ability mean (D1) Ability SD (D1)
M 0 2 0.20 -0.07 -2.26 0.02 -1.14 2.18
a 0 67 6.71 -0.07 -2.25 0.02 -0.52 0.88
b 1 766 76.68 0.14 4.62 0.00 0.15 0.88
c 0 48 4.80 -0.07 -2.13 0.03 -0.37 0.85
d 0 116 11.61 -0.08 -2.56 0.01 -0.42 0.85
x
item-total 0.32
item-rest 0.14
obs_mean 0.77
exp_mean 0.77
adj_mean 0.77
delta_dot -1.39
x
item:9 (item nine) group:All Cases
Category Score Count Percent Pt Bis Pt Bis t stat. Pt Bis sig. Ability mean (D1) Ability SD (D1)
M 0 5 0.50 -0.08 -2.55 0.01 -0.98 0.96
a 0 24 2.40 -0.18 -5.91 0.00 -1.07 0.81
b 1 852 85.29 0.29 9.67 0.00 0.13 0.87
c 0 19 1.90 -0.15 -4.74 0.00 -0.86 0.84
d 0 99 9.91 -0.17 -5.32 0.00 -0.59 0.71
x
item-total 0.42
item-rest 0.29
obs_mean 0.85
exp_mean 0.86
adj_mean 0.86
delta_dot -2.03
x
item:10 (item ten) group:All Cases
Category Score Count Percent Pt Bis Pt Bis t stat. Pt Bis sig. Ability mean (D1) Ability SD (D1)
M 0 8 0.80 -0.09 -2.84 0.00 -0.79 1.01
a 1 776 77.68 0.19 6.12 0.00 0.14 0.89
b 0 70 7.01 -0.02 -0.77 0.44 -0.32 0.84
c 0 57 5.71 -0.14 -4.55 0.00 -0.51 0.84
d 0 88 8.81 -0.11 -3.58 0.00 -0.44 0.85
x
item-total 0.35
item-rest 0.19
obs_mean 0.78
exp_mean 0.78
adj_mean 0.78
delta_dot -1.46
x
item:11 (item eleven) group:All Cases
Category Score Count Percent Pt Bis Pt Bis t stat. Pt Bis sig. Ability mean (D1) Ability SD (D1)
M 0 12 1.20 -0.13 -4.28 0 -0.91 0.90
a 0 108 10.81 -0.15 -4.91 0 -0.55 0.70
b 0 54 5.41 -0.19 -5.96 0 -0.79 0.82
c 1 792 79.28 0.33 11.14 0 0.18 0.87
d 0 33 3.30 -0.17 -5.48 0 -0.64 0.71
x
item-total 0.48
item-rest 0.33
obs_mean 0.79
exp_mean 0.80
adj_mean 0.80
delta_dot -1.57
x
item:12 (item twelve) group:All Cases
Category Score Count Percent Pt Bis Pt Bis t stat. Pt Bis sig. Ability mean (D1) Ability SD (D1)
M 0 13 1.30 -0.09 -2.82 0.00 -0.87 1.18
a 0 68 6.81 -0.07 -2.25 0.02 -0.34 0.74
b 0 199 19.92 -0.25 -8.00 0.00 -0.45 0.80
c 1 575 57.56 0.30 9.97 0.00 0.29 0.88
d 0 144 14.41 -0.06 -2.04 0.04 -0.26 0.74
x
item-total 0.48
item-rest 0.30
obs_mean 0.58
exp_mean 0.58
adj_mean 0.58
delta_dot -0.36
Percent Missing N Mean SD Variance Skew Kurtosis Standard error of mean Standard error of measurement Alpha
0 999 8.44 2.4 5.78 -0.6 -0.2 0.08 1.43 0.64

Visual summary of convergence

Iteration history of item parameters.
Iteration history of item parameters.

Item 1 Summary

Item 1 Statistics:

Item 1 ICC:

Inserting red text for demo purposes.