A Supplemental Information About Assessment Design and Development

A.1 Differential Item Functioning Plots

The plots in this section display the best-fitting regression line for each gender group, with jittered plots representing the total linkage levels mastered for individuals in each gender group. Plots are labeled with the item ID, and only items with non-negligible effect-size changes are included. The results from the uniform and combined logistic regression models are presented separately. For a full description of the analysis, see the Evaluation of Item-Level Bias section.

A.1.1 Uniform Model

These plots show items that had a non-negligible effect-size change when comparing \(M_1\) to \(M_0\). In this model, the probability of a correct response was modeled as a function of ability and gender.

The plot of the uniform gender differential item function evidence for English language arts item 14981. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the uniform gender differential item function evidence for Mathematics item 67039. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the uniform gender differential item function evidence for English language arts item 15961. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the uniform gender differential item function evidence for English language arts item 23698. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the uniform gender differential item function evidence for English language arts item 39201. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the uniform gender differential item function evidence for English language arts item 50786. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the uniform race differential item function evidence for English language arts item 39602. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the uniform race differential item function evidence for Mathematics item 45523. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the uniform race differential item function evidence for Mathematics item 64572. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis.

A.1.2 Combined Model

These plots show items that had a non-negligible effect-size change when comparing \(M_2\) to \(M_0\). In this model, the probability of a correct response was modeled as a function of ability, gender, and their interaction.

The plot of the combined gender differential item function evidence for English language arts item 14981. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined gender differential item function evidence for English language arts item 70285. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined gender differential item function evidence for English language arts item 80659. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined gender differential item function evidence for Mathematics item 15727. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined gender differential item function evidence for Mathematics item 67039. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined gender differential item function evidence for English language arts item 11501. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined gender differential item function evidence for English language arts item 13433. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined gender differential item function evidence for English language arts item 14820. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined gender differential item function evidence for English language arts item 15961. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined gender differential item function evidence for English language arts item 21409. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined gender differential item function evidence for English language arts item 23698. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined gender differential item function evidence for English language arts item 31405. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined gender differential item function evidence for English language arts item 33125. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined gender differential item function evidence for English language arts item 33845. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined gender differential item function evidence for English language arts item 33860. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined gender differential item function evidence for English language arts item 34566. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined gender differential item function evidence for English language arts item 39201. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined gender differential item function evidence for English language arts item 39755. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined gender differential item function evidence for English language arts item 40993. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined gender differential item function evidence for English language arts item 49638. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined gender differential item function evidence for English language arts item 50786. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined gender differential item function evidence for English language arts item 55472. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined gender differential item function evidence for English language arts item 55475. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined gender differential item function evidence for English language arts item 56085. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined gender differential item function evidence for English language arts item 56991. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined gender differential item function evidence for English language arts item 70825. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined gender differential item function evidence for English language arts item 75304. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined gender differential item function evidence for English language arts item 75954. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined gender differential item function evidence for Mathematics item 25442. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined gender differential item function evidence for Mathematics item 39090. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined gender differential item function evidence for Mathematics item 70834. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined race differential item function evidence for English language arts item 39602. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined race differential item function evidence for Mathematics item 12186. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined race differential item function evidence for Mathematics item 45523. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined race differential item function evidence for Mathematics item 64572. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined race differential item function evidence for Mathematics item 70558. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined race differential item function evidence for English language arts item 23256. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined race differential item function evidence for Mathematics item 16496. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined race differential item function evidence for Mathematics item 40521. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined race differential item function evidence for Mathematics item 68833. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined race differential item function evidence for Mathematics item 68836. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined race differential item function evidence for Mathematics item 69046. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined race differential item function evidence for Mathematics item 81243. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis.