C Supplemental Information About Assessment Design and Development

C.1 Differential Item Functioning Plots

The plots in this section display the best-fitting regression line for each gender group, with jittered plots representing the total linkage levels mastered for individuals in each gender group. Plots are labeled with the item ID, and only items with non-negligible effect-size changes are included. The results from the uniform and combined logistic regression models are presented separately. For a full description of the analysis, see the Evaluation of Item-Level Bias section.

C.1.1 Uniform Model

These plots show items that had a non-negligible effect-size change when comparing equation (3.2) to equation (3.1). In this model, the probability of a correct response was modeled as a function of ability and gender.

The plot of the uniform gender differential item function evidence for English language arts item 33860. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the uniform gender differential item function evidence for Mathematics item 37072. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the uniform gender differential item function evidence for Mathematics item 8502. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis.

C.1.2 Combined Model

These plots show items that had a non-negligible effect-size change when comparing equation (3.3) to equation (3.1). In this model, the probability of a correct response was modeled as a function of ability, gender, and their interaction.

The plot of the combined gender differential item function evidence for English language arts item 14820. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined gender differential item function evidence for English language arts item 33860. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined gender differential item function evidence for English language arts item 34775. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined gender differential item function evidence for English language arts item 37562. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined gender differential item function evidence for English language arts item 38986. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined gender differential item function evidence for English language arts item 38989. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined gender differential item function evidence for English language arts item 44818. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined gender differential item function evidence for English language arts item 55590. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined gender differential item function evidence for English language arts item 56991. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined gender differential item function evidence for Mathematics item 11704. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined gender differential item function evidence for Mathematics item 36498. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined gender differential item function evidence for Mathematics item 37072. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined gender differential item function evidence for Mathematics item 41665. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined gender differential item function evidence for Mathematics item 41683. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined gender differential item function evidence for Mathematics item 8502. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined race differential item function evidence for English language arts item 37622. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined race differential item function evidence for English language arts item 49280. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis.