Beyond multiple choice - balancing the affordances and constraints of closed- and open-response formats

Free-response conceptual assessments, like the Colorado Upper-division Electrostatics Diagnostic (CUE), provide rich, fine-grained information about students' reasoning. However, because of the difficulties inherent in scoring these assessments, the majority of the large-scale conceptual assessments in physics are multiple-choice. To increase the scalability and usability of the CUE, we set out to create a new version of the assessment that preserves the insights afforded by a free-response format while exploiting the logistical advantages of a multiple-choice assessment. We used our extensive database of responses to the free-response CUE to construct distractors for a new version where students can select multiple responses and receive partial credit based on the accuracy and consistency of their selections. Here, we offer examples of the questions and scoring of this new coupled multiple-response CUE. We also present a direct comparison of test statistics for both versions and potential insights into student reasoning from the new version.