Go deeper · from Step 4 · about 15 minutes
Assessment twins
Step 4 introduced the twin, a second assessment of the same learning outcome, and two ways to score the pair. This page goes further into the reasoning behind it and the design process the authors propose, including what to do when the two parts disagree.
The summary on this page is ours. Quotations are in the article’s own words. Read the article in the Journal of Applied Learning & Teaching.
§01 The starting point
A question of validity
If you can’t tell whether work is the student’s own, you can’t tell whether they have met the standards of the course either. Roe, Perkins and Giray follow Dawson and colleagues (2024) in treating this as a problem of validity. Detection tools are too unreliable to base decisions on, and guidelines that only describe acceptable AI use depend on students complying (Corbin, Dawson and Liu, 2025). Responses built on surveillance may also affect the relational side of assessment, and Carless (2009) argued that reform depends on trust between students and institutions.
Our addition. This is why we don’t treat rules about AI use as a security measure. A rule says what you hope students will do, and in a task done at home nobody can see whether they do it.
The authors find structural redesign more promising, but the literature offers few concrete methods for it. They would also keep take-home essays and other unsupervised work, since essays develop abilities like self-regulated learning and metacognitive awareness that other formats can’t develop as well (Corbin et al., 2026).
Their idea of validity comes from Messick (1989). Validity is one overall judgement of how far the evidence supports the appropriateness, meaningfulness and usefulness of assessment results, and it is always made about particular tasks and their results. Each pair you design therefore has to be judged on the evidence it produces.
Validity is a property of particular assessment results rather than of the twin approach itself.
§02 Design step 1
Find the vulnerability
The authors’ definition ties a twin to a known vulnerability, such as AI completing the task or someone impersonating the student. No twin has been tried in practice yet, and they propose an iterative process in three steps, followed by a pilot. The first step takes a threshold level of AI literacy, enough to know what current models can and can’t do. Three questions help you judge the risk.
- Could AI produce high-quality work for the task with little or no input from the student?
- Can the student do it remotely, without supervision?
- How hard would it be to tell AI-generated work from the student’s own?
If most or all of these apply, a twin may help. Being unsupervised doesn’t make a task vulnerable on its own, though. The authors’ example is an art project in oils on canvas, which a student can make at home and which still isn’t meaningfully open to AI completion. For a structured check they point to the PANDORA rubric (Bannister et al., 2025), which rates how susceptible a task is to undeclared AI use.
§03 Design step 2
Start from the learning outcome
Next you spell out what the assessment has to measure, meaning what a student needs to know and be able to do in order to pass, and map both parts onto those outcomes. Reading them closely also shows which parts of the learning AI is most likely to undermine. The article gives two examples.
Evaluating sources critically
An essay can show a clear, structured argument. An oral discussion, or a video in which the student reflects on the work, can then verify the reasoning behind it.
Applying knowledge in practice
A simulation of an authentic task, or a problem-based task in class, can be combined with a written report. In this example the report is the secondary part.
Real-time formats such as oral explanations and group discussions may be out of reach with large cohorts and few resources, and then the authors suggest exploring peer assessment, team-based assessment for instance. Group work can be vulnerable too, if individual contributions are produced with AI.
A twin can be low-tech, like an oral defence, or high-tech, like a concept map that a group builds with AI tools in class. For generalisation the authors suggest assessing the same outcomes in low- and high-technology settings, restricting AI where needed.
Our addition. So the twin doesn’t have to be the part without AI. Students use AI in several roles, working alone, letting AI help or handing parts of the work over, and they move between them in no fixed order. What a twin can check across all of them is the student’s own understanding.
§04 Design step 3
When the two parts disagree
The threshold and the confirming weight from Step 4 both rest on what the authors call interdependence. One part has a say in what the other is worth, so a 50/50 split between a prepared presentation and an interview wouldn’t qualify. The framework assumes that a gap between the parts tells you something about the learning.
In their section on limitations the authors are more careful. A gap can have legitimate causes, such as anxiety, uneven skill development or less familiarity with one format, and two formats may not capture equivalent learning outcomes at all. They list reconciling conflicting grades among the barriers still to overcome.
Oral formats can be especially hard for students with social anxiety, other communication styles or another cultural background, and language barriers weigh on international students and others for whom English isn’t a first language. They still regard oral work as an important part of higher education, and they suggest supporting students with practice and scaffolding. Accommodations for disabled students have to cover both parts, they add, and Universal Design for Learning can help you anticipate diverse needs early.
Our addition. Decide in advance what a mismatch will lead to. We would treat it as a reason for a second conversation about the student’s drafts or notes before it becomes a mark. Nerves or language may explain the gap, so give credit for understanding even when a student expresses it haltingly or in a second language.
Watch how it works
If you try a twin, the authors suggest monitoring it. Compare the grades on the two parts, record outliers and discrepancies, and use student feedback to develop the design.
§05 Neighbours
Twins among other designs
The article presents twins as a way to triangulate evidence across formats that are good for learning and vulnerable to AI. Its examples of lower-risk modes for the second part are a supervised discussion, a quick derivation in class, an oral walkthrough and a process log.
Our addition. The process log is where twins meet Black Box Assessment (Winstone, Gravett and Elkington, 2026), which builds the process into the task and asks students to make their thinking visible through reflections, drafts and feedback encounters. Roe and colleagues add a second task that confirms the first. The two can be combined, and Black Box Assessment has its own deep dive.
§06 Read it for what it is
A proposal waiting for evidence
The article is conceptual, and no empirical data on the approach exist yet. The authors call the model a “bold and necessary experiment” (p. 10).
Twins cost staff time and need administrative and institutional support. Random sampling, the authors’ own answer for large cohorts, could weaken the validity the twin is meant to protect. For very large cohorts or tight resources they see a twin as possible but not optimal, and a complete redesign of the overall assessment strategy as more likely to help. Extra assessment also puts unequal pressure on students with paid work or family responsibilities.
Step 4 noted the risk the authors find perhaps most concerning, which is how twins are framed. Presented mainly as a way to catch AI misuse, they can build a surveillance mentality that treats students as potential cheaters and wears down the trust education depends on. Their conclusion points towards several assessment modes that work as complementary learning opportunities.
They call for pilot studies, mixed-methods research that includes student stress and staff workload, longitudinal studies of whether twins improve learning, and research into whether twin performance relates to competence outside the university.
Your own assessment
Choose one assessment in your course that is vulnerable to AI.
- Which aspect of validity is most at risk? Think of content, thinking, scoring, consequences, generalisation and the link to practice.
- Which twin could confirm the same learning outcome, and can you run it with the number of students you have?
- Should the twin set a threshold, confirm the grade or count as a weighted part, and how will you make it fair to every student?
Sources
- Bannister, P., Santamaría Urbieta, A. and Brufau Alvira, N. (2025). Appraising higher education assessment validity: development of the PANDORA GenAI susceptibility rubric. Journal of Applied Learning & Teaching, 8(1), 41–55. doi.org/10.37074/jalt.2025.8.1.20
- Carless, D. (2009). Trust, distrust and their impact on assessment reform. Assessment & Evaluation in Higher Education, 34(1), 79–89. doi.org/10.1080/02602930801895786
- Corbin, T., Dawson, P. and Liu, D. (2025). Talk is cheap: why structural assessment changes are needed for a time of GenAI. Assessment & Evaluation in Higher Education, 50, 1087–1097. doi.org/10.1080/02602938.2025.2503964
- Corbin, T., Walton, J., Bannister, P. and Deranty, J.-P. (2026). On the essay in a time of GenAI. Educational Philosophy and Theory, 58(3), 198–210. doi.org/10.1080/00131857.2025.2572802
- Dawson, P., Bearman, M., Dollinger, M. and Boud, D. (2024). Validity matters more than cheating. Assessment & Evaluation in Higher Education, 49(7), 1005–1016. doi.org/10.1080/02602938.2024.2386662
- Messick, S. (1989). Validity. In R. L. Linn (Ed.), Educational measurement (3rd ed., pp. 13–103). American Council on Education.
- Roe, J., Perkins, M. and Giray, L. (2026). Assessment twins: an approach for strengthening assessment validity in the age of generative AI. Journal of Applied Learning & Teaching, 9(2). Open access (CC BY). doi.org/10.37074/jalt.2026.9.2.3
- Winstone, N. E., Gravett, K. and Elkington, S. (2026). Black Box Assessment: rethinking integrity and learning for a time of generative AI. Assessment & Evaluation in Higher Education. Open access (CC BY-NC-ND 4.0). doi.org/10.1080/02602938.2026.2661365

