Oral Exam

Online assessment interview During an online assessment interview, the examiner asks the student questions based on predetermined criteria, using video conferencing software. These could be questions about situations that show that the student has acquired certain skills and competences. The examiner may also ask follow-up questions. Often, an online assessment interview takes place following the submission of a portfolio, project/product or presentation. During an online assessment interview, the student may be allowed to give a short online presentation.

Online oral exam In an online oral exam, the student answers questions orally. As examiner, you can ask follow-up questions or ask the student to clarify an idea, to check that they really understand it. You can ask the question orally and/or in writing (e.g. using the chat function). Online oral exams are often used instead of a written exam with open-ended and/or closed-ended questions.

A combination is of course also possible.

Advantages

• Location-independent.
• Fewer opportunities for cheating.

Disadvantages

• Less reliable if only one examiner is present.
• Technical problems may occur if connection is lost.
• Difficult to organise for a large group of students.

Preparation

Questions The questions that you ask during an online assessment interview or oral exam are no different from those that you would ask face-to-face. You can also use images such as an anatomical or technical drawing, or a model.

Anticipating technical problems The organisation does differ from a face-to-face oral exam. As well as the ’normal’ information (about planning, procedure, equipment, expectations, assessment method), you also need to communicate the ground rules for working on the online platform. For example, rules about sharing the screen, turning the camera/microphone on and off, the procedure for asking questions, and what to do in the case of any technical problems. Many students are happy to know that they can redo an assessment interview if there is a technical problem. You can also encourage students to practice with each other beforehand. Some institutions allow students to loan equipment or provide a physical location for the exam. In any case, make sure to communicate any instructions/ground rules clearly and in plenty of time.

Recording The reliability of the assessment can be improved by recording the assessment interview, as it can be reviewed if there are any questions about the assessment. Make sure to inform the student beforehand if a recording is to be made. Note too that the processing, storage and deletion of recordings must take place in accordance with legal requirements. Find out what the rules are for this at your educational institution.

Multiple examiners The reliability of the assessment can also be improved by using more than one examiner, either during the exam or to review the recording afterwards. In the case of formative assessment, other students can also take on this role.

Topic list It is important to have a lot of questions for an online oral exam. If you have converted an exam with open- and closed-ended questions into an oral exam, you need to take the following into account:

• Closed-ended questions are not recommended in oral exams for a large group of students as the questions might easily be leaked, while asking students different questions further reduces the already impacted reliability. It also makes it more difficult to ask in-depth questions, which is the advantage of an oral exam.
• You can also ask questions about an image such as an anatomical or technical drawing or a model during an oral exam.
• Estimate how many questions you will be able to ask in the time available.
• Make a note of the learning objectives, corresponding questions and follow-up questions in a table. For example:

If the oral exam is based on a written exam with open-ended questions, you can also use the original assessment table, after making a few adjustments.

During the exam

Just before the assessment interview

• Make sure that all the equipment is charged.
• Make sure that the interview can take place in a quiet location where you will not be disturbed.
• Test the equipment before the interview, and use a headset where necessary.
• Make sure that you have the required documents to hand (rubric, assessment form, etc.), either printed out or on a second screen.
• Log into the video conference a few minutes before the exam.
• Make sure that any documents such as images to accompany questions are ready.

Start

• Reassure the student.
• Check that the rules are clear, and repeat them if necessary.
• Tell the student when they can expect the grade and/or feedback.
• If necessary, explain that the exam will be recorded.

Exam

• Deal with any technical problems.

End of exam

• If you are working with other examiners and would like to provide direct feedback, you could ask the student to leave the online session for a moment or put them in a breakout room. You can then invite the student to return to the session once you have discussed the observations with the others.

After the exam

Provide the student with feedback immediately after the assessment interview and before giving a grade, as this is when the student is most receptive to the feedback. You may decide to allow the student access to the recording afterwards.

Points to note

• Students find oral exams stressful, and being clear about what they can expect can help. Make sure therefore to inform the students in full and in plenty of time about the content of the exam, the procedures, the examiners taking part and the assessment method, and set out the ground rules for use of the online platform.
• Students with autism may find an online assessment interview particularly difficult. Make sure that these students can prepare properly for the interview, by being very clear about the procedure and the assessment method and about what is expected. You could also ask the students what you can do to make it easier for them.

• When old becomes new (Akimov and Malin 2020) describes how online oral exams can be used as an online assessment tool or to supplement other assessment tools. The online oral exam is mainly used as an interview. Tips are provided for ensuring the reliability and validity of this form of online assessment.
• An article (in Dutch) by the Open University on online oral exams. This article describes the main procedural aspects of online oral exams.