icon

Definition

By digital assessment, we mean assessment using a software programme that has been designed for that purpose. This can be a part of an e-learning platform such as Canvas, or a separate assessment software programme such as TestVision or Remindo. Digital assessment makes it possible to use various types of questions, from multiple choice, to drag and drop, to short essay questions. Digital assessment is suitable for assessing the following levels of cognitive learning: remembering, understanding, applying, analysing and evaluating.

icon

Online

Digital assessment can take place either on-campus or online. However, a decision needs to be made as to whether it can also be taken at any time. Should every student take the exam at the same time, or can they take it at …

Digital assessment can take place either on-campus or online. However, a decision needs to be made as to whether it can also be taken at any time. Should every student take the exam at the same time, or can they take it at different times? In the case of formative assessment, there is little objection to this. However, it does have implications for summative assessment, as the questions from previous exams may have been leaked. For both location- and time-independent summative assessment, we advise making sure that the online proctoring is working properly (see, in Dutch, Klinkenberg, 2021).

Formative

Examples of digital formative assessment could be a practice test for an exam that covers all of the learning objectives, or an exam that covers a limited set of learning objectives, such as an online formative exam that selects random questions from an item bank on a specific subject. Another possibility is the use of a practice test as a learning tool. Such a test could include theory in the form of short videos, text, images and other files. An example is an Excel assessment test, which first explains how to use Excel, then has the student download an Excel file, explains how to carry out a certain action, and has a field in which the student can enter the outcome of the action. The results of formative exams are valuable both for the student and the lecturer, as they provide both with insight into the student’s progress as well as any gaps in the student’s knowledge.

Advantages and disadvantages

  • Student can receive direct feedback, as part of the learning process.
  • This does not depend on the lecturer, but is provided by the system.
  • Answers can be marked automatically and narrative feedback can be added.
  • The results can provide insight into the learning process, both for the students and the lecturer.
  • It is time-consuming to design and fine-tune good assessments.

Summative

There are some difficulties involved in the use of online exams to provide a grade. To ensure that the exam is the student’s own work, it is imperative that the student’s identity can be verified for the complete duration of the exam. Online proctoring makes this possible, but its effectiveness depends very much on the selected method. Generally speaking, there are four types of online proctoring (SURF, 2020):

*Live proctoring using conference software (SURF report §1.2) *Live proctoring using proctoring software (SURF report §1.3) *Recording and post-monitoring using proctoring software (SURF report §1.4) *Automated reviewing (SURF report §1.4)

Depending on how important an exam is, a decision needs to be made as to which form of online proctoring should be used. Find out which facilities are available at your educational institution and what the policy is concerning the use of online proctoring.

Advantages and disadvantages

  • Can provide an alternative if there is a lack of capacity on-campus.
  • Gives students with a functional impairment the opportunity to take an exam at home, where they may have better facilities.
  • Reduces the pressure on public transport.
  • A technical challenge: it is very annoying if something goes wrong.
  • Increases the pressure on boards of examiners.
  • Can be considered a breach of privacy.
expand section expand section Show more Show less
icon

Approach

Various steps are involved, depending on whether formative or summative assessment is used. Furthermore, the number of questions in an exam that cannot be marked automatically will depend on the number of students and the time …

Various steps are involved, depending on whether formative or summative assessment is used. Furthermore, the number of questions in an exam that cannot be marked automatically will depend on the number of students and the time available for marking.

Formative

Prior to assessment

Choice of assessment method: preferably the same as for summative assessment, so that students can familiarise themselves with the selected method.

Design of exam questions or educational resources: we advise doing this well before the course starts.

The design of formative exams, and in particular of practice exams as a learning resource, can be very time-consuming. However, student assistants can help with this. Please also see interview, in Dutch, in which this is discussed.

During assessment

Formative assessment does not have to take place at a specific time. Assignments can also be made available for a week, or to prepare for a lecture or seminar.

After assessment

To maximise the learning outcome, students should be able to access their answers and the model answers after they have completed the formative assessment.

Insight into the student’s answers can also help the lecturer to see where difficulties still exist. Such insights can then be used to make adjustments to the teaching during the course.

Points to note

The results obtained in a formative exam can influence the effort that students put into their studies. This is particularly the case in a large student group.

If the formative exam counts toward the final grade, this can have a negative impact. It may therefore be worth considering a different reward system, such as a straf staffel.

In one course unit in which the learning material was assessed later on in the course, we converted a summative multiple choice test into a formative assessment, to be completed by students in groups of three. The resulting discussion had such a big learning outcome that no proctoring was required.

Summative

Since providing a practice exam with proctoring, we have had far fewer technical issues with real online exams.

Prior to assessment

Design your assessment questions, preferably in a personal or shared item bank so that you can reuse the questions later.

Depending on the exam procedure at your educational institution, some tasks such as planning an exam date, adding students to the exam group and informing students of the exam will be done for you.

Make sure to communicate clearly to the students how the online proctoring system works. Not all students have a suitable work space at home or the required equipment. Tell the students what you expect in plenty of time, as well as what they need, how they can request support from the university (e.g. loan equipment) and how they can practice prior to the exam.

During assessment

Depending on the chosen proctoring method, you are either virtually present in the conferencing software, are watching live or are on standby.

After assessment

The processing of the proctoring results depends not just on the chosen proctoring method, but also on the agreements made at your educational institution. You should therefore familiarise yourself with your institution’s policy and procedure.

If use is made of ‘recorded proctoring’ or ‘automated proctoring’, the recordings will need to be analysed. Any cases of suspected cheating will then be forwarded to the examiner or the board of examiners for assessment.

Further processing of the results is then carried out in the same way as the processing of all other digital assessments at the institution.

Points to note

Not all students are able to complete exams at home, especially if online proctoring is required. You should therefore alert the students to other locations where they may take the exam, or to opportunities for support (such as the loan of a laptop and/or webcam).

If proctoring is to be used, let the students take a practice exam so that they can practice using the system. This is also important for students with a visual or hearing impairment who use speech recognition or text-to-speech software.

For students who object to the use of online proctoring, many educational institutions provide the possibility to take the exam on-campus.

The national clinical perfusionist course uses automated proctoring for online assessment. This means that students no longer need to travel from Groningen or Maastricht to Leiden to take an exam.

expand section expand section Show more Show less
icon

Tips

I have students write their own exam questions and let other students use them as practice material. Some of these questions can also be used in the exam.

  • Use tags to link your learning objectives to the formative and summative online exams and report the results to the students and to yourself as lecturer. See SURF publication, in Dutch.
  • In the case of formative assessment, emphasise that it is permitted to make mistakes, but that the students should do their best to practice.
  • Ensure compatibility between formative and summative assessment.
icon

References

Bibliography

Molkenboer, Harry. 2015. Toetsen Volgens de Toetscyclus. Bureau voor Toetsen & Beoordelen.
Nguyen, Joseph G, Kristopher J Keuseman, and Jonathan J Humston. 2020. “Minimize Online Cheating for Online Assessments During COVID-19 Pandemic.” Journal of Chemical Education 97 (9): 3429–35.
expand section expand section Show more Show less

Different assessment method

For assessment methods (Verschillende toetsmethoden die online inzetbaar zijn.) - Change groupsize