Many areas of online education and educational technologies benefit from AI and machine learning, including online proctoring. Although AI is advancing every day, it still needs human oversight to maximize its capabilities.
But before we show you how combining AI with humans improves online proctoring, we’ll summarize what it is and how it works. If you’re familiar with online proctoring, skip to the next section.
Online proctoring, sometimes called remote proctoring and proctored testing, protects academic integrity by using AI software and/or humans to monitor student behavior during online assessments.
Generally speaking, online proctoring is accomplished in a few ways:
- Fully automated proctoring (only uses AI to monitor student behavior)
- Live proctoring (only humans monitor student behavior)
- Blended proctoring (monitors student behavior with a combination of AI and humans)
It depends on the type of online proctoring used. For example, automated proctoring can include browser lockdown software, which is limited, but it can cover a few aspects of exam protection.
In contrast, blended proctoring solutions are more flexible and used for traditional assessment formats and nontraditional alternative assessment formats, like virtual presentations/demonstrations, handwritten essays and math problems, and students using software to complete activities.
Online proctoring is used to create a fair test environment and protect academic integrity.
While most assume that online proctoring is just a way to prevent students from cheating, some services can improve the entire testing experience for students and faculty.
In this article, we’ll show you how online proctoring that combines AI with machine learning and human proctors can improve online assessments by reducing distractions and test anxiety, providing better exam insights, and streamlining faculty review.
Three ways combining AI with human oversight improves online proctoring and the testing experience for students and instructors:
1. AI + human proctors creates a better test experience with fewer distractions
Fewer distractions mean that students can better focus on their exams. However, some proctoring solutions can trigger unnecessary flags that disrupt students because they’re overly sensitive. The downside for faculty is that those flags take extra time during review.
Many behaviors can trigger flags during an exam, such as students talking to themselves while working through a test question. In general, most proctoring AI can detect sounds, but some have the ability to intelligently detect voices. The terms “sound detection” and “voice detection” are often used interchangeably, but they impact the test experience in different ways.
- Sound detection may trigger a flag for basically any sound, such as a doorbell ringing, a dog barking, or a student coughing.
- Voice detection flags specific keywords and phrases, such as “OK Google” or “Hey Siri.” Instructors can add custom lists of words and phrases that the AI listens for, such as, “What’s the answer?”
While AI voice detection is advanced, it can still be tricky in certain situations. What if the student says a keyword that triggers a flag, but they aren’t actually cheating?
- “OK Google” is used as a keyword that triggers a flag.
- During the exam, the student says, “OK, Google was founded in 1998, so it’s older than Microsoft Bing.”
So, the AI does its job here, but review from a live proctor is key.
When AI voice detection triggers for “OK Google,” it alerts the live proctor, who can review the situation in an analysis window and determine that the student wasn’t cheating, so intervention isn’t required.
2. Provides flexibility to proctor alternative assessment formats and activities
AI works well for most traditional assessment formats, like multiple-choice and true-or-false questions.
But, what if instructors want to test students on their presentation abilities, which includes a demonstration?
Combining AI test monitoring with human proctors is crucial to protecting alternative assessment activities.
For this example, AI monitors for things like other people or prohibited resources in the room, voices, and the use of restricted browsers.
However, during non-traditional assessment activities, like presentations, instructors may want to allow specific resources, such as notecards or a whiteboard.
Instructors can adjust settings before the assessment, decide which proctoring features to use, and provide proctor instructions for further customization. Proctor instructions can provide information, such as resources permitted during the assessment and specific accommodations that provide bathroom breaks and assistive technologies, for example.
Example: The assessment requires students to complete math problems using a pen and paper.
The instructor asks the proctor to turn on “Scratch Paper Allowed” so that students aren’t flagged for looking down at their papers.
Further instructions can require students to use specific items (blank white paper and a black or blue pen) and that they must show the paper before and after each problem is completed.
This combination of AI with human oversight is important because it provides the flexibility to proctor complex alternative assessments while reducing interruptions and flags for faculty to review.
3. Provides data feedback that makes AI smarter and streamlines instructor reviews
AI can collect data from several areas, such as potential violations and suspicious behavior, feedback from human proctors, and input from instructors.
This comprehensive collection of data helps the online proctoring AI continually learn and adapt to provide individual institutions and instructors with better insights about their online assessments. In other words, the AI makes more accurate correlations between specific behaviors that can indicate academic dishonesty and those that are false flags due to oversensitivity or other factors.
This helps proctors and instructors focus on important behaviors and situations related to academic dishonesty and streamlines the review rather than being bogged down by reviewing unimportant flags.
While AI is powerful and continually advancing, it isn’t always perfect and shouldn’t be used as a singular way to protect academic integrity in online testing. Instead, AI should be harnessed to complement, not replace, instructors and proctors.
Honorlock Online Proctoring
What is Honorlock?
Honorlock is an online proctoring service that monitors online assessments with AI combined with live test proctors. Our approach makes online proctoring simple, easy, and human.
How does Honorlock work?
Honorlock’s online proctoring AI monitors the exam session and alerts a live proctor if it detects any potential suspicious behavior. The live proctor can then review the situation in an analysis window before deciding to intervene.
This blend of AI and human review provides students with a less intimidating and non-invasive proctored assessment experience because they aren’t constantly watched as they take their exam.
In fact, a student survey about test anxiety with a partner university showed that Honorlock’s approach to online proctoring actually helped reduce student test anxiety.
Honorlock features and benefits:
- No scheduling needed because students can take proctored exams 24/7/365
- Live, US-based support is available on-demand 24/7/365
- Integrates with your LMS in an hour
- Provides intelligent voice detection
- Can detect cell phones
- Allows proctoring on third-party exam platforms
- Gives instructors easy-to-read, time-stamped reports and recordings
- Finds leaked test content and provides steps to take action
- Offers a flat-rate cost per exam or per student
- Secures and protects student data
- Verifies ID in about a minute
Get in touch to see how Honorlock makes online proctoring better.
Sign up for more online learning & higher education resources