Many companies have mixed feelings about emerging AI tools, especially ChatGPT. While some companies are already using ChatGPT, many are still skeptical of the potential risks.
How are companies using ChatGPT and other similar AI tools?
Companies are using ChatGPT for things like:
- 24/7 chat support
- Interactive training & simulations
- Writing sales emails, website copy, and training materials
- Translating and localizing content
- Debugging code
Companies using ChatGPT are enjoying the benefits, but there are a lot of risks.
Risks for companies using AI tools like ChatGPT
AI tools like ChatGPT can create significant risks for companies, such as:
Data security: anything typed into ChatGPT is collected, saved, and could be used in future responses to other users.
- What if a developer asked it to debug code?
- What if employees’ personally identifiable information is accidentally used?
Employee training: AI tools can automatically answer questions during post-training tests.
- What if employees skip company security training but pass your training assessments because they used ChatGPT?
Assessing job skills: ChatGPT can provide step-by-step instructions to complete tasks, including tasks within software like Salesforce, Quickbooks, Excel, Google Analytics, etc.
- What if employees are promoted after using AI to pass a skills test?
Certification exam integrity: participants can use AI tools to answer exam questions, write responses, and even complete complex math problems.
- How much would that hurt the reputation of your certification programs?
Pre-employment assessment: job candidates could use AI tools to pass pre-employment assessments, even those requiring in-depth product expertise.
- How much would that cost your company in the long run?
How to stop AI tools during corporate assessments
Whether it’s assessments after security training, certification exams, or pre-employment assessments, you need to keep AI tools under control. This section shows you instructional design tips and technologies that can prevent the use of AI during corporate exams.
Will browser lockdown software, plagiarism checkers, or AI detection tools work? Not really.
They can help, but they’re easy to work around. If you’re only using browser lockdown software, what if the test taker uses ChatGPT on their cell phone?
Both AI detection tools and plagiarism checkers have proven to be pretty ineffective against tools like ChatGPT for a few reasons:
- ChatGPT doesn’t plagiarize content from the internet
- Giving ChatGPT detailed prompts creates tailored responses that are nearly impossible to detect, while basic prompts will usually be caught.
- Basic prompt example: Explain capital gains.
- More detailed prompt example: Explain what capital gains are in 75 words or less. Don’t use these words: refer, asset, investors, returns. Write conversationally and use an analogy. Include a sentence that says: Capital gains basically tell you if you’ve made money or lost money.
Tips to help stop AI during corporate testing
Ask for written responses based on the employee’s role, the organization itself, or specific case studies
Asking for responses to questions about their role-specific resources, like case studies, makes AI like ChatGPT less effective because, while it was trained on internet resources, it doesn’t have access to specific resources (currently) and it doesn’t plagiarize.
Ask for responses that encourage participants to apply their knowledge in different ways and integrate their opinions and reasoning. Examples below.
General question | Example role-specific question |
|---|---|
1. What are three similarities and three differences between Agile methodology and Waterfall model? | 1. What are three ways your daily planning, documenting, and carrying out tasks would change with a shift from Waterfall to Agile? |
General question | Example role-specific question |
|---|---|
1. What are three advantages and three disadvantages of using Agile methodology? | 1. Why did ABC Corporation decide to stop using Agile and transition to Waterfall?
|
2. What are three different situations when it’s better to use Waterfall instead of Agile? | 2. Given ABC Corporation’s situation, would you continue using Agile or switch to Waterfall? Provide three reasons.
|
Use video responses to dig deeper into a subject
Aside from practicing presentation skills and increasing engagement, answering test questions on video is a great way to further assess test takers’ knowledge. The goal is for them to elaborate on a topic and express their knowledge, ideas, and opinions in different ways.
Example of a written question and follow-up question for a video response:
- Written question: What are three ways your role would change in terms of planning, documenting, and executing your daily tasks if our company transitioned from Waterfall to Agile?
- Video response follow-up question:Give a 1-2 minute spoken summary of how this transition would impact the way you work with other departments.
How to use online proctoring software to stop AI tools during online corporate testing
Detect cell phones and other devices
Lockdown the browser and control access
Most online proctoring services offer browser lockdown software, which is an entry-level tool that prevents access to unauthorized sites and applications. But some proctoring platforms offer admins the flexibility to give participants access to specific resources while blocking all others.
Example: allowing participants to watch two specific videos on YouTube while blocking all other videos, websites, and applications.
Using Honorlock’s Smart Voice Detection technology makes sure that participants aren’t asking virtual assistants, like Siri and Alexa, to navigate ChatGPT and read the responses to them.
Here’s how it works: Our Smart Voice Detection listens for specific keywords and phrases that can activate virtual assistants, like “Alexa” and “Hey Siri,” and records and transcribes what’s said.
Check the room for other devices and monitor behavior
Proctoring software that uses video helps ensure that participants aren’t using unauthorized devices (like cell phones or other computers), and it monitors and records behavior during tests.
Disable keyboard shortcuts like copying and pasting
If an employee or participant has a basic idea of what they’ll write about during the test, they could generate a response in ChatGPT before the test starts, then copy and paste the response to use as their own. Some browser lockdown software prevents the use of keyboard shortcuts and flags the behavior.
Stay ahead of AI cheating with Honorlock’s remote proctoring software and services
AI evolves every day. Make sure your strategies to protect against it are evolving too.
While updating test questions is a great start, you need technology in place to be certain that academic integrity is protected. That’s where Honorlock fits in.
Honorlock’s blended remote proctoring solution is flexible, scalable, and cost effective.
Here’s how Honorlock works: Powerful AI monitors exams and alerts a live proctor if it detects potential academic dishonesty. The proctor can review the situation and decide whether to intervene or not. This creates a non-invasive test environment that won’t distract test takers.
Read our G2 reviews to learn why Honorlock is the best online proctoring service.