How I Use AI to Catch Cheaters at School

It's a tale as old as teaching -- a student, for one reason or another, uses someone else's work to complete their assignment. Only in 2024, that someone else could be an artificial intelligence tool.

The allure is understandable. Away with those shady essay writing services where a student has to plonk down real cash for an unscrupulous person to write them 1,200 words on the fall of the Roman Empire. An AI writing tool can do that for free in 30 seconds flat.

As a professor of strategic communications, I encounter students using AI tools like ChatGPT, Grammarly and EssayGenius on a regular basis. It's usually easy to tell when a student has used one of these tools to draft their entire work. The tell-tale signs include ambiguous language and a super annoying tendency for AI to spit out text with the assignment prompt featured broadly.

For example, a student might use ChatGPT -- an AI tool that uses large language model learning and a conversational question and answer format to provide query results -- to write a short essay response to a prompt by simply copying and pasting the essay question into the tool.

Take this prompt: In 300 words or less, explain how this SWAT and brand audit will inform your final pitch.

This is ChatGPT's result:

I have received responses like this, or those very close to it, a few times in my tenure as a teacher, and one of the most recognizable red flags is the amount of instances in which key terms from the prompt are used in the final product. 

Students don't normally repeat key terms from the prompt in their work in this way, and the results read closer to old-school SEO-driven copy meant to define these terms rather than a unique essay meant to demonstrate an understanding of subject matter.

But can teachers use AI tools to catch students using AI tools? I came up with some ways to be smarter in spotting artificial intelligence in papers.

Catching cheaters with AI

Here's how to use AI tools to catch cheaters in your class:

1. Understand AI capabilities: There are AI tools on the market now that can scan an assignment and its grading criteria to provide a fully written, cited and complete piece of work in a matter of moments. Familiarizing yourself with these tools is the first step in the war against AI-driven integrity violations. 
2. Do as the cheaters do: Before the semester begins, copy and paste all your assignments into a tool like ChatGPT and ask it to do the work for you. When you have an example of the type of results it provides specifically in response to your assignments, you'll be better equipped to catch robot-written answers. You could also use a tool designed specifically to spot AI writing in papers.
3. Get a real sample of writing: At the beginning of the semester, require your students to submit a simple, fun and personal piece of writing to you. The prompt should be something like "200 words on what your favorite toy was as a child," or "Tell me a story about the most fun you ever had." Once you have a sample of the student's real writing style in hand, you can use it later to have an AI tool review that sample against what you suspect might be AI-written work.
4. Ask for a rewrite: If you suspect a student of using AI to cheat on their assignment, take the submitted work and ask an AI tool to rewrite the work for you. In most cases I've encountered, an AI tool will rewrite its own work in the laziest manner possible, substituting synonyms instead of changing any material elements of the "original" work.

Here's an example:

Now, let's take something an actual human (me) wrote, my CNET bio:

The phrasing is changed, extracting much of the soul in the writing and replacing it with sentences that are arguably more clear and straightforward. There are also more additions to the writing, presumably for further clarity.

The most important part about catching cheaters who use AI to do their work is having a reasonable amount of evidence to show the student and the administration at your school if it comes to that. Maintaining a skeptical mind when grading is vital, and your ability to demonstrate ease of use and understanding with these tools will make your case that much stronger.

Good luck out there in the new AI frontier, fellow teachers, and try not to be offended when a student turns in work written by their robot collaborator. It's up to us to make the prospect of learning more alluring than the temptation to cheat.