US Universities Abandon AI Detectors Amid Homework Scams Concerns

Biology professor Timothy Paustian at the University of Wisconsin-Madison has been grappling with a growing problem: students using artificial intelligence to complete their homework assignments. But instead of relying on AI detectors, his institution is rethinking its approach to teaching and assessment methods.

The use of large language models (LLMs) has made it easier for students to generate credible solutions to written assignments within seconds. However, studies have shown that AI text detectors are often unreliable, generating false positives that can erode trust between instructors and students.

In one assignment designed to test students’ ability to evaluate scientific arguments, Paustian inserted a hidden prompt to catch potential cheaters. But even this strategy proved ineffective against current LLMs, which ignore such prompts or remove them before submitting the work.

Paustian has effectively given up on traditional writing assignments for lower-level classes, acknowledging that LLMs are pushing educators to be more creative in their assessments. He believes students need to learn how to think critically and demonstrate this skill through various means, not just written assignments.

As AI cheating becomes increasingly widespread, four US university professors told AFP they are rethinking how to evaluate students’ work. They are pairing take-home written assignments with oral exams or video debates to make it more difficult for students to rely on LLMs.

A growing number of universities have either banned or discouraged faculty reliance on AI detection tools as the primary evidence of alleged cheating. The detectors can be imperfect, carry the risk of false positives, and may even discriminate against non-native English speakers.

False charges of AI cheating can damage a student’s academic record or upend their career prospects. In some cases, students have sued universities that accused them of cheating in coursework. Cornell University has stated that detection technologies are unlikely to provide a workable solution due to the difficulty in accurately detecting AI-generated content.

The detectors may also be ineffective against new ‘humanising’ tools emerging that rewrite AI-generated text to make it appear more authentic. Researchers warn of a technology arms race between detector developers and those creating evasive LLMs.

A recent survey by the American Association of Colleges and Universities and Elon University found 95% of college faculty fear students’ over-reliance on AI tools. Some academics argue that this reliance can lead to ‘cognitive surrender’, where students fall back on LLMs at the first sign of struggle.

However, others emphasize the need for students to develop AI skills to improve efficiency and meet modern workforce demands. Harvard College dean David Deming has suggested accepting or even encouraging AI in writing-based courses as a way to adapt to changing educational needs.

The debate among academics highlights the challenges universities face in addressing homework scams while also preparing students for an increasingly technology-driven world.