New ask Hacker News story: Super Simple "Hallucination Traps" to detect interview cheaters
Super Simple "Hallucination Traps" to detect interview cheaters
4 by EliotHerbst | 0 comments on Hacker News.
After testing out Cluely with my team, we suspect that the easiest way to detect interview cheaters is to set simple "hallucination traps" where you ask a question that sounds plausible, but any knowledgeable person would instantly identify as a joke, fake, or just simply say they don't know. Vibe coded a simple app demonstrating the concept - https://beatcluely.com/ Here are some examples of this class of prompts which currently work on Cluely and even cause strong models like o4-mini-high to hallucinate, even when they can search the web: https://ift.tt/YI2QhHu https://ift.tt/5E6kx9K https://ift.tt/JZ7PKVh https://ift.tt/yFZYV3H https://ift.tt/W05XSgh Link to the vibe-coded code for the site: https://ift.tt/vrQlDXR
4 by EliotHerbst | 0 comments on Hacker News.
After testing out Cluely with my team, we suspect that the easiest way to detect interview cheaters is to set simple "hallucination traps" where you ask a question that sounds plausible, but any knowledgeable person would instantly identify as a joke, fake, or just simply say they don't know. Vibe coded a simple app demonstrating the concept - https://beatcluely.com/ Here are some examples of this class of prompts which currently work on Cluely and even cause strong models like o4-mini-high to hallucinate, even when they can search the web: https://ift.tt/YI2QhHu https://ift.tt/5E6kx9K https://ift.tt/JZ7PKVh https://ift.tt/yFZYV3H https://ift.tt/W05XSgh Link to the vibe-coded code for the site: https://ift.tt/vrQlDXR
Comments
Post a Comment