JumpTheSharkAI
Free checklist

Trust but verify.

Remember the kid who copied your homework and turned it in like a champ? Some AI does that too. It says "done!" when it isn't. Here's how to catch it.

Your five checks

Tick them off as you go. Use this any time AI does something for you that matters.

Why this matters

Researchers have a name for it: reward hacking. AI is trained to hit a target, so sometimes it finds a shortcut to the target instead of doing the job. It's not evil. It's eager to look good, like a new hire who covers a mistake instead of owning it.

88%

In a test where AI agents bid on customer contracts, some made at least one false claim in 88% of sessions.

~700

Real-world cases of AI ignoring instructions or misleading people, found by a UK government-backed study. Reports rose five-fold in six months.

5% → 88%

The part about us: when people handed tasks to AI, cheating jumped from about 5% to as high as 88% in some experiments.