The game is simple:
Two photos side by side
One’s made by a human, one’s made with AI
Pick the AI one
See if you’re right (plus the source/prompt)
Is this site just going to use the results to train AI to generate better fake imagery?
I don’t think much training can be done on 20 pictures
This is literally us giving them training data for AI to identify what pictures look like AI…
Which in turn is training data to help AI make better pictures
Nice try but I’m not doing QA checks for generative AI slop.
It seems like a reply to the wrong point.
I’m not saying most people can tell the difference. If they can now, they won’t soon. My issues with AI are about training on people’s work and then killing their jobs. Also destroying the environment, and other issues.
Those images are very AI-easy IMO. No crowds or complex images.
70%. I noticed that the more I tried to dissect it, the worse I was. I was far more accurate taking a quick glance at both and making a decision after like 5 seconds.
Interesting, I was kinda the opposite. I got 80% looking very carefully at each pair.
Just like multiple choice quizzes, go with your first guess if unsure.
I didn’t zoom in or anything like that, but I also feel like I was playing against “Dev traps” instead of unbiased pairs if that makes sense.
🤖 Reality Check #1 15/20 🔥 Perfect Streak: 9
I can spot AI images 75% of the time. 🧠 Can you beat me? realitycheckk.com
🤖 Reality Check #1 20/20 🔥 Perfect Streak: 20
I can spot AI images 100% of the time. 🧠
Most of the AI generated images looked too clean and smooth. It made me appreciate the real images more.
Yeah, the quickest way to tell was to look for things that AI wouldn’t include, like brown tips on flower petals or broken sticks that have the right fracture pattern and don’t just fade away. AI tends to generate things that are very averaged/ideal looking. The textures of ai images also look wavy with like a 10-20pixel periodicity when zoomed in. The noise from real cameras is much more speckly.
I also got 20/20, but only because it was an A/B comparison. If asked AI or real on each image indlividually, I’m not sure I would get much above 65%.
Reality Check #1 19/20
This thing messed me up:
They both looked like they could be AI - but to me it looks like that one has an AI artifact
Meh, the block just got pushed vertical, but it is weird, agreed. The one on the left doesn’t strike me as natural. Ice neither forms nor breaks up like it’s been put through a blender.
This broke my streak…
Same
Here’s the thing: you should expect some things that aren’t average in reality. Sure, most ice won’t do what you’re looking at, but some will. The left image all looks the same across the image. There’s nothing that is non-average looking.
That’s one of the problems with AI images, anything that looks weird is now dismissed as AI even if the photos are century old. A colleague of mine said crabeater seal teeth are definitely AI, for instance.
crabeater seal skull
That’s the one got me too.
fuck that UI. tapping to select and zoom below is odd. I messed up a few and exited.
The swipe to move to the next slide was so similar to the swipe backwards, I exited twice and gave up.
Skill issue /s
20/20.
The nature shots were harder than shit that had man-made things or people in them. But also, the resolution of each pairing being dramatically different kinda gave a pattern to which one would be which.
So the hardest part was that a lot of the pairings both looked like AI and every 50/50 guess I made was wrong. Many real images that I got wrong looked like staged professional shots with a ton of digital manipulation afterward.
Final Accuracy: 60%
AI image generation is in this weird place between professional staged shots and amateur photography and is probably there because the training set includes both.
Same, I was looking for inconsistencies in lighting, black/white points, etc, and I think in several cases I picked an image as AI based on details that were a result of photo manipulation and not “real”. I got the same score as you in the end here.
Kinda interesting, somewhat invalidated what I thought this was testing, but it’s an interesting test nonetheless. I may retake this in a few days now that I know it’s comparing AI to photoshop and not “reality”. Would certainly need a different strategy.
Plot twist: they were all AI generated.
That’s what I would do if I would create such a test. But I would add the option “can not decide” to keep it a bit more fair.
🤖 Reality Check #1 19/20 🔥 Perfect Streak: 18
I can spot AI images 95% of the time. 🧠 Can you beat me? realitycheckk.com
The one pic with the pink flower and water bubbles under water really put me off
Yep that got me too. Those lily pads looked very unlikely
🤖 Reality Check #1 16/20
🔥 Perfect Streak: 12
I can spot AI images 80% of the time. 🧠It’s almost always, “this looks too clean/perfect.”
Am dumb?
🤖 12/20 🔥 Perfect Streak: 4
I can spot AI images 60% of the time. 🧠
Got up to 11 myself before I lost it.
