What signals do AI detectors actually measure?
Most detectors estimate how statistically predictable a passage is. Two common signals are perplexity, which measures how surprising each word is given the words before it, and burstiness, which measures how much sentence length and complexity vary. Many detectors also feed text into a machine-learning classifier trained on human and AI samples that outputs a probability. None of these signals identify an author with certainty.
What is watermarking and does SynthID-style detection change things?
Watermarking embeds a subtle, statistical signature into a model's output at generation time, and a matching detector such as Google's SynthID looks for that signature later. It can be more reliable than guesswork, but only for text produced by the specific model that added the watermark, and it can weaken after heavy editing or paraphrasing. It does nothing for text from models that never watermarked their output.
Why do AI detectors produce false positives?
Because they judge predictability, not authorship. Plain, well-structured writing, formulaic formats and non-native English can all look statistically predictable and get flagged as AI even when a human wrote every word. Famous human-written texts have been wrongly flagged in tests. False positives are an inherent limitation of the statistical approach, not a rare glitch.
How accurate are AI detectors?
Accuracy varies widely by tool, text length and text type, and vendor accuracy figures are usually measured under favourable conditions. Real-world performance is lower, especially on short passages, edited or paraphrased text, and writing by non-native speakers. Because both false positives and false negatives occur, no detector should be treated as a reliable single source of truth.
What does an AI-detection score actually mean?
A score is an estimate of the probability that text resembles AI-generated writing based on statistical patterns. A high score means the text looks predictable to that tool, not that it was definitely written by AI. Different detectors give different scores for the same text, and scores change as tools are updated, so a percentage is a rough signal rather than proof.
What should I do if my genuine writing is wrongly flagged?
Stay calm and gather evidence of your process: keep drafts, outlines, version history, and document metadata that show how the work developed. Ask which detector was used and point out that detectors produce false positives, especially on plain or non-native English writing. Request a fair review rather than accepting a single score as proof, and going forward save your revision history routinely.