AI Text Detection Signals 2026: How Detectors Actually Work
Short answer: AI text detectors in 2026 use 7 broad signal categories: (1) perplexity (predictability), (2) burstiness (sentence variation), (3) n-gram repetition (overused phrases), (4) statistical watermarks where providers support them, (5) zero-shot likelihood probes such as DetectGPT-style perturbation checks, (6) supervised classifiers trained on labeled examples, and (7) stylometric fingerprints such as function-word distribution and syntax patterns. Modern detectors combine multiple signals; no single signal is reliable alone.
Source-reviewed June 17, 2026
Use this page as a technical map, not as a proof standard. The latest source check compared Google SynthID Text documentation, NIST AI 600-1 provenance guidance, C2PA Content Credentials, GPTZero perplexity/burstiness guidance, Turnitin AI Writing Report limits, OpenAI classifier limitations, DetectGPT-style research, and Stanford HAI false-positive findings.
Detectors estimate review risk from a cluster of statistical, provenance, classifier, and context signals. A score should trigger review; it should not replace draft history, source evidence, assignment or publication context, and human judgment.
Signal evidence map for 2026
| User question | Best answer | Best next page |
|---|---|---|
| "What does low perplexity mean?" | The text was predictable to a reference model; it is a clue, not proof. | Perplexity FAQ |
| "Can a watermark prove AI text?" | Only when the generator applied a supported watermark and the detector can verify it; absence is inconclusive. | Watermark guide |
| "Should I act on a detector score?" | Use the score as triage, then check drafts, sources, policy context, and human explanation. | False-positive calculator |
| "Can I test my text now?" | Paste a long enough sample and review score, confidence, short-sample warnings, and evidence notes. | Live text detector |
The 7 detection signals: full breakdown
| Signal | What it measures | AI tends to: | Defeated by |
|---|---|---|---|
| Perplexity | Average token surprise (log-likelihood from reference LLM) | Low (predictable token choices) | Paraphrasers, deliberate "human-like" prompting |
| Burstiness | Sentence-length variance / mean | Uniform medium length | Manual mixing of long + short sentences |
| N-gram repetition | Frequency of "AI tell" phrases vs corpus baseline | Over-use ("delve", "tapestry", "navigate", "in conclusion") | Custom system prompts banning specific phrases |
| Watermarks | Statistical signature embedded at sampling time (Google DeepMind SynthID, Kirchenbauer) | Carry signature if model owner cooperates | Heavy paraphrasing, translation, manual edits |
| Zero-shot probes | DetectGPT log-likelihood curvature | Sit on local likelihood maxima | Adversarial perturbation training |
| Supervised classifier | Neural net trained on labeled AI vs human samples | Match training distribution | New models not in training set, distribution shift |
| Stylometry | Function-word freq, syntactic complexity, POS-tag entropy | Lower variance, formal register | Style transfer, prompt engineering for "casual" tone |
Common assistant-style phrase patterns (n-gram repetition signal)
These phrases are not proof of AI authorship, but repeated generic transitions and marketing-style connectors can support a broader review when they appear with uniform sentence rhythm, low source specificity, and weak process evidence:
Noun phrases: tapestry, landscape (of), realm (of), ecosystem (of), paradigm (shift), nuanced perspective, multifaceted approach, intricate balance, holistic view, robust framework, transformative impact, paramount importance
Connectives: in conclusion (overuse), it is important to note that, it is worth noting, in this comprehensive guide, dive deeper, deep dive, in essence, ultimately
Hedging: while it may, however it is, on the other hand (over-frequency), nevertheless, in light of, in the realm of, when it comes to
Detection difficulty by text condition
| Text condition | Typical signal clarity | Main caveat |
|---|---|---|
| Raw, generic assistant-style prose | Clearer | Still needs enough text and more than one signal. |
| Prompted casual or brand-voice prose | Moderate | Can intentionally include varied rhythm and concrete details. |
| Paraphrased or humanized text | Lower | Surface statistics change; semantic and source checks matter more. |
| Mixed human + AI editing | Mixed by span | Document-level scores hide sentence-level differences. |
| Short chat, social, or informal text | Weak | Too few words and sentence boundaries for strong authorship inference. |
| Formal, technical, legal, or translated human text | Risky | Genre constraints can mimic low-burstiness AI patterns. |
Why detection isn't 100% reliable: and never will be
- Theoretical limit (Sadasivan et al., TMLR): As LLMs approach human-level distribution, statistical detection approaches a fundamental error floor. For text that is genuinely indistinguishable from human writing on token-level statistics, no detector can do better than random from those statistics alone.
- Adversarial paraphrasing scales faster than detection: Each new detection method is published; counter-paraphrasers train against it within months. Detection usually lags new evasion patterns.
- Non-native English bias (Liang et al. 2023, Stanford HAI): Stanford HAI summarized the finding as 61.22% of TOEFL essays by non-native English writers classified as AI-generated, with unanimous incorrect verdicts on about 19% of the essays.
- Genre flattening: Highly formal genres (legal briefs, academic abstracts, medical reports) have intrinsically low perplexity and uniform burstiness because the GENRE demands it. Any detector flagging these will have high false positives.
Recommended best practices when using detectors
- Never rely on a single detector or a single metric
- Use span-level (sentence) scores rather than document averages
- Be especially cautious with non-native English writers, formal genres, and translated text
- Treat middle-confidence results as inconclusive unless independent evidence supports the concern
- Pair detection with process signals (revision history, draft snapshots, viva-voce questioning) for high-stakes decisions
Frequently Asked Questions
What is perplexity in AI text detection?
Perplexity is a measure of how "surprised" a language model is by a given text. AI-generated text typically has LOW perplexity because it was generated by sampling from high-probability tokens: the words it picks are predictable to a language model. Human text has higher perplexity because humans use unexpected word choices, idioms, and abrupt topic shifts. Detectors compute perplexity by feeding the text back through a reference language model (often GPT-2 or a small open-source LLM) and measuring how confidently it predicted each token.
What is burstiness in AI text detection?
Burstiness measures variation in sentence length and structure. Human writing alternates between short punchy sentences and long flowing ones: bursty. AI text tends toward consistent medium-length sentences (15-25 words) with similar syntactic structure. Detectors measure burstiness as the standard deviation of sentence lengths divided by the mean. Bursty text (high std/mean) typically reads as human; uniform text (low std/mean) flags as AI.
How does Google DeepMind SynthID text watermarking work?
Google DeepMind SynthID and similar watermarking schemes embed a statistical signature during generation by adjusting token probabilities. The signature is invisible to readers and does not change output quality in normal use, but it is only available when the model provider adds the watermark at generation time. DeepMind says confidence can fall when text is thoroughly rewritten or translated.
Which AI text detection signals survive paraphrasing or editing?
Perplexity, burstiness, and phrase-repetition signals usually weaken when text is heavily paraphrased, translated, or manually edited. Provider-side watermarks such as SynthID can survive light edits when the original model embedded the watermark, but confidence can fall after thorough rewriting or translation. Stylometry is most useful when compared against a known author history. None of these signals should be cited as proof by itself.
What is n-gram repetition in AI text?
N-gram repetition measures repeated word pairs, word triples, transitions, and generic assistant-style phrases against a baseline corpus. Phrases such as "delve into" or "navigate the complexities of" are not proof by themselves, but repetition can support a broader review when it appears with uniform sentence rhythm, low source specificity, and weak process evidence.
Do paraphrasers and humanizers defeat AI detectors?
Partially. Paraphrasers and humanizer tools can increase surface variation, break repeated n-grams, and change sentence rhythm. That may lower confidence in some detectors, but it can also create awkward idioms, source errors, and inconsistent tone. A lower detector score after paraphrasing does not prove human authorship.
What is zero-shot AI text detection?
Zero-shot detection means the detector was not trained on the exact labeled AI-vs-human examples it is reviewing; it uses model-behavior signals such as likelihood, log-rank, or perturbation response. DetectGPT is a well-known example that compares likelihood around small text perturbations. Zero-shot methods can help with new models, but they still fail on short, edited, translated, or genre-constrained text.
Can AI text detection be fooled by mixing human + AI editing?
Yes: this is the hardest case. When a human edits AI-generated text by replacing 20-30% of sentences with their own writing, perplexity becomes mixed and burstiness rises, blurring detection. Some detectors output sentence-level scores rather than document-level, allowing users to identify which spans look AI-generated even when the whole doc passes a 50% threshold. The 2025 GPTZero "Smart Sentence" feature and EyeSift's span-level highlighting both target this use case.
Why do AI detectors give false positives on human writing?
Several known cases: non-native English writing, highly formal academic writing, journalistic style, translated text, and short samples. Stanford HAI summarized a 2023 study finding that seven detectors classified 61.22% of TOEFL essays by non-native English writers as AI-generated, with all seven detectors agreeing on about 19% of those essays.
Related EyeSift resources
- Is GPTZero Accurate? 2026 Perplexity, Burstiness & RAID Benchmarks
- GPTZero vs ZeroGPT: Stylometric & ESL False-Positive Comparison
- GPTZero vs Copyleaks: Classifier & LMS Comparison
- GPTZero vs QuillBot AI Detector: Paraphrase Signal Comparison
- Best AI Detectors 2026, full comparison
- Complete Guide to AI Detection
- AI Detection Accuracy Benchmarks
- AI Detection False Positives
- Free AI Text Detector (EyeSift)
Sources checked June 17, 2026: Mitchell et al., DetectGPT; Kirchenbauer et al., A Watermark for Large Language Models; Google SynthID Text documentation; Google DeepMind SynthID; NIST AI 600-1 Generative AI Profile; C2PA Content Credentials; GPTZero metric guidance; Turnitin AI Writing Report guidance; Stanford HAI detector-bias summary; Sadasivan et al., Can AI-Generated Text be Reliably Detected?; OpenAI classifier limitations. Individual detector performance varies with input length, content domain, editing depth, and model version.