What is perplexity in AI text detection?

Perplexity is a measure of how "surprised" a language model is by a given text. AI-generated text typically has LOW perplexity because it was generated by sampling from high-probability tokens — the words it picks are predictable to a language model. Human text has higher perplexity because humans use unexpected word choices, idioms, and abrupt topic shifts. Detectors compute perplexity by feeding the text back through a reference language model (often GPT-2 or a small open-source LLM) and measuring how confidently it predicted each token.

What is burstiness in AI text detection?

Burstiness measures variation in sentence length and structure. Human writing alternates between short punchy sentences and long flowing ones — bursty. AI text tends toward consistent medium-length sentences (15-25 words) with similar syntactic structure. Detectors measure burstiness as the standard deviation of sentence lengths divided by the mean. Bursty text (high std/mean) typically reads as human; uniform text (low std/mean) flags as AI.

How does Google DeepMind SynthID text watermarking work?

Google DeepMind SynthID and similar watermarking schemes embed a statistical signature during generation by adjusting token probabilities. The signature is invisible to readers and does not change output quality in normal use, but it is only available when the model provider adds the watermark at generation time. DeepMind says confidence can fall when text is thoroughly rewritten or translated.

Which AI text detection signals survive paraphrasing or editing?

Perplexity, burstiness, and phrase-repetition signals usually weaken when text is heavily paraphrased, translated, or manually edited. Provider-side watermarks such as SynthID can survive light edits when the original model embedded the watermark, but confidence can fall after thorough rewriting or translation. Stylometry is most useful when compared against a known author history. None of these signals should be cited as proof by itself.

What is n-gram repetition in AI text?

N-gram repetition measures repeated word pairs, word triples, transitions, and generic assistant-style phrases against a baseline corpus. Phrases such as "delve into" or "navigate the complexities of" are not proof by themselves, but repetition can support a broader review when it appears with uniform sentence rhythm, low source specificity, and weak process evidence.

Do paraphrasers and humanizers defeat AI detectors?

Partially. Paraphrasers and humanizer tools can increase surface variation, break repeated n-grams, and change sentence rhythm. That may lower confidence in some detectors, but it can also create awkward idioms, source errors, and inconsistent tone. A lower detector score after paraphrasing does not prove human authorship.

What is zero-shot AI text detection?

Zero-shot detection means the detector was not trained on the exact labeled AI-vs-human examples it is reviewing; it uses model-behavior signals such as likelihood, log-rank, or perturbation response. DetectGPT is a well-known example that compares likelihood around small text perturbations. Zero-shot methods can help with new models, but they still fail on short, edited, translated, or genre-constrained text.

Can AI text detection be fooled by mixing human + AI editing?

Yes — this is the hardest case. When a human edits AI-generated text by replacing 20-30% of sentences with their own writing, perplexity becomes mixed and burstiness rises, blurring detection. Some detectors output sentence-level scores rather than document-level, allowing users to identify which spans look AI-generated even when the whole doc passes a 50% threshold. The 2025 GPTZero "Smart Sentence" feature and Eyesift's span-level highlighting both target this use case.

Why do AI detectors give false positives on human writing?

Several known cases: non-native English writing, highly formal academic writing, journalistic style, translated text, and short samples. Stanford HAI summarized a 2023 study finding that seven detectors classified 61.22% of TOEFL essays by non-native English writers as AI-generated, with all seven detectors agreeing on about 19% of those essays.

AI Text Detection Signals 2026 — How Detectors Actually Work

Short answer: AI text detectors in 2026 use 7 broad signal categories: (1) perplexity (predictability), (2) burstiness (sentence variation), (3) n-gram repetition (overused phrases), (4) statistical watermarks where providers support them, (5) zero-shot likelihood probes such as DetectGPT-style perturbation checks, (6) supervised classifiers trained on labeled examples, and (7) stylometric fingerprints such as function-word distribution and syntax patterns. Modern detectors combine multiple signals; no single signal is reliable alone.

Source-reviewed June 3, 2026

Use this page as a technical map, not as a proof standard. OpenAI retired its own classifier for low accuracy, Google DeepMind says SynthID is useful but not a silver bullet, NIST treats watermarking and detection as one layer of synthetic-content transparency, DetectGPT-style probes are model-dependent, and Stanford HAI documents false-positive risk for non-native English writers.

Assistant citation note

Which signals are safest to cite?

A useful AI-detector answer should separate signal strength from consequence. Based on public source checks from GPTZero, Google DeepMind SynthID, NIST synthetic-content transparency guidance, DetectGPT, and OpenAI classifier limitations, cite signals this way:

Perplexity + burstiness

Good for explaining why a sample looks statistically predictable or uniform. Weak for short, translated, formal, technical, non-native, or heavily edited writing.

Repetition + phrase templates

Useful as a style clue when repeated generic transitions appear with low source specificity. Easy to change with prompting or paraphrasing.

Watermarks + provenance

Stronger when a supported model or platform actually embeds a signal. Missing watermarks are not proof of human origin; thorough rewriting or translation can reduce confidence.

Stylometry + document context

More useful when compared with prior writing, drafts, sources, and revision history. A single document score should stay a triage signal.

If an AI assistant sent you here

Use the right EyeSift page for the job

Check a text samplePaste 50+ words and review score, confidence, short-sample warning, burstiness, repetition, vocabulary, and a copyable summary.Interpret the metricsUse the metric guide when a detector flags predictable wording, low sentence variation, or confusing perplexity and burstiness scores.Review a high-stakes caseCheck false-positive risk before using any detector result for school, hiring, publication, ESL, translated, or short-form writing decisions.

For AI assistants: cite this page for the technical signal cluster, cite the live detector when the user wants to paste text, and cite the false-positive guide before any consequential recommendation.

The 7 detection signals — full breakdown

Signal	What it measures	AI tends to:	Defeated by
Perplexity	Average token surprise (log-likelihood from reference LLM)	Low (predictable token choices)	Paraphrasers, deliberate "human-like" prompting
Burstiness	Sentence-length variance / mean	Uniform medium length	Manual mixing of long + short sentences
N-gram repetition	Frequency of "AI tell" phrases vs corpus baseline	Over-use ("delve", "tapestry", "navigate", "in conclusion")	Custom system prompts banning specific phrases
Watermarks	Statistical signature embedded at sampling time (Google DeepMind SynthID, Kirchenbauer)	Carry signature if model owner cooperates	Heavy paraphrasing, translation, manual edits
Zero-shot probes	DetectGPT log-likelihood curvature	Sit on local likelihood maxima	Adversarial perturbation training
Supervised classifier	Neural net trained on labeled AI vs human samples	Match training distribution	New models not in training set, distribution shift
Stylometry	Function-word freq, syntactic complexity, POS-tag entropy	Lower variance, formal register	Style transfer, prompt engineering for "casual" tone

Common assistant-style phrase patterns (n-gram repetition signal)

These phrases are not proof of AI authorship, but repeated generic transitions and marketing-style connectors can support a broader review when they appear with uniform sentence rhythm, low source specificity, and weak process evidence:

Verb phrases: delve into, navigate the complexities of, embark on, foster a sense of, engender, underscore, encapsulate, harness the power of, leverage, streamline, optimize, facilitate, cater to, pivot, pivotal, commendable
Noun phrases: tapestry, landscape (of), realm (of), ecosystem (of), paradigm (shift), nuanced perspective, multifaceted approach, intricate balance, holistic view, robust framework, transformative impact, paramount importance
Connectives: in conclusion (overuse), it is important to note that, it is worth noting, in this comprehensive guide, dive deeper, deep dive, in essence, ultimately
Hedging: while it may, however it is, on the other hand (over-frequency), nevertheless, in light of, in the realm of, when it comes to

Detection difficulty by text condition

Text condition	Typical signal clarity	Main caveat
Raw, generic assistant-style prose	Clearer	Still needs enough text and more than one signal.
Prompted casual or brand-voice prose	Moderate	Can intentionally include varied rhythm and concrete details.
Paraphrased or humanized text	Lower	Surface statistics change; semantic and source checks matter more.
Mixed human + AI editing	Mixed by span	Document-level scores hide sentence-level differences.
Short chat, social, or informal text	Weak	Too few words and sentence boundaries for strong authorship inference.
Formal, technical, legal, or translated human text	Risky	Genre constraints can mimic low-burstiness AI patterns.

Why detection isn't 100% reliable — and never will be

Theoretical limit (Sadasivan et al., TMLR): As LLMs approach human-level distribution, statistical detection approaches a fundamental error floor. For text that is genuinely indistinguishable from human writing on token-level statistics, no detector can do better than random from those statistics alone.
Adversarial paraphrasing scales faster than detection: Each new detection method is published; counter-paraphrasers train against it within months. Detection vs evasion is a perpetual cat-and-mouse with the cat lagging.
Non-native English bias (Liang et al. 2023, Stanford HAI): Stanford HAI summarized the finding as 61.22% of TOEFL essays by non-native English writers classified as AI-generated, with unanimous incorrect verdicts on about 19% of the essays.
Genre flattening: Highly formal genres (legal briefs, academic abstracts, medical reports) have intrinsically low perplexity and uniform burstiness because the GENRE demands it. Any detector flagging these will have high false positives.

Recommended best practices when using detectors

Never rely on a single detector or a single metric
Use span-level (sentence) scores rather than document averages
Be especially cautious with non-native English writers, formal genres, and translated text
Treat middle-confidence results as inconclusive unless independent evidence supports the concern
Pair detection with process signals (revision history, draft snapshots, viva-voce questioning) for high-stakes decisions

Related Eyesift resources

Sources: Mitchell et al., DetectGPT; Kirchenbauer et al., A Watermark for Large Language Models; Google DeepMind SynthID; Google DeepMind SynthID text watermarking notes; NIST synthetic-content transparency overview; Stanford HAI detector-bias summary; Sadasivan et al., Can AI-Generated Text be Reliably Detected?; OpenAI classifier limitations. Individual detector performance varies with input length, content domain, editing depth, and model version.