AI Slop Detection
AI slop is identified by patterns of usage rather than individual words. While a single "delve" might be acceptable, its proximity to markers like "tapestry" or "embark" signals generated text. We analyze the density of these markers per 100 words, their clustering, and whether the overall tone fits the document type.
Execution Workflow
Start by identifying target files and classifying them as technical docs, narrative prose, or code comments. This allows for context-aware scoring during analysis.
Vocabulary and Phrase Detection
Load: @modules/vocabulary-patterns.md
We categorize markers into three tiers based on confidence. Tier 1 words appear dramatically more often in AI text and include "delve," "multifaceted," and "leverage." Tier 2 covers context-dependent transitions like "moreover" or "subsequently," while Tier 3 identifies vapid phrases such as "In today's fast-paced world" or "cannot be overstated."
| Word |
Context |
Human Alternative |
| delve |
"delve into" |
explore, examine, look at |
| tapestry |
"rich tapestry" |
mix, combination, variety |
| realm |
"in the realm of" |
in, within, regarding |
| embark |
"embark on a journey" |
start, begin |
| beacon |
"a beacon of" |
example, model |
| spearheaded |
formal attribution |
led, started |
| multifaceted |
describing complexity |
complex, varied |
| comprehensive |
describing scope |
thorough, complete |
| pivotal |
importance marker |
key, important |
| nuanced |
sophistication signal |
subtle, detailed |
| meticulous/meticulously |
care marker |
careful, detailed |
| intricate |
complexity marker |
detailed, complex |
| showcasing |
display verb |
showing, displaying |
| leveraging |
business jargon |
using |
| streamline |
optimization verb |
simplify, improve |
Tier 2: Medium-Confidence Markers (Score: 2 each)
Common but context-dependent:
| Category |
Words |
| Transition overuse |
moreover, furthermore, indeed, notably, subsequently |
| Intensity clustering |
significantly, substantially, fundamentally, profoundly |
| Hedging stacks |
potentially, typically, often, might, perhaps |
| Action inflation |
revolutionize, transform, unlock, unleash, elevate |
| Empty emphasis |
crucial, vital, essential, paramount |
Tier 3: Phrase Patterns (Score: 2-4 each)
| Phrase |
Score |
Issue |
| "In today's fast-paced world" |
4 |
Vapid opener |
| "It's worth noting that" |
3 |
Filler |
| "At its core" |
2 |
Positional crutch |
| "Cannot be overstated" |
3 |
Empty emphasis |
| "A testament to" |
3 |
Attribution cliche |
| "Navigate the complexities" |
4 |
Business speak |
| "Unlock the potential" |
4 |
Marketing speak |
| "Treasure trove of" |
3 |
Overused metaphor |
| "Game changer" |
3 |
Buzzword |
| "Look no further" |
4 |
Sales pitch |
| "Nestled in the heart of" |
4 |
Travel writing cliche |
| "Embark on a journey" |
4 |
Melodrama |
| "Ever-evolving landscape" |
4 |
Tech cliche |
| "Hustle and bustle" |
3 |
Filler |
Step 3: Structural Pattern Detection
Load: @modules/structural-patterns.md
Em Dash Overuse
Count em dashes (—) per 1000 words:
- 0-2: Normal human range
- 3-5: Elevated, review usage
- 6+: Strong AI signal
# Count em dashes in file
grep -o '—' file.md | wc -l
Tricolon Detection
AI loves groups of three with alliteration:
- "fast, efficient, and reliable"
- "clear, concise, and compelling"
- "robust, reliable, and resilient"
Pattern: adjective, adjective, and adjective with similar sounds.
List-to-Prose Ratio
Count bullet points vs paragraph sentences:
- >60% bullets: AI tendency
- Emoji-led bullets: Strong AI signal in technical docs
Sentence Length Uniformity
Measure standard deviation of sentence lengths:
- Low variance (SD < 5 words): AI monotony
- High variance (SD > 10 words): Human variation
Paragraph Symmetry
AI produces "blocky" text with uniform paragraph lengths. Check if paragraphs cluster around the same word count.
Step 4: Sycophantic Pattern Detection
Especially relevant for conversational or instructional content:
| Phrase |
Issue |
| "I'd be happy to" |
Servile opener |
| "Great question!" |
Empty validation |
| "Absolutely!" |
Over-agreement |
| "That's a wonderful point" |
Flattery |
| "I'm glad you asked" |
Filler |
| "You're absolutely right" |
Sycophancy |
These phrases add no information and signal generated content.
Step 5: Calculate Slop Density Score
slop_score = (tier1_count * 3 + tier2_count * 2 + phrase_count * avg_phrase_score) / word_count * 100
| Score |
Rating |
Action |
| 0-1.0 |
Clean |
No action needed |
| 1.0-2.5 |
Light |
Spot remediation |
| 2.5-5.0 |
Moderate |
Section rewrite recommended |
| 5.0+ |
Heavy |
Full document review |
Step 6: Generate Report
Output format:
## Slop Detection Report: [filename]
**Overall Score**: X.X / 10 (Rating)
**Word Count**: N words
**Markers Found**: N total
### High-Confidence Markers
- Line 23: "delve into" -> consider: "explore"
- Line 45: "rich tapestry" -> consider: "variety"
### Structural Issues
- Em dash density: 8/1000 words (HIGH)
- Bullet ratio: 72% (ELEVATED)
- Sentence length SD: 3.2 words (LOW VARIANCE)
### Phrase Patterns
- Line 12: "In today's fast-paced world" (vapid opener)
- Line 89: "cannot be overstated" (empty emphasis)
### Recommendations
1. Replace [specific word] with [alternative]
2. Convert bullet list at line 34-56 to prose
3. Vary sentence structure in paragraphs 3-5
Module Reference
- See
modules/fiction-patterns.md for narrative-specific slop markers
- See
modules/remediation-strategies.md for fix recommendations
Integration with Remediation
After detection, invoke Skill(scribe:doc-generator) with --remediate flag to apply fixes, or manually edit using the report as a guide.
Exit Criteria
- All target files scanned
- Density scores calculated
- Report generated with actionable recommendations
- High-severity items flagged for immediate attention
1---2name: slop-detector3description: Detect and flag AI-generated content markers in documentation and prose. Triggers: ai slop, ai-generated, llm markers, chatgpt phrases, claude tells, slop detection, ai cleanup, humanize text, remove ai markers, detect chatgpt, detect llm, writing quality, ai tells. Use when reviewing documentation for AI markers, cleaning up LLM-generated content, or auditing prose quality. Do not use when generating new content (use doc-generator) or learning writing styles (use style-learner).4---5
6# AI Slop Detection
7
8AI slop is identified by patterns of usage rather than individual words. While a single "delve" might be acceptable, its proximity to markers like "tapestry" or "embark" signals generated text. We analyze the density of these markers per 100 words, their clustering, and whether the overall tone fits the document type.
9
10## Execution Workflow
11
12Start by identifying target files and classifying them as technical docs, narrative prose, or code comments. This allows for context-aware scoring during analysis.
13
14### Vocabulary and Phrase Detection
15
16Load: `@modules/vocabulary-patterns.md`
17
18We categorize markers into three tiers based on confidence. Tier 1 words appear dramatically more often in AI text and include "delve," "multifaceted," and "leverage." Tier 2 covers context-dependent transitions like "moreover" or "subsequently," while Tier 3 identifies vapid phrases such as "In today's fast-paced world" or "cannot be overstated."
19
20| Word | Context | Human Alternative |
21|------|---------|-------------------|
22| delve | "delve into" | explore, examine, look at |
23| tapestry | "rich tapestry" | mix, combination, variety |
24| realm | "in the realm of" | in, within, regarding |
25| embark | "embark on a journey" | start, begin |
26| beacon | "a beacon of" | example, model |
27| spearheaded | formal attribution | led, started |
28| multifaceted | describing complexity | complex, varied |
29| comprehensive | describing scope | thorough, complete |
30| pivotal | importance marker | key, important |
31| nuanced | sophistication signal | subtle, detailed |
32| meticulous/meticulously | care marker | careful, detailed |
33| intricate | complexity marker | detailed, complex |
34| showcasing | display verb | showing, displaying |
35| leveraging | business jargon | using |
36| streamline | optimization verb | simplify, improve |
37
38### Tier 2: Medium-Confidence Markers (Score: 2 each)
39
40Common but context-dependent:
41
42| Category | Words |
43|----------|-------|
44| Transition overuse | moreover, furthermore, indeed, notably, subsequently |
45| Intensity clustering | significantly, substantially, fundamentally, profoundly |
46| Hedging stacks | potentially, typically, often, might, perhaps |
47| Action inflation | revolutionize, transform, unlock, unleash, elevate |
48| Empty emphasis | crucial, vital, essential, paramount |
49
50### Tier 3: Phrase Patterns (Score: 2-4 each)
51
52| Phrase | Score | Issue |
53|--------|-------|-------|
54| "In today's fast-paced world" | 4 | Vapid opener |
55| "It's worth noting that" | 3 | Filler |
56| "At its core" | 2 | Positional crutch |
57| "Cannot be overstated" | 3 | Empty emphasis |
58| "A testament to" | 3 | Attribution cliche |
59| "Navigate the complexities" | 4 | Business speak |
60| "Unlock the potential" | 4 | Marketing speak |
61| "Treasure trove of" | 3 | Overused metaphor |
62| "Game changer" | 3 | Buzzword |
63| "Look no further" | 4 | Sales pitch |
64| "Nestled in the heart of" | 4 | Travel writing cliche |
65| "Embark on a journey" | 4 | Melodrama |
66| "Ever-evolving landscape" | 4 | Tech cliche |
67| "Hustle and bustle" | 3 | Filler |
68
69## Step 3: Structural Pattern Detection
70
71Load: `@modules/structural-patterns.md`
72
73### Em Dash Overuse
74
75Count em dashes (—) per 1000 words:
76- **0-2**: Normal human range
77- **3-5**: Elevated, review usage
78- **6+**: Strong AI signal
79
80```bash
81# Count em dashes in file
82grep -o '—' file.md | wc -l
83```
84
85### Tricolon Detection
86
87AI loves groups of three with alliteration:
88- "fast, efficient, and reliable"
89- "clear, concise, and compelling"
90- "robust, reliable, and resilient"
91
92Pattern: `adjective, adjective, and adjective` with similar sounds.
93
94### List-to-Prose Ratio
95
96Count bullet points vs paragraph sentences:
97- **>60% bullets**: AI tendency
98- **Emoji-led bullets**: Strong AI signal in technical docs
99
100### Sentence Length Uniformity
101
102Measure standard deviation of sentence lengths:
103- **Low variance** (SD < 5 words): AI monotony
104- **High variance** (SD > 10 words): Human variation
105
106### Paragraph Symmetry
107
108AI produces "blocky" text with uniform paragraph lengths. Check if paragraphs cluster around the same word count.
109
110## Step 4: Sycophantic Pattern Detection
111
112Especially relevant for conversational or instructional content:
113
114| Phrase | Issue |
115|--------|-------|
116| "I'd be happy to" | Servile opener |
117| "Great question!" | Empty validation |
118| "Absolutely!" | Over-agreement |
119| "That's a wonderful point" | Flattery |
120| "I'm glad you asked" | Filler |
121| "You're absolutely right" | Sycophancy |
122
123These phrases add no information and signal generated content.
124
125## Step 5: Calculate Slop Density Score
126
127```
128slop_score = (tier1_count * 3 + tier2_count * 2 + phrase_count * avg_phrase_score) / word_count * 100
129```
130
131| Score | Rating | Action |
132|-------|--------|--------|
133| 0-1.0 | Clean | No action needed |
134| 1.0-2.5 | Light | Spot remediation |
135| 2.5-5.0 | Moderate | Section rewrite recommended |
136| 5.0+ | Heavy | Full document review |
137
138## Step 6: Generate Report
139
140Output format:
141
142```markdown
143## Slop Detection Report: [filename]
144
145**Overall Score**: X.X / 10 (Rating)
146**Word Count**: N words
147**Markers Found**: N total
148
149### High-Confidence Markers
150- Line 23: "delve into" -> consider: "explore"
151- Line 45: "rich tapestry" -> consider: "variety"
152
153### Structural Issues
154- Em dash density: 8/1000 words (HIGH)
155- Bullet ratio: 72% (ELEVATED)
156- Sentence length SD: 3.2 words (LOW VARIANCE)
157
158### Phrase Patterns
159- Line 12: "In today's fast-paced world" (vapid opener)
160- Line 89: "cannot be overstated" (empty emphasis)
161
162### Recommendations
1631. Replace [specific word] with [alternative]
1642. Convert bullet list at line 34-56 to prose
1653. Vary sentence structure in paragraphs 3-5
166```
167
168## Module Reference
169
170- See `modules/fiction-patterns.md` for narrative-specific slop markers
171- See `modules/remediation-strategies.md` for fix recommendations
172
173## Integration with Remediation
174
175After detection, invoke `Skill(scribe:doc-generator)` with `--remediate` flag to apply fixes, or manually edit using the report as a guide.
176
177## Exit Criteria
178
179- All target files scanned
180- Density scores calculated
181- Report generated with actionable recommendations
182- High-severity items flagged for immediate attention