Customization
Before executing, check for user customizations at:
~/.claude/LIFEOS/USER/CUSTOMIZATIONS/SKILLS/BiasCheck/
If this directory exists, load and apply any PREFERENCES.md or additional reference files found there. These override default behavior. If the directory does not exist, proceed with skill defaults.
BiasCheck
Voice Notification
When executing a workflow, do BOTH:
Send voice notification:
curl -s -X POST http://localhost:31337/notify \
-H "Content-Type: application/json" \
-d '{"message": "Running the Check workflow in the BiasCheck skill to audit the source"}' \
> /dev/null 2>&1 &
Output text notification:
Running the **Check** workflow in the **BiasCheck** skill to audit the source...
What It Does
Runs a three-layer bias audit on any source — a URL, a file path, or raw text. It fetches the content plus any study it cites, then checks (1) biases inside the data, (2) conflicts of interest in the source organization, and (3) distortions the journalism added on top. The output separates what the data actually supports from what got editorialized.
The Problem
Most "this is biased" arguments are vibes — a feeling about a source, with nothing concrete underneath. They're not repeatable and they don't tell you where the distortion lives. The other failure is analyzing an article without ever reaching the study it cites, so you critique the headline and never see that the underlying data was fine (or that it was junk). A fixed taxonomy and a fixed output shape fix both: the analysis is repeatable, the gaps are visible, and every claim ties to a specific tell.
How It Works
The skill operates on three layers:
- The data itself — biases inside the underlying study, paper, or dataset (funding, sampling, instrument design, demand characteristics, self-report distance from behavior, causal inflation, missing benchmark, publication availability)
- The source organization — who paid for or produced the work, what they sell, what conclusion would be inconvenient
- The journalism on top — what the reporter/commentator added: headline-to-source distortion, frame escalation, echo-chain amplification, causal claims layered over correlational data
Output cleanly separates what the data actually supports from what was editorialized on top. Confidence is anchored to specifics — no vibes-based "this seems biased."
Workflow Routing
| Workflow |
Trigger |
File |
| Check |
"bias check", "analyze bias on", "check this study/source/article" |
Workflows/Check.md |
Quick Reference
- Input: one argument — URL, file path, raw text, or any combination.
- Always tries to find the primary source. If the input is journalism citing a study, the skill fetches the study itself, not just the article. If the primary source can't be located, that's a finding.
- Three-layer output — never collapse layers; the distortion usually lives in the layer the source is least transparent about.
- Hard separation between supported and editorialized — this is the deliverable shape.
- Bias taxonomy reference:
BiasTaxonomy.md (load on demand for the full category catalog with definitions and tells).
Examples
Example 1: Article citing a vendor study
User: "bias check https://futurism.com/some-article-citing-a-mercer-survey"
→ Invokes Check workflow
→ Fetches the article, identifies the cited Mercer study, fetches Mercer's source
→ Runs three-layer audit: vendor conflict-of-interest, sample/question-design biases, journalism's headline-vs-source swap
→ Returns structured bias report + supported-vs-editorialized split
Example 2: Raw paste of a study abstract
User: "bias check this abstract: [pastes 4 paragraphs from a paper]"
→ Invokes Check workflow
→ Skips Layer 3 (no journalism on top — input IS the primary source)
→ Audits Layers 1 + 2 only: funding disclosure, sample, methodology, conflict-of-interest
→ Notes if abstract is insufficient to assess methodology (publication availability bias)
Example 3: File path
User: "bias check ~/Downloads/some-report.pdf"
→ Invokes Check workflow
→ Reads file
→ Identifies if report cites further upstream sources; fetches what it can
→ Three-layer audit with specifics
Output Requirements
- Format: Markdown with the fixed section structure defined in
Workflows/Check.md.
- Length: Scales with source complexity. A single-claim tweet gets ~200 words; a vendor-funded study + viral article gets 800–1500.
- Tone: Plain. Specific. No vibes. Every bias claim ties to a concrete tell — a quoted phrase, a sample-frame fact, a missing disclosure.
- Must Include: Methodology line (sample, dates, instrument availability), the three layers, the supported-vs-editorialized split, a one-paragraph bottom line, sources list with URLs.
- Must Avoid: Hedging ("could potentially be biased"). Diagnose or don't. The reader gets to disagree — but they should know what the analyst actually thinks.
Gotchas
- Always try to find the primary source. The single biggest failure mode is analyzing an article without ever reaching the underlying study. If the input cites a study/report/paper/dataset, the skill MUST attempt to fetch it. Inability to locate the primary source is itself a finding (publication availability bias) and goes in the output.
- An impossibly high consensus number is a tell about the question. When a survey claims 95%+ agreement on a substantive question, that almost always means the question was a low-bar yes/no. Note it explicitly even when the instrument is hidden.
- Vendor research is research; treat it that way. Don't dismiss a Mercer/McKinsey/PwC/Gartner report because they sell consulting. Their funding bias is a multiplier on the analysis, not an automatic disqualifier. Specific finding > generic "vendor bias."
- Don't conflate Layer 1 and Layer 3. A bad headline doesn't make the underlying data bad. A flawed study doesn't make the journalism dishonest. Keep them separate even when both have problems.
- Headlines travel; bodies don't. Most readers see only the headline. A headline-to-source mismatch is the most consequential journalism bias and should always be flagged when present.
- "Charitable reading" is required. Before concluding the source is misleading, articulate what the data DOES support. This anchors the critique in specifics.
- Don't go beyond the source you fetched. No drive-by claims about Mercer's other reports if you only read one. No "they always do X" — stick to what's in the artifact.
- Pure opinion piece with no data? This skill is the wrong tool — redirect to a psychological author-analysis skill for a psychological author read. BiasCheck needs claims with empirical scaffolding.
- Author background is out of scope. This skill audits the source artifact, not the author's biography. If you need "who is this writer and what's their track record," use Research or a dedicated OSINT/entity-investigation skill.
Execution Log
echo '{"ts":"'$(date -u +%Y-%m-%dT%H:%M:%SZ)'","skill":"BiasCheck","workflow":"Check","input":"8_WORD_SUMMARY","status":"ok|error","duration_s":SECONDS}' >> ~/.claude/LIFEOS/MEMORY/SKILLS/execution.jsonl
1---2name: biascheck3description: Three-layer bias analysis on any URL, file, or text — auto-fetches the content and any cited study, then audits data-level biases, source conflicts of interest, and journalism-added distortions, separating what the data supports from what's editorialized. USE WHEN bias analysis, analyze bias, bias check, check this study, who funded this, is this source biased, fact-check article, methodological flaws, source credibility, what's wrong with this claim. NOT FOR psychological author analysis, research synthesis (use Research), entity due diligence.4---5
6## Customization
7
8**Before executing, check for user customizations at:**
9`~/.claude/LIFEOS/USER/CUSTOMIZATIONS/SKILLS/BiasCheck/`
10
11If this directory exists, load and apply any `PREFERENCES.md` or additional reference files found there. These override default behavior. If the directory does not exist, proceed with skill defaults.
12
13# BiasCheck
14
15## Voice Notification
16
17**When executing a workflow, do BOTH:**
18
191. **Send voice notification**:
20 ```bash
21 curl -s -X POST http://localhost:31337/notify \
22 -H "Content-Type: application/json" \
23 -d '{"message": "Running the Check workflow in the BiasCheck skill to audit the source"}' \
24 > /dev/null 2>&1 &
25 ```
26
272. **Output text notification**:
28 ```
29 Running the **Check** workflow in the **BiasCheck** skill to audit the source...
30 ```
31
32## What It Does
33
34Runs a three-layer bias audit on any source — a URL, a file path, or raw text. It fetches the content plus any study it cites, then checks (1) biases inside the data, (2) conflicts of interest in the source organization, and (3) distortions the journalism added on top. The output separates what the data actually supports from what got editorialized.
35
36## The Problem
37
38Most "this is biased" arguments are vibes — a feeling about a source, with nothing concrete underneath. They're not repeatable and they don't tell you where the distortion lives. The other failure is analyzing an article without ever reaching the study it cites, so you critique the headline and never see that the underlying data was fine (or that it was junk). A fixed taxonomy and a fixed output shape fix both: the analysis is repeatable, the gaps are visible, and every claim ties to a specific tell.
39
40## How It Works
41
42The skill operates on three layers:
43
441. **The data itself** — biases inside the underlying study, paper, or dataset (funding, sampling, instrument design, demand characteristics, self-report distance from behavior, causal inflation, missing benchmark, publication availability)
452. **The source organization** — who paid for or produced the work, what they sell, what conclusion would be inconvenient
463. **The journalism on top** — what the reporter/commentator added: headline-to-source distortion, frame escalation, echo-chain amplification, causal claims layered over correlational data
47
48Output cleanly separates **what the data actually supports** from **what was editorialized on top**. Confidence is anchored to specifics — no vibes-based "this seems biased."
49
50## Workflow Routing
51
52| Workflow | Trigger | File |
53|----------|---------|------|
54| **Check** | "bias check", "analyze bias on", "check this study/source/article" | `Workflows/Check.md` |
55
56## Quick Reference
57
58- **Input:** one argument — URL, file path, raw text, or any combination.
59- **Always tries to find the primary source.** If the input is journalism citing a study, the skill fetches the study itself, not just the article. If the primary source can't be located, that's a finding.
60- **Three-layer output** — never collapse layers; the distortion usually lives in the layer the source is least transparent about.
61- **Hard separation between supported and editorialized** — this is the deliverable shape.
62- **Bias taxonomy reference:** `BiasTaxonomy.md` (load on demand for the full category catalog with definitions and tells).
63
64## Examples
65
66**Example 1: Article citing a vendor study**
67```
68User: "bias check https://futurism.com/some-article-citing-a-mercer-survey"
69→ Invokes Check workflow
70→ Fetches the article, identifies the cited Mercer study, fetches Mercer's source
71→ Runs three-layer audit: vendor conflict-of-interest, sample/question-design biases, journalism's headline-vs-source swap
72→ Returns structured bias report + supported-vs-editorialized split
73```
74
75**Example 2: Raw paste of a study abstract**
76```
77User: "bias check this abstract: [pastes 4 paragraphs from a paper]"
78→ Invokes Check workflow
79→ Skips Layer 3 (no journalism on top — input IS the primary source)
80→ Audits Layers 1 + 2 only: funding disclosure, sample, methodology, conflict-of-interest
81→ Notes if abstract is insufficient to assess methodology (publication availability bias)
82```
83
84**Example 3: File path**
85```
86User: "bias check ~/Downloads/some-report.pdf"
87→ Invokes Check workflow
88→ Reads file
89→ Identifies if report cites further upstream sources; fetches what it can
90→ Three-layer audit with specifics
91```
92
93## Output Requirements
94
95- **Format:** Markdown with the fixed section structure defined in `Workflows/Check.md`.
96- **Length:** Scales with source complexity. A single-claim tweet gets ~200 words; a vendor-funded study + viral article gets 800–1500.
97- **Tone:** Plain. Specific. No vibes. Every bias claim ties to a concrete tell — a quoted phrase, a sample-frame fact, a missing disclosure.
98- **Must Include:** Methodology line (sample, dates, instrument availability), the three layers, the supported-vs-editorialized split, a one-paragraph bottom line, sources list with URLs.
99- **Must Avoid:** Hedging ("could potentially be biased"). Diagnose or don't. The reader gets to disagree — but they should know what the analyst actually thinks.
100
101## Gotchas
102
103- **Always try to find the primary source.** The single biggest failure mode is analyzing an article without ever reaching the underlying study. If the input cites a study/report/paper/dataset, the skill MUST attempt to fetch it. Inability to locate the primary source is itself a finding (publication availability bias) and goes in the output.
104- **An impossibly high consensus number is a tell about the question.** When a survey claims 95%+ agreement on a substantive question, that almost always means the question was a low-bar yes/no. Note it explicitly even when the instrument is hidden.
105- **Vendor research is research; treat it that way.** Don't dismiss a Mercer/McKinsey/PwC/Gartner report because they sell consulting. Their funding bias is a multiplier on the analysis, not an automatic disqualifier. Specific finding > generic "vendor bias."
106- **Don't conflate Layer 1 and Layer 3.** A bad headline doesn't make the underlying data bad. A flawed study doesn't make the journalism dishonest. Keep them separate even when both have problems.
107- **Headlines travel; bodies don't.** Most readers see only the headline. A headline-to-source mismatch is the most consequential journalism bias and should always be flagged when present.
108- **"Charitable reading" is required.** Before concluding the source is misleading, articulate what the data DOES support. This anchors the critique in specifics.
109- **Don't go beyond the source you fetched.** No drive-by claims about Mercer's other reports if you only read one. No "they always do X" — stick to what's in the artifact.
110- **Pure opinion piece with no data?** This skill is the wrong tool — redirect to a psychological author-analysis skill for a psychological author read. BiasCheck needs claims with empirical scaffolding.
111- **Author background is out of scope.** This skill audits the source artifact, not the author's biography. If you need "who is this writer and what's their track record," use Research or a dedicated OSINT/entity-investigation skill.
112
113## Execution Log
114
115```bash
116echo '{"ts":"'$(date -u +%Y-%m-%dT%H:%M:%SZ)'","skill":"BiasCheck","workflow":"Check","input":"8_WORD_SUMMARY","status":"ok|error","duration_s":SECONDS}' >> ~/.claude/LIFEOS/MEMORY/SKILLS/execution.jsonl
117```
danielmiessler