Education Evidence Check
Goal
Improve paper quality by verifying that important claims are grounded in reliable, recent, and relevant evidence.
Inputs
- Claim, paragraph, draft section, or citation list
- Target standard: course paper, thesis, journal article, systematic review
- Field/context: education level, region, subject area
- Existing references if available
Workflow
- Extract atomic claims from the text.
- Classify each claim:
- background claim
- empirical finding
- causal claim
- theory claim
- method claim
- policy/practice implication
- For each high-risk claim, search supporting and contrasting evidence.
- Check citation quality:
- relevance
- recency
- empirical strength
- citation context
- whether later studies support or contradict it
- Rewrite claims with calibrated strength.
- Produce a citation-gap list.
Tool Calls
Scite
Use for citation context and support/contrast checks.
https://scite.ai/
Recommended checks:
- Is the cited paper supported or contradicted?
- Is the citation used for the same claim?
- Are there later reviews or meta-analyses?
Elicit
Use for evidence reports and structured extraction.
https://elicit.com/
Query pattern:
What evidence supports or challenges the claim that [claim] in [education context]?
Semantic Scholar Citation Lookup
Find paper details:
curl "https://api.semanticscholar.org/graph/v1/paper/DOI:10.xxxx/yyyy?fields=title,year,abstract,citationCount,influentialCitationCount,references,citations"
Find papers on a claim:
curl "https://api.semanticscholar.org/graph/v1/paper/search?query=teacher%20feedback%20student%20writing%20achievement%20meta-analysis&limit=10&fields=title,year,abstract,citationCount,authors,venue"
OpenAlex
curl "https://api.openalex.org/works?search=teacher%20feedback%20student%20writing%20achievement%20meta-analysis&sort=cited_by_count:desc&per-page=10&mailto=YOUR_EMAIL"
Output Format
Return:
| Claim |
Current Citation |
Evidence Status |
Better Evidence Needed |
Suggested Rewrite |
Risk |
Evidence status:
- Strongly supported
- Moderately supported
- Mixed evidence
- Weak evidence
- Contradicted
- Needs citation
- Overclaimed
Quality Rules
- Causal language requires causal evidence.
- Prefer systematic reviews, meta-analyses, and recent empirical studies for broad claims.
- Do not cite a paper merely because it is related; verify the specific claim.
- Mark unsupported claims instead of smoothing them over.
- For AI-assisted writing, preserve a clear audit trail of searched sources and citation decisions.
1---2name: education-evidence-check3category: 研究检索4description: Use when checking whether claims, theory choices, research questions, variable relationships, or literature review statements in education papers are supported, contradicted, weakly supported, outdated, or missing citations. Uses Scite-style citation context, Elicit evidence reports, Semantic Scholar citation relationships, and manual source verification.5metadata:6 source: https://skillmd.com/skills/ilog3/education-evidence-check7 short-description: Verify evidence and citation strength in education writing8---910# Education Evidence Check1112## Goal1314Improve paper quality by verifying that important claims are grounded in reliable, recent, and relevant evidence.1516## Inputs1718- Claim, paragraph, draft section, or citation list19- Target standard: course paper, thesis, journal article, systematic review20- Field/context: education level, region, subject area21- Existing references if available2223## Workflow24251. Extract atomic claims from the text.262. Classify each claim:27 - background claim28 - empirical finding29 - causal claim30 - theory claim31 - method claim32 - policy/practice implication333. For each high-risk claim, search supporting and contrasting evidence.344. Check citation quality:35 - relevance36 - recency37 - empirical strength38 - citation context39 - whether later studies support or contradict it405. Rewrite claims with calibrated strength.416. Produce a citation-gap list.4243## Tool Calls4445### Scite4647Use for citation context and support/contrast checks.4849```text50https://scite.ai/51```5253Recommended checks:5455- Is the cited paper supported or contradicted?56- Is the citation used for the same claim?57- Are there later reviews or meta-analyses?5859### Elicit6061Use for evidence reports and structured extraction.6263```text64https://elicit.com/65```6667Query pattern:6869```text70What evidence supports or challenges the claim that [claim] in [education context]?71```7273### Semantic Scholar Citation Lookup7475Find paper details:7677```bash78curl "https://api.semanticscholar.org/graph/v1/paper/DOI:10.xxxx/yyyy?fields=title,year,abstract,citationCount,influentialCitationCount,references,citations"79```8081Find papers on a claim:8283```bash84curl "https://api.semanticscholar.org/graph/v1/paper/search?query=teacher%20feedback%20student%20writing%20achievement%20meta-analysis&limit=10&fields=title,year,abstract,citationCount,authors,venue"85```8687### OpenAlex8889```bash90curl "https://api.openalex.org/works?search=teacher%20feedback%20student%20writing%20achievement%20meta-analysis&sort=cited_by_count:desc&per-page=10&mailto=YOUR_EMAIL"91```9293## Output Format9495Return:9697| Claim | Current Citation | Evidence Status | Better Evidence Needed | Suggested Rewrite | Risk |98|---|---|---|---|---|---|99100Evidence status:101102- Strongly supported103- Moderately supported104- Mixed evidence105- Weak evidence106- Contradicted107- Needs citation108- Overclaimed109110## Quality Rules111112- Causal language requires causal evidence.113- Prefer systematic reviews, meta-analyses, and recent empirical studies for broad claims.114- Do not cite a paper merely because it is related; verify the specific claim.115- Mark unsupported claims instead of smoothing them over.116- For AI-assisted writing, preserve a clear audit trail of searched sources and citation decisions.