How do I install the Fetch Meta To Kb skill?

Run npx skillmds add tiangong-ai/fetch-meta-to-kb in your terminal (requires Node.js), paste this page's agent-chat prompt into Claude, Cursor, or any MCP-connected agent, or download the SKILL.md file and copy it into your agent's skills directory.

Is Fetch Meta To Kb safe to use?

This skill has not completed SkillMD's automated safety review yet. Capability flags: executes scripts, makes network calls. SkillMD never runs a skill's scripts for you; review the SKILL.md before installing.

Which AI agents work with Fetch Meta To Kb?

This skill is tagged as working with Claude Code, Claude.ai, OpenAI Codex. SKILL.md is an open format, so most agents that read a skills directory can load it too.

Is Fetch Meta To Kb free to use?

Yes. Installing skills from SkillMD is free, and the skill stays under its author's original license.

Who published Fetch Meta To Kb?

tiangong-ai (@tiangong-ai) published this skill. Their other Agent Skills are listed on their SkillMD profile.

Fetch Meta To Kb by tiangong-ai — Agent Skill

Name: Fetch Meta To Kb
Rating: 4.666666666666667 (3 reviews)
Author: tiangong-ai

Fetch Meta To Kb

Fetch journal articles from Crossref published after a user-specified date and insert them into PostgreSQL `journals` with DOI deduplication. Use when incrementally ingesting journal metadata from `journals_issn` into `journals`.

tiangong-ai d621f59 3 files · 10.5 KB Updated Sep 9, 2026

File contents

Fetch Meta to KB

Core Goal

Pull journal-article records from Crossref after a given --from-date.
Read ISSN seed rows from journals_issn (journal, issn1).
Insert rows into journals with ON CONFLICT (doi) DO NOTHING.
Keep the implementation aligned with fetch_meta_to_kb.py.

Run Workflow

Set database connection env vars (user-managed keys prefixed with KB_):

KB_DB_HOST
KB_DB_PORT
KB_DB_NAME
KB_DB_USER
KB_DB_PASSWORD
KB_LOG_DIR (required, log output directory)

Run incremental fetch with a required date:

python3 scripts/fetch_meta_to_kb.py --from-date 2024-05-01

If executing through an exec tool call, set timeout to 1800 seconds (30 minutes).

Check logs in:

${KB_LOG_DIR}/fetch-meta-to-kb-YYYYMMDD-HHMMSS.log (UTC timestamp, one file per run)

Build user-facing summary strictly from the current run output:

Prefer RUN_SUMMARY_JSON emitted by fetch_meta_to_kb.py.
If JSON is unavailable, parse only this run's ${KB_LOG_DIR}/fetch-meta-to-kb-YYYYMMDD-HHMMSS.log.
total_inserted must mean rows inserted in this run (after DOI dedup), not cumulative rows in table.

Behavior Contract

Query Crossref endpoint: https://api.crossref.org/journals/{issn}/works.
Filter with type:journal-article,from-pub-date:<from-date>.
Keep only items whose container-title equals target journal title (case-insensitive).
Continue pagination with cursor until no matching items remain.
Store fields in journals: title, doi, journal, authors, date, abstract (nullable when Crossref has no abstract).
Reporting/announcement metrics must use current-run log/summary only.
Do not compute announcement counts via database-wide or time-window SQL such as WHERE date >= ....

Scope Boundary

Implement only Crossref incremental fetch + insert into journals.

Script

scripts/fetch_meta_to_kb.py

---name: fetch-meta-to-kbdescription: Fetch journal articles from Crossref published after a user-specified date and insert them into PostgreSQL `journals` with DOI deduplication. Use when incrementally ingesting journal metadata from `journals_issn` into `journals`.--- # Fetch Meta to KB ## Core Goal - Pull `journal-article` records from Crossref after a given `--from-date`. - Read ISSN seed rows from `journals_issn` (`journal`, `issn1`). - Insert rows into `journals` with `ON CONFLICT (doi) DO NOTHING`. - Keep the implementation aligned with `fetch_meta_to_kb.py`. ## Run Workflow 1. Set database connection env vars (user-managed keys prefixed with `KB_`): - `KB_DB_HOST` - `KB_DB_PORT` - `KB_DB_NAME` - `KB_DB_USER` - `KB_DB_PASSWORD` - `KB_LOG_DIR` (required, log output directory) 2. Run incremental fetch with a required date: ```bash python3 scripts/fetch_meta_to_kb.py --from-date 2024-05-01 ``` - If executing through an `exec` tool call, set timeout to **1800 seconds (30 minutes)**. 3. Check logs in: - `${KB_LOG_DIR}/fetch-meta-to-kb-YYYYMMDD-HHMMSS.log` (UTC timestamp, one file per run) 4. Build user-facing summary strictly from the current run output: - Prefer `RUN_SUMMARY_JSON` emitted by `fetch_meta_to_kb.py`. - If JSON is unavailable, parse only this run's `${KB_LOG_DIR}/fetch-meta-to-kb-YYYYMMDD-HHMMSS.log`. - `total_inserted` must mean rows inserted in this run (after DOI dedup), not cumulative rows in table. ## Behavior Contract - Query Crossref endpoint: `https://api.crossref.org/journals/{issn}/works`. - Filter with `type:journal-article,from-pub-date:<from-date>`. - Keep only items whose `container-title` equals target journal title (case-insensitive). - Continue pagination with cursor until no matching items remain. - Store fields in `journals`: `title`, `doi`, `journal`, `authors`, `date`, `abstract` (nullable when Crossref has no abstract). - Reporting/announcement metrics must use current-run log/summary only. - Do **not** compute announcement counts via database-wide or time-window SQL such as `WHERE date >= ...`. ## Scope Boundary - Implement only Crossref incremental fetch + insert into `journals`. ## Script - `scripts/fetch_meta_to_kb.py`

Frequently asked questions