Level1Techs Forum Extraction Skill
This skill automates the extraction of discussion data from various Level1Techs forum threads and maintains an organized agentic primitive archive on GitHub.
Repository
https://github.com/bojak83318/level1techs-forums
Directory Structure
Primitives are organized by category and sub-category matching the forum URL structure:
high-performance-computing/deep-machine-learning-ai/
Primitive Naming
Convention: [topic-slug]-primitive.json
Remote Execution
Extraction is performed within the kasm-vm Docker container ff9c2ffca193 using curl_cffi (chrome124 impersonation) to bypass protections.
Script Location: .gemini/skills/arc-pro-b70-extraction/scripts/extract_l1t.py
Workflow
- Prepare Script: Ensure the topic list in
extract_l1t.pyincludes the target topic IDs. - Push to Container:
incus file push .gemini/skills/arc-pro-b70-extraction/scripts/extract_l1t.py kasm-vm/home/kasm-user/extract_l1t.pyincus exec kasm-vm -- docker cp /home/kasm-user/extract_l1t.py ff9c2ffca193:/home/kasm-user/extract_l1t.py - Execute Extraction:
incus exec kasm-vm -- docker exec -u kasm-user ff9c2ffca193 python3 /home/kasm-user/extract_l1t.py - Retrieve Primitives:
Pull the generated
[slug]-primitive.jsonfiles from the container back to the host. - Sync to GitHub:
Move primitives to the correct category folder (e.g.,
high-performance-computing/deep-machine-learning-ai/) and push tobojak83318/level1techs-forumsusing the authorized token.
Data Schema (Agentic Primitive)
primitive_id: "[topic-slug]-primitive"domain: "forum.level1techs.com"source: Full thread URLdata.mappings: Array of{username, post_number, created_at, board, topic, content_markdown}