Resource Monitor — Track What Matters
Manage the feed subscription system (ADR-0127). Inngest cron checks subscriptions hourly, detects changes, summarizes via LLM, and notifies Joel via gateway with approve/dismiss for /cool publishing.
Joel's Interest Profile
Use this to assess whether a discovered resource is worth monitoring. If a resource clearly maps to 2+ of these, recommend monitoring with a brief explanation.
- Agentic AI — agent patterns, agent infrastructure, tool use, MCP, multi-agent systems
- Developer education — course platforms, learning design, course-builder ecosystem
- TypeScript tooling — Effect ecosystem, Bun, type-level programming, compiler work
- Inngest / durable workflows — event-driven systems, step functions, background jobs
- Personal AI systems — local-first AI, semantic memory, knowledge management, RAG
- BEAM / Elixir / OTP — Erlang ecosystem, actor model, fault tolerance
- Video infrastructure — Mux, transcription, media pipelines
- Next.js / React — RSC, App Router, cache components, Vercel platform
- CLI design — agent-first interfaces, HATEOAS, terminal UIs
- Knowledge management — Obsidian, digital gardens, PKM, zettelkasten
- Self-hosted infra — homelab, k8s, Tailscale, NAS, local services
- AT Protocol / Bluesky — decentralized web, PDS, lexicons
- Convex — real-time database, reactive backends
CLI Commands
# List all monitored subscriptions
joelclaw subscribe list
# Add a subscription (auto-detects type from URL)
joelclaw subscribe add <url> --name "Simon Willison" --interval hourly
joelclaw subscribe add <url> --name "json-render" --type github --interval daily
# Remove a subscription
joelclaw subscribe remove <id>
# Force-check a specific subscription now
joelclaw subscribe check --id <id>
# Force-check all subscriptions
joelclaw subscribe check
# Show recent updates across all subscriptions
joelclaw subscribe summary
Direct Inngest Fallback (alternative)
# Add subscription via event
joelclaw send subscription/add -d '{
"id": "simon-willison-blog",
"name": "Simon Willison",
"feedUrl": "https://simonwillison.net/atom/everything/",
"type": "atom",
"checkInterval": "hourly",
"notify": true,
"summarize": true,
"publishToCool": false,
"active": true
}'
# Force check all
joelclaw send subscription/check-feeds
# Check single
joelclaw send subscription/check-single -d '{"subscriptionId": "simon-willison-blog"}'
Subscription Types
| Type |
Detection |
Method |
Best For |
atom / rss |
URL ends in /atom/, /feed/, /rss or has XML content-type |
Standard feed parse |
Blogs, newsletters |
github |
github.com/<owner>/<repo> |
GitHub API (releases, commits) |
Open source projects |
page |
Any other URL |
Content hash diff via defuddle |
Living documents, guides |
bluesky |
bsky.app or AT Protocol handle |
AT Protocol feed |
Social/microblog |
Auto-Detection Heuristics
When adding a subscription, detect the type:
- GitHub URL →
github type, check releases + significant commits
- URL with
/atom/ or /feed/ → atom type
- URL with
/rss → rss type
- Blog root URL → try
{url}/atom/, {url}/feed/, {url}/rss.xml before falling back to page
- Everything else →
page type (content hash diff)
How Updates Flow
Inngest cron (hourly) → subscription/check-feeds
→ fans out: subscription/check-single per subscription
→ fetch feed / API / page hash
→ new entries detected?
→ YES: subscription/summarize → LLM summary
→ gateway notification with [Publish to /cool] [Dismiss]
→ Joel approves → discovery/noted → vault note → /cool
→ NO: log quiet check, move on
Notification Format
Gateway notifications for feed updates include:
- Source name and subscription type
- Brief LLM summary of what changed
- Entry count and links to significant items
- Relevance tag (which interest areas it maps to)
- Action buttons: [Publish to /cool] [Dismiss]
Adding from Discovery
When the discovery skill fires and the agent assesses the resource is monitorable, use MCQ to recommend:
After firing joelclaw discover:
1. Assess: Is this a blog, repo, or living page with ongoing updates?
2. Assess: Does it map to 2+ items in Joel's Interest Profile above?
3. If both yes → recommend monitoring via MCQ with brief reasoning
4. If monitorable but low relevance → mention it's monitorable but don't push
5. If not monitorable (one-shot article, tweet, etc.) → don't mention monitoring
Backend
- Redis storage:
joelclaw:subscriptions hash (lib at packages/system-bus/src/lib/subscriptions.ts)
- Inngest functions:
packages/system-bus/src/inngest/functions/subscriptions.ts
- Feed checker:
packages/system-bus/src/lib/feed-checker.ts
- ADR:
~/Vault/docs/decisions/0127-feed-subscriptions-and-resource-monitoring.md
1---2name: monitor3description: Manage feed subscriptions that track blogs, repos, and living pages for changes. Use when adding, listing, removing, or checking monitored resources. Also use when the discovery skill flags a resource as monitorable. Triggers on: 'monitor this', 'subscribe to', 'track this repo', 'watch this blog', 'what are we monitoring', 'check feeds', 'unsubscribe', 'stop monitoring', or any task involving feed subscriptions.4---5
6# Resource Monitor — Track What Matters
7
8Manage the feed subscription system (ADR-0127). Inngest cron checks subscriptions hourly, detects changes, summarizes via LLM, and notifies Joel via gateway with approve/dismiss for `/cool` publishing.
9
10## Joel's Interest Profile
11
12Use this to assess whether a discovered resource is worth monitoring. If a resource clearly maps to 2+ of these, **recommend monitoring** with a brief explanation.
13
14- **Agentic AI** — agent patterns, agent infrastructure, tool use, MCP, multi-agent systems
15- **Developer education** — course platforms, learning design, course-builder ecosystem
16- **TypeScript tooling** — Effect ecosystem, Bun, type-level programming, compiler work
17- **Inngest / durable workflows** — event-driven systems, step functions, background jobs
18- **Personal AI systems** — local-first AI, semantic memory, knowledge management, RAG
19- **BEAM / Elixir / OTP** — Erlang ecosystem, actor model, fault tolerance
20- **Video infrastructure** — Mux, transcription, media pipelines
21- **Next.js / React** — RSC, App Router, cache components, Vercel platform
22- **CLI design** — agent-first interfaces, HATEOAS, terminal UIs
23- **Knowledge management** — Obsidian, digital gardens, PKM, zettelkasten
24- **Self-hosted infra** — homelab, k8s, Tailscale, NAS, local services
25- **AT Protocol / Bluesky** — decentralized web, PDS, lexicons
26- **Convex** — real-time database, reactive backends
27
28## CLI Commands
29
30```bash
31# List all monitored subscriptions
32joelclaw subscribe list
33
34# Add a subscription (auto-detects type from URL)
35joelclaw subscribe add <url> --name "Simon Willison" --interval hourly
36joelclaw subscribe add <url> --name "json-render" --type github --interval daily
37
38# Remove a subscription
39joelclaw subscribe remove <id>
40
41# Force-check a specific subscription now
42joelclaw subscribe check --id <id>
43
44# Force-check all subscriptions
45joelclaw subscribe check
46
47# Show recent updates across all subscriptions
48joelclaw subscribe summary
49```
50
51### Direct Inngest Fallback (alternative)
52
53```bash
54# Add subscription via event
55joelclaw send subscription/add -d '{
56 "id": "simon-willison-blog",
57 "name": "Simon Willison",
58 "feedUrl": "https://simonwillison.net/atom/everything/",
59 "type": "atom",
60 "checkInterval": "hourly",
61 "notify": true,
62 "summarize": true,
63 "publishToCool": false,
64 "active": true
65}'
66
67# Force check all
68joelclaw send subscription/check-feeds
69
70# Check single
71joelclaw send subscription/check-single -d '{"subscriptionId": "simon-willison-blog"}'
72```
73
74## Subscription Types
75
76| Type | Detection | Method | Best For |
77|------|-----------|--------|----------|
78| `atom` / `rss` | URL ends in `/atom/`, `/feed/`, `/rss` or has XML content-type | Standard feed parse | Blogs, newsletters |
79| `github` | `github.com/<owner>/<repo>` | GitHub API (releases, commits) | Open source projects |
80| `page` | Any other URL | Content hash diff via defuddle | Living documents, guides |
81| `bluesky` | `bsky.app` or AT Protocol handle | AT Protocol feed | Social/microblog |
82
83## Auto-Detection Heuristics
84
85When adding a subscription, detect the type:
86
871. **GitHub URL** → `github` type, check releases + significant commits
882. **URL with `/atom/` or `/feed/`** → `atom` type
893. **URL with `/rss`** → `rss` type
904. **Blog root URL** → try `{url}/atom/`, `{url}/feed/`, `{url}/rss.xml` before falling back to `page`
915. **Everything else** → `page` type (content hash diff)
92
93## How Updates Flow
94
95```
96Inngest cron (hourly) → subscription/check-feeds
97 → fans out: subscription/check-single per subscription
98 → fetch feed / API / page hash
99 → new entries detected?
100 → YES: subscription/summarize → LLM summary
101 → gateway notification with [Publish to /cool] [Dismiss]
102 → Joel approves → discovery/noted → vault note → /cool
103 → NO: log quiet check, move on
104```
105
106## Notification Format
107
108Gateway notifications for feed updates include:
109- **Source name** and subscription type
110- **Brief LLM summary** of what changed
111- **Entry count** and links to significant items
112- **Relevance tag** (which interest areas it maps to)
113- **Action buttons**: [Publish to /cool] [Dismiss]
114
115## Adding from Discovery
116
117When the discovery skill fires and the agent assesses the resource is monitorable, use MCQ to recommend:
118
119```
120After firing joelclaw discover:
121
1221. Assess: Is this a blog, repo, or living page with ongoing updates?
1232. Assess: Does it map to 2+ items in Joel's Interest Profile above?
1243. If both yes → recommend monitoring via MCQ with brief reasoning
1254. If monitorable but low relevance → mention it's monitorable but don't push
1265. If not monitorable (one-shot article, tweet, etc.) → don't mention monitoring
127```
128
129## Backend
130
131- **Redis storage**: `joelclaw:subscriptions` hash (lib at `packages/system-bus/src/lib/subscriptions.ts`)
132- **Inngest functions**: `packages/system-bus/src/inngest/functions/subscriptions.ts`
133- **Feed checker**: `packages/system-bus/src/lib/feed-checker.ts`
134- **ADR**: `~/Vault/docs/decisions/0127-feed-subscriptions-and-resource-monitoring.md`