Closed-Loop Analytics Upgrade
Principle
A workflow is not a closed loop until it checks whether the change worked and updates the playbook from that evidence.
For marketing skills, that means pulling analytics after the change window. Manual opinions are useful. Platform truth wins.
Core pattern
- Input: usage logs, recommendations, shipped changes, platform analytics, owner feedback, and cost/runtime data.
- AI action: compare baseline vs candidate, find repeatable signals, and propose a skill/playbook patch.
- Output: candidate patch to a prompt, skill, connector, brief template, scoring rubric, or next-action rule.
- Judgment: success rate, speed, cost, quality, human correction rate, and actual performance delta.
- Self-improvement: promote only if it beats baseline. Otherwise keep testing, rollback, or mark unproven.
Analytics by surface
X/Twitter
Track:
- impressions
- engagement rate
- replies
- reposts
- bookmarks
- profile clicks
- follower delta
- post length
- hook style
- proof number
- CTA type
- topic bucket
Use for:
- title/hook formulas
- longform structure
- CTA patterns
- post timing
- topic scoring
YouTube
Track:
- impressions
- CTR
- average view duration
- retention curve
- watch time
- subscribers gained
- comments
- traffic source
- title/thumbnail/hook metadata
- video length and topic bucket
Use for:
- title formulas
- thumbnail rules
- first-15-second hook
- retention beats
- chapter structure
- Shorts cutdowns
- repurposing guidance
SEO/AEO/GEO
Track:
- GSC clicks, impressions, CTR, average position, query/page mix
- GA4 sessions, engaged sessions, conversions, assisted leads
- Ahrefs rankings, backlinks, traffic estimates, keyword movement
- ClickFlow opportunities
- AI-search / answer-engine visibility where available
- CMS/page change log
Use for:
- content refresh patterns
- AEO/GEO opportunity scoring
- query/page prioritization
- internal linking and schema recommendations
- rollback decisions
Revenue / outbound
Track:
- HubSpot owner, lead, deal, and pipeline movement
- Gong call language, objections, buying signals, and outcomes
- Instantly/Smartlead positive replies, booked meetings, unsubscribes, spam risk
- Metricool/LinkedIn post performance
- GA4/HubSpot attribution
Use for:
- outbound sequence patches
- offer angle scoring
- sales follow-up language
- content-to-pipeline investment decisions
Required readback fields
Every promoted change needs:
- change made
- owner
- baseline window
- candidate window
- source systems pulled
- primary metric
- secondary metrics
- metric winner
- caveats/confounders
- decision: promote / keep testing / rollback / unproven
- next patch
- next readback date
Promotion rules
Promote when:
- the candidate beats baseline on the primary metric, or
- the candidate exposes a repeatable audience/customer signal, and
- downside metrics are not meaningfully worse.
Do not promote when:
- volume is too low
- attribution is too dirty
- the result is explained by seasonality or unrelated campaigns
- the connector failed
- only the author liked it
That last one is harsh but spiritually important.
Safety boundaries
Read-only analytics pulls are fine. External writes still require approval:
- posting to X/LinkedIn/YouTube
- publishing or editing CMS content
- changing ad accounts, bids, budgets, targeting, or creative
- mutating CRM/outbound tools
- sending emails or DMs
- changing credentials or production systems
Output template
# Readback: <skill/change>
## Verdict
Promote / keep testing / rollback / unproven
## Change tested
<what changed>
## Data pulled
| Source | Window | Status |
|---|---|---|
## Baseline vs candidate
| Metric | Baseline | Candidate | Delta | Interpretation |
|---|---:|---:|---:|---|
## Caveats
<confounders and missing data>
## Patch
<what changes in the skill/playbook>
## Next readback
<date + metric>
1---2name: closed-loop-analytics-upgrade3description: Upgrade marketing, content, SEO/AEO/GEO, and revenue skills so changes are judged by platform analytics instead of vibes. Use when applying closed-loop learning to X, YouTube, SEO, AEO/GEO, outbound, paid creative, or revenue workflows.4metadata:5 source: https://skillmd.com/skills/ericosiu/closed-loop-analytics-upgrade6---78# Closed-Loop Analytics Upgrade910## Principle1112A workflow is not a closed loop until it checks whether the change worked and updates the playbook from that evidence.1314For marketing skills, that means pulling analytics after the change window. Manual opinions are useful. Platform truth wins.1516## Core pattern17181. **Input**: usage logs, recommendations, shipped changes, platform analytics, owner feedback, and cost/runtime data.192. **AI action**: compare baseline vs candidate, find repeatable signals, and propose a skill/playbook patch.203. **Output**: candidate patch to a prompt, skill, connector, brief template, scoring rubric, or next-action rule.214. **Judgment**: success rate, speed, cost, quality, human correction rate, and actual performance delta.225. **Self-improvement**: promote only if it beats baseline. Otherwise keep testing, rollback, or mark unproven.2324## Analytics by surface2526### X/Twitter27Track:28- impressions29- engagement rate30- replies31- reposts32- bookmarks33- profile clicks34- follower delta35- post length36- hook style37- proof number38- CTA type39- topic bucket4041Use for:42- title/hook formulas43- longform structure44- CTA patterns45- post timing46- topic scoring4748### YouTube49Track:50- impressions51- CTR52- average view duration53- retention curve54- watch time55- subscribers gained56- comments57- traffic source58- title/thumbnail/hook metadata59- video length and topic bucket6061Use for:62- title formulas63- thumbnail rules64- first-15-second hook65- retention beats66- chapter structure67- Shorts cutdowns68- repurposing guidance6970### SEO/AEO/GEO71Track:72- GSC clicks, impressions, CTR, average position, query/page mix73- GA4 sessions, engaged sessions, conversions, assisted leads74- Ahrefs rankings, backlinks, traffic estimates, keyword movement75- ClickFlow opportunities76- AI-search / answer-engine visibility where available77- CMS/page change log7879Use for:80- content refresh patterns81- AEO/GEO opportunity scoring82- query/page prioritization83- internal linking and schema recommendations84- rollback decisions8586### Revenue / outbound87Track:88- HubSpot owner, lead, deal, and pipeline movement89- Gong call language, objections, buying signals, and outcomes90- Instantly/Smartlead positive replies, booked meetings, unsubscribes, spam risk91- Metricool/LinkedIn post performance92- GA4/HubSpot attribution9394Use for:95- outbound sequence patches96- offer angle scoring97- sales follow-up language98- content-to-pipeline investment decisions99100## Required readback fields101102Every promoted change needs:103104- change made105- owner106- baseline window107- candidate window108- source systems pulled109- primary metric110- secondary metrics111- metric winner112- caveats/confounders113- decision: promote / keep testing / rollback / unproven114- next patch115- next readback date116117## Promotion rules118119Promote when:120- the candidate beats baseline on the primary metric, or121- the candidate exposes a repeatable audience/customer signal, and122- downside metrics are not meaningfully worse.123124Do not promote when:125- volume is too low126- attribution is too dirty127- the result is explained by seasonality or unrelated campaigns128- the connector failed129- only the author liked it130131That last one is harsh but spiritually important.132133## Safety boundaries134135Read-only analytics pulls are fine. External writes still require approval:136137- posting to X/LinkedIn/YouTube138- publishing or editing CMS content139- changing ad accounts, bids, budgets, targeting, or creative140- mutating CRM/outbound tools141- sending emails or DMs142- changing credentials or production systems143144## Output template145146```markdown147# Readback: <skill/change>148149## Verdict150Promote / keep testing / rollback / unproven151152## Change tested153<what changed>154155## Data pulled156| Source | Window | Status |157|---|---|---|158159## Baseline vs candidate160| Metric | Baseline | Candidate | Delta | Interpretation |161|---|---:|---:|---:|---|162163## Caveats164<confounders and missing data>165166## Patch167<what changes in the skill/playbook>168169## Next readback170<date + metric>171```