# Gradient Data Gathering

> Data gathering tools for the Gradient Research Team. Fetches news (Google News RSS), SEC filings (EDGAR), fundamental financials (SEC EDGAR XBRL + yfinance), Reddit sentiment, and technical price data (yfinance) for stock tickers on the watchlist.

- Skill: `rogue-iteration/gradient-data-gathering` (Agent Skill, multi-file: 5 files)
- Install (CLI): `npx skillmds@latest add rogue-iteration/gradient-data-gathering`
- Raw SKILL.md: https://api.skillmd.com/api/skills/rogue-iteration/gradient-data-gathering/raw
- Safety review: pending
- Works with: Claude Code, Claude.ai, OpenAI Codex
- Category: Research & Search
- Author: Rogue-Iteration (https://skillmd.com/u/rogue-iteration)
- Updated: 2026-09-10
- Page: https://skillmd.com/skills/rogue-iteration/gradient-data-gathering

---


# Data Gathering

Four data-gathering scripts used by the Gradient Research Team agents.
Each agent runs its own gatherer on a heartbeat cycle and stores results via the
`gradient-research-assistant` shared skill.

## Scripts

### gather_web.py — News & SEC Filings (Nova)

```bash
python3 gather_web.py --ticker BNTX --name "BioNTech SE" --theme "mRNA cancer research"
```

Fetches from Google News RSS and SEC EDGAR full-text search.
Outputs a combined Markdown report with sourced articles and filings.

### gather_social.py — Reddit Sentiment (Luna)

```bash
python3 gather_social.py --ticker CAKE --company "The Cheesecake Factory"
python3 gather_social.py --ticker HOG --json
```

Searches Reddit (r/wallstreetbets, r/stocks, r/investing, etc.) and calculates
sentiment signals: volume, engagement ratio, cross-subreddit spread, upvote ratio.

### gather_fundamentals.py — Financial Statements (Max)

```bash
python3 gather_fundamentals.py --ticker CAKE --company "The Cheesecake Factory"
python3 gather_fundamentals.py --ticker BNTX --json
```

Pulls structured financial data from SEC EDGAR XBRL API (companyfacts endpoint) for
5+ years of audited financials: revenue, net income, EPS, margins, balance sheet,
cash flow, and key ratios (D/E, current ratio, net debt). Supplements with yfinance
for company info, analyst recommendations, and earnings beat/miss history.

### gather_technicals.py — Price & Indicators (Ace)

```bash
python3 gather_technicals.py --ticker CAKE --company "The Cheesecake Factory"
python3 gather_technicals.py --ticker HOG --json
```

Uses `yfinance` to fetch 5 years of OHLCV data and calculates:
SMA (20/50/200), RSI(14), MACD(12,26,9), Bollinger Bands(20,2), volume analysis.
Identifies signals: golden/death crosses, RSI overbought/oversold, MACD crossovers,
Bollinger squeezes, volume spikes.

## External Endpoints

| Endpoint | Data Sent | Script |
|----------|-----------|--------|
| `news.google.com/rss/search` | Ticker + theme as query | `gather_web.py` |
| `efts.sec.gov/LATEST/search-index` | Ticker as query | `gather_web.py` |
| `data.sec.gov/api/xbrl/companyfacts/` | CIK number | `gather_fundamentals.py` |
| `www.sec.gov/files/company_tickers.json` | None (bulk download) | `gather_fundamentals.py` |
| `www.reddit.com/search.json` | Ticker as query | `gather_social.py` |
| `www.reddit.com/r/{sub}/search.json` | Ticker as query | `gather_social.py` |
| Yahoo Finance (via `yfinance`) | Ticker symbol | `gather_technicals.py`, `gather_fundamentals.py` |

## Security & Privacy

- All data sources are **public APIs** — no authentication required
- No user data or API keys are sent to these endpoints
- The SEC EDGAR endpoint requires a user-agent with contact info (demo email used)
- Reddit requests use a research bot user-agent
- `yfinance` downloads publicly available market data

## Trust Statement

> By using this skill, public market data is fetched from Google News, SEC EDGAR
> (text search + XBRL), Reddit, and Yahoo Finance. No private data leaves the machine.
> Only install if you trust these public data sources.