Data Labeler
A data processing and labeling toolkit for ingesting, transforming, querying, and managing data entries from the command line. All operations are logged with timestamps and stored locally.
Commands
Data Operations
Each data command works in two modes: run without arguments to view recent entries, or pass input to record a new entry.
| Command |
Description |
data-labeler ingest <input> |
Ingest data — record a new ingest entry or view recent ones |
data-labeler transform <input> |
Transform data — record a transformation or view recent ones |
data-labeler query <input> |
Query data — record a query or view recent ones |
data-labeler filter <input> |
Filter data — record a filter operation or view recent ones |
data-labeler aggregate <input> |
Aggregate data — record an aggregation or view recent ones |
data-labeler visualize <input> |
Visualize data — record a visualization or view recent ones |
data-labeler export <input> |
Export data — record an export entry or view recent ones |
data-labeler sample <input> |
Sample data — record a sample or view recent ones |
data-labeler schema <input> |
Schema management — record a schema entry or view recent ones |
data-labeler validate <input> |
Validate data — record a validation or view recent ones |
data-labeler pipeline <input> |
Pipeline management — record a pipeline step or view recent ones |
data-labeler profile <input> |
Profile data — record a profile or view recent ones |
Utility Commands
| Command |
Description |
data-labeler stats |
Show summary statistics — entry counts per category, total entries, disk usage |
data-labeler export <fmt> |
Export all data to a file (formats: json, csv, txt) |
data-labeler search <term> |
Search all log files for a term (case-insensitive) |
data-labeler recent |
Show last 20 entries from activity history |
data-labeler status |
Health check — version, data directory, entry count, disk usage, last activity |
data-labeler help |
Show available commands |
data-labeler version |
Show version (v2.0.0) |
Data Storage
All data is stored locally at ~/.local/share/data-labeler/:
- Each data command writes to its own log file (e.g.,
ingest.log, transform.log)
- Entries are stored as
timestamp|value pairs (pipe-delimited)
- All actions are tracked in
history.log with timestamps
- Export generates files in the data directory (
export.json, export.csv, or export.txt)
Requirements
- Bash (with
set -euo pipefail)
- Standard Unix utilities:
date, wc, du, grep, tail, cat, sed
- No external dependencies or API keys required
When to Use
- To log and track data processing operations (ingest, transform, query, etc.)
- To maintain a searchable history of data pipeline activities
- To export accumulated records in JSON, CSV, or plain text format
- As part of larger automation or data-pipeline workflows
- When you need a lightweight, local-only data operation tracker
Examples
# Record a new ingest entry
data-labeler ingest "loaded customer_data.csv 5000 rows"
# View recent transform entries
data-labeler transform
# Search across all logs
data-labeler search "customer"
# Export everything as JSON
data-labeler export json
# Check overall statistics
data-labeler stats
# View recent activity
data-labeler recent
# Health check
data-labeler status
Powered by BytesAgain | bytesagain.com | hello@bytesagain.com
💬 Feedback & Feature Requests: https://bytesagain.com/feedback
1---2name: label-studio3description: Label Studio is a multi-type data labeling and annotation tool with standardized output format label studio, typescript, annotation, annotation-tool.4---5
6# Data Labeler
7
8A data processing and labeling toolkit for ingesting, transforming, querying, and managing data entries from the command line. All operations are logged with timestamps and stored locally.
9
10## Commands
11
12### Data Operations
13
14Each data command works in two modes: run without arguments to view recent entries, or pass input to record a new entry.
15
16| Command | Description |
17|---------|-------------|
18| `data-labeler ingest <input>` | Ingest data — record a new ingest entry or view recent ones |
19| `data-labeler transform <input>` | Transform data — record a transformation or view recent ones |
20| `data-labeler query <input>` | Query data — record a query or view recent ones |
21| `data-labeler filter <input>` | Filter data — record a filter operation or view recent ones |
22| `data-labeler aggregate <input>` | Aggregate data — record an aggregation or view recent ones |
23| `data-labeler visualize <input>` | Visualize data — record a visualization or view recent ones |
24| `data-labeler export <input>` | Export data — record an export entry or view recent ones |
25| `data-labeler sample <input>` | Sample data — record a sample or view recent ones |
26| `data-labeler schema <input>` | Schema management — record a schema entry or view recent ones |
27| `data-labeler validate <input>` | Validate data — record a validation or view recent ones |
28| `data-labeler pipeline <input>` | Pipeline management — record a pipeline step or view recent ones |
29| `data-labeler profile <input>` | Profile data — record a profile or view recent ones |
30
31### Utility Commands
32
33| Command | Description |
34|---------|-------------|
35| `data-labeler stats` | Show summary statistics — entry counts per category, total entries, disk usage |
36| `data-labeler export <fmt>` | Export all data to a file (formats: `json`, `csv`, `txt`) |
37| `data-labeler search <term>` | Search all log files for a term (case-insensitive) |
38| `data-labeler recent` | Show last 20 entries from activity history |
39| `data-labeler status` | Health check — version, data directory, entry count, disk usage, last activity |
40| `data-labeler help` | Show available commands |
41| `data-labeler version` | Show version (v2.0.0) |
42
43## Data Storage
44
45All data is stored locally at `~/.local/share/data-labeler/`:
46
47- Each data command writes to its own log file (e.g., `ingest.log`, `transform.log`)
48- Entries are stored as `timestamp|value` pairs (pipe-delimited)
49- All actions are tracked in `history.log` with timestamps
50- Export generates files in the data directory (`export.json`, `export.csv`, or `export.txt`)
51
52## Requirements
53
54- Bash (with `set -euo pipefail`)
55- Standard Unix utilities: `date`, `wc`, `du`, `grep`, `tail`, `cat`, `sed`
56- No external dependencies or API keys required
57
58## When to Use
59
60- To log and track data processing operations (ingest, transform, query, etc.)
61- To maintain a searchable history of data pipeline activities
62- To export accumulated records in JSON, CSV, or plain text format
63- As part of larger automation or data-pipeline workflows
64- When you need a lightweight, local-only data operation tracker
65
66## Examples
67
68```bash
69# Record a new ingest entry
70data-labeler ingest "loaded customer_data.csv 5000 rows"
71
72# View recent transform entries
73data-labeler transform
74
75# Search across all logs
76data-labeler search "customer"
77
78# Export everything as JSON
79data-labeler export json
80
81# Check overall statistics
82data-labeler stats
83
84# View recent activity
85data-labeler recent
86
87# Health check
88data-labeler status
89```
90
91---
92Powered by BytesAgain | bytesagain.com | hello@bytesagain.com
93💬 Feedback & Feature Requests: https://bytesagain.com/feedback
bytesagain