How do I install the Doris Debug Compaction skill?

Run npx skillmds@latest add apache/doris-debug-compaction in your terminal (requires Node.js), paste this page's agent-chat prompt into Claude, Cursor, or any MCP-connected agent, or download the SKILL.md file and copy it into your agent's skills directory.

Is Doris Debug Compaction safe to use?

This skill has not completed SkillMD's automated safety review yet. SkillMD never runs a skill's scripts for you; review the SKILL.md before installing.

Which AI agents work with Doris Debug Compaction?

This skill is tagged as working with Claude Code, Claude.ai, OpenAI Codex. SKILL.md is an open format, so most agents that read a skills directory can load it too.

Is Doris Debug Compaction free to use?

Yes. Installing skills from SkillMD is free, and the skill stays under its author's original license.

Who published Doris Debug Compaction?

apache (@apache) published this skill. Their other Agent Skills are listed on their SkillMD profile.

Doris Debug Compaction by apache — Agent Skill

Name: Doris Debug Compaction
Author: apache

Doris Debug Compaction

Use for Doris -235 / too many versions and compaction lag. Error raised in RowsetBuilder::check_tablet_version_count when version_count > max_tablet_version_num (default 2000) or meta serialize size limit.

apache 068549f 3 files · 7.0 KB Updated Sep 17, 2026

File contents

Compaction / Versions

Code

be/src/storage/rowset_builder.cpp:

version_count > max_version_config → Status::Error<TOO_MANY_VERSION>(...)
Suggests reduce load frequency or raise max_tablet_version_num / time_series_max_tablet_version_num in be.conf
Near limit triggers cumulative compaction submit

Defaults (config.cpp): max_tablet_version_num=2000, time_series_max_tablet_version_num=20000.

Causes

ID	Cause	Evidence	Fix direction
A	Ingest rate > compaction throughput	version_count rising; compaction score growing	Reduce ingest frequency or increase compaction threads
B	Disk IO bottleneck	`iostat` shows disk util > 90%	Move WAL to separate disk; add compaction disks
C	max_tablet_version_num too low for workload	-235 on normal ingest rates	Raise limit (temporary), then fix root cause
D	Single-tablet hotspot	One tablet has 10× versions of peers	Partition / bucket key skew

Actions

Confirm with ./scripts/doris-debug log-grep be/log --pack versions
Check compaction throughput: ./scripts/doris-debug be-metrics --be http://$BE:8040 --grep compaction
Check disk IO: iostat -x 1
Slow ingest / enlarge group commit batches
Raising max_tablet_version_num is a temporary valve — fix ingest vs compaction balance

./scripts/doris-debug be-metrics --be http://$BE:8040 --grep compaction

Compaction knobs

# be.conf
max_tablet_version_num = 2000               # hard cap, raise only as stopgap
time_series_max_tablet_version_num = 20000   # separate cap for time-series tables
max_cumulative_compaction_threads = -1       # -1 = auto based on CPU cores
compaction_task_num_per_disk = 4             # per-disk concurrent compaction tasks
compaction_tablet_size_threshold = 107374182400  # 100GB — above this, skip base compaction

Source

be/src/storage/rowset_builder.cpp — -235 error
be/src/common/config.cpp — all compaction config defaults
be/src/olap/cumulative_compaction_policy.cpp — score calculation

---name: doris-debug-compactiondescription: Use for Doris -235 / too many versions and compaction lag. Error raised in RowsetBuilder::check_tablet_version_count when version_count > max_tablet_version_num (default 2000) or meta serialize size limit.---# Compaction / Versions## Code`be/src/storage/rowset_builder.cpp`:- `version_count > max_version_config` → `Status::Error<TOO_MANY_VERSION>(...)`- Suggests reduce load frequency or raise `max_tablet_version_num` / `time_series_max_tablet_version_num` in `be.conf`- Near limit triggers cumulative compaction submitDefaults (`config.cpp`): `max_tablet_version_num=2000`, `time_series_max_tablet_version_num=20000`.## Causes| ID | Cause | Evidence | Fix direction ||----|-------|----------|---------------|| A | Ingest rate > compaction throughput | version_count rising; compaction score growing | Reduce ingest frequency or increase compaction threads || B | Disk IO bottleneck | `iostat` shows disk util > 90% | Move WAL to separate disk; add compaction disks || C | max_tablet_version_num too low for workload | -235 on normal ingest rates | Raise limit (temporary), then fix root cause || D | Single-tablet hotspot | One tablet has 10× versions of peers | Partition / bucket key skew |## Actions1. Confirm with `./scripts/doris-debug log-grep be/log --pack versions`2. Check compaction throughput: `./scripts/doris-debug be-metrics --be http://$BE:8040 --grep compaction`3. Check disk IO: `iostat -x 1`4. Slow ingest / enlarge group commit batches5. Raising `max_tablet_version_num` is a temporary valve — fix ingest vs compaction balance```bash./scripts/doris-debug be-metrics --be http://$BE:8040 --grep compaction```## Compaction knobs```properties# be.confmax_tablet_version_num = 2000 # hard cap, raise only as stopgaptime_series_max_tablet_version_num = 20000 # separate cap for time-series tablesmax_cumulative_compaction_threads = -1 # -1 = auto based on CPU corescompaction_task_num_per_disk = 4 # per-disk concurrent compaction taskscompaction_tablet_size_threshold = 107374182400 # 100GB — above this, skip base compaction```## Source- `be/src/storage/rowset_builder.cpp` — `-235` error- `be/src/common/config.cpp` — all compaction config defaults- `be/src/olap/cumulative_compaction_policy.cpp` — score calculation

Frequently asked questions