input-configurations
When to use
Load this skill whenever tasks include:
- building, modifying, or reviewing
agent/stream/*.yml.hbs templates for non-CEL input types
- configuring request, response, pagination, cursor, or authentication blocks in HTTPJSON templates
- wiring up cloud storage inputs (AWS S3, GCS, Azure Blob, Azure EventHub)
- setting up network inputs (TCP, UDP, HTTP Endpoint, WebSocket)
- configuring file-based inputs (Filestream, Logfile, Journald, Winlog)
- enabling Federated Identity (Cloud Connectors) on an AWS integration package
When not to use
Do not use this skill as the primary guide for:
- CEL program development (
cel-programs) -- CEL program structure, state model, and mito workflow. Exception: the auth.aws / use_cloud_connectors template block for Federated Identity is owned here via references/federated-identity-aws.md
- ingest pipeline processor design (
ingest-pipelines)
- field mappings and ECS compliance (
ecs-field-mappings)
var_groups / provider_permissions schema and format_version floors alone (package-spec) -- use this skill for the end-to-end federation procedure that applies them
Mandatory first read
Always load references/common-input-patterns.md first. It covers patterns that apply to every input type (tags, processors passthrough, variable conventions, forwarded/publisher_pipeline.disable_host coupling). These patterns are prerequisites for all type-specific guides.
Type routing table
Detect the input type from the filename pattern in agent/stream/ or from the data stream manifest input: field, then load the matching guide.
| Input type |
Filename pattern |
Guide |
| HTTPJSON |
httpjson.yml.hbs |
references/httpjson-guide.md |
| AWS S3 |
aws-s3.yml.hbs |
references/aws-s3-guide.md |
| CloudWatch |
aws-cloudwatch.yml.hbs |
references/aws-cloudwatch-guide.md |
| Azure Blob Storage |
azure-blob-storage.yml.hbs |
references/azure-blob-storage-guide.md |
| Azure Event Hub |
azure-eventhub.yml.hbs |
references/azure-eventhub-guide.md |
| GCS |
gcs.yml.hbs |
references/gcs-guide.md |
| GCP Pub/Sub |
gcp-pubsub.yml.hbs |
references/gcp-pubsub-guide.md |
| TCP |
tcp.yml.hbs |
references/tcp-udp-guide.md |
| UDP |
udp.yml.hbs |
references/tcp-udp-guide.md |
| HTTP Endpoint |
http_endpoint.yml.hbs |
references/http-endpoint-guide.md |
| Filestream |
filestream.yml.hbs |
references/filestream-logfile-guide.md |
| Logfile |
log.yml.hbs |
references/filestream-logfile-guide.md |
| Journald |
journald.yml.hbs |
references/journald-guide.md |
| Winlog |
winlog.yml.hbs |
references/winlog-guide.md |
| WebSocket |
websocket.yml.hbs |
references/websocket-guide.md |
Load only the guide for the detected input type, not all guides.
For Federated Identity tasks (any eligible input type, including cel), load
references/federated-identity-aws.md regardless of which input type is
involved.
Handoff
- For CEL program logic, hand off to the
cel-programs skill. Keep this skill loaded for Federated Identity auth.aws / use_cloud_connectors edits on cel.yml.hbs.
- For manifest schema (
var_groups, provider_permissions, format_version / conditions floors), hand off to the package-spec skill (references/var-groups-and-provider-permissions.md).
- For pipeline issues discovered while reviewing input templates, hand off to the
ingest-pipelines skill.
- For field mapping issues found in template variable wiring, hand off to the
ecs-field-mappings skill.
References
references/common-input-patterns.md -- tags, processors passthrough, variable conventions, review flags (applies to ALL input types)
references/httpjson-guide.md -- HTTPJSON template syntax, structure, validation rules, pagination patterns, authentication, cursor persistence
references/aws-s3-guide.md -- S3 bucket/SQS notification collection
references/aws-cloudwatch-guide.md -- CloudWatch log group collection
references/azure-blob-storage-guide.md -- Azure Blob Storage collection
references/azure-eventhub-guide.md -- Azure Event Hub collection
references/gcs-guide.md -- Google Cloud Storage collection
references/gcp-pubsub-guide.md -- GCP Pub/Sub collection
references/tcp-udp-guide.md -- TCP and UDP (syslog-style) listeners
references/http-endpoint-guide.md -- HTTP Endpoint (webhook receiver)
references/filestream-logfile-guide.md -- Filestream and legacy Logfile inputs
references/journald-guide.md -- Journald collection
references/winlog-guide.md -- Windows Event Log collection
references/websocket-guide.md -- WebSocket streaming (may embed CEL)
references/federated-identity-aws.md -- AWS Federated Identity procedure: input classification, federation vars, auth.aws / use_cloud_connectors, input gating (schema lives in package-spec)
1---2name: input-configurations3description: Input template configuration for Elastic integrations. Covers agent stream templates (agent/stream/*.yml.hbs) for all non-CEL input types: HTTPJSON, AWS S3, CloudWatch, Azure Blob, Azure EventHub, GCS, GCP Pub/Sub, TCP, UDP, HTTP Endpoint, Filestream, Logfile, Journald, Winlog, and WebSocket. Also covers Federated Identity (Cloud Connectors) for agentless AWS integrations, including the auth.aws / use_cloud_connectors block on CEL stream templates. For CEL program logic, use the cel-programs skill.4license: Apache-2.05---6
7# input-configurations
8
9## When to use
10
11Load this skill whenever tasks include:
12- building, modifying, or reviewing `agent/stream/*.yml.hbs` templates for non-CEL input types
13- configuring request, response, pagination, cursor, or authentication blocks in HTTPJSON templates
14- wiring up cloud storage inputs (AWS S3, GCS, Azure Blob, Azure EventHub)
15- setting up network inputs (TCP, UDP, HTTP Endpoint, WebSocket)
16- configuring file-based inputs (Filestream, Logfile, Journald, Winlog)
17- enabling Federated Identity (Cloud Connectors) on an AWS integration package
18
19## When not to use
20
21Do not use this skill as the primary guide for:
22- CEL *program* development (`cel-programs`) -- CEL program structure, state model, and mito workflow. Exception: the `auth.aws` / `use_cloud_connectors` template block for Federated Identity is owned here via `references/federated-identity-aws.md`
23- ingest pipeline processor design (`ingest-pipelines`)
24- field mappings and ECS compliance (`ecs-field-mappings`)
25- `var_groups` / `provider_permissions` *schema* and `format_version` floors alone (`package-spec`) -- use this skill for the end-to-end federation procedure that applies them
26
27## Mandatory first read
28
29**Always load `references/common-input-patterns.md` first.** It covers patterns that apply to every input type (tags, processors passthrough, variable conventions, `forwarded`/`publisher_pipeline.disable_host` coupling). These patterns are prerequisites for all type-specific guides.
30
31## Type routing table
32
33Detect the input type from the filename pattern in `agent/stream/` or from the data stream manifest `input:` field, then load the matching guide.
34
35| Input type | Filename pattern | Guide |
36|---|---|---|
37| HTTPJSON | `httpjson.yml.hbs` | `references/httpjson-guide.md` |
38| AWS S3 | `aws-s3.yml.hbs` | `references/aws-s3-guide.md` |
39| CloudWatch | `aws-cloudwatch.yml.hbs` | `references/aws-cloudwatch-guide.md` |
40| Azure Blob Storage | `azure-blob-storage.yml.hbs` | `references/azure-blob-storage-guide.md` |
41| Azure Event Hub | `azure-eventhub.yml.hbs` | `references/azure-eventhub-guide.md` |
42| GCS | `gcs.yml.hbs` | `references/gcs-guide.md` |
43| GCP Pub/Sub | `gcp-pubsub.yml.hbs` | `references/gcp-pubsub-guide.md` |
44| TCP | `tcp.yml.hbs` | `references/tcp-udp-guide.md` |
45| UDP | `udp.yml.hbs` | `references/tcp-udp-guide.md` |
46| HTTP Endpoint | `http_endpoint.yml.hbs` | `references/http-endpoint-guide.md` |
47| Filestream | `filestream.yml.hbs` | `references/filestream-logfile-guide.md` |
48| Logfile | `log.yml.hbs` | `references/filestream-logfile-guide.md` |
49| Journald | `journald.yml.hbs` | `references/journald-guide.md` |
50| Winlog | `winlog.yml.hbs` | `references/winlog-guide.md` |
51| WebSocket | `websocket.yml.hbs` | `references/websocket-guide.md` |
52
53Load **only** the guide for the detected input type, not all guides.
54
55For **Federated Identity** tasks (any eligible input type, including `cel`), load
56`references/federated-identity-aws.md` regardless of which input type is
57involved.
58
59## Handoff
60
61- For **CEL program logic**, hand off to the `cel-programs` skill. Keep this skill loaded for Federated Identity `auth.aws` / `use_cloud_connectors` edits on `cel.yml.hbs`.
62- For **manifest schema** (`var_groups`, `provider_permissions`, `format_version` / conditions floors), hand off to the `package-spec` skill (`references/var-groups-and-provider-permissions.md`).
63- For **pipeline issues** discovered while reviewing input templates, hand off to the `ingest-pipelines` skill.
64- For **field mapping issues** found in template variable wiring, hand off to the `ecs-field-mappings` skill.
65
66## References
67
68- `references/common-input-patterns.md` -- tags, processors passthrough, variable conventions, review flags (applies to ALL input types)
69- `references/httpjson-guide.md` -- HTTPJSON template syntax, structure, validation rules, pagination patterns, authentication, cursor persistence
70- `references/aws-s3-guide.md` -- S3 bucket/SQS notification collection
71- `references/aws-cloudwatch-guide.md` -- CloudWatch log group collection
72- `references/azure-blob-storage-guide.md` -- Azure Blob Storage collection
73- `references/azure-eventhub-guide.md` -- Azure Event Hub collection
74- `references/gcs-guide.md` -- Google Cloud Storage collection
75- `references/gcp-pubsub-guide.md` -- GCP Pub/Sub collection
76- `references/tcp-udp-guide.md` -- TCP and UDP (syslog-style) listeners
77- `references/http-endpoint-guide.md` -- HTTP Endpoint (webhook receiver)
78- `references/filestream-logfile-guide.md` -- Filestream and legacy Logfile inputs
79- `references/journald-guide.md` -- Journald collection
80- `references/winlog-guide.md` -- Windows Event Log collection
81- `references/websocket-guide.md` -- WebSocket streaming (may embed CEL)
82- `references/federated-identity-aws.md` -- AWS Federated Identity procedure: input classification, federation vars, `auth.aws` / `use_cloud_connectors`, input gating (schema lives in `package-spec`)