1---2name: azure-event-hubs3description: Expert knowledge for Azure Event Hubs development including troubleshooting, best practices, decision making, architecture & design patterns, limits & quotas, security, configuration, integrations & coding patterns, and deployment. Use when using Kafka clients/Streams, .NET SDK, geo-replication, Entra ID/RBAC auth, or Blob checkpointing, and other Azure Event Hubs related development tasks. Not for Azure Service Bus (use azure-service-bus), Azure Event Grid (use azure-event-grid), Azure Notification Hubs (use azure-notification-hubs), Azure Web PubSub (use azure-web-pubsub).4---5# Azure Event Hubs Skill
6
7This skill provides expert guidance for Azure Event Hubs. Covers troubleshooting, best practices, decision making, architecture & design patterns, limits & quotas, security, configuration, integrations & coding patterns, and deployment. It combines local quick-reference content with remote documentation fetching capabilities.
8
9## How to Use This Skill
10
11> **IMPORTANT for Agent**: Use the **Category Index** below to locate relevant sections. For categories with line ranges (e.g., `L35-L120`), use `read_file` with the specified lines. For categories with file links (e.g., `[security.md](security.md)`), use `read_file` on the linked reference file
12
13> **IMPORTANT for Agent**: If `metadata.generated_at` is more than 3 months old, suggest the user pull the latest version from the repository. If `mcp_microsoftdocs` tools are not available, suggest the user install it: [Installation Guide](https://github.com/MicrosoftDocs/mcp/blob/main/README.md)
14
15This skill requires **network access** to fetch documentation content:
16- **Preferred**: Use `mcp_microsoftdocs:microsoft_docs_fetch` with query string `from=learn-agent-skill`. Returns Markdown.
17- **Fallback**: Use `fetch_webpage` with query string `from=learn-agent-skill&accept=text/markdown`. Returns Markdown.
18
19## Category Index
20
21| Category | Lines | Description |
22|----------|-------|-------------|
23| Troubleshooting | L37-L49 | Diagnosing and fixing Event Hubs runtime issues: Kafka/AMQP errors, .NET/legacy exceptions, ARM failures, auth problems, connectivity, and Blob Storage checkpoint store errors. |
24| Best Practices | L50-L55 | Guidance on routing events between AMQP, Kafka, and HTTPS, and on designing/scaling Event Hubs with partitions and throughput units for performance and capacity. |
25| Decision Making | L56-L62 | Guidance on choosing Event Hubs tiers, auto-inflate settings, geo-replication modes, and planning migrations from Apache Kafka to Event Hubs. |
26| Architecture & Design Patterns | L63-L69 | Patterns and guidance for Event Hubs reliability: availability/consistency design, geo-disaster recovery, and building/operating replication tasks (often with Azure Functions). |
27| Limits & Quotas | L70-L79 | Event Hubs limits, quotas, and tier differences; max message sizes, capture intervals, platform behaviors, and governance via application groups. |
28| Security | L80-L108 | Securing Event Hubs: auth (Entra ID, SAS, RBAC, managed identities), encryption/CMK, confidential computing, TLS, and network access (NSP, VNet, firewall, Private Link, Azure Policy compliance). |
29| Configuration | L109-L121 | Configuring Event Hubs behavior: partitions, retention, geo-recovery, replication, log compaction, emulator setup, Avro capture schema, metrics/logs, and application group governance. |
30| Integrations & Coding Patterns | L122-L139 | Patterns and code for integrating Event Hubs with .NET, Kafka (clients, Streams, Connect, Debezium), Flink, Spark, Akka, schema/JSON registry, and adding metadata or managing hubs programmatically |
31| Deployment | L140-L145 | Guides for deploying Event Hubs with Kafka mirroring (MirrorMaker 1/2), setting up geo-replication, and running/local-testing Event Hubs apps using the emulator. |
32
33### Troubleshooting
34| Topic | URL |
35|-------|-----|
36| Resolve common Azure Event Hubs Kafka migration issues | https://learn.microsoft.com/en-us/azure/event-hubs/apache-kafka-frequently-asked-questions |
37| Troubleshoot Azure Event Hubs for Apache Kafka | https://learn.microsoft.com/en-us/azure/event-hubs/apache-kafka-troubleshooting-guide |
38| Troubleshoot AMQP errors in Azure Event Hubs | https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-amqp-troubleshoot |
39| Handle legacy Azure Event Hubs messaging exceptions | https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-messaging-exceptions |
40| Handle Azure Event Hubs .NET exceptions and recommended actions | https://learn.microsoft.com/en-us/azure/event-hubs/exceptions-dotnet |
41| Resolve Azure Resource Manager exceptions for Event Hubs operations | https://learn.microsoft.com/en-us/azure/event-hubs/resource-manager-exceptions |
42| Troubleshoot authentication and authorization failures in Event Hubs | https://learn.microsoft.com/en-us/azure/event-hubs/troubleshoot-authentication-authorization |
43| Resolve Blob Storage checkpoint store issues for Event Hubs | https://learn.microsoft.com/en-us/azure/event-hubs/troubleshoot-checkpoint-store-issues |
44| Diagnose and fix Azure Event Hubs connectivity issues | https://learn.microsoft.com/en-us/azure/event-hubs/troubleshooting-guide |
45
46### Best Practices
47| Topic | URL |
48|-------|-----|
49| Exchange Event Hubs events across AMQP, Kafka, and HTTPS | https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-exchange-events-different-protocols |
50| Scale Azure Event Hubs with partitions and throughput units | https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-scalability |
51
52### Decision Making
53| Topic | URL |
54|-------|-----|
55| Plan migration from Apache Kafka to Event Hubs | https://learn.microsoft.com/en-us/azure/event-hubs/apache-kafka-migration-guide |
56| Decide when and how to use Event Hubs Auto Inflate | https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-auto-inflate |
57| Choose and manage Azure Event Hubs geo-replication modes | https://learn.microsoft.com/en-us/azure/event-hubs/geo-replication |
58
59### Architecture & Design Patterns
60| Topic | URL |
61|-------|-----|
62| Design for availability and consistency in Event Hubs | https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-availability-and-consistency |
63| Apply Event Hubs event replication task patterns | https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-federation-patterns |
64| Design Event Hubs replication tasks with Azure Functions | https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-federation-replicator-functions |
65
66### Limits & Quotas
67| Topic | URL |
68|-------|-----|
69| Compare Event Hubs tier features and quotas | https://learn.microsoft.com/en-us/azure/event-hubs/compare-tiers |
70| Configure Event Hubs Capture intervals and limits | https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-capture-overview |
71| Azure Event Hubs platform limits and behavioral details | https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-faq |
72| Send and receive large Event Hubs messages | https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-quickstart-stream-large-messages |
73| Review Azure Event Hubs quotas and limits | https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-quotas |
74| Govern Event Hubs resources with application groups | https://learn.microsoft.com/en-us/azure/event-hubs/resource-governance-overview |
75
76### Security
77| Topic | URL |
78|-------|-----|
79| Associate network security perimeters with Event Hubs namespaces | https://learn.microsoft.com/en-us/azure/event-hubs/associate-network-security-perimeter |
80| Authenticate applications with Entra ID for Event Hubs | https://learn.microsoft.com/en-us/azure/event-hubs/authenticate-application |
81| Use managed identities to authenticate to Event Hubs | https://learn.microsoft.com/en-us/azure/event-hubs/authenticate-managed-identity |
82| Authenticate to Event Hubs from VMs with managed identity | https://learn.microsoft.com/en-us/azure/event-hubs/authenticate-managed-identity-virtual-machine |
83| Implement SAS authentication for Azure Event Hubs | https://learn.microsoft.com/en-us/azure/event-hubs/authenticate-shared-access-signature |
84| Authorize Event Hubs access using Entra ID and RBAC | https://learn.microsoft.com/en-us/azure/event-hubs/authorize-access-azure-active-directory |
85| Choose and configure Event Hubs authorization options | https://learn.microsoft.com/en-us/azure/event-hubs/authorize-access-event-hubs |
86| Configure SAS authorization for Azure Event Hubs | https://learn.microsoft.com/en-us/azure/event-hubs/authorize-access-shared-access-signature |
87| Enable confidential computing for Azure Event Hubs Dedicated | https://learn.microsoft.com/en-us/azure/event-hubs/confidential-computing |
88| Configure customer-managed keys for Event Hubs encryption | https://learn.microsoft.com/en-us/azure/event-hubs/configure-customer-managed-key |
89| Enable and configure managed identities for Event Hubs namespaces | https://learn.microsoft.com/en-us/azure/event-hubs/enable-managed-identity |
90| Configure managed identity for Event Hubs Capture | https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-capture-managed-identity |
91| Retrieve and understand Event Hubs connection strings | https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-get-connection-string |
92| Configure IP firewall rules for Azure Event Hubs | https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-ip-filtering |
93| Secure Event Hubs with virtual network service endpoints | https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-service-endpoints |
94| Configure network security for Azure Event Hubs | https://learn.microsoft.com/en-us/azure/event-hubs/network-security |
95| Secure Event Hubs with Network Security Perimeter | https://learn.microsoft.com/en-us/azure/event-hubs/network-security-perimeter |
96| Migrate Event Hubs apps to passwordless authentication with Entra ID | https://learn.microsoft.com/en-us/azure/event-hubs/passwordless-migration-event-hubs |
97| Use built-in Azure Policy definitions for Event Hubs governance | https://learn.microsoft.com/en-us/azure/event-hubs/policy-reference |
98| Restrict Event Hubs access using Private Link endpoints | https://learn.microsoft.com/en-us/azure/event-hubs/private-link-service |
99| Apply regulatory compliance policies to Event Hubs | https://learn.microsoft.com/en-us/azure/event-hubs/security-controls-policy |
100| Audit Event Hubs TLS compliance using Azure Policy | https://learn.microsoft.com/en-us/azure/event-hubs/transport-layer-security-audit-minimum-version |
101| Configure Event Hubs client applications to use specific TLS versions | https://learn.microsoft.com/en-us/azure/event-hubs/transport-layer-security-configure-client-version |
102| Set minimum TLS version for Azure Event Hubs namespaces | https://learn.microsoft.com/en-us/azure/event-hubs/transport-layer-security-configure-minimum-version |
103| Enforce minimum TLS version for Event Hubs | https://learn.microsoft.com/en-us/azure/event-hubs/transport-layer-security-enforce-minimum-version |
104
105### Configuration
106| Topic | URL |
107|-------|-----|
108| Configure partitioning, retention, and cleanup for Event Hubs | https://learn.microsoft.com/en-us/azure/event-hubs/configure-event-hub-properties |
109| Configure geo-disaster recovery pairing for Event Hubs | https://learn.microsoft.com/en-us/azure/event-hubs/configure-geo-disaster-recovery |
110| Dynamically increase partitions in an Event Hub | https://learn.microsoft.com/en-us/azure/event-hubs/dynamically-add-partitions |
111| Configure code-free Event Hubs replication tasks | https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-federation-configuration |
112| Understand and use Event Hubs captured Avro schema | https://learn.microsoft.com/en-us/azure/event-hubs/explore-captured-avro-files |
113| Reference monitoring metrics and logs for Azure Event Hubs | https://learn.microsoft.com/en-us/azure/event-hubs/monitor-event-hubs-reference |
114| Configure Event Hubs application groups for resource governance | https://learn.microsoft.com/en-us/azure/event-hubs/resource-governance-with-app-groups |
115| Configure and run the Azure Event Hubs emulator locally | https://learn.microsoft.com/en-us/azure/event-hubs/test-locally-with-event-hub-emulator |
116| Configure and use log compaction in Azure Event Hubs | https://learn.microsoft.com/en-us/azure/event-hubs/use-log-compaction |
117
118### Integrations & Coding Patterns
119| Topic | URL |
120|-------|-----|
121| Add custom metadata to Event Hubs events | https://learn.microsoft.com/en-us/azure/event-hubs/add-custom-data-event |
122| Configure Apache Kafka clients for Azure Event Hubs compatibility | https://learn.microsoft.com/en-us/azure/event-hubs/apache-kafka-configurations |
123| Use Kafka Streams with Azure Event Hubs | https://learn.microsoft.com/en-us/azure/event-hubs/apache-kafka-streams |
124| Use Kafka transactions with Azure Event Hubs | https://learn.microsoft.com/en-us/azure/event-hubs/apache-kafka-transactions |
125| Connect .NET applications to Azure Event Hubs | https://learn.microsoft.com/en-us/azure/event-hubs/connect-event-hub |
126| Connect Akka Streams to Azure Event Hubs via Kafka | https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-kafka-akka-streams-tutorial |
127| Use Debezium CDC with Kafka Connect on Event Hubs | https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-kafka-connect-debezium |
128| Integrate Kafka Connect with Azure Event Hubs | https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-kafka-connect-tutorial |
129| Connect Apache Flink to Azure Event Hubs | https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-kafka-flink-tutorial |
130| Connect Apache Spark streaming apps to Event Hubs | https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-kafka-spark-tutorial |
131| Use .NET management libraries to provision Event Hubs | https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-management-libraries |
132| Implement client-side schema enforcement for Event Hubs | https://learn.microsoft.com/en-us/azure/event-hubs/schema-registry-client-side-enforcement |
133| Use JSON Schema registry with Kafka clients on Event Hubs | https://learn.microsoft.com/en-us/azure/event-hubs/schema-registry-json-schema-kafka |
134| Choose and use client SDKs for Azure Event Hubs | https://learn.microsoft.com/en-us/azure/event-hubs/sdks |
135
136### Deployment
137| Topic | URL |
138|-------|-----|
139| Mirror Kafka brokers to Event Hubs with MirrorMaker 1 | https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-kafka-mirror-maker-tutorial |
140| Replicate Kafka clusters to Event Hubs with MirrorMaker 2 | https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-kafka-mirrormaker-2-tutorial |
141| Configure and operate Event Hubs geo-replication | https://learn.microsoft.com/en-us/azure/event-hubs/use-geo-replication |
microsoftdocs