Kafka

Apache Kafka

NeuralBlitz Updated 1 repo stars

File contents

Apache Kafka

Kafka is a distributed event streaming platform for high-throughput, fault-tolerant data pipelines. It enables building real-time data streaming applications at scale.

Key Concepts

  • Topics and partitions
  • Producers and consumers
  • Consumer groups
  • Offset management
  • Stream processing with Kafka Streams

Common Use Cases

  • Event sourcing
  • Real-time analytics
  • Data integration pipelines
  • Event-driven microservices
  • Audit logs

Best Practices

  • Design topic strategies
  • Configure appropriate retention
  • Use exactly-once semantics
  • Monitor consumer lag
  • Implement proper partitioning

Resources

  • Kafka.apache.org: kafka.apache.org/documentation
  • Related Skills: event-driven, streaming, distributed-systems

NeuralBlitz/Agent-Gateway/tree/main/agent-gateway/skills/user/categories/messaging/kafka commit 50151006c4

Frequently asked questions

npx skillmds@latest add neuralblitz/kafka-2