Skip to content

project

Apache Kafka

Apache Kafka is an open-source distributed event-streaming platform for publishing, storing, and processing real-time data as partitioned, replicated logs.

Known aliases

  • Apache Kafka
  • Apache Kafka 3.7
  • Apache Kafka 4.0
  • Kafka
  • Kafka Streams

Relationships

No evidence-backed relationships are recorded.

Current stories

build1 publisher

Ian Cooper's ABCs define what every event-driven endpoint has to publish

Ian Cooper says event-driven orgs of up to about five teams can manage async APIs on shared knowledge of each other's services. His model for doing it at scale begins with the address, binding and contract each endpoint has to describe to its consumers.

Publishers:infoq.com

Reality

Evidence62
Adoption
Insufficient
Hype gap+10
Incentives20
Confidence55
build1 publisher

Confluent Cloud gains an OSPAR attestation for Singapore bank outsourcing reviews

Confluent Cloud now holds an OSPAR attestation, adding Singapore's bank-sector audit to the four reports already in its Trust Center. Singapore banks vetting Confluent as an outsourced provider can start from one audit built on the banking association's own control baseline.

Publishers:confluent.io

Reality

Evidence35
Adoption
Insufficient
Hype gap+15
Incentives80
Confidence40
build1 publisher

Monest designs tag-event fan-out around BullMQ's one-consumer jobs

Monest's CTO kept tag-event fan-out on BullMQ, where each job goes to one worker, for two client integrations and several internal teams. A first attempt, one worker calling every consumer, replayed finished calls on retry and forced one retry count on all of them.

Publishers:dev.to

Reality

Evidence40
Adoption8
Hype gap+8
Incentives55
Confidence45
build1 publisher

A Kafka Streams auth cache kept a revoked API key working for four days

Moving authz-gateway's key checks from Postgres to a Kafka Streams store cut p99 from 40ms to 4ms, yet a revoked key kept working for four days. Three pods cut off from Kafka for 30 hours rejoined at zero lag and kept honoring it, a dev.to write-up says.

Publishers:dev.to

Reality

Evidence45
Adoption
Insufficient
Hype gap+10
Incentives
Insufficient
Confidence50
build1 publisher

A dedicated vector database adds a sync job to every write

A dev.to post argues that moving embeddings out of Postgres buys a second source of truth, a four-leg query path and 50 to 150 ms of internet latency. Its 8 ms pgvector counter-figure has no benchmark behind it.

Publishers:dev.to

Reality

Evidence24
Adoption
Insufficient
Hype gap+55
Incentives55
Confidence45

Earlier coverage

  1. Numbering six retrieved chunks turned one handbook into three agreeing sources

    Build · September 13, 2026 · 1 publisher

  2. A governance tag push turned five EKS workers into Prometheus scrape targets

    Build · September 11, 2026 · 1 publisher

  3. Datadog billed 5.6 times what the two servers replacing the AWS cluster cost

    Build · September 11, 2026 · 1 publisher

  4. Kestra 2.0 takes the database credential out of the worker

    Build · September 8, 2026 · 1 publisher

  5. The legacy engine's own lease API closed the stale-read window behind migrated writes

    Build · September 7, 2026 · 1 publisher

  6. Twilio computes data lake freshness from the checkpoint Hudi already writes to S3

    Build · September 1, 2026 · 1 publisher

  7. Why pod counts stay a directional guess until real load tests run

    Build · August 29, 2026 · 1 publisher

  8. Reversibility decides which of six services may guess and which must refuse

    Build · August 28, 2026 · 1 publisher

  9. Grab converts data contract breaches into tickets that close only when the backfill lands

    Build · August 28, 2026 · 1 publisher

  10. Confluent triples its Kafka console ceiling to 400K partitions and leaves the brokers alone

    Build · August 26, 2026 · 1 publisher

  11. Shopify built its own telemetry platform, and its architect would now buy the managed version

    Leadership · August 26, 2026 · 1 publisher

  12. Offset lag measures the consumer, not the data: reading freshness from Hudi's own checkpoint

    Build · August 26, 2026 · 1 publisher

  13. Two layers instead of an outbox: when the dual-write gap is cheap enough to live with

    Build · August 25, 2026 · 1 publisher

  14. The AI SRE that is not allowed to guess: Databricks scopes its agent to "what changed"

    Build · August 24, 2026 · 1 publisher

  15. One incident instead of two: what SKIP LOCKED actually buys you

    Build · August 22, 2026 · 1 publisher

  16. Four control planes, one Postgres: a team's case against polyglot persistence

    Build · August 21, 2026 · 1 publisher

  17. Three services you can delete: queue, cache and search in one Postgres

    Build · August 20, 2026 · 1 publisher

  18. Cloudera bets the agentic AI bottleneck is where the data sits, not which model runs

    Product · August 19, 2026 · 1 publisher

  19. Databricks moves feature serving to streaming, and the 200ms is measured to the write

    Build · August 17, 2026 · 1 publisher

  20. Three Postgres CDC tools ran on YugabyteDB after small fixes, all from one assumption

    Product · August 17, 2026 · 1 publisher

  21. Say "reliably" in a webhook spec and you have bought the whole distributed systems curriculum

    Build · August 17, 2026 · 1 publisher

  22. Scale Kafka sinks on lag, not CPU: KEDA to zero, then fix the per-pod drain rate

    Build · August 15, 2026 · 1 publisher