Blog
Field notes from the stream.
How we build a realtime data layer, what breaks at 1M events a second, and what teams ship once their data stops arriving late.
Engineering
Engines and latency
Product
What shipped and why
Customers
Teams in production
Featured
The latest from the engine room.
Archive
Every post, newest first.
Exactly-once without two-phase commit
Idempotent sinks, epoch fencing and a 64-bit sequence per partition. No coordinator, no stalls.
Time travel is just a really good index
Why AS OF queries on 30 days of history cost less than one extra replica.
Orbitly deleted 14 pipelines in a quarter
How a fintech team replaced nightly batch jobs with six materialized views.
Designing schema evolution nobody notices
Additive changes ship instantly. Breaking ones backfill in the background while v1 keeps serving.
What 38 regions taught us about clocks
Hybrid logical clocks, a 3 ms skew budget and the night Singapore drifted.
Lineage you can actually read
The new graph view collapses 200-node pipelines into the five hops that matter.
Quarry tracks 9,000 trucks on one view
GPS pings, CDC from the dispatch database and a single join, served under 5 ms.
One email, every other Thursday.
New posts, release notes and the occasional benchmark. Around 9,000 engineers read it. Unsubscribe in one click.
