Skip to content

Architecture2 min read

Live and on-demand want opposite things

A stadium-scale live surge and a fifteen-year archive have opposite cache behaviour, opposite failure tolerance and opposite cost profiles. You pick one.

  • live
  • vod
  • broadcast
  • capacity

Put both workloads on one edge and the surge wins, every time, at the moment the archive can least afford to lose.

The conflict, concretely

During a live event, tens of thousands of viewers request the same few segments within seconds of each other. The working set is tiny and it moves continuously, so caching it aggressively gives a near-perfect hit ratio.

An archive is the opposite: a large working set, sparsely and unpredictably accessed, where any given slice may be requested twice a week.

Share a machine and the live working set, small and hot and constantly refreshed, evicts the archive's. When the match ends, every archive request is a miss against an origin that is also recovering.

LiveOn demand
Working setTiny, movingLarge, static
Concurrency shapeA cliff, on a scheduleA smooth curve
Tolerance for a stallNoneSome
Right eviction policyAggressiveConservative
Failure impactEveryone at onceA few people

The structural answer

Two edges. The same hardware budget, split instead of pooled, with their own cache policies and their own failure domains.

The gain is not only cache behaviour. A live failure and an archive failure stop being the same incident. On the night that matters, you want the blast radius to be smaller than the whole service.

Peak night is the architecture

An average-day design fails on the one night that matters. Broadcast concurrency is a flat line with a cliff in it, and the cliff arrives on a schedule everyone already knows. That is a gift, because it can be planned for, and a trap for any platform sized to the average.

What this costs

Two machines held at a utilisation neither would justify alone. That is real, and it is the price of the failure domains. A purely on-demand service should not pay it, while anyone carrying live events is buying the cheapest insurance in the architecture.

More on what this means for a broadcast deployment on the broadcasters page.

If this write-up describes your setup, send us your numbers and we will read them against it.

Book a call