Back to roadmap
Module 1 · Foundations & MethodDay 00725 min

Tradeoff Frameworks

Pick a corner of the triangle and own it.

Day 007

Tradeoff Frameworks

Consistency ⇆ Availabil...
note
Latency ⇆ Throughput
note
Cost ⇆ Reliability
note
Simple ⇆ Flexible
note
Memory hook

Tradeoff Frameworks: pick a corner of the triangle and own it

Mental model

frame the problem before drawing the system

Design lens

Lower latency and higher throughput, paid in staleness and ops.

Recall anchors
CAP / PACELCLatency vs throughputCost vs reliability

Why it matters

Most design decisions are not 'right vs wrong' but 'which corner of which triangle'. The classic axes — consistency vs availability, latency vs throughput, cost vs reliability, simple vs flexible — recur across every design and every layer.

Deep dive

CAP for the data layer: under partition you must pick consistency or availability. PACELC adds: even when there is no partition, you trade latency vs consistency.

Latency vs throughput at every queue. A bigger batch raises throughput but adds wait. A smaller batch keeps latency low but underutilizes resources. Little's Law makes this exact: L = λW.

Cost vs reliability is geometric. Each extra '9' often roughly multiplies infrastructure cost. 99.9% may cost 1×, 99.99% 2–3×, 99.999% 5–10×.

When a teammate claims 'no tradeoff', look harder — they're usually paying it somewhere else (cost, complexity, future flexibility).

Demo / scenario

Caching the user-profile lookup.

  1. Adding a Redis cache cuts p95 from 80ms to 4ms — latency win.
  2. But staleness up to TTL is now possible — consistency loss.
  3. Cost adds Redis cluster — small but real.
  4. Failure modes grow — Redis down means cold path or fallback.

Tradeoffs

  • Lower latency and higher throughput, paid in staleness and ops.
  • Mitigate with short TTL + write-through.
  • Or accept eventual consistency for non-billing data.

Diagram

Consistency ⇆ Availability
Latency ⇆ Throughput
Cost ⇆ Reliability
Simple ⇆ Flexible
The four standard tradeoff axes.

Mind map

Check yourself

Loading quiz…

Sources & further reading