CLOUDY MUSINGS

People often toss around latency  and throughput  like they are one and the same. They are not. They live in the same world but serve very different roles. One cares about how fast something starts. The other cares about how much it moves. Understanding the difference is vital for cloud architects, platform engineers, FinOps professionals, and really anyone building digital systems. The best way to think about them is like two roommates with wildly different sleep schedules.

All code for this blog can be found here . So this is still relevant in 2025. Having worked at Microsoft, I always believed customers...