Scalability and Elasticity

Scalability describes a system's ability to handle growing demand, while elasticity specifically describes the ability to scale resources automatically, both up and down, in response to real-time demand.

Vertical vs Horizontal Scaling

Vertical scaling ("scaling up") means adding more power — CPU, memory — to an existing server. Horizontal scaling ("scaling out") means adding more servers to share the load. Horizontal scaling is generally preferred in cloud architectures because it has no hard upper limit and improves fault tolerance — if one server fails, others continue serving traffic.

Elasticity in Practice

Elasticity is what lets a cloud application automatically add servers during a traffic spike (like a flash sale) and remove them again once demand drops, paying only for the actual capacity used at any given moment — a capability that's genuinely difficult and expensive to replicate with physical, owned hardware.

Common Mistakes

• Relying solely on vertical scaling, which eventually hits a hard ceiling on how large a single server can become.
• Designing an application that can't run multiple instances simultaneously (e.g. storing session data only in local server memory), preventing effective horizontal scaling.
• Setting auto-scaling thresholds too conservatively, causing a slow response to sudden traffic spikes.
• Confusing scalability (the general capability to handle growth) with elasticity (the specific ability to scale automatically and dynamically).