Concurrency for scale out

The concurrency for scale out principle states that processes should be designed to scale out by replicating the processes. This is in addition to the use of threads within the process.

In the microservices world, services are designed for a scale out rather than scale up. The X-axis scaling technique is primarily used for scaling a service by spinning up another identical service instance. The services can be elastically scaled or shrunk, based on the traffic flow. Furthermore, microservices may make use of parallel processing and concurrency frameworks to further speed up or scale up the transaction processing.