Skip to content
Author: Tianle Yuan

Elastic Load Balancing and Auto Scaling⚓︎

What demand?

  • How can we make sure that our applications have enough capacity and enough EC2 instances available?

  • How can we distribute incoming connections to those EC2 instances?

How?

  • Auto Scaling helps to make sure that you have the right number of EC2 instances to service the demand of your application.

  • Then, put Elastic Load Balancing in front of your application. ELB will distribute incoming connections across the pool of instances that are managed by the Auto Scaling Group.

All in all, those two technologies above enable you to have elastic and fault-tolerant applications.

Elasticity: Scaling Up v.s. Out⚓︎

Assume that we have an EC2 instance for our application now:

picture 14

Let's see what is Scaling Up (Vertical Scaling):

picture 15

picture 17

Let's see what is Scaling Out (Horizontal Scaling):

picture 16

picture 18

Amazon EC2 Auto Scaling⚓︎

Amazon EC2 Auto Scaling is horizontal scaling (scales out), which dynamically launches and terminates instances. CloudWatch metrics and EC2 status checks will process the responsed information from EC2 Auto Scaling. The pipeline to realize the elasticity and scalability can be seen below：

picture 20

Load Balancing and High Availability⚓︎

From EC2 Auto Scaling, we end up with lots of different instances of the same application.

Demand?

How do we direct traffic to those instances?

Load Balancer

As you can see in the pictures below,

  • Load Balancer can not only provide high availability (availability zones) if some server is in the crash.

picture 21

  • Load Balancer can also increase fault tolerance when the system has redundant components (more than one server or more than one hardware).

picture 22

Let's see the case we combine EC2 Auto Scaling and Load Balancer together:

picture 23

picture 24

picture 25

Types of Elastic Load Balancer⚓︎

There are four types of Elastic Load Balancer:

picture 26

picture 27

Here are some use cases for different types of ELB:

picture 28

picture 29

The details about ALB and NLB focus on the URL they use:

picture 30

picture 31

References:⚓︎

Last update: December 6, 2022 19:56:40
Created: November 17, 2022 07:31:08

Comments