We are living in a digital era where organizations deal with massive amounts of data generated from various sources. These data hold a huge potential for meaningful insights if processed correctly. It needs scalable and efficient data processing systems to harness this power and Lambda Architecture is one such approach…

Consensus Algorithms are the foundation of distributed computing systems. It enables multiple nodes to reach an agreement on a shared value or decision. A distributed system expects multiple nodes and processes to cooperate for a common goal, whether it is maintaining a distributed database, replicating data across servers, or electing…

We have API management tools that help create a bridge between a client and the backend services. As the name gateway itself suggests, this is an entry point to get into the system so that the clients can have a well-tailored API. Apart from these, an API gateway is responsible…

System Design has many background concepts that might not sound so important but are always good to keep in mind. Similar concepts are some communication protocols like SSL, TLS, and mTLS. SSL (Secure Sockets Layer) SSL is a protocol that encrypts and secures communication happening over the internet. Though it was already developed in…

What is a Virtual Machine? Virtual machines (VMs) are virtual environments that work as a system with all the requirements like CPU, memory, network interface, and storage. They are created on a physical hardware system with software called a hypervisor. …

The term resilience means the ability of a system to keep functioning correctly and reliably in case of unexpected events like hardware failures, network outages, or software errors. Resiliency is one of the most important aspects of system design because the software systems need to be capable to handle any…

Availability is the time portion when the system is up and running for a particular mission time. It is usually represented in percentages. For example, 99.99% availability means the system has four nines availability which is a high percentage. To calculate the availability, Availability = Uptime / (Uptime + Downtime) …

Reliability is the ability of a system with consistency and dependability to perform as expected under specific conditions over time. With redundancy, reliability is the probability of not failing in a specific environment for a particular mission time. Since it is a statistical probability and there are absolutely no guarantees…

Redundancy is the most common approach to making reliability and availability better in a system. To accomplish this, we use some extra or duplicate components within a system as a safety measure so that the system can function even in the case of failure and malfunctions. However, adding extra components…