In this tutorial, we are going to perform a very important practical experiment that will help you visually and conceptually understand how Elasticsearch distributes data across nodes and shards, and how it still gives you a single combined search result. This is one of the core ideas behind Elasticsearch’s scalability and performance. We will create…

In this tutorial, we are going to observe and understand the master election process in Elasticsearch by performing a few controlled experiments on our already running three-node cluster. Until now, we have been using the cluster normally, but we have not really tested what happens when nodes go down and come back up. This is…

In this tutorial, we are going to move from a single-node Elasticsearch setup to a real multi-node cluster consisting of three Elasticsearch nodes and one Kibana instance, all running locally using Docker Compose. This is an extremely important milestone in learning Elasticsearch, because features such as sharding, replication, fault tolerance, node discovery, and master election…

Before we spin up a multi-node Elasticsearch cluster, it is extremely important to understand node roles.Node roles define what responsibilities each node is allowed to perform inside the cluster, and they play a crucial role in scalability, stability, performance, and resource planning. In this tutorial, we will slowly build a clear mental model of why…

In this tutorial, we will understand why an Elasticsearch cluster shows YELLOW status, especially when you are running a single-node Docker setup, and how to fix or intentionally control this behavior.This is a very common point of confusion for beginners, and once you understand it properly, cluster health indicators will start making a lot more…

Replication is the mechanism that protects your data from node failures and also improves read performance under heavy search load. While sharding helps with scaling, replication helps with availability and throughput. Both are equally important in real-world systems. Why Replication Is Needed Primary Shards vs Replica Shards High-Level Flow of Document Indexing with Replication Important…

In this short tutorial, we will clearly and systematically understand how Elasticsearch decides where a document is stored and how it is retrieved, even when an index is split into multiple shards across many nodes.This concept is known as routing, and it is one of the most important internal mechanisms that allows Elasticsearch to scale…

Why Sharding Is Needed Let us start with a practical scenario. What Exactly Is Sharding? Sharding is a logical and physical data distribution mechanism in Elasticsearch. In simple terms, sharding is the foundation that allows Elasticsearch to scale out rather than scale up. Why Are They Called Primary Shards? At this point, a very natural…

In this tutorial, we move beyond running a single Elasticsearch instance and start understanding how Elasticsearch works in a distributed, production-ready setup. Until now, running a single node has been perfectly fine for learning, experimenting locally, and even for development or QA environments. However, production systems have very different requirements around availability, scalability, and fault…

In this short but important tutorial, we focus on a concept that often surprises people when they start working with Elasticsearch—the fact that newly inserted or updated documents do not become searchable immediately. This behavior is intentional, well-designed, and deeply connected to Elasticsearch’s performance and near-real-time search model. Although this topic may feel subtle at…