Elasticsearch
Elasticsearch
Elasticsearch is a distributed, open-source search and analytics engine built on Apache Lucene. It is designed for horizontal scalability, real-time search, and handling large volumes of structured and unstructured data. Elasticsearch is a core component of the Elastic Stack (formerly known as the ELK Stack), alongside Logstash and Kibana.
Elasticsearch exposes a RESTful API and uses a JSON-based document model. Data is stored in indices, which are divided into shards and replicated across nodes in a cluster. Its inverted index and full-text search capabilities make it suitable for log analytics, application search, security analytics, and observability use cases.
Features
- Distributed architecture: Automatically manages sharding, replication, and node discovery.
- Full-text search: Supports complex queries, relevance scoring, fuzzy matching, and autocomplete using Apache Lucene.
- RESTful API: All operations are performed via HTTP with JSON payloads.
- Real-time indexing: Documents are searchable within milliseconds of being indexed.
- Aggregations: Allows data summarization and analytics on search results, including metrics, buckets, and pipeline aggregations.
- Schema-free: Documents can be indexed without predefined mappings; dynamic mapping infers field types.
- Scalability: Can scale horizontally by adding nodes; data is rebalanced automatically.
- High availability: Replica shards provide failover and query load distribution.
- Security: Offers role-based access control, encryption, and audit logging (available as a paid feature or via the Elastic License).
History
Elasticsearch was first released in 2010 by Shay Banon as an open-source search server. It quickly gained popularity for its ease of use and scalability. In 2012, Elasticsearch BV (now Elastic N.V.) was founded to provide commercial support and development. The product became the cornerstone of the Elastic Stack, which integrated Logstash for data ingestion and Kibana for visualization.
In 2018, Elastic began offering the Elastic License alongside the Apache 2.0 license, placing restrictions on certain use cases (e.g., providing the software as a SaaS service). Despite this, Elasticsearch remains widely used in both open-source and commercial deployments. Major changes included the introduction of the next-generation search engine, new aggregation types, and improved security features.