- ElasticSearch Cookbook
- Alberto Paro
- 474字
- 2021-04-02 10:09:55
Understanding cluster, replication, and sharding
Related to shard management, there is the key concept of replication and cluster status.
Getting ready
You need one or more nodes running to have a cluster. To test an effective cluster you need at least two nodes (they can be on the same machine).
How it works...
An index can have one or more replicas—the shards are called primary if they are part of the master index and secondary if they are part of replicas.
To maintain consistency in write operations the following workflow is executed:
- The write is first executed in the primary shard.
- If the primary write is successfully done, it is propagated simultaneously in all the secondary shards.
- If a primary shard dies, a secondary one is elected as primary (if available) and the flow is re-executed.
During search operations, a valid set of shards is chosen randomly between primary and secondary to improve performances.
The following figure shows an example of possible shards configuration:
There's more…
Related to the concept of replication there is the cluster indicator of the health of your cluster.
It can cover three different states:
- Green: Everything is ok.
- Yellow: Something is missing but you can work.
- Red: "Houston, we have a problem". Some primary shards are missing.
Mainly yellow status is due to some shards that are not allocated. If your cluster is in recovery status, just wait if there is enough space in nodes for your shards.
If your cluster, even after recovery is still in yellow state, it means you don't have enough nodes to contain your replicas so you can either reduce the number of your replicas or add the required number of nodes.
When you have lost data (that is, one or more shard is missing), you need to try restoring the node(s) that are missing. If your nodes restart and the system goes back to yellow or green status you are safe. Otherwise, you have lost data and your cluster is not usable. In this case, delete the index/indices and restore them from backup (if you have it) or from other sources.
See also
- Replica and shard management in this chapter.
- 蘋果電腦玩全攻略 OS X 10.8 Mountain Lion
- 無蘋果不生活 OS X Mountain Lion隨身寶典
- Extending Puppet
- Learn Helm
- VMware Horizon View 6 Desktop Virtualization Cookbook
- 高性能Linux服務器構建實戰：系統安全、故障排查、自動化運維與集群架構
- Linux操作系統應用編程
- Mobile First Design with HTML5 and CSS3
- Linux內核設計的藝術：圖解Linux操作系統架構設計與實現原理
- 計算機系統的自主設計
- INSTANT Galleria Howto
- Hadoop Real-World Solutions Cookbook
- iOS 10快速開發：18天零基礎開發一個商業應用
- Linux操作系統案例教程（第2版）
- Getting Started with UDK