Elasticsearch AWS Service configuration options

Solved679 viewsAWS Elasticsearch
0
0 Comments

Hi Dojo,
Apologies if it is listed elsewhere, but are there any guidelines on the configurable parameters when provisioning an ElasticSearch service within AWS? We are particularly keen to assign a workable value to provisioned throughput and provisioned IOPs

Many thanks,

Thomas

Marieke Goethals [SLC] [DevOps Catalyst] Selected answer as best 12th July 2023

1 Answer

0
762 0 Comments

Hi Thomas,

An SSD is recommended. If you do opt for HDD, 15K RPM is advised. There is no need to opt for RAID1, as replication should be handled by the cluster configuration.

In addition, the disk throughput is of vital importance. The following minimum requirements apply:

  • 4 KiB blocks should be 10 MB/s or higher.
  • 512 KiB blocks should be 300 MB/s or higher.
  • The average latency should be lower than 10 ms.

The above is taken as an extract from our system requirements page:

https://community.dataminer.services/dataminer-compute-requirements/

I cannot answer the IOPS requirement but I would be more than happy to have a call with you to go through the build process on Amazon with one of our experts and Amazon contact to ensure you have an optimised setup in your environment.

Marieke Goethals [SLC] [DevOps Catalyst] Selected answer as best 12th July 2023