Hello Dojo,
Are there any requirements or specific guidelines to take into account to re-use an existing database cluster (Cassandra Cluster & Elasticsearch/Opensearch Cluster) for a new Dataminer system?
So the situation is that one existing DMS is using the database cluster consisting of 3-node Cassandra cluster and a 3-node Elasticsearch cluster. Now a separate DMS (consisting of one failover pair) will be re-using the same self-managed database cluster as its database.
Is there any pre-requisite for configuration on the new DMS to make sure the existing database cluster can be re-used in a safe and robust way? Does the new DMS need a different cluster name? I am thinking in terms of keyspace names in Cassandra or similar objects in Elasticsearch or Opensearch?
Thanks!
Hi Koen,
I’m not aware of any specific guidelines beyond the documentation here, which states that “using a self-managed data storage architecture is not recommended.”
Despite that recommendation, it is technically possible for two or more DataMiner systems to share the same Cassandra (and OpenSearch) cluster. We have a few customers running this setup. In such cases each DMS must use a unique DB prefix (configured in DB.xml); as long as the prefixes differ, each system will read from and write to its respective tables.
The main challenge with this architecture is sizing the shared DB cluster (nodes, disk, CPU, memory, etc.) so it can cope with multiple DMS instances. Proper dimensioning depends on many variables — expected load, amount of trending data, element update frequency, desired performance, redundancy requirements, and so on — which makes it difficult to capture in a short, universal guideline.
If you want to proceed with a shared-cluster architecture, I’d start by determining the requirements for each DMS independently, then use our dimensioning tools to estimate cluster needs per system and combine those estimates into a final cluster sizing. Team Infrastructure can also assist with sizing and deployment recommendations.
Hope this helps!