Hello Dojo,
Are there any requirements or specific guidelines to take into account to re-use an existing database cluster (Cassandra Cluster & Elasticsearch/Opensearch Cluster) for a new Dataminer system?
So the situation is that one existing DMS is using the database cluster consisting of 3-node Cassandra cluster and a 3-node Elasticsearch cluster. Now a separate DMS (consisting of one failover pair) will be re-using the same self-managed database cluster as its database.
Is there any pre-requisite for configuration on the new DMS to make sure the existing database cluster can be re-used in a safe and robust way? Does the new DMS need a different cluster name? I am thinking in terms of keyspace names in Cassandra or similar objects in Elasticsearch or Opensearch?
Thanks!
Hi Koen,
Re-using an existing database is perfectly viable. The main thing to keep in mind here is for the other DMS to indeed have a different keyspace (On the docs page here the "Keyspace prefix" box in Cube, translates to the DB tag in DB.xml, for both DB types).
As long as those 2 are different between the cluster, the data from each cluster won't interfere with the others.
The other important thing here to keep in mind is Database performance/resources, with more agents writing/reading to/from the same Database, there is a higher risk of one cluster impacting the performance of the other. With each database type having 3 node's they should be able to handle the smaller clusters here but it is something to test and keep evaluating as the load on the clusters or the clusters themselves grow.
Kind regards,
Michiel