Hi Everyone
If you have any comments on this topic, they would be very helpful:
We currently have a 2 agent Dataminer cluster connected to a 3 servers Cassandra cluster and a 3 servers OpenSearch cluster. Our question is whether we can connect a second 3 agents Dataminer cluster to the same Cassandra and OpenSearch clusters, or if we should have separate Cassandra and OpenSearch clusters for this second Dataminer cluster.
We look forward to your comments.
Many thanks.
Hi Isabel,
You can connect a second cluster to the same Cassandra & OpenSearch cluster.
The most important part when doing so is configuring the prefixes to ensure that each DataMiner cluster has a unique prefix which it uses to create its tables/keyspaces in the DB clusters.
See 'Configuring the general database'
So in your scenario your existing cluster has been configured with a prefix for both Cassandra and OpenSearch. When you configure the new cluster to make use of the same databases, this new cluster needs its own unique prefixes. Otherwise their data could potentially overwrite on another.
Another important aspect here is to carefully monitor the database nodes in this scenario, as a heavy query load from one system can potentially impact the other cluster. It's of the utmost importance to ensure the database clusters can handle the load of both systems at peak usage.
In short, this can be done but takes a bit more planning and monitoring. If you're looking to minimize the hardware cost for these server nodes then perhaps STaaS could be a great alternative for DataMiner clusters of this size? Since you're currently running more database nodes than DataMiner agents.
With Kind Regards,