We have a running Dataminer system with Cassandra and OpenSearch which is being stopped due to project being completed. However, the customer wants to maintain access to the data collected. I see that there is an option for MySQL offload, however, is limited to data from time started. Is there a way to offload all data to MySQL to backup a running system and make data searchable from external tools.
Or is there a better way to make the collected data (trend and alarm) accessible once the system is turned off?
Hi Steve,
A possible solution is to use the Data Aggregator to offload information history information (alarm and/or trend data). For example, we are currently using this feature to download history alarms from the DB to CSV files.
Since Data Aggregator relies on GQI queries, you could implement adhoc data sources data offload specific information from DB. However, as Wale mentions, it is not a trivial exercise.
Hope it helps.
Wild thought! – Since you say that everything has or will be ‘stopped’, I do wonder how the offload process will behave if you roll back the time on the Dataminer and DB servers ??
The offload process itself (Cassandra) is a cql export query to a csv file followed by a load data infile request to a MySQL database. Perfectly possible to mimic this with a small or large dataset but could still be a tedious process to get it quite right.
For the data in Opensearch, you could use the Opensearch Dashboards to visualize the data. (Assuming here you’ve taken a snapshot and restored on another server).
The customer may require the data to be retained for a period of time when the contract ends per contractual requirements. All we are looking for is how to dump the data so IF the customer should ever require the data they would be able to get the information without setting up dataminer.