Possibility to use data from another Dataminer Cluster with dashboards/low code apps ?

332 viewsDashboard data low code app
1
1 Comment

Hello Dataminer community,

I would like to know if there is an easy way to retrieve data easily from one Dataminer cluster system to another and combine them in dashboards or low code apps.

Kind regards,

Marieke Goethals [SLC] [DevOps Catalyst] Posted new comment 22nd November 2024
Marieke Goethals [SLC] [DevOps Catalyst] commented

Hi Alexandre,
I see that this question has been inactive for some time. Do you still need help with this? If not, could you select the answer that has been most helpful for you (using the ✓ icon)?

2 Answers

3
1.84K 0 Comments

Hi Alexander,

one way to achieve this would be to create User-Defined APIs on source cluster, and then to call those APIs from GQI DS on destination cluster.

We've recently worked on similar solution and there are a few caveats to consider:

  • You have to define which data the API would return, and you have to build it on source cluster.
  • User-Defined APIs use token for authentication and you have to decide how you will store that token in the GQI DS on destination cluster. Regardless of how you decide to store it, the best practice would be to create user with VERY limited access and to use that users token.
  • You will have to implement HTTP communication yourself, you can use native .NET HTTPClient though.
  • Web Services provide wide range of possibilities to interact with source cluster as well, depending on your needs you might not need to use User-Defined APIs.

Hope this helps and let me know if you have any further questions,
Cheers

Edib Šupić [SLC] [DevOps Catalyst] Edited answer 1st August 2024
1
16.30K 0 Comments

Hi Alexandre,

Depending of your use case, I believe there are two possible options:

  • In case you plan to retrieve specific information from the cluster, the option described by Edib will be a good approach. Something to keep in mind is that the every time that you open a dashboard in the destination cluster, the GQI query will be triggered requesting data from the source cluster. For example, if there will be multiple users opening this dashboard, the GQI query will be executed multiple times. You will need to see if a cache mechanism is required.
  • In case you plan large amount of data (e.g. the list of all amplifiers available on your cluster, the peak value of a KPI from the last 24 hours), then you could use Data Aggregator. Data Aggregator can execute GQI queries in the source cluster (in a scheduled way) and store the result in a CSV file (in the destination cluster). Then the dashboard in the destination cluster will read the content of the CSV file. In that way you avoid retrieving data from the source cluster every time that you open a dashboard in the destination cluster.

Hope it helps.

Miguel Obregon [SLC] [DevOps Catalyst] Answered question 2nd August 2024