Duplicates in GQI query

Solved583 viewsduplicate GQI GQI Filter
1
2 Comments

Hi Dojo,

Is there a simple way to remove duplicate entries from a GQI query?  My query is retrieving multiple alarm messages from different elements, all talking to the same end point, and I want to have only 1 instance of each entry.

Thanks

Dave Keller [DevOps Enabler] Selected answer as best 13th March 2024
Sebastiaan Dumoulein [SLC] [DevOps Catalyst] commented

Hi Dave, are you getting these duplicate alarm messages from an out-of-the box data source? If so, can you share your query?
Dave Keller [DevOps Enabler] commented

Hi Sebastiaan,
We have 4 elements, hosted in 4 separate availability zones, all receiving the same alarm string from a single end point Playout Automation interface.
Using a GQI
> Get parameters for elements where
> Protocol = Playout Automation Interface
> Version = Production
> Selected parameter =Unacknowledged Alarms

This produces 4 versions of every alarm string message from the Playout Automation system, but we have resilience in case any of the availability zones/elements is not working correctly. Removing duplicates in the table would achieve what we are after.

1 Answer

2
16.30K 2 Comments

Hi Dave,

I believe this use case can be tackled through aggregation/group by operations . For example, you can aggregate by alarm message type and group by element name to have different alarm types per element name.

Dave Keller [DevOps Enabler] Selected answer as best 13th March 2024
Dave Keller [DevOps Enabler] commented

Thanks for the suggestion Miguel.

For Aggregate I only see Count and Distinct Count, so I guess I’m not running a version that supports GroupBy.
The documentation suggests that this is supported from 10.3.3 and I’m running 10.3.4, but I don’t know if it is Soft Launch from 10.3.3?
Sebastiaan Dumoulein [SLC] [DevOps Catalyst] commented

Hi Dave, this should be possible in your version. It only becomes available after doing an initial aggregation. So you could for instance do a count first and then add another operator to do the group by.