Dear members of the Dojo Community,
Recently we created an ad hoc data source that can return more than 10 K rows. We tested it in a dashboard and there it works as expected, apart from the fact that we could not sort and got this exception:
This is not an issue for us, as eventually we just want to use this query for the Data Aggregator, to execute this GQI query once every morning (1 AM), so that the results are directly stored in a CSV-file, that is then used further in our DataMiner Solution.
We were wondering if this 10k limit is something that we should take into account, or if the Data Aggregator automatically covers this in a kind of paging algorithm.
Can someone please help clarifying?
Kind regards,
Joachim
Hi Joachim,
The Data Aggregator is build directly on top of the same GQI framework and the paging algorithm does not affect this sort limit. So the behavior you see in dashboards will be exactly the same when executing the query via the Data Aggregator.
Usually this does not really matter when querying via the Data Aggregator because the main use case is to just offload aggregated/filtered data periodically. While sorting is only really useful when visualizing the data.
That said, with the GQI DxM in 10.5.5 and 10.5.0(CU2) we recently increased the sort limit from 10k to 100k and are considering more flexible alternatives to limit rows so we can eventually get rid of this hardcoded limit.
Thank you Ronald, very clear! ✅