Skip to content
DataMiner DoJo

More results...

Generic selectors
Exact matches only
Search in title
Search in content
Post Type Selectors
Search in posts
Search in pages
Search in posts
Search in pages
Log in
Menu
  • Blog
  • Questions
  • Learning
    • E-learning Courses
    • Open Classroom Training
    • Certification
      • DataMiner Fundamentals
      • DataMiner Configurator
      • DataMiner Automation
      • Scripts & Connectors Developer: HTTP Basics
      • Scripts & Connectors Developer: SNMP Basics
      • Visual Overview – Level 1
      • Verify a certificate
    • Tutorials
    • Video Library
    • Books We Like
    • >> Go to DataMiner Docs
  • Expert Center
    • Solutions & Use Cases
      • Solutions
      • Use Case Library
    • Markets & Industries
      • Media production
      • Government & defense
      • Content distribution
      • Service providers
      • Partners
      • OSS/BSS
    • DataMiner Insights
      • Security
      • Integration Studio
      • System Architecture
      • DataMiner Releases & Updates
      • DataMiner Apps
    • Agile
      • Agile Webspace
      • Everything Agile
        • The Agile Manifesto
        • Best Practices
        • Retro Recipes
      • Methodologies
        • The Scrum Framework
        • Kanban
        • Extreme Programming
      • Roles
        • The Product Owner
        • The Agile Coach
        • The Quality & UX Coach (QX)
    • DataMiner DevOps Professional Program
  • Downloads
  • More
    • Feature Suggestions
    • Climb the leaderboard!
    • Swag Shop
    • Contact
      • General Inquiries
      • DataMiner DevOps Support
      • Commercial Requests
    • Global Feedback Survey
  • PARTNERS
    • All Partners
    • Technology Partners
    • Strategic Partner Program
    • Deal Registration
  • >> Go to dataminer.services

What is the impact of performing queries in dashboards?

Solved1.81K views3rd June 2022Dashboard Dashboards GQI
0
Michiel Saelen [SLC] [DevOps Enabler]5.63K 27th May 2022 0 Comments

What is the impact of creating complex queries in dashboards for DataMiner?
Will there be an extra load on NATS/SLNet/Elastic/...?

Are there numbers on what the limitations are for queries or will the queries just be performed slower in case of many dashboards/queries?

Michiel Saelen [SLC] [DevOps Enabler] Selected answer as best 3rd June 2022

1 Answer

  • Active
  • Voted
  • Newest
  • Oldest
5
Sebastiaan Dumoulein [SLC] [DevOps Enabler]12.73K Posted 27th May 2022 2 Comments

Hi Michiel,

Great question!

It depends where the data is actually coming from. As you know, GQI allows you to query different data sets. We recently also added the possibility to create your own data set so the source of that could be anything.

GQI will start requesting data from the data source upon executing a query. For most sources, this will result in a new SLNet request which will be forwarded to the appropriate process. So this could be SLNet, SLElement, SLDataGateway or somewhere else.

Now GQI is designed with performance in mind. Here are some of the optimizations that are currently in place:

  • Lazy loading of data (aka query sessions)
    The client will start requesting data page by page. GQI will in turn also start requesting data from the source. If the client is only requesting 100 rows, then GQI will fetch data from the source until 100 rows can be returned.

    All operators are also built to be as lazy as possible, they will not request more data than required.

  • Forwarding of filters
    Filter operations that are done in the query are forwarded to the source. For instance, filtering a parameter table on a column is actually done in SLElement (or Elastic in case of logger tables).

  • Forwarding of aggregations
    Aggregation operations that are doine in the query are forwarded to the source. For instance, aggregations on logger tables are forwarded to Elastic.

Note that there is currently no built-in mechanism of caching, this means that executing a query X times will cause the load X times.

Numbers on the amount of concurrent queries are hard since it highly depends of the query itself. These can be very complex and might require a lot of data.

Michiel Saelen [SLC] [DevOps Enabler] Selected answer as best 3rd June 2022
Michiel Saelen [SLC] [DevOps Enabler] commented 30th May 2022

So if you have many end-users consulting the dashboard at the same time you might overload the system? Can the system crash when performing too many queries, or is there a protection mechanism to prevent this from happening?

Sebastiaan Dumoulein [SLC] [DevOps Enabler] commented 30th May 2022

No, there’s a limit to the amount of concurrent executing queries per DMA, this is currently set to 20. Any additional queries that are executed are placed in a queue.

Please login to be able to comment or post an answer.

My DevOps rank

DevOps Members get more insights on their profile page.

My user earnings

0 Dojo credits

Spend your credits in our swag shop.

0 Reputation points

Boost your reputation, climb the leaderboard.

Promo banner DataMiner DevOps Professiona Program
DataMiner Integration Studio (DIS)
Empower Katas

Recent questions

Web Applications exception in Cube due to invalid certificate 0 Answers | 0 Votes
Redundancy Groups and Alarming – Duplicate Alarms 0 Answers | 0 Votes
Correlation Engine: “Test rule” doesn’t result in a hit, despite functional rule 1 Answer | 3 Votes

Question Tags

adl2099 (115) alarm (62) Alarm Console (82) alarms (100) alarm template (83) Automation (223) automation scipt (111) Automation script (167) backup (71) Cassandra (180) Connector (109) Correlation (69) Correlation rule (52) Cube (151) Dashboard (194) Dashboards (188) database (83) DataMiner Cube (57) DIS (81) DMS (71) DOM (140) driver (65) DVE (56) Elastic (83) Elasticsearch (115) elements (80) Failover (104) GQI (159) HTTP (76) IDP (74) LCA (152) low code app (166) low code apps (93) lowcodeapps (75) MySQL (53) protocol (203) QAction (83) security (88) SNMP (86) SRM (337) table (54) trending (87) upgrade (62) Visio (539) Visual Overview (345)
Privacy Policy • Terms & Conditions • Contact

© 2025 Skyline Communications. All rights reserved.

DOJO Q&A widget

Can't find what you need?

? Explore the Q&A DataMiner Docs

[ Placeholder content for popup link ] WordPress Download Manager - Best Download Management Plugin