Skip to content
DataMiner DoJo

More results...

Generic selectors
Exact matches only
Search in title
Search in content
Post Type Selectors
Search in posts
Search in pages
Search in posts
Search in pages
Log in
Menu
  • Blog
  • Questions
  • Learning
    • E-learning Courses
    • Open Classroom Training
    • Certification
      • DataMiner Fundamentals
      • DataMiner Configurator
      • DataMiner Automation
      • Scripts & Connectors Developer: HTTP Basics
      • Scripts & Connectors Developer: SNMP Basics
      • Visual Overview – Level 1
      • Verify a certificate
    • Tutorials
    • Video Library
    • Books We Like
    • >> Go to DataMiner Docs
  • Expert Center
    • Solutions & Use Cases
      • Solutions
      • Use Case Library
    • Markets & Industries
      • Media production
      • Government & defense
      • Content distribution
      • Service providers
      • Partners
      • OSS/BSS
    • DataMiner Insights
      • Security
      • Integration Studio
      • System Architecture
      • DataMiner Releases & Updates
      • DataMiner Apps
    • Agile
      • Agile Webspace
      • Everything Agile
        • The Agile Manifesto
        • Best Practices
        • Retro Recipes
      • Methodologies
        • The Scrum Framework
        • Kanban
        • Extreme Programming
      • Roles
        • The Product Owner
        • The Agile Coach
        • The Quality & UX Coach (QX)
    • DataMiner DevOps Professional Program
  • Downloads
  • More
    • Feature Suggestions
    • Climb the leaderboard!
    • Swag Shop
    • Contact
      • General Inquiries
      • DataMiner DevOps Support
      • Commercial Requests
    • Global Feedback Survey
  • PARTNERS
    • All Partners
    • Technology Partners
    • Strategic Partner Program
    • Deal Registration
  • >> Go to dataminer.services

Large database table(s) for parent elements

Solved1.08K views12th July 2023DVE MySQL trending
1
Robin Devos [SLC] [DevOps Advocate]2.46K 19th September 2022 1 Comment

We have a single agent (v9.6 CU23) using MySQL. On it there are several elements which create DVE's. If 1 parent-element creates 100 DVE's, then all trend data will be put in the DATA/DATAAVG table of the parent. Causing this table to grow and eventually get into trouble due to its size (slow data ingest/update/..).

Is there a way to mitigate this? More beyond the point of looking into the trend template(s).
Is there a way to generate a DATA(AVG) table per DVE in order to avoid such large parent DATA/DATAAVG tables?

(The discussions to move to Cassandra are on-going but complex)

Marieke Goethals [SLC] [DevOps Catalyst] Selected answer as best 12th July 2023
Jeff Douglass commented 4th October 2022

Robin, we have been having these same issues for years on multiple systems and like you, moving to Cassandra is not an easy move. If you would be interested, we could connect offline and share any experiences and possible solutions.

1 Answer

  • Active
  • Voted
  • Newest
  • Oldest
2
Tom Van Bruaene [SLC] [DevOps Member]758 Posted 19th September 2022 0 Comments

It's not possible to move the data to child element, as that would require too many changes in dataminer.
What could be an option to look at is partitionedTrending (databaseOptions attribute | DataMiner Docs)

The major slowdown on MySQL is mainly the cleaning. And all the other things just slow down during that cleaning. partitioning could remedy that.

Note: going to Cassandra would obviously still be the preferred way 🙂

Marieke Goethals [SLC] [DevOps Catalyst] Selected answer as best 12th July 2023
Please login to be able to comment or post an answer.

My DevOps rank

DevOps Members get more insights on their profile page.

My user earnings

0 Dojo credits

Spend your credits in our swag shop.

0 Reputation points

Boost your reputation, climb the leaderboard.

Promo banner DataMiner DevOps Professiona Program
DataMiner Integration Studio (DIS)
Empower Katas

Recent questions

Alarm Dashboard PDF/CSV Export 1 Answer | 0 Votes
Is the Microsoft SharePoint Connector Still Usable 0 Answers | 0 Votes
Is the Microsoft SharePoint Connector Still Usable 0 Answers | 0 Votes

Question Tags

adl2099 (115) alarm (62) Alarm Console (82) alarms (100) alarm template (83) Automation (223) automation scipt (111) Automation script (167) backup (71) Cassandra (180) Connector (108) Correlation (68) Cube (150) Dashboard (194) Dashboards (188) database (83) DataMiner Cube (57) DIS (81) DMS (71) DOM (139) driver (65) DVE (55) Elastic (83) Elasticsearch (115) elements (80) Failover (104) GQI (159) HTTP (76) IDP (74) LCA (151) low code app (166) low code apps (93) lowcodeapps (75) MySQL (53) protocol (203) QAction (83) security (88) services (51) SNMP (86) SRM (337) table (54) trending (87) upgrade (62) Visio (539) Visual Overview (345)
Privacy Policy • Terms & Conditions • Contact

© 2025 Skyline Communications. All rights reserved.

DOJO Q&A widget

Can't find what you need?

? Explore the Q&A DataMiner Docs

[ Placeholder content for popup link ] WordPress Download Manager - Best Download Management Plugin