Skip to content
DataMiner DoJo

More results...

Generic selectors
Exact matches only
Search in title
Search in content
Post Type Selectors
Search in posts
Search in pages
Search in posts
Search in pages
Log in
Menu
  • Blog
  • Questions
  • Learning
    • E-learning Courses
    • Open Classroom Training
    • Certification
      • DataMiner Fundamentals
      • DataMiner Configurator
      • DataMiner Automation
      • Scripts & Connectors Developer: HTTP Basics
      • Scripts & Connectors Developer: SNMP Basics
      • Visual Overview – Level 1
      • Verify a certificate
    • Tutorials
    • Video Library
    • Books We Like
    • >> Go to DataMiner Docs
  • Expert Center
    • Solutions & Use Cases
      • Solutions
      • Use Case Library
    • Markets & Industries
      • Media production
      • Government & defense
      • Content distribution
      • Service providers
      • Partners
      • OSS/BSS
    • DataMiner Insights
      • Security
      • Integration Studio
      • System Architecture
      • DataMiner Releases & Updates
      • DataMiner Apps
    • Agile
      • Agile Webspace
      • Everything Agile
        • The Agile Manifesto
        • Best Practices
        • Retro Recipes
      • Methodologies
        • The Scrum Framework
        • Kanban
        • Extreme Programming
      • Roles
        • The Product Owner
        • The Agile Coach
        • The Quality & UX Coach (QX)
    • DataMiner DevOps Professional Program
  • Downloads
  • More
    • Feature Suggestions
    • Climb the leaderboard!
    • Swag Shop
    • Contact
      • General Inquiries
      • DataMiner DevOps Support
      • Commercial Requests
    • Global Feedback Survey
  • PARTNERS
    • All Partners
    • Technology Partners
    • Strategic Partner Program
    • Deal Registration
  • >> Go to dataminer.services

Cassandra – What are default thresholds for maximum partition size?

Solved1.00K views2nd January 2023cassadra
1
Jens Vandewalle [SLC] [DevOps Enabler]9.44K 16th December 2022 0 Comments

Hi Dojo,

Are there some default thresholds that we can define for the Maximum Partition Size in the Apache Cassandra Cluster Monitor connector?

In my case table elementdata throws an critical alarm because the value is greater than 500 MiB. Is this a valid alarm or should I adapt my thresholds?

Jens Vandewalle [SLC] [DevOps Enabler] Selected answer as best 2nd January 2023

1 Answer

  • Active
  • Voted
  • Newest
  • Oldest
2
Michiel Saelen [SLC] [DevOps Enabler]5.63K Posted 23rd December 2022 0 Comments

Hi Jens,

The recommendation is to stay below 200MB for performance reasons. If you have a powerful server and lots of memory, you might be less concerned about going over it.

In your case, you have at least one partition of 532MB in elementdata table (saved parameters). With the current DataMiner versions all the saved parameters are stored in one partition in the elementdata table. This is mainly to be able to retrieve all saved data with one query when the element is restarted. This means that we have a limitation on how many parameters we can save and how frequently we can update them in one element. There are discussions to split that partition into multiple ones to have the ability to store more saved parameters into one element.

There should be no immediate issue in running Cassandra with large partitions (assuming they don't exceed 2G), but you will notice that systems without large partitions will be much more performant and much more responsive. The recommendation would be to evaluate what element/protocol is causing for the large partitions avoiding having that many saved parameters or updates on saved parameters in your element/protocol.

Most seen cases are:

  • Tables that have rows that are continuously being added/removed (could be a hidden table).
    Solution: Make the table volatile if possible (keys and display keys are saved by default).
  • Values that are saved change continuously.
    Solution: Remove the saved option (values that change continuously should not be saved).
  • Tables that grow indefinitely.
    Solution: Implement a safety to keep the number of rows in a table under control.

If you don't know which element(s) are causing the large partitions then you might need to analyze the sstables on the node with large paritions. A tool that I have been using for this: GitHub - instaclustr/cassandra-sstable-tools: Tools for working with sstables

Jens Vandewalle [SLC] [DevOps Enabler] Selected answer as best 2nd January 2023
Please login to be able to comment or post an answer.

My DevOps rank

DevOps Members get more insights on their profile page.

My user earnings

0 Dojo credits

Spend your credits in our swag shop.

0 Reputation points

Boost your reputation, climb the leaderboard.

Promo banner DataMiner DevOps Professiona Program
DataMiner Integration Studio (DIS)
Empower Katas

Recent questions

Alarm Dashboard PDF/CSV Export 0 Answers | 0 Votes
Is the Microsoft SharePoint Connector Still Usable 0 Answers | 0 Votes
Is the Microsoft SharePoint Connector Still Usable 0 Answers | 0 Votes

Question Tags

adl2099 (115) alarm (62) Alarm Console (82) alarms (100) alarm template (83) Automation (223) automation scipt (111) Automation script (167) backup (71) Cassandra (180) Connector (108) Correlation (68) Cube (150) Dashboard (194) Dashboards (188) database (83) DataMiner Cube (57) DIS (81) DMS (71) DOM (139) driver (65) DVE (55) Elastic (83) Elasticsearch (115) elements (80) Failover (104) GQI (159) HTTP (76) IDP (74) LCA (151) low code app (166) low code apps (93) lowcodeapps (75) MySQL (53) protocol (203) QAction (83) security (88) services (51) SNMP (86) SRM (337) table (54) trending (87) upgrade (62) Visio (539) Visual Overview (345)
Privacy Policy • Terms & Conditions • Contact

© 2025 Skyline Communications. All rights reserved.

DOJO Q&A widget

Can't find what you need?

? Explore the Q&A DataMiner Docs

[ Placeholder content for popup link ] WordPress Download Manager - Best Download Management Plugin