Skip to content
DataMiner DoJo

More results...

Generic selectors
Exact matches only
Search in title
Search in content
Post Type Selectors
Search in posts
Search in pages
Search in posts
Search in pages
Log in
Menu
  • Blog
  • Questions
  • Learning
    • Courses
    • Tutorials
    • Open Classroom Training
    • Certification
      • DataMiner Fundamentals
      • DataMiner Configurator
      • DataMiner Automation
      • Scripts & Connectors Developer: HTTP Basics
      • Scripts & Connectors Developer: SNMP Basics
      • Visual Overview – Level 1
      • Verify a certificate
    • Video Library
    • Documentation
    • Books We Like
    • Third-party Courses
    • Quizzes
  • Agile
    • Agile Webspace
    • Everything Agile
      • The Agile Manifesto
      • Best Practices
      • Retro Recipes
    • Methodologies
      • The Scrum Framework
      • Kanban
      • Extreme Programming
    • Roles
      • The Product Owner
      • The Agile Coach
      • The Quality & UX Coach (QX)
  • Expert Hubs
    • DataMiner DevOps Professional Program
    • DataMiner
      • DataMiner Releases & Updates
      • System Architecture
      • Integration Studio
      • Visual Overview
      • Security
    • Technologies
      • Converged Interconnect Networks
      • DOCSIS 3.1 / DAA
      • Kubernetes
      • Telemetry / Flow Monitoring
      • PTP
      • SDN / ST2110 / NMOS
    • Business
      • Software Business models
      • Perpetual Use or Usage-based Services
      • Storage as a Service (STaaS)
      • Transition to DataMiner as a Service (DaaS)
  • Discover
    • Markets
      • Media production
      • Government & defense
      • Content distribution
      • Service providers
      • Partners
      • OSS/BSS
    • Solutions
    • Use Case Library
    • DataMiner Dashboards
    • DataMiner Downloads
    • DataMiner Stack Functions
    • DataMiner Apps
    • SRM Suite
    • Professional Services
  • PARTNERS
    • All Partners
    • Technology Partners
    • Strategic Partner Program
    • Deal Registration
  • Pricing
  • More
    • Feature Suggestions
    • Online DataMiner Systems
    • Climb the leaderboard!
    • Swag Shop
    • Contact
      • General Inquiries
      • DataMiner DevOps Support
      • Commercial Requests
    • Global Feedback Survey
  • >> Go to dataminer.services

Tombstones in Cassandra cluster increasing

602 views2nd September 2024cassandra cluster tombstone
1
Miloš Sedláček [DevOps Advocate]636 28th August 2024 0 Comments

Dear community,

we have a 3 node cassandra cluster with one Dataminer (the lab one) hooked on it. We monitor it by the Apache Cassandra Cluster Monitor connector. We have also installed the Cassandra Reaper that is periodically checking (and hopefully) fixing the tables.

And we see tombstones are growing for some tables. Mainly the tables of the non Dataminer keyspaces  - reaper_db, system_auth, system. These are growing linearly like this one:

But there are also some tables of Dataminer keyspaces that seem to grow without any control:

Can you please advice what we could be missing in setup of our Cassandra cluster that would manage the tombstones count in a healthy limits?

Regards,

Milos

Miloš Sedláček [DevOps Advocate] Answered question 2nd September 2024

2 Answers

  • Active
  • Voted
  • Newest
  • Oldest
4
Michiel Saelen [SLC] [DevOps Enabler]5.59K Posted 29th August 2024 0 Comments

It is expected that the count will continue to increase as this is a counter (similar to packet counters in switches). The columns that might be interesting to understand if your tombstones keeps on rising is the Max and Percentiles columns. These will indicate what percentage of data was tombstones that were received when during reads towards the DB. As it is only registered on read it could be that you have many tombstones, but they only can be noticed when you perform a read. For example, for elementdata you will see a spike when restarting an element (that has a lot of table updates) as then DataMiner will read the data from DB to start up. The Max, Percentiles columns are for the last 5 minutes. FYI under the details section when double-clicking a cell or parameter you will find a description. In addition, from Cassandra 5.0 we will be able to read the logging which will be a better way to understand tombstone problems.

In short to know if you have a tombstone problem, look at the max trending for spikes to see if your spikes keep on raising.

Michiel Saelen [SLC] [DevOps Enabler] Answered question 29th August 2024
You are viewing 1 out of 2 answers, click here to view all answers.
Please login to be able to comment or post an answer.

My DevOps rank

DevOps Members get more insights on their profile page.

My user earnings

0 Dojo credits

Spend your credits in our swag shop.

0 Reputation points

Boost your reputation, climb the leaderboard.

Promo banner DataMiner DevOps Professiona Program
DataMiner Integration Studio (DIS)
Empower Katas

Recent questions

How to temporarily Show/Hide Retrieved Table Value in Protocol 0 Answers | 0 Votes
How to send the Location in Headers on a User-Define API 0 Answers | 0 Votes
Cannot Read Properties of Undefined (Web/Text Component in LCA) 0 Answers | 2 Votes

Question Tags

adl2099 (112) alarm (60) Alarm Console (78) alarms (97) alarm template (83) Automation (219) automation scipt (111) Automation script (163) backup (70) C++ (51) Cassandra (179) Connector (107) Correlation (67) Cube (148) Dashboard (193) Dashboards (187) database (83) DataMiner Cube (55) DIS (80) DMS (71) DOM (138) driver (65) DVE (54) Elastic (82) Elasticsearch (115) elements (78) Failover (103) GQI (150) HTTP (72) IDP (74) LCA (134) low code app (160) low code apps (88) lowcodeapps (74) MySQL (53) protocol (197) QAction (80) security (86) services (51) SNMP (85) SRM (336) trending (87) upgrade (62) Visio (527) Visual Overview (342)
Privacy Policy • Terms & Conditions • Contact

© 2025 Skyline Communications. All rights reserved.

DOJO Q&A widget

Can't find what you need?

? Explore the Q&A DataMiner Docs

[ Placeholder content for popup link ] WordPress Download Manager - Best Download Management Plugin