Skip to content
DataMiner DoJo

More results...

Generic selectors
Exact matches only
Search in title
Search in content
Post Type Selectors
Search in posts
Search in pages
Search in posts
Search in pages
Log in
Menu
  • Blog
  • Questions
  • Learning
    • E-learning Courses
    • Open Classroom Training
    • Certification
      • DataMiner Fundamentals
      • DataMiner Configurator
      • DataMiner Automation
      • Scripts & Connectors Developer: HTTP Basics
      • Scripts & Connectors Developer: SNMP Basics
      • Visual Overview – Level 1
      • Verify a certificate
    • Tutorials
    • Video Library
    • Books We Like
    • >> Go to DataMiner Docs
  • Expert Center
    • Solutions & Use Cases
      • Solutions
      • Use Case Library
    • Markets & Industries
      • Media production
      • Government & defense
      • Content distribution
      • Service providers
      • Partners
      • OSS/BSS
    • DataMiner Insights
      • Security
      • Integration Studio
      • System Architecture
      • DataMiner Releases & Updates
      • DataMiner Apps
    • Agile
      • Agile Webspace
      • Everything Agile
        • The Agile Manifesto
        • Best Practices
        • Retro Recipes
      • Methodologies
        • The Scrum Framework
        • Kanban
        • Extreme Programming
      • Roles
        • The Product Owner
        • The Agile Coach
        • The Quality & UX Coach (QX)
    • DataMiner DevOps Professional Program
  • Downloads
  • More
    • Feature Suggestions
    • Climb the leaderboard!
    • Swag Shop
    • Contact
      • General Inquiries
      • DataMiner DevOps Support
      • Commercial Requests
    • Global Feedback Survey
  • PARTNERS
    • All Partners
    • Technology Partners
    • Strategic Partner Program
    • Deal Registration
  • >> Go to dataminer.services

Why does Cassandra’s compaction use my C partition if the database is located on a different disk?

Solved1.67K views13th October 2020Cassandra compaction database
3
Gelber Mahecha [SLC] [DevOps Enabler]1.62K 9th October 2020 0 Comments

We have configured Cassandra to run on a separate D drive but noticed that during compaction, it also uses a lot of space of our C partition, where we have the OS and DataMiner. Because the C partition has less space, we wonder about any action to prevent this situation...

Gelber Mahecha [SLC] [DevOps Enabler] Selected answer as best 13th October 2020

3 Answers

  • Active
  • Voted
  • Newest
  • Oldest
5
Michiel Saelen [SLC] [DevOps Enabler]5.63K Posted 13th October 2020 1 Comment

All ssTables (the DB data on disk) is stored on the separate drive. When Cassandra does compaction it tries to clean up and group ssTables for more efficient lookup. To do this it needs to go over the ssTables and start write the data to new ssTables on the separate disk.

When going over the data the Cassandra process wants to take a lot of data into memory. If you have large partitions it can lead to large memory consumption. This could become so large that there is not enough Memory (RAM) and at that point Windows provides the Cassandra application with page files (memory on disk) to prevent the application from crashing. Most likely this is why you are impact on C disk during the compaction (Cassandra is eating all resources from the OS). This could lead to other processes in the end being impacted (like the DataMiner services). There are a couple of things that you can do to improve this:

  • Evaluate if you can reduce DB load (most effective)
    This can be done by creating less alarms or alarm updates. If they have a lot of services make sure the service impact of your alarms is limited. Less trending, especially real time trending is heavy for DB as it needs to clean up a lot of data on every compaction cycle. This will heavily depend on your use case and what is possible for the customer.
  • Evaluate your page file settings
    Could be that by enabling page files on more than only the C drive you are seeing less problems.
    Note: you should always leave the page file settings on automatic to prevent crashes when limits are reached.
  • Move Cassandra to separate server
    To prevent impact on DataMiner services you can move Cassandra to another server.
    In case of virtualized environments make sure your disks are not shared or you could end up with the same problems again.
Gelber Mahecha [SLC] [DevOps Enabler] Selected answer as best 13th October 2020
Gelber Mahecha [SLC] [DevOps Enabler] commented 13th October 2020

Thanks Michiel. At the first opportunity, we will check the configuration and sizes of the DB, to confirm if the page file is causing such usage on C partition.

3
Wouter Demuynck [SLC] [DevOps Advocate]5.91K Posted 12th October 2020 0 Comments

During compaction, there should not be extra writes to drive C, unless Cassandra needs memory and Windows starts using a page file.

If correctly configured to have Cassandra on an separate drive D, drive C should only be used for:

  • Commit logs (where Cassandra temporarily saves new data)
  • Hint files (used for synchronization with other Cassandra nodes, such as on a Failover system)

Both of these are unrelated to compaction.

Wouter Demuynck [SLC] [DevOps Advocate] Answered question 12th October 2020
2
Ive Herreman [SLC] [DevOps Enabler]13.52K Posted 9th October 2020 0 Comments

Hi Gelber,

Can you check if this is caused by a large page file?

Ive Herreman [SLC] [DevOps Enabler] Answered question 9th October 2020
Please login to be able to comment or post an answer.

My DevOps rank

DevOps Members get more insights on their profile page.

My user earnings

0 Dojo credits

Spend your credits in our swag shop.

0 Reputation points

Boost your reputation, climb the leaderboard.

Promo banner DataMiner DevOps Professiona Program
DataMiner Integration Studio (DIS)
Empower Katas

Recent questions

Web Applications exception in Cube due to invalid certificate 0 Answers | 0 Votes
Redundancy Groups and Alarming – Duplicate Alarms 0 Answers | 0 Votes
Correlation Engine: “Test rule” doesn’t result in a hit, despite functional rule 1 Answer | 3 Votes

Question Tags

adl2099 (115) alarm (62) Alarm Console (82) alarms (100) alarm template (83) Automation (223) automation scipt (111) Automation script (167) backup (71) Cassandra (180) Connector (109) Correlation (69) Correlation rule (52) Cube (151) Dashboard (194) Dashboards (188) database (83) DataMiner Cube (57) DIS (81) DMS (71) DOM (140) driver (65) DVE (56) Elastic (83) Elasticsearch (115) elements (80) Failover (104) GQI (159) HTTP (76) IDP (74) LCA (152) low code app (166) low code apps (93) lowcodeapps (75) MySQL (53) protocol (203) QAction (83) security (88) SNMP (86) SRM (337) table (54) trending (87) upgrade (62) Visio (539) Visual Overview (345)
Privacy Policy • Terms & Conditions • Contact

© 2025 Skyline Communications. All rights reserved.

DOJO Q&A widget

Can't find what you need?

? Explore the Q&A DataMiner Docs

[ Placeholder content for popup link ] WordPress Download Manager - Best Download Management Plugin