Skip to content
DataMiner DoJo

More results...

Generic selectors
Exact matches only
Search in title
Search in content
Post Type Selectors
Search in posts
Search in pages
Search in posts
Search in pages
Log in
Menu
  • Updates & Insights
  • Questions
  • Learning
    • E-learning Courses
    • Empower Replay: Limited Edition
    • Tutorials
    • Open Classroom Training
    • Certification
      • DataMiner Fundamentals
      • DataMiner Configurator
      • DataMiner Automation
      • Scripts & Connectors Developer: HTTP Basics
      • Scripts & Connectors Developer: SNMP Basics
      • Visual Overview – Level 1
      • Verify a certificate
    • Video Library
    • Books We Like
    • >> Go to DataMiner Docs
  • Expert Center
    • Solutions & Use Cases
      • Solutions
      • Use Case Library
    • Markets & Industries
      • Media production
      • Government & defense
      • Content distribution
      • Service providers
      • Partners
      • OSS/BSS
    • Agile
      • Agile Webspace
      • Everything Agile
        • The Agile Manifesto
        • Best Practices
        • Retro Recipes
      • Methodologies
        • The Scrum Framework
        • Kanban
        • Extreme Programming
      • Roles
        • The Product Owner
        • The Agile Coach
        • The Quality & UX Coach (QX)
    • DataMiner DevOps Professional Program
      • About the DevOps Program
      • DataMiner DevOps Support
  • Downloads
  • More
    • DataMiner Releases & Updates
    • Feature Suggestions
    • Climb the leaderboard!
    • Swag Shop
    • Contact
    • Global Feedback Survey
  • PARTNERS
    • All Partners
    • Technology Partners
    • Strategic Partner Program
    • Deal Registration
  • >> Go to dataminer.services

Cassandra cluster maintenance

Solved1.06K views29th June 2023Cassandra cluster maintenance
5
Petro Misiuk76 13th February 2023 0 Comments

We have a 6 node Cassandra cluster with a replication factor of 3 and consistency level of 2. We need to bring down 2 nodes for maintenance, but they cannot be done separately. Maximum downtime will likely be 15 minutes so any data that cannot be written will be cached in the Dataminer nodes as I understand. Are there any risks here or can this be done safely?

Thanks.

Robin Devos [SLC] [DevOps Advocate] Selected answer as best 29th June 2023

1 Answer

  • Active
  • Voted
  • Newest
  • Oldest
8
Robin Devos [SLC] [DevOps Advocate]2.46K Posted 13th February 2023 1 Comment

Hi Petro, I’m glad you found your way to the Dojo questions! 🙂
I’ll provide the same/similar answer, as I provided via mail, to help others.

The DM Docs are a good place to start:

  • Data replication (RF) defines how many copies of the data needs to be present in the Cassandra cluster.
  • Consistency level (C) defines how many replicas need to respond before the response is seen as acceptable.

The DM Docs also provide a nice and fitting example:

  • If the replication factor is 3 and the consistency level is 2, Cassandra queries will require an answer from 2 out of 3 replicas to be considered successful. This means that if one node is down, queries will still succeed, but if another node is down, it is possible that queries will no longer succeed.

A more concrete example to your situation:

2 of your nodes will be down for a short time, should you request data (e.g. a trending or elementdata) which happens to be located on these 2 nodes, then this read request will fail. (Even if there’s a 3rd copy on another node due to RF = 3, the response won’t be accepted due to C = 2.)
Writing shouldn’t be an issue, as there are still 4 other nodes available.
However, in case there would be an issue with pushing the data to the DB, then you are correct. In that case, data will be kept locally on the disk until the Cassandra cluster is available again.

As mentioned via mail, all went well and no anomalies were seen during your maintenance window.

Robin Devos [SLC] [DevOps Advocate] Selected answer as best 29th June 2023
Michiel Saelen [SLC] [DevOps Enabler] commented 15th February 2023

In addition, you could set the consistency level temporarily to one to prevent reads/writes would fail. Keep in mind that to ensure strong consistency (always have the latest data) you should have R + W > RF. As you say it is only 15 min it might mean longer downtime to change the CL (DMA restart needed) than to get your Cassandra nodes back up.

More info:
https://docs.dataminer.services/user-guide/Advanced_Functionality/Databases/Supported_System_Data_Storage_Architectures/Migrating_the_general_database_to_a_DMS_Cassandra_cluster.html?tabs=tabid-1#customizing-the-consistency-level-of-the-cassandra-cluster
R => Read Consistency
W => Write Consitency
RF => Replication Factor

Please login to be able to comment or post an answer.

My DevOps rank

DevOps Members get more insights on their profile page.

My user earnings

0 Dojo credits

Spend your credits in our swag shop.

0 Reputation points

Boost your reputation, climb the leaderboard.

Promo banner DataMiner DevOps Professiona Program
DataMiner Integration Studio (DIS)
Empower Katas
Privacy Policy • Terms & Conditions • Contact

© 2025 Skyline Communications. All rights reserved.

DOJO Q&A widget

Can't find what you need?

? Explore the Q&A DataMiner Docs