Skip to content
DataMiner Dojo

More results...

Generic selectors
Exact matches only
Search in title
Search in content
Post Type Selectors
Search in posts
Search in pages
Search in posts
Search in pages
Log in
Menu
  • Updates & Insights
  • Questions
  • Learning
    • E-learning Courses
    • Tutorials
    • Open Classroom Training
    • Certification
      • DataMiner Fundamentals
      • DataMiner Configurator
      • DataMiner Automation
      • Scripts & Connectors Developer: HTTP Basics
      • Scripts & Connectors Developer: SNMP Basics
      • Visual Overview – Level 1
      • Verify a certificate
    • YouTube Videos
    • Solutions & Use Cases
      • Solutions
      • Use Case Library
    • Agility
      • Learn more about Agile
        • Agile Webspace
        • Everything Agile
          • The Agile Manifesto
          • Best Practices
          • Retro Recipes
        • Methodologies
          • The Scrum Framework
          • Kanban
          • Extreme Programming
        • Roles
          • The Product Owner
          • The Agile Coach
          • The Quality & UX Coach (QX)
      • Book your Agile Fundamentals training
      • Book you Kanban workshop
    • >> Go to DataMiner Docs
  • DevOps
    • About the DevOps Program
    • Sign up for the DevOps Program
    • DataMiner DevOps Support
    • Feature Suggestions
  • Downloads
  • Swag Shop
  • PARTNERS
    • Business Partners
    • Technology Partners
  • Contact
    • Sales, Training & Certification
    • DataMiner Support
    • Global Feedback Survey
  • >> Go to dataminer.services

Cassandra node sizing and Open Search

Solved18 views4 hours agoCassandra DMS opensearch
0
Isabel Arce [DevOps Member]163 8 hours ago 0 Comments

Hi everyone,

We have a Dataminer cluster with 3 agents of 500 elements each, where we currently have 1100 elements. Each server has its own Cassandra database on one of its disks. However, since memory consumption increases to almost 100% during the compaction process, we want to migrate the databases to independent servers and add OpenSearch servers.

The question is: Is it sufficient to consider 3 Cassandra servers and 3 Elasticsearch servers, or what number of servers would you recommend for this cluster?

Resources:

Cassandra servers: RAM 64GB // Disk 1: 250GB SSD
Disk 2: 500GB SSD
OpenSearch server: RAM  64GB // Disk 1: 1TB SSD

Many thanks

Isabel Arce [DevOps Member] Selected answer as best 4 hours ago

1 Answer

  • Active
  • Voted
  • Newest
  • Oldest
0
Bert Vandenberghe [SLC] [DevOps Enabler]9.42K Posted 7 hours ago 1 Comment

Hi Isabel,

Looking at the data you provided, it looks like 3 servers for Cassandra and OpenSearch should be sufficient. Today you are able to run on 3 Cassandra nodes, although they max out during compaction, but in the new architecture, you are going to benefit from dedicated servers for the storage, and you will also have some load going from Cassandra to OpenSearch. Three servers also give you the possibility to make sure the cluster has some resilience if one node goes down. So, yes, I believe your plan looks great.

PS: If you want to take it one step further, you could also consider moving the storage to STaaS. Then your DMS would connect to cloud native storage from Microsoft Azure (Cosmos DB and Table Storage) managed by Skyline in dataminer.services. Then you only need to do one click to connect to STaaS and really forget about storage. No longer needed to build databases yourself, maintain and upgrade them, migrate to newer versions, patching, etc... The robustness, reliability and security levels you have now and forever in STaaS is very difficult to achieve yourselves with Cassandra and OpenSearch nodes on-prem. I believe it's better to put your valuable time in building solutions on top of DataMiner which will empower your team to be better and faster. Storage is just storage. It is readily available in STaaS, better, faster and cheaper... More info: Storage as a Service (STaaS) | DataMiner Docs

Bert

Isabel Arce [DevOps Member] Selected answer as best 4 hours ago
Isabel Arce [DevOps Member] commented 4 hours ago

Thank you very much for your kind reply, Bert. We will also review more documentation regarding the STaaS solution.

You are viewing 1 out of 1 answers, click here to view all answers.
Please login to be able to comment or post an answer.

My DevOps rank

DevOps Members get more insights on their profile page.

My user earnings

0 Dojo credits

Spend your credits in our swag shop.

0 Reputation points

Boost your reputation, climb the leaderboard.

Promo banner DataMiner DevOps Professiona Program
DataMiner Integration Studio (DIS)
Empower Katas
Privacy Policy • Terms & Conditions • Contact

© 2025 Skyline Communications. All rights reserved.

DOJO Q&A widget

Can't find what you need?

? Explore the Q&A DataMiner Docs

[ Placeholder content for popup link ] WordPress Download Manager - Best Download Management Plugin