Skip to content
DataMiner DoJo

More results...

Generic selectors
Exact matches only
Search in title
Search in content
Post Type Selectors
Search in posts
Search in pages
Search in posts
Search in pages
Log in
Menu
  • Blog
  • Questions
  • Learning
    • Courses
    • Certification
      • DataMiner Operator
      • DataMiner Administrator
      • DataMiner Automation
      • Scripts & Connectors Developer: HTTP Basics
      • Scripts & Connectors Developer: SNMP Basics
      • Visual Overview – Level 1
    • Video Library
    • Books We Like
    • Third-party Courses
    • DevOps Enablement Services
    • Quizzes
  • RESOURCES
  • Agile
    • Agile Webspace
    • Everything Agile
      • The Agile Manifesto
      • Best Practices
      • Retro Recipes
    • Methodologies
      • The Scrum Framework
      • Kanban
      • Extreme Programming
    • Roles
      • The Product Owner
      • The Agile Coach
      • The Quality & UX Coach (QX)
  • Expert Hubs
    • DataMiner DevOps Professional Program
    • DataMiner
      • DataMiner Releases & Updates
      • System Architecture
      • Integration Studio
      • Visual Overview
      • Security
    • Technologies
      • CI/CD
      • Converged Interconnect Networks
      • DOCSIS 3.1 / DAA
      • Elasticsearch
      • Kubernetes
      • Telemetry / Flow Monitoring
      • PTP
      • SDN / ST2110 / NMOS
    • Business
      • Software Business models
      • Perpetual Use or Usage-based Services
  • Discover
    • Markets
      • Media production
      • Government & defense
      • Content distribution
      • Service providers
      • Partners
      • OSS/BSS
    • Solutions
    • Use Case Library
    • DataMiner Dashboards
    • DataMiner Downloads
    • DataMiner Modules
      • Core features
      • SRM features
    • DataMiner Apps
    • Professional Services
  • PARTNERS
    • All Partners
    • Technology Partners
    • Strategic Partner Program
    • Deal Registration
  • Pricing
  • More
    • Feature Suggestions
    • Online DataMiner Systems
    • Leaderboard
    • Swag Shop
    • Contact
      • General Inquiries
      • DataMiner DevOps Support
      • Commercial Requests
    • Global Feedback Survey
    • Verify a certificate
  • >> Go to dataminer.services

Cassandra and Elastic max allowed disk size per node

Solved534 views4 days ago
1
Naveendran Murthy [SLC] [DevOps Member]226 12th September 2023 0 Comments

For the below VM resource spec (1 for Cassandra and 1 for elastic), what will be the maximum SSD disk size that can be loaded for storage? And what will be the usable storage vs actual storage?

CPU: 1x16 core (10K passmark), RAM: 64 GB, OS: Linux Ubuntu LTS

Marieke Goethals [SLC] [DevOps Enabler] Selected answer as best 4 days ago

1 Answer

  • Active
  • Voted
  • Newest
  • Oldest
2
Thibault Heylen [SLC] [DevOps Advocate]720 Posted 13th September 2023 1 Comment

Hi Naveendran,

It's hard to put 1 number on this as is has to many dependencies. Below you can find a general number for both databases.

For Cassandra:
Depending on how you configure it, as standalone Cassandra, or Cassandra Cluster with 1 node the data is saved a little different. However for this we follow the general rules from DataStax Cassandra, this to have a maximum of 2/3 TB per node in a cluster.
On the disk you should have space left same as the biggest table on your system. For example if you have lot of average trending, 400GB, then you need at least 400GB of free disk space so Cassandra can compact your data.

more information can be found here: https://docs.datastax.com/en/ossplanning/docs/oss-capacity-planning.html

For Elastic:
Here we follow the recommendations from ElasticSearch itself, with the configuration of the CPU and memory, this would mean a maximum disk of 1.9TB.
For the usable space, this is almost the whole disk, as Elastic has a different way of handling the data.

Marieke Goethals [SLC] [DevOps Enabler] Selected answer as best 4 days ago
Srikanth Mandava [SLC] [DevOps Advocate] commented 13th September 2023

Naveen, I also suggest using https://community.dataminer.services/calculator/ for approximating the storage space needs.

In terms of the Elasticsearch, the user needs to consider the scenario of losing a node in the cluster. As Thibault mentioned, ES can use the complete disk in the way it works. However if 1 out 3 nodes goes down then the same size ES indexes need to spread between 2 nodes instead of 3. I couldn’t find the relevant elastic documentation for this, but I suggest to plan based on 30% free space.

You are viewing 1 out of 1 answers, click here to view all answers.
Please login to be able to comment or post an answer.

My Dojo Points

0 Credits
0 Reputation

Question Tag Cloud

adl2099 (54) Alarm Console (53) alarms (70) alarm template (58) API (35) Automation (144) automation scipt (65) Automation script (95) backup (54) Cassandra (142) cloud (37) Connector (44) Correlation (42) Cube (114) Dashboard (134) Dashboards (136) database (64) DataMiner Cube (37) DIS (53) DMS (48) DOM (68) driver (48) DVE (43) Elastic (73) Elasticsearch (99) elements (49) Failover (90) GQI (51) HTTP (45) IDP (55) low code app (70) low code apps (43) MySQL (50) protocol (145) QAction (58) resources (35) security (71) SNMP (56) SRM (267) SRM resources (39) timeout (35) trending (66) upgrade (44) Visio (373) Visual Overview (290)
Privacy Policy • Terms & Conditions • Contact

© 2023 Skyline Communications. All rights reserved.

[ Placeholder content for popup link ] WordPress Download Manager - Best Download Management Plugin