Skip to content
DataMiner DoJo

More results...

Generic selectors
Exact matches only
Search in title
Search in content
Post Type Selectors
Search in posts
Search in pages
Search in posts
Search in pages
Log in
Menu
  • Blog
  • Questions
  • Learning
    • E-learning Courses
    • Open Classroom Training
    • Certification
      • DataMiner Fundamentals
      • DataMiner Configurator
      • DataMiner Automation
      • Scripts & Connectors Developer: HTTP Basics
      • Scripts & Connectors Developer: SNMP Basics
      • Visual Overview – Level 1
      • Verify a certificate
    • Tutorials
    • Video Library
    • Books We Like
    • >> Go to DataMiner Docs
  • Expert Center
    • Solutions & Use Cases
      • Solutions
      • Use Case Library
    • Markets & Industries
      • Media production
      • Government & defense
      • Content distribution
      • Service providers
      • Partners
      • OSS/BSS
    • DataMiner Insights
      • Security
      • Integration Studio
      • System Architecture
      • DataMiner Releases & Updates
      • DataMiner Apps
    • Agile
      • Agile Webspace
      • Everything Agile
        • The Agile Manifesto
        • Best Practices
        • Retro Recipes
      • Methodologies
        • The Scrum Framework
        • Kanban
        • Extreme Programming
      • Roles
        • The Product Owner
        • The Agile Coach
        • The Quality & UX Coach (QX)
    • DataMiner DevOps Professional Program
  • Downloads
  • More
    • Feature Suggestions
    • Climb the leaderboard!
    • Swag Shop
    • Contact
      • General Inquiries
      • DataMiner DevOps Support
      • Commercial Requests
    • Global Feedback Survey
  • PARTNERS
    • All Partners
    • Technology Partners
    • Strategic Partner Program
    • Deal Registration
  • >> Go to dataminer.services

Managing backups and restoring DMA

Solved2.13K views20th September 2022backup restore Elasticsearch external cassandra node
4
Max Stephany211 19th September 2022 0 Comments

Hello folks,

Last week we successfully migrated our Cassandra database to separate Cassandra + Elasticsearch clusters with 1 node each, thanks to the great support from Skyline.
We would now like to understand how the backup mechanics work and in the event of a system failure, how to restore the databases.

After reading the documentation, the following is my understanding on how the backups and restore work so I may be wrong and thus would like some clarification.

The backups for Cassandra are still done as usual (as a complete DMA backup package if “Full backup” is selected as backup type in system center) and stored in the path specified here:

However, on the Cassandra server itself, old backups (also called snapshots) are not removed automatically and need manual cleaning.

As for Elastic, unlike Cassandra, the data is not integrated in the complete backup package but has to be treated separately using the “Standalone Elastic Backup Tool”.
The following setting in "system center -> backup" only works if Elastic is installed on the same machine as the DMA and NOT in our case:

Restoring our Dataminer system works by using the restore utility in the taskbar. This does not restore the Elastic data, which must be done separately by again using the tool.

Is this correct?

Best Regards,

Max

Max Stephany Selected answer as best 20th September 2022

1 Answer

  • Active
  • Voted
  • Newest
  • Oldest
2
Alexander Gorbunov [SLC] [DevOps Advocate]978 Posted 19th September 2022 2 Comments

Hello Max,

I believe this answers your question: https://community.dataminer.services/question/dataminer-backup-full-backup-with-remote-cassandra-and-elastic-db/answer/61662/

In short, the answer suggests to use the following tools to back up and restore external database nodes:

Standalone Elastic Backup tool | DataMiner Docs

Standalone Cassandra Backup tool | DataMiner Docs

According to the documentation, the Cassandra Backup tool only creates a snapshot on the database node. To prevent loss of data in case of server failure, the snapshot has to be moved to an external storage manually or via some custom automation on the database node. (for example, a shell script triggered by cron in Linux).

To restore the backup, the contents of the snapshot directory must be copied to the respective database table directory.

Alexander Gorbunov [SLC] [DevOps Advocate] Posted new comment 20th September 2022
Max Stephany commented 20th September 2022

Hello Alexander,

Thank you, I was not 100% sure about Cassandra but this answers my question.

BR,
Max

Alexander Gorbunov [SLC] [DevOps Advocate] commented 20th September 2022

Hi Max, there are a couple of things I omitted for the sake of brevity, but now I see it’s important to mention them in this answer.

1. The standard DataMiner backup utility doesn’t include a backup of a remote Cassandra database. Therefore custom backup logic has to be provisioned (schedule, copying and cleaning up snapshots).

2. To restore a Cassandra snapshot, the tables which are restored must be truncated first (this is mentioned in the Docs page for the backup tool).

You are viewing 1 out of 1 answers, click here to view all answers.
Please login to be able to comment or post an answer.

My DevOps rank

DevOps Members get more insights on their profile page.

My user earnings

0 Dojo credits

Spend your credits in our swag shop.

0 Reputation points

Boost your reputation, climb the leaderboard.

Promo banner DataMiner DevOps Professiona Program
DataMiner Integration Studio (DIS)
Empower Katas

Recent questions

Alarm Dashboard PDF/CSV Export 0 Answers | 0 Votes
Is the Microsoft SharePoint Connector Still Usable 0 Answers | 0 Votes
Is the Microsoft SharePoint Connector Still Usable 0 Answers | 0 Votes

Question Tags

adl2099 (115) alarm (62) Alarm Console (82) alarms (100) alarm template (83) Automation (223) automation scipt (111) Automation script (167) backup (71) Cassandra (180) Connector (108) Correlation (68) Cube (150) Dashboard (194) Dashboards (188) database (83) DataMiner Cube (57) DIS (81) DMS (71) DOM (139) driver (65) DVE (55) Elastic (83) Elasticsearch (115) elements (80) Failover (104) GQI (159) HTTP (76) IDP (74) LCA (151) low code app (166) low code apps (93) lowcodeapps (75) MySQL (53) protocol (203) QAction (83) security (88) services (51) SNMP (86) SRM (337) table (54) trending (87) upgrade (62) Visio (539) Visual Overview (345)
Privacy Policy • Terms & Conditions • Contact

© 2025 Skyline Communications. All rights reserved.

DOJO Q&A widget

Can't find what you need?

? Explore the Q&A DataMiner Docs

[ Placeholder content for popup link ] WordPress Download Manager - Best Download Management Plugin