Skip to content
DataMiner Dojo

More results...

Generic selectors
Exact matches only
Search in title
Search in content
Post Type Selectors
Search in posts
Search in pages
Search in posts
Search in pages
Log in
Menu
  • Updates & Insights
  • Questions
  • Learning
    • E-learning Courses
    • Tutorials
    • Open Classroom Training
    • Certification
      • DataMiner Fundamentals
      • DataMiner Configurator
      • DataMiner Automation
      • Scripts & Connectors Developer: HTTP Basics
      • Scripts & Connectors Developer: SNMP Basics
      • Visual Overview – Level 1
      • Verify a certificate
    • YouTube Videos
    • Solutions & Use Cases
      • Solutions
      • Use Case Library
    • Agility
      • Learn more about Agile
        • Agile Webspace
        • Everything Agile
          • The Agile Manifesto
          • Best Practices
          • Retro Recipes
        • Methodologies
          • The Scrum Framework
          • Kanban
          • Extreme Programming
        • Roles
          • The Product Owner
          • The Agile Coach
          • The Quality & UX Coach (QX)
      • Book your Agile Fundamentals training
      • Book you Kanban workshop
    • >> Go to DataMiner Docs
  • DevOps
    • About the DevOps Program
    • Sign up for the DevOps Program
    • DataMiner DevOps Support
    • Feature Suggestions
  • Downloads
  • Swag Shop
  • PARTNERS
    • Business Partners
    • Technology Partners
  • Contact
    • Sales, Training & Certification
    • DataMiner Support
    • Global Feedback Survey
  • >> Go to dataminer.services

STaaS Migration Procedure for Multi-Agent Cluster with Separate Per-Agent Cassandra Nodes

Solved110 views3 days agoCassandraDB STaaS
5
Miguel Barquet [SLC] [DevOps Enabler]1.75K 4 days ago 0 Comments

Dear DataMiner Community,

We are preparing to migrate the historical data from a production DataMiner cluster consisting of 5 main agents, each configured with a dedicated failover backup agent (1+1 redundancy model), to Skyline's STaaS. Our intention is to adhere to the standard migration procedure outlined in the official documentation: Migrating existing data to STaaS.

Current Database Architecture:

  • DataMiner Installation: Hosted on the C: drive across all agents.
  • Cassandra Deployment: Collocated in the DataMiner server, running on D: drive
  • ElasticSearch Configuration: A single, standalone ElasticSearch node that serves all agents in the cluster for indexing and search functionalities.
  • Data Scope: The migration encompasses all historical data types (e.g., trending, alarms, custom data including DOM, SRM, and Analytics), with no specific exclusions planned at this stage.

Procedure Alignment:

Given our architecture with fully segregated Cassandra nodes per agent (as opposed to a consolidated cluster-wide Cassandra deployment), we seek clarification on the following:

  1. Direct Applicability: Does the standard procedure fully apply without modifications in this scenario, particularly regarding the coordination of data transfer across independent Cassandra nodes? For instance, will the migration script automatically handle ring-wide synchronization during the "Start Move to STaaS" and subsequent phases?
  2. ElasticSearch: How does the shared single ElasticSearch node factor into the process??
  3. Monitoring and Rollback: In a multi-agent setup, how can we best monitor progress granularly per storage type and agent?

Any insights, experiences from similar migrations, or references to additional resources would be greatly appreciated.

Thank you in advance for your expertise.

Miguel Barquet [SLC] [DevOps Enabler] Selected answer as best 3 days ago

1 Answer

  • Active
  • Voted
  • Newest
  • Oldest
1
Louis Lavens [SLC] [DevOps Advocate]459 Posted 4 days ago 1 Comment

Hi Miguel,

This procedure can also be used with your current setup. The migration script will detect that Cassandra has individual nodes and trigger the migration on each agent. It will also detect that Elastic is cluster-wide and trigger the migration once.

Progress can be monitored using the CloudStorageMigrationProgress script, as mentioned in the documentation. Each agent will report its progress.

As a reminder, you mentioned failover. Before starting the script, ensure that the main agent is active for each pair.

Kind regards,
Louis

Miguel Barquet [SLC] [DevOps Enabler] Posted new comment 3 days ago
Miguel Barquet [SLC] [DevOps Enabler] commented 3 days ago

Thanks, Louis.

You are viewing 1 out of 1 answers, click here to view all answers.
Please login to be able to comment or post an answer.

My DevOps rank

DevOps Members get more insights on their profile page.

My user earnings

0 Dojo credits

Spend your credits in our swag shop.

0 Reputation points

Boost your reputation, climb the leaderboard.

Promo banner DataMiner DevOps Professiona Program
DataMiner Integration Studio (DIS)
Empower Katas
Privacy Policy • Terms & Conditions • Contact

© 2025 Skyline Communications. All rights reserved.

DOJO Q&A widget

Can't find what you need?

? Explore the Q&A DataMiner Docs

[ Placeholder content for popup link ] WordPress Download Manager - Best Download Management Plugin