Skip to content
DataMiner DoJo

More results...

Generic selectors
Exact matches only
Search in title
Search in content
Post Type Selectors
Search in posts
Search in pages
Search in posts
Search in pages
Log in
Menu
  • Blog
  • Questions
  • Learning
    • E-learning Courses
    • Open Classroom Training
    • Certification
      • DataMiner Fundamentals
      • DataMiner Configurator
      • DataMiner Automation
      • Scripts & Connectors Developer: HTTP Basics
      • Scripts & Connectors Developer: SNMP Basics
      • Visual Overview – Level 1
      • Verify a certificate
    • Tutorials
    • Video Library
    • Books We Like
    • >> Go to DataMiner Docs
  • Expert Center
    • Solutions & Use Cases
      • Solutions
      • Use Case Library
    • Markets & Industries
      • Media production
      • Government & defense
      • Content distribution
      • Service providers
      • Partners
      • OSS/BSS
    • DataMiner Insights
      • Security
      • Integration Studio
      • System Architecture
      • DataMiner Releases & Updates
      • DataMiner Apps
    • Agile
      • Agile Webspace
      • Everything Agile
        • The Agile Manifesto
        • Best Practices
        • Retro Recipes
      • Methodologies
        • The Scrum Framework
        • Kanban
        • Extreme Programming
      • Roles
        • The Product Owner
        • The Agile Coach
        • The Quality & UX Coach (QX)
    • DataMiner DevOps Professional Program
  • Downloads
  • More
    • Feature Suggestions
    • Climb the leaderboard!
    • Swag Shop
    • Contact
      • General Inquiries
      • DataMiner DevOps Support
      • Commercial Requests
    • Global Feedback Survey
  • PARTNERS
    • All Partners
    • Technology Partners
    • Strategic Partner Program
    • Deal Registration
  • >> Go to dataminer.services

Cassandra: analytics_* tables. Where and how are they used?

Solved885 views10th January 2023Analytics Cassandra
5
Paulo Henriques [SLC] [DevOps Member]550 9th January 2023 0 Comments

Hi,

In Dataminer 10.x we have a couple of DB tables with their name beginning with analytics_*, e.g.,
analytics_changepointsv1, analytics_wavestream, etc.

Where can we find more information about these tables? In which analytics features are they used and what is their purpose? How easily they can grow?
In the result below from the Cassandra BPA, one of these tables was signaled as having a large partition for a specific element. What shall we do?

Thanks in advance.

Paulo Henriques [SLC] [DevOps Member] Selected answer as best 10th January 2023

1 Answer

  • Active
  • Voted
  • Newest
  • Oldest
9
Tobe Deprez [SLC] [DevOps Advocate]894 Posted 10th January 2023 2 Comments

As the name suggests, these tables are indeed used by the analytics features. The large partition size for analytics_wavestream is likely caused by an element with a large table, as it stores a model for each (trended) entry in the table, and analytics_wavestream is partitioned per element. We are aware that partition sizes of around a 100 MiB can happen in some circumstances, but according to our Cassandra expert, this should not really cause problems in most cases. Moreover, we do not expect the partition size to grow over time, as there is just one model per trended parameter. There is also a limit on the number of parameters that are monitored by Behavioral Anomaly Detection.

However, if you want to reduce the partition size, a solution could be to try and split the data over multiple elements. I am not sure, but this might also help with some of the large partition sizes for other tables.

Here is an overview of what data is stored for which feature:

  • analytics_alarmfocus: stores one model for Alarm Focus for each monitored parameter that had an alarm in the last two weeks, or each monitored table cell. The amount of data in the table should be more or less stable after two weeks.
  • analytics_arrowwindows_v1: this is an old table that was used by the Trend Icons before version 10.2.4.
  • analytics_changepointalarmentries: used to keep track of the suggestions/alarms created by Behavioral Anomaly Detection. The amount of data should not keep growing over time, as the TTL of each record is 8 days.
  • analytics_changepoints_v1: keeps the detected changepoints for one year. In case of elements with large tables and a lot of changepoints, partition sizes can become quite large here. In more recent versions we moved to analytics_changepoints_v2 with smaller partitions (one partition per parameter or table cell).
  • analytics_parameterinfo_v1: keeps some data per trended parameter that is used for updating models in several features. The amount of data should be stable.
  • analytics_trendalarms_v1: this is an old table that is not used anymore in newer versions
  • analytics_trendalarms: used to keep track of the suggestions/alarms created by Proactive Cap Detection. The amount of data should not keep growing over time, as the TTL of each record is 60 days.
  • analytics_waveletlevels_v2: this is an old table that is not used anymore in newer versions.
  • analytics_wavestream: keeps a model per trended parameter or table cell for Proactive Cap Detection and Behavioral Anomaly Detection. The amount of data is related to the number of monitored parameters and should not grow over time.
Tobe Deprez [SLC] [DevOps Advocate] Posted new comment 10th January 2023
Paulo Henriques [SLC] [DevOps Member] commented 10th January 2023

Excellent explanation Tobe! Many thanks.
Wondering if some of this info could be added to our online documentation, e.g., in here: https://docs.dataminer.services/develop/devguide/Connector/AdvancedDataMinerDataPersistenceNoSqlCassandra.html?q=nosql

Tobe Deprez [SLC] [DevOps Advocate] commented 10th January 2023

Great idea! It’s on our to-do list.

You are viewing 1 out of 1 answers, click here to view all answers.
Please login to be able to comment or post an answer.

My DevOps rank

DevOps Members get more insights on their profile page.

My user earnings

0 Dojo credits

Spend your credits in our swag shop.

0 Reputation points

Boost your reputation, climb the leaderboard.

Promo banner DataMiner DevOps Professiona Program
DataMiner Integration Studio (DIS)
Empower Katas

Recent questions

Alarm Dashboard PDF/CSV Export 1 Answer | 0 Votes
Is the Microsoft SharePoint Connector Still Usable 0 Answers | 0 Votes
Is the Microsoft SharePoint Connector Still Usable 0 Answers | 0 Votes

Question Tags

adl2099 (115) alarm (62) Alarm Console (82) alarms (100) alarm template (83) Automation (223) automation scipt (111) Automation script (167) backup (71) Cassandra (180) Connector (108) Correlation (68) Cube (150) Dashboard (194) Dashboards (188) database (83) DataMiner Cube (57) DIS (81) DMS (71) DOM (139) driver (65) DVE (55) Elastic (83) Elasticsearch (115) elements (80) Failover (104) GQI (159) HTTP (76) IDP (74) LCA (151) low code app (166) low code apps (93) lowcodeapps (75) MySQL (53) protocol (203) QAction (83) security (88) services (51) SNMP (86) SRM (337) table (54) trending (87) upgrade (62) Visio (539) Visual Overview (345)
Privacy Policy • Terms & Conditions • Contact

© 2025 Skyline Communications. All rights reserved.

DOJO Q&A widget

Can't find what you need?

? Explore the Q&A DataMiner Docs

[ Placeholder content for popup link ] WordPress Download Manager - Best Download Management Plugin