Skip to content
DataMiner DoJo

More results...

Generic selectors
Exact matches only
Search in title
Search in content
Post Type Selectors
Search in posts
Search in pages
Search in posts
Search in pages
Log in
Menu
  • Updates & Insights
  • Questions
  • Learning
    • E-learning Courses
    • Empower Replay: Limited Edition
    • Tutorials
    • Open Classroom Training
    • Certification
      • DataMiner Fundamentals
      • DataMiner Configurator
      • DataMiner Automation
      • Scripts & Connectors Developer: HTTP Basics
      • Scripts & Connectors Developer: SNMP Basics
      • Visual Overview – Level 1
      • Verify a certificate
    • Video Library
    • Books We Like
    • >> Go to DataMiner Docs
  • Expert Center
    • Solutions & Use Cases
      • Solutions
      • Use Case Library
    • Markets & Industries
      • Media production
      • Government & defense
      • Content distribution
      • Service providers
      • Partners
      • OSS/BSS
    • Agile
      • Agile Webspace
      • Everything Agile
        • The Agile Manifesto
        • Best Practices
        • Retro Recipes
      • Methodologies
        • The Scrum Framework
        • Kanban
        • Extreme Programming
      • Roles
        • The Product Owner
        • The Agile Coach
        • The Quality & UX Coach (QX)
    • DataMiner DevOps Professional Program
      • About the DevOps Program
      • DataMiner DevOps Support
  • Downloads
  • More
    • DataMiner Releases & Updates
    • Feature Suggestions
    • Climb the leaderboard!
    • Swag Shop
    • Contact
      • General Inquiries
    • Global Feedback Survey
  • PARTNERS
    • All Partners
    • Technology Partners
    • Strategic Partner Program
    • Deal Registration
  • >> Go to dataminer.services

Cassandra TTL granularity

Solved903 views18th July 2023Cassandra
1
Jeff Douglass860 5th November 2021 0 Comments

Is it possible in Cassandra to set the custom ttl values for specific information events to have these types of event deleted from the dbase after say a day or two? We have a very specific problem in that our system is designed around a large amount of services and one of the parameters of one of the service’s elements are changed very often and this causes an excessive amount of service update by scripting information events, some times 10s of thousands a day, that we don’t care about to be generated and fill up the info database table. This is causing a number of problems in MySQL such as the table becoming to large for DM to handle and also starving out all the very important user initiated command (what I refer to as system audit events) info events. With the default DM setting of limiting the info table to 300K events we often have the table only contain 3-5 days worth of events and %99 percent of these are useless unwanted events and in turn, we only have 3-5 days of records of what actions users have performed. We could increase the number of event the table holds but then we run into problems with the table being too big and starting to cause basic DM problems. I expect we will have the same or similar problem once we migrate to Cassandra. The best solution would be if DM had a setting to disable the logging of these types of events, but since that does not appear to be possible or something Skyline is willing to add the next best thing in Cassandra would be to set a short TTL for these types of events so the don’t fill up and load down the database. This single behavior is currently one of our biggest issues and is starting become a show stopper to delivering larger systems to our customers.

Any ideas? Thanks in advance

Marieke Goethals [SLC] [DevOps Catalyst] Selected answer as best 18th July 2023

1 Answer

  • Active
  • Voted
  • Newest
  • Oldest
0
Michiel Saelen [SLC] [DevOps Enabler]5.63K Posted 5th November 2021 6 Comments

Hi Jeff,

Would be good to share an example of such an information event (you can overwrite sensitive data if needed) to be sure we are talking about the same information events. If it is not possible to disable these, I would suggest creating a feature suggestion (DataMiner Feature Suggestions – DataMiner Dojo). Depending on the number of votes we try to evaluate the importance of your suggestion.

Can you provide an example of your information events?

Marieke Goethals [SLC] [DevOps Catalyst] Selected answer as best 18th July 2023
Jeff Douglass commented 5th November 2021

Element name Element description Parameter description Value Time Root time

Circuit PRO 1-1 Edited Circuit PRO 1-1 By SCRIPTING:31811/959 Today 6:23:11 AM Today 6:23:11 AM
Circuit MGT PRO Edited Circuit MGT PRO By SCRIPTING:31811/959 Today 6:23:10 AM Today 6:23:10 AM
Circuit MGT PICO Edited Circuit MGT PICO By SCRIPTING:31811/959 Today 6:23:10 AM Today 6:23:10 AM
Circuit PRO 2-3 Edited Circuit PRO 2-3 By SCRIPTING:31811/959 Today 6:23:10 AM Today 6:23:10 AM
Circuit PICO 2-3 Edited Circuit PICO 2-3 By SCRIPTING:31811/959 Today 6:23:10 AM Today 6:23:10 AM
Circuit PLUS 2-3 Edited Circuit PLUS 2-3 By SCRIPTING:31811/959 Today 6:23:10 AM Today 6:23:10 AM
Circuit PLUS 2-2 Edited Circuit PLUS 2-2 By SCRIPTING:31811/959 Today 6:23:10 AM Today 6:23:10 AM
Circuit PRO 2-2 Edited Circuit PRO 2-2 By SCRIPTING:31811/959 Today 6:23:10 AM Today 6:23:10 AM
Circuit PICO 2-2 Edited Circuit PICO 2-2 By SCRIPTING:31811/959 Today 6:23:10 AM Today 6:23:10 AM
Circuit PLUS 2-1 Edited Circuit PLUS 2-1 By SCRIPTING:31811/959 Today 6:23:10 AM Today 6:23:10 AM
Circuit PRO 2-1 Edited Circuit PRO 2-1 By SCRIPTING:31811/959 Today 6:23:10 AM Today 6:23:10 AM

Jeff Douglass commented 5th November 2021

Each one of these is a service where a filter value for one of the member elements gets changed resulting in these edited messages.

Michiel Saelen [SLC] [DevOps Enabler] commented 5th November 2021

It looks like you are editing your services (or service template?) through a QAction. Can you share the notify call or the method from the class library?

Jeff Douglass commented 8th November 2021

I believe that the code is editing the filter for one of the Service’s elements so it only shows table entries that are associated with this particular service and after editing the filter it saves the changes (service.SaveService()) which results in the service’s xml getting saved to disk which then triggers the information event getting logged if I understand it correctly. I would have the get the Skyline engineer who wrote the code to provide sample of the code.

Jeff Douglass commented 8th November 2021

And yes it is all triggered from QAction

Show 1 more comments
Please login to be able to comment or post an answer.

My DevOps rank

DevOps Members get more insights on their profile page.

My user earnings

0 Dojo credits

Spend your credits in our swag shop.

0 Reputation points

Boost your reputation, climb the leaderboard.

Promo banner DataMiner DevOps Professiona Program
DataMiner Integration Studio (DIS)
Empower Katas
Privacy Policy • Terms & Conditions • Contact

© 2025 Skyline Communications. All rights reserved.

DOJO Q&A widget

Can't find what you need?

? Explore the Q&A DataMiner Docs