Skip to content
DataMiner DoJo

More results...

Generic selectors
Exact matches only
Search in title
Search in content
Post Type Selectors
Search in posts
Search in pages
Search in posts
Search in pages
Log in
Menu
  • Blog
  • Questions
  • Learning
    • E-learning Courses
    • Open Classroom Training
    • Certification
      • DataMiner Fundamentals
      • DataMiner Configurator
      • DataMiner Automation
      • Scripts & Connectors Developer: HTTP Basics
      • Scripts & Connectors Developer: SNMP Basics
      • Visual Overview – Level 1
      • Verify a certificate
    • Tutorials
    • Video Library
    • Books We Like
    • >> Go to DataMiner Docs
  • Expert Center
    • Solutions & Use Cases
      • Solutions
      • Use Case Library
    • Markets & Industries
      • Media production
      • Government & defense
      • Content distribution
      • Service providers
      • Partners
      • OSS/BSS
    • DataMiner Insights
      • Security
      • Integration Studio
      • System Architecture
      • DataMiner Releases & Updates
      • DataMiner Apps
    • Agile
      • Agile Webspace
      • Everything Agile
        • The Agile Manifesto
        • Best Practices
        • Retro Recipes
      • Methodologies
        • The Scrum Framework
        • Kanban
        • Extreme Programming
      • Roles
        • The Product Owner
        • The Agile Coach
        • The Quality & UX Coach (QX)
    • DataMiner DevOps Professional Program
  • Downloads
  • More
    • Feature Suggestions
    • Climb the leaderboard!
    • Swag Shop
    • Contact
      • General Inquiries
      • DataMiner DevOps Support
      • Commercial Requests
    • Global Feedback Survey
  • PARTNERS
    • All Partners
    • Technology Partners
    • Strategic Partner Program
    • Deal Registration
  • >> Go to dataminer.services

Offload Database DMS resource consumption

Solved978 views27th February 2023offload database Offload MySQL Offload performance SLDataGateway
4
Elvio Mendes398 6th February 2023 2 Comments

Hi Dojo - We have enabled data offload to MySQL and, right after that, the memory usage and CPU of the DMAs started increasing too much, generally across the system but mainly the SLDataGateway. Is this an expected behaviour?

In addition, what's the most optimum configuration for data offload frequency (5 mins by default)?

We have also seen data being offload from months before the offload activation time. Is this expected?

Zain Akhtar [SLC] [DevOps Member] Selected answer as best 27th February 2023
Simon Raine [SLC] [DevOps Advocate] commented 7th February 2023

Hi Elvio. What proportion increase are you seeing and for how long?

Elvio Mendes commented 7th February 2023

Hi Simon
With dataminer 10.2.10 the SLDataGateway CPU increased by 3 times, and the Memory usage from 1 GB to 10GB and was still increasing until a restart was performed and stabilized after I disabled the data snapshot option, Dataavg, and also to only export when data changes for optimization.
It is more evident on the SLDataGateway process where we can see a data leak, however, other processes increased as well since the overall memory consumption increased substantially

1 Answer

  • Active
  • Voted
  • Newest
  • Oldest
4
Jeremiah Allen [SLC] [DevOps Advocate]704 Posted 8th February 2023 0 Comments

Hey Elvio,

How is SLDataGateway behaving after the restart and modifying the offload configuration? SLDataGateway was likely strained due to the amount of data being offloaded.

How much data is being offloaded is heavily influenced by:

  • Exporting values even if they don't change. For real-time data this is the "All parameter values" setting. For average data this is controlled with the "oldstyle" setting in DB.xml. These settings may also trigger data backfilling.
  • Trend templates. By default offloading is enabled for every parameter in trend templates. So if the parameter has trending enabled (real-time or avg.) it will be offloaded.

You should fine-tune your trend templates to exclude unneeded parameters from offload. Offloading can also be disabled at an element level.

Hope this helps.

Zain Akhtar [SLC] [DevOps Member] Selected answer as best 27th February 2023
Please login to be able to comment or post an answer.

My DevOps rank

DevOps Members get more insights on their profile page.

My user earnings

0 Dojo credits

Spend your credits in our swag shop.

0 Reputation points

Boost your reputation, climb the leaderboard.

Promo banner DataMiner DevOps Professiona Program
DataMiner Integration Studio (DIS)
Empower Katas

Recent questions

Web Applications exception in Cube due to invalid certificate 0 Answers | 0 Votes
Redundancy Groups and Alarming – Duplicate Alarms 0 Answers | 0 Votes
Correlation Engine: “Test rule” doesn’t result in a hit, despite functional rule 1 Answer | 3 Votes

Question Tags

adl2099 (115) alarm (62) Alarm Console (82) alarms (100) alarm template (83) Automation (223) automation scipt (111) Automation script (167) backup (71) Cassandra (180) Connector (109) Correlation (69) Correlation rule (52) Cube (151) Dashboard (194) Dashboards (188) database (83) DataMiner Cube (57) DIS (81) DMS (71) DOM (140) driver (65) DVE (56) Elastic (83) Elasticsearch (115) elements (80) Failover (104) GQI (159) HTTP (76) IDP (74) LCA (152) low code app (166) low code apps (93) lowcodeapps (75) MySQL (53) protocol (203) QAction (83) security (88) SNMP (86) SRM (337) table (54) trending (87) upgrade (62) Visio (539) Visual Overview (345)
Privacy Policy • Terms & Conditions • Contact

© 2025 Skyline Communications. All rights reserved.

DOJO Q&A widget

Can't find what you need?

? Explore the Q&A DataMiner Docs

[ Placeholder content for popup link ] WordPress Download Manager - Best Download Management Plugin