Skip to content
DataMiner DoJo

More results...

Generic selectors
Exact matches only
Search in title
Search in content
Post Type Selectors
Search in posts
Search in pages
Search in posts
Search in pages
Log in
Menu
  • Updates & Insights
  • Questions
  • Learning
    • E-learning Courses
    • Empower Replay: Limited Edition
    • Tutorials
    • Open Classroom Training
    • Certification
      • DataMiner Fundamentals
      • DataMiner Configurator
      • DataMiner Automation
      • Scripts & Connectors Developer: HTTP Basics
      • Scripts & Connectors Developer: SNMP Basics
      • Visual Overview – Level 1
      • Verify a certificate
    • Video Library
    • Books We Like
    • >> Go to DataMiner Docs
  • Expert Center
    • Solutions & Use Cases
      • Solutions
      • Use Case Library
    • Markets & Industries
      • Media production
      • Government & defense
      • Content distribution
      • Service providers
      • Partners
      • OSS/BSS
    • Agile
      • Agile Webspace
      • Everything Agile
        • The Agile Manifesto
        • Best Practices
        • Retro Recipes
      • Methodologies
        • The Scrum Framework
        • Kanban
        • Extreme Programming
      • Roles
        • The Product Owner
        • The Agile Coach
        • The Quality & UX Coach (QX)
    • DataMiner DevOps Professional Program
      • About the DevOps Program
      • DataMiner DevOps Support
  • Downloads
  • More
    • DataMiner Releases & Updates
    • Feature Suggestions
    • Climb the leaderboard!
    • Swag Shop
    • Contact
    • Global Feedback Survey
  • PARTNERS
    • All Partners
    • Technology Partners
    • Strategic Partner Program
    • Deal Registration
  • >> Go to dataminer.services

Offloading to DB

Solved1.17K views1st February 2021
4
Arunkrishna Shreeder [SLC] [DevOps Advocate]4.02K 1st February 2021 0 Comments

Hi Dojo,

There have been cases where the System Cache folder gets flooded with lots of files while offloading to the DB(MySQL) and this causes the DMA to not start up. Why does this happen and what can we do to ensure this does not occur ? Thanks in advance.

Arunkrishna Shreeder [SLC] [DevOps Advocate] Selected answer as best 1st February 2021

2 Answers

  • Active
  • Voted
  • Newest
  • Oldest
6
Jelle Hoorne [SLC] [DevOps Member]197 Posted 1st February 2021 1 Comment

The systemcache/local folder is used as a temporary offload of all the elementdata queries before we push them into MySQL (it's faster to push a bulk of data than to open a connection for one query). For elementdata this means the files will contain all changes of saved parameters for every protocol of every active element of that DMA

Having a large folder usually means you're encountering one of the following issues:

  1. There was a brief period the files couldn't be put into MySQL (make sure there is no connection drop in MySQL) (usually indicated by files older than 5 min).
  2. You have too much activity on the saved parameters (double-check the drivers to see if all the saved parameters should be saved.
  3. You might have tables that are too large (each cell is one row in the DB, and thus one line in the file; if you have tables with +100k rows you should consider using a loggertable).

When a DMA starts up it will first check if there are still files present in the system cache folder and offload these first. When there are a lot of files present this will indeed hinder the DMA from starting up (stuck at 99%) until all files are offloaded.

To speed this up you could copy these files from the offload folder so it’s empty again and then put them back once the DMA is started up so it will continue offloading to DB.

Jelle Hoorne [SLC] [DevOps Member] Edited answer 1st February 2021
Arunkrishna Shreeder [SLC] [DevOps Advocate] commented 1st February 2021

Thank you Jelle.

You are viewing 1 out of 2 answers, click here to view all answers.
Please login to be able to comment or post an answer.

My DevOps rank

DevOps Members get more insights on their profile page.

My user earnings

0 Dojo credits

Spend your credits in our swag shop.

0 Reputation points

Boost your reputation, climb the leaderboard.

Promo banner DataMiner DevOps Professiona Program
DataMiner Integration Studio (DIS)
Empower Katas
Privacy Policy • Terms & Conditions • Contact

© 2025 Skyline Communications. All rights reserved.

DOJO Q&A widget

Can't find what you need?

? Explore the Q&A DataMiner Docs

[ Placeholder content for popup link ] WordPress Download Manager - Best Download Management Plugin