Hi Dojo,
There have been cases where the System Cache folder gets flooded with lots of files while offloading to the DB(MySQL) and this causes the DMA to not start up. Why does this happen and what can we do to ensure this does not occur ? Thanks in advance.
The systemcache/local folder is used as a temporary offload of all the elementdata queries before we push them into MySQL (it's faster to push a bulk of data than to open a connection for one query). For elementdata this means the files will contain all changes of saved parameters for every protocol of every active element of that DMA
Having a large folder usually means you're encountering one of the following issues:
- There was a brief period the files couldn't be put into MySQL (make sure there is no connection drop in MySQL) (usually indicated by files older than 5 min).
- You have too much activity on the saved parameters (double-check the drivers to see if all the saved parameters should be saved.
- You might have tables that are too large (each cell is one row in the DB, and thus one line in the file; if you have tables with +100k rows you should consider using a loggertable).
When a DMA starts up it will first check if there are still files present in the system cache folder and offload these first. When there are a lot of files present this will indeed hinder the DMA from starting up (stuck at 99%) until all files are offloaded.
To speed this up you could copy these files from the offload folder so it’s empty again and then put them back once the DMA is started up so it will continue offloading to DB.
Hi Arunkrishna,
Offloading towards files (instead of DB) happens when DataMiner is unable to communicate with the DB. You will need to find out why your MySQL database was unreachable according to DataMiner. You should be able to find more information on this in the SLDBConnection log file.
As you have a MySQL DB I would also have a look into your data folder. We already seen in the past that when the ibdata1 file is starting to grow over a couple of GB and that this file could be the cause of large delays on your queries and therefor the cause of MySQL not responding in time to DataMiner. We have normally a scheduled task to do some DB maintenance (Skyline DataMiner Database Optimization) one of the things this task does is to reduce the size of that file when possible.
Hope this helps you further.
Actually MySQL will always offload to files before they are inserted into the DB, this to make use of ‘bulk’ offload instead of opening a connection for every query.
Thank you Michiel.
Thank you Jelle.