Skip to content
DataMiner DoJo

More results...

Generic selectors
Exact matches only
Search in title
Search in content
Post Type Selectors
Search in posts
Search in pages
Search in posts
Search in pages
Log in
Menu
  • Blog
  • Questions
  • Learning
    • E-learning Courses
    • Open Classroom Training
    • Certification
      • DataMiner Fundamentals
      • DataMiner Configurator
      • DataMiner Automation
      • Scripts & Connectors Developer: HTTP Basics
      • Scripts & Connectors Developer: SNMP Basics
      • Visual Overview – Level 1
      • Verify a certificate
    • Tutorials
    • Video Library
    • Books We Like
    • >> Go to DataMiner Docs
  • Expert Center
    • Solutions & Use Cases
      • Solutions
      • Use Case Library
    • Markets & Industries
      • Media production
      • Government & defense
      • Content distribution
      • Service providers
      • Partners
      • OSS/BSS
    • DataMiner Insights
      • Security
      • Integration Studio
      • System Architecture
      • DataMiner Releases & Updates
      • DataMiner Apps
    • Agile
      • Agile Webspace
      • Everything Agile
        • The Agile Manifesto
        • Best Practices
        • Retro Recipes
      • Methodologies
        • The Scrum Framework
        • Kanban
        • Extreme Programming
      • Roles
        • The Product Owner
        • The Agile Coach
        • The Quality & UX Coach (QX)
    • DataMiner DevOps Professional Program
  • Downloads
  • More
    • Feature Suggestions
    • Climb the leaderboard!
    • Swag Shop
    • Contact
      • General Inquiries
      • DataMiner DevOps Support
      • Commercial Requests
    • Global Feedback Survey
  • PARTNERS
    • All Partners
    • Technology Partners
    • Strategic Partner Program
    • Deal Registration
  • >> Go to dataminer.services

Why does SLDataGateway.exe take all the virtual Memory

Solved1.60K views18th July 2023DMA memory management SLDataGateway
1
Alasdair Smith 12th October 2021 0 Comments

Does anyone have some good steps for diagnosing SLDataGateway.exe taking all Virtual Memory and Crashing the DMA?

Please see some interesting log file entries from just before DMA crashing:

Windows successfully diagnosed a low virtual memory condition. The following programs consumed the most virtual memory: SLDataGateway.exe (5944) consumed 46393978880 bytes, prunsrv.exe (1296) consumed 7146168320 bytes, and SLElement.exe (6652) consumed 1616957440 bytes.

Windows successfully diagnosed a low virtual memory condition. The following programs consumed the most virtual memory: SLDataGateway.exe (5792) consumed 40352841728 bytes, prunsrv.exe (1224) consumed 7361466368 bytes, and SLNet.exe (2652) consumed 2814517248 bytes.

Thank you for looking.

Marieke Goethals [SLC] [DevOps Catalyst] Selected answer as best 18th July 2023

3 Answers

  • Active
  • Voted
  • Newest
  • Oldest
0
Alexander Gorbunov [SLC] [DevOps Advocate]978 Posted 4th November 2022 0 Comments

As I stumbled upon this question a year later, I'd like to update this question with our later findings. Perhaps it can still be relevant to some users.

Two causes of high memory usage were found:

  1. Setting large volume of trending data via History Sets (iDirect Platform in History Polling mode).
    History sets and related calculations are more resource intensive than regular trending. That causes build-up of queues in SLDataGateway.
    This has been resolved by the feature NewAverageTrending, available in DataMiner 10.2.0 and newer.
  2. Replaying large volumes of data from the Offload file.
    When a database is unavailable for some time, the new data is being written to a temporary file in C:\Skyline DataMiner\Offload\. When the connection to the database is restored, the data is pushed from the offload file to the database (so-called replay). This operation can be quite resource intensive and cause the build-up of queues in SLDataGateway.
    The best practice would be to avoid database outages and monitor the health of the database, e.g., with the protocol Apache Cassandra Cluster Monitor.
Marieke Goethals [SLC] [DevOps Catalyst] Selected answer as best 18th July 2023
0
Alexander Gorbunov [SLC] [DevOps Advocate]978 Posted 14th October 2021 0 Comments

Hi Alasdair, here are some checks you can perform to narrow down an SLDataGateway memory issue:

  1. Check VM Size trending of SLDataGateway in a Microsoft Platform element that monitors your agent. Does SLDataGateway memory usage change over time? Are there sudden spikes or leak patterns? Are they reoccurring on a month-to-date timespan?
  2. Compare SLDataGateway VM Size trending with Commit Charge Total  or Free Virtual Memory trending on the same agent. There may be other processes consuming the memory, and SLDataGateway may be not the culprit.
  3. Note the starting points of leaks. Check the SLWatchdog2.txt log around the start time of the issue. Pay attention to lines like "Process * stopped" or "Not signaled 1 (since *)".
  4. If possible, check if any configuration changes were made in DataMiner around the time the issue occurred for the first time.
  5. If available, check the SLDataGateway.txt and SLDBConnection.txt logs around the time the issue started, pay attention to lines like
    "Queue for * exceeded *000 items".

These checks may help you collect some initial facts required for the investigation.

Alexander Gorbunov [SLC] [DevOps Advocate] Answered question 14th October 2021
0
Alexander Verriest [SLC] [DevOps Advocate]424 Posted 13th October 2021 0 Comments

I would check the SLDBConnection log file to get an idea of what is happening in the SLDataGateway process around that time.

Also note you can increase/decrease the log level in System Center - Logging - DataMiner if you need to change the detail of the logs.

Alexander Verriest [SLC] [DevOps Advocate] Answered question 13th October 2021
Please login to be able to comment or post an answer.

My DevOps rank

DevOps Members get more insights on their profile page.

My user earnings

0 Dojo credits

Spend your credits in our swag shop.

0 Reputation points

Boost your reputation, climb the leaderboard.

Promo banner DataMiner DevOps Professiona Program
DataMiner Integration Studio (DIS)
Empower Katas

Recent questions

Alarm Dashboard PDF/CSV Export 1 Answer | 0 Votes
Is the Microsoft SharePoint Connector Still Usable 0 Answers | 0 Votes
Is the Microsoft SharePoint Connector Still Usable 0 Answers | 0 Votes

Question Tags

adl2099 (115) alarm (62) Alarm Console (82) alarms (100) alarm template (83) Automation (223) automation scipt (111) Automation script (167) backup (71) Cassandra (180) Connector (108) Correlation (68) Cube (150) Dashboard (194) Dashboards (188) database (83) DataMiner Cube (57) DIS (81) DMS (71) DOM (139) driver (65) DVE (55) Elastic (83) Elasticsearch (115) elements (80) Failover (104) GQI (159) HTTP (76) IDP (74) LCA (151) low code app (166) low code apps (93) lowcodeapps (75) MySQL (53) protocol (203) QAction (83) security (88) services (51) SNMP (86) SRM (337) table (54) trending (87) upgrade (62) Visio (539) Visual Overview (345)
Privacy Policy • Terms & Conditions • Contact

© 2025 Skyline Communications. All rights reserved.

DOJO Q&A widget

Can't find what you need?

? Explore the Q&A DataMiner Docs

[ Placeholder content for popup link ] WordPress Download Manager - Best Download Management Plugin