Skip to content
DataMiner DoJo

More results...

Generic selectors
Exact matches only
Search in title
Search in content
Post Type Selectors
Search in posts
Search in pages
Search in posts
Search in pages
Log in
Menu
  • Updates & Insights
  • Questions
  • Learning
    • E-learning Courses
    • Empower Replay: Limited Edition
    • Tutorials
    • Open Classroom Training
    • Certification
      • DataMiner Fundamentals
      • DataMiner Configurator
      • DataMiner Automation
      • Scripts & Connectors Developer: HTTP Basics
      • Scripts & Connectors Developer: SNMP Basics
      • Visual Overview – Level 1
      • Verify a certificate
    • Video Library
    • Books We Like
    • >> Go to DataMiner Docs
  • Expert Center
    • Solutions & Use Cases
      • Solutions
      • Use Case Library
    • Markets & Industries
      • Media production
      • Government & defense
      • Content distribution
      • Service providers
      • Partners
      • OSS/BSS
    • Agile
      • Agile Webspace
      • Everything Agile
        • The Agile Manifesto
        • Best Practices
        • Retro Recipes
      • Methodologies
        • The Scrum Framework
        • Kanban
        • Extreme Programming
      • Roles
        • The Product Owner
        • The Agile Coach
        • The Quality & UX Coach (QX)
    • DataMiner DevOps Professional Program
      • About the DevOps Program
      • DataMiner DevOps Support
  • Downloads
  • More
    • DataMiner Releases & Updates
    • Feature Suggestions
    • Climb the leaderboard!
    • Swag Shop
    • Contact
    • Global Feedback Survey
  • PARTNERS
    • All Partners
    • Technology Partners
    • Strategic Partner Program
    • Deal Registration
  • >> Go to dataminer.services

How is offload file limit monitored?

Solved1.72K views15th February 2024offload
0
Bing Herng Chong [SLC] [DevOps Advocate]1.06K 25th January 2024 0 Comments

Hi, it is understood that the offload file limit is 10GB by default (i.e.: when either Cassandra or Elastic is offline data is pushed to offload sqlite files in c:/Skyline DataMiner/Offload folder).

Can I ask for further clarification that this 10GB limit is enforced at the folder level? (i.e.: if the total size of the folder is 10GB, then the offload mechanism will stop storing further data in sqlite files and data-loss is expected).

This reason behind this question is to help define customer acceptance/validation testing.

Bing Herng Chong [SLC] [DevOps Advocate] Selected answer as best 15th February 2024

1 Answer

  • Active
  • Voted
  • Newest
  • Oldest
0
Dieter Degrande [SLC] [DevOps Advocate]417 Posted 25th January 2024 0 Comments

Hi Bing,

The size of 10GB is enforced on the SQLite database level, we calculate the actual amount of data stored in the database file(s) and stop writing if the configured threshold is passed. In the offload folder there are also transaction log files, these are not taken into account, it's purely the actual data in the database file(s).

To be more specific, we launch the following queries towards the sqlite database file(s) and sum the result for comparison:
SELECT page_count * page_size as size FROM pragma_page_count(), pragma_page_size();

Bing Herng Chong [SLC] [DevOps Advocate] Selected answer as best 15th February 2024
You are viewing 1 out of 1 answers, click here to view all answers.
Please login to be able to comment or post an answer.

My DevOps rank

DevOps Members get more insights on their profile page.

My user earnings

0 Dojo credits

Spend your credits in our swag shop.

0 Reputation points

Boost your reputation, climb the leaderboard.

Promo banner DataMiner DevOps Professiona Program
DataMiner Integration Studio (DIS)
Empower Katas
Privacy Policy • Terms & Conditions • Contact

© 2025 Skyline Communications. All rights reserved.

DOJO Q&A widget

Can't find what you need?

? Explore the Q&A DataMiner Docs

[ Placeholder content for popup link ] WordPress Download Manager - Best Download Management Plugin