Hi Dojo,
Is it possible that I can use Keyspaces in Amazon for Dataminer offload DB.
Keyspaces is designed for Cassandra workloads.
Or
Can I integrate Dataminer with AWS RDS?
Please suggest
Hi,
A task has been created for one of our teams to investigate the AWS RDS. We'll keep you posted about our outcome of this investigation.
Kind regards
Hi,
We’re currently validating Amazon Opensearch for Elastic and the Amazon Keyspaces for Cassandra.
We’ll then also investigate AWS RDS.
None of the systems have been fully tested at this moment (setup, migration, qa tests,….) but we’re working hard on those to have these available for your.
Please keep an eye on the dojo pages as we’ll create a newspost once these items have been added.
Kind regards,
Thibalt
Thanks @Thibault Heylen for the update. Really appreciate it
Hi,
Currently, it's not yet possible to connect DataMiner directly to AWS Keyspaces.
There are some changes planned to add support for AWS Keyspaces.
These enhancements will allow AWS Keyspaces to be used as a central database cluster (used by DataMiner itself), but this will not function as an offload database.
I don't know if DataMiner works with AWS RDS.
I'm curious about this one - subscribing - till now I've always considered fully separate use cases and differentiated between what would be a local DB and any other "offload" applications.
So, not really an answer from me, I'm afraid - just "broadcast" questions,
from one to many 🙂 ... although rather "DB" related: if the DataMiner offload option currently supports just MySQL/SQL/Oracle, what is the envisaged usage for AWS KeySpaces in an offload scenario?
Aren't Cassandra/Elastic just for local DBs?
Or... Is there any NoSQL-to-NoSQL scenario also available?
What I mean is: can the DataMiner DLL write to the expected offload DB type, regardless of the DB location (on-premise/cloud) or is there any additional requirement for "non on-premise" environments? (E.g. latency... ?)
I know that cloud native can bring in some unexpected behaviour, but as long as a connection string is available, does it actually matter if the offload DB is hosted in AWS? After all the offload DB solution is for a DB that isn't local to the agent.
This might need a separate post, but sharing here as it's the original question that inspired 🙂 actually, interested in any previous testing with any cloud provider
(AWS, GCP, Azure) for the classic offload types on SQL/MySQL/Oracle.
I've used the DataMiner Help section for the above scenarios - just added the "cloud" in purple (funny how we spend years learning visio, and then I find myself still stuck with MSpaint when it comes to quickly jotting down stuff 🙂 )
Alberto, you’re right. What we call ‘local’ or ‘offload’ databases can be hosted everywhere as long as there is connectivity towards the database system. The local database is where DataMiner (1) relies on the function and (2) does maintenance on (e.g. cleaning old records). The offload database is from a dataminer perspective ‘fire and forget’. I haven’t found records internally that verified the ‘offload-cloud-option’, but there is no reason I can think of this wouldn’t work. As you said, interesting topic.
Cool – thanks for feedback, Jan – much appreciated
Indeed with the whole focus on Cassandra (& ElasticSearch) clusters architecture, even the “local” DB isn’t “strictly” local anymore – need to revise how I refer to the different components
Hi @Thibault Heylen Thank you for sharing the info Then whats the best way that I can integrate Dataminer with AWS.