Does Skyline already have a Kafka integration in a form of a driver or as a module part of the core software?
If not, are there any expectations in terms of a roadmap to allow the users to import/export data from/to Kafka?
Kafka is not part of the core software at this moment. I have created a driver that consumes messages from a Kafka queue. This is part of a larger project that also processes the message, but you could extract that consumer part from the project. There is no need to use dlls for this, the Apache commands are fairly easy by simply sending commands and receiving responses this can be implemented in a serial driver which benefits from the standard DataMiner functionality such as the possibility to see the communication in the StreamViewer, have automatic timeout and we have full control over the content that is being sent. If a dll is used then you'll lose all that functionality. A very interesting link that explains the Kafka command and response structure can be found here https://cwiki.apache.org/confluence/display/KAFKA/A+Guide+To+The+Kafka+Protocol
Was this later addressed with the integrations in this thread?
https://community.dataminer.services/question/kafka-producer-and-consumer-connectors/?hilite=kafka
I had a circumstance in which I was asked if we were able to send data northbound to a Kafka cluster.
As far as I know we don't support direct Apache Kafka data ingestion. I believe however that this is something we can perfectly achieve if the DMA servers are configured to support Apache Kafka so that the DMA can act as producer and the destination system as consumer (in a scenario in which we send our data northbound to a Kafka Cluster), by sending forwarding messages using Apache's .NET dlls in our automation engine / drivers.
Cool article about this: https://www.infoworld.com/article/3215165/how-to-use-apache-kafka-messaging-in-net.html
This seems like my use case. As a user, I want to get metrics out of DataMiner towards Kafka.
Like SNMP, REST API’s, Kafka is now becoming de-facto standard for the transportation of the telemetric data in the telco world. So it would be good to have a DataMiner driver or plugin to enable both southbound and northbound interfaces.
As mentioned in the comment of Bruno’s reply, what I’m looking in here is to get metrics out of DataMiner towards Kafka.