Hi Dojo,
We're looking for a clarification and possibly an example of a working configuration
for a Kafka Producer element.
While configuring the element, the wizard requests also an SNMP interface: what is this used for?
The protocol help says it is the "device" IP - so should we point this to the Kafka Broker?
(Disregard the local host in this sample below)
Does it need to be a separate connection from the one defined as the Kafka Broker address below?
In our test environment, the DMA is able to TNC to the broker port:
However the initial connection at element level is failing:
We are suspecting some additional topic may have to be defined on the broker, for the DMA to publish on it, any steer would be helpful.
Also, what's the function of the generic SNMP forwarder on the DMA in this config?
Shall we define a dedicated forwarder on the DMA towards the broker as well?
Thanks for your support
Hi Alberto!
The Kafka Producer works along with the SNMP forwarding module as a trap receiver to format the DataMiner alarm traps into JSON and insert them to a Kafka broker.
The configuration I used in the past was to manage everything locally to distribute the load, which means 1 Kafka Producer element per DMA, so the SNMP connection in the element will have the 127.0.0.1 IP, but I suspect it doesn’t interfere with any functionality, it’s just a mandatory field we need to fill (probably the documentation needs to be adjusted for that).
Regarding the TNC test to the Broker, I had the same issue where from PowerShell it said “true” but from the element, the connection failed.
I our case we found that a firewall was blocking Cofluent at application level, once it was permitted, the connection was stablished successfully.
SNMP forwarding configuration: As I stated before, it’s necessary to configure it to forward the alarms to the DMA that will connect to the Kafka Broker, in our example it uses localhost to manage its own alarms:
It’s important to configure the alarms to be sent, because when DataMiner receives the traps, it doesn’t forward all information to the Kafka Broker: Generic KAFKA Producer | DataMiner Docs
And of course, in the More configurations section, the Custom Bindings OID needs to match with the one in the SNMP forwarding module:
Hope it helps!