LDIO Kafka In

Ldio:KafkaIn

The LDIO Kafka In listens to messages from a kafka topic.

Two security protocols are supported:

Config

Property Description Required Default Example Supported values
content-type Any content type supported by Apache Jena Yes N/A application/n-quads Any type supported by Apache Jena
bootstrap-servers Comma separated list of uris of the bootstrap servers Yes N/A localhost:9012 url
topics Names of the topics (comma separated) Yes N/A quickstart-events String
group-id Group identifier the consumer belongs to No generated value group-1 String
security-protocol Security protocol to be used to connect to the kafka broker No NO_AUTH SASL_SSL_PLAIN SASL_SSL_PLAIN or NO_AUTH
sasl-jaas-user Username used in the security protocol No null client String
sasl-jaas-password Password used in the security protocol No null secret String

Example

NO SECURITY

outputs:
  - name: Ldio:KafkaIn
    config:
      content-type: application/n-quads
      topics: quickstart-events
      bootstrap-servers: localhost:9092

SASL SSL PLAIN

outputs:
  - name: Ldio:KafkaIn
    config:
      content-type: application/n-quads
      topics: quickstart-events
      bootstrap-servers: localhost:9092
      group-id: testing_group
      security-protocol: SASL_SSL_PLAIN
      sasl-jaas-user: client
      sasl-jaas-password: client-secret

Pausing

When paused, this component will stop listening to the kafka topics. When resumed, it will try to resync with all topics.