LDIO Kafka Out

Ldio:KafkaOut

The LDIO Kafka Out sends messages to a kafka topic. Two security protocols are supported:

Config

Property Description Required Default Example Supported values
bootstrap-servers Comma separated list of uris of the bootstrap servers Yes N/A localhost:9012 url
topic Name of the topic Yes N/A quickstart-events String
key-property-path Optional property path to extract the kafka key from the data model No null http://purl.org/dc/terms/title ARQ property path
security-protocol Security protocol to be used to connect to the kafka broker No NO_AUTH SASL_SSL_PLAIN SASL_SSL_PLAIN or NO_AUTH
sasl-jaas-user Username used in the security protocol No null client String
sasl-jaas-password Password used in the security protocol No null secret String
frame-type RDF type of the objects that need to be included for JSON-LD framing. No N/A http://purl.org/goodrelations/v1#Offering Any RDF type

RDF Writer Properties

Property Description Required Default Supported values Example
rdf-writer.content-type Target content type. No text/turtle Any type supported by Apache Jena application/ld+json
rdf-writer.frame Additional JSON-LD Frame to format the outputted JSON-LD Object. No N/A Any valid JSON Object that describes a JSON-LD Frame See https://www.w3.org/TR/json-ld11-framing/#sample-library-frame
Example RDF Writer config

Format as N-Quads:

      config:
        rdf-writer:
          content-type: application/n-quads

Format as JSON-LD with given frame:

      config:
        rdf-writer:
          content-type: application/ld+json
          frame: |
            {
              "@context": {"@vocab": "http://example.org/"},
              "@type": "Library",
              "contains": {
                "@type": "Book",
                "contains": {
                  "@type": "Chapter"
                }
              }
            }

Example

NO SECURITY

outputs:
  - name: Ldio:KafkaOut
    config:
      bootstrap-servers: localhost:9092
      topic: quickstart-events
      key-property-path: <https://purl.org/geojson/vocab#properties>/<http://purl.org/dc/terms/title>

SASL SSL PLAIN

outputs:
  - name: Ldio:KafkaOut
    config:
      bootstrap-servers: localhost:9092
      topic: quickstart-events
      key-property-path: <https://purl.org/geojson/vocab#properties>/<http://purl.org/dc/terms/title>
      security-protocol: SASL_SSL_PLAIN
      sasl-jaas-user: client
      sasl-jaas-password: client-secret