genegraph.sink.stream

client-properties

consumer-record-to-clj

(consumer-record-to-clj consumer-record)

consumer-thread

current-offsets

document-name

(document-name doc-def model)

end-offsets

import-record!

(import-record! record)

load-local-data

(load-local-data dir)
Treat all files stored in dir as loadable data in json-ld form, load them
into base datastore

long-poll

(long-poll c)

offset-file

read-end-offsets!

(read-end-offsets! consumer topic-partitions)

read-offsets!

(read-offsets!)

run-consumer

subscribe!

(subscribe! topic-list)
Start a Kafka consumer listening to topics in topic-list
Messages are transformed to RDF, if needed, and imported into triplestore

topic-data

(topic-data topic)

topic-handlers

topic-to-disk

(topic-to-disk topic folder)

up-to-date?

(up-to-date?)
Returns true if all partitions of all topics subscribed to have had messages
consumed up to the latest offset when the consumer was started.

update-offsets!

(update-offsets! consumer tps)