genegraph.sink.stream
consumer-record-to-clj
(consumer-record-to-clj consumer-record)
document-name
(document-name doc-def model)
import-record!
(import-record! record)
load-local-data
(load-local-data dir)
Treat all files stored in dir as loadable data in json-ld form, load them
into base datastore
read-end-offsets!
(read-end-offsets! consumer topic-partitions)
read-offsets!
(read-offsets!)
subscribe!
(subscribe! topic-list)
Start a Kafka consumer listening to topics in topic-list
Messages are transformed to RDF, if needed, and imported into triplestore
topic-data
(topic-data topic)
topic-to-disk
(topic-to-disk topic folder)
up-to-date?
(up-to-date?)
Returns true if all partitions of all topics subscribed to have had messages
consumed up to the latest offset when the consumer was started.
update-offsets!
(update-offsets! consumer tps)