Github user vakshorton commented on the issue:

    https://github.com/apache/nifi/pull/2181
  
    @mattyb149 As Druid is optimized for OLAP it does not work as an OLTP 
datastore, The REST API of Druid is for querying and obtaining meta data (like 
segment schema and time interval), it does not support writes. That is mainly 
because writes in Druid can only happen after a configured quantity of data 
(Segment Granularity Spec) has been indexed and organized into a storage 
segment (schema, bitmap index, aggregate metrics, compression). Only an 
Indexing job can create a segment (either batch or realtime). Realtime indexing 
jobs can be created in one of two ways. 1.) Pull via a Firehose (Druid Aware 
Pull API) created to read the stream source, controlled by a Druid Realtime 
Node (like the Kafka Indexing Service). 2.) Push via Tranquility (Druid 
Indexing API) from stream source to Druid Overlord and then MiddleManager Nodes 
that will make the data immediately queryable while indexing it for storage as 
a segment. Since the goal is to push data from Nifi into Druid, Tranquility 
seems 
 like the best option.


---

Reply via email to