Frank Greguska created SDAP-17:
----------------------------------

             Summary: Redesign Ingestion to be Batch Focused
                 Key: SDAP-17
                 URL: https://issues.apache.org/jira/browse/SDAP-17
             Project: Apache Science Data Analytics Platform
          Issue Type: Improvement
            Reporter: Frank Greguska


Currently, NEXUS ingestion is based on a streaming model. In reality, new data 
for NEXUS appears as files, usually in regular intervals. Therefore, it makes 
more sense to ingest new data into NEXUS as batches instead of an always-on 
stream. This will also reduce the cost of the NEXUS ingestion system.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to