Frank Greguska created SDAP-17:
----------------------------------
Summary: Redesign Ingestion to be Batch Focused
Key: SDAP-17
URL: https://issues.apache.org/jira/browse/SDAP-17
Project: Apache Science Data Analytics Platform
Issue Type: Improvement
Reporter: Frank Greguska
Currently, NEXUS ingestion is based on a streaming model. In reality, new data
for NEXUS appears as files, usually in regular intervals. Therefore, it makes
more sense to ingest new data into NEXUS as batches instead of an always-on
stream. This will also reduce the cost of the NEXUS ingestion system.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)