[
https://issues.apache.org/jira/browse/SDAP-17?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Frank Greguska updated SDAP-17:
-------------------------------
Resolution: Fixed
Status: Done (was: To Do)
Implementation of version 1.0.0-SNAPSHOT is complete. Will continue testing and
moving towards a release candidate; but for now this task can be considered
complete.
> Redesign Ingestion to be Batch Focused
> --------------------------------------
>
> Key: SDAP-17
> URL: https://issues.apache.org/jira/browse/SDAP-17
> Project: Apache Science Data Analytics Platform
> Issue Type: Improvement
> Components: nexus
> Reporter: Frank Greguska
> Assignee: Frank Greguska
> Priority: Major
>
> Currently, NEXUS ingestion is based on a streaming model. In reality, new
> data for NEXUS appears as files, usually in regular intervals. Therefore, it
> makes more sense to ingest new data into NEXUS as batches instead of an
> always-on stream. This will also reduce the cost of the NEXUS ingestion
> system.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)