[
https://issues.apache.org/jira/browse/SDAP-17?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16344349#comment-16344349
]
ASF GitHub Bot commented on SDAP-17:
------------------------------------
fgreg opened a new pull request #2: SDAP-17: Required library for ningester
URL: https://github.com/apache/incubator-sdap-nexusproto/pull/2
This addresses SDAP-17
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
> Redesign Ingestion to be Batch Focused
> --------------------------------------
>
> Key: SDAP-17
> URL: https://issues.apache.org/jira/browse/SDAP-17
> Project: Apache Science Data Analytics Platform
> Issue Type: Improvement
> Components: nexus
> Reporter: Frank Greguska
> Assignee: Frank Greguska
> Priority: Major
>
> Currently, NEXUS ingestion is based on a streaming model. In reality, new
> data for NEXUS appears as files, usually in regular intervals. Therefore, it
> makes more sense to ingest new data into NEXUS as batches instead of an
> always-on stream. This will also reduce the cost of the NEXUS ingestion
> system.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
