abdullah alamoudi has uploaded a new patch set (#2). Change subject: [ASTERIXDB-2067][ING] Handle Failures in Controller Flush ......................................................................
[ASTERIXDB-2067][ING] Handle Failures in Controller Flush - user model changes: no - storage format changes: no - interface changes: no details: - Failures that happen in feed while reading from external sources allows ingestion pipeline to close gracefully pushing parsed records in the frame forward before failing. - There was an assumption that when hasNext() or next() are being called on a data reader and we fail, then the failure didn't affect the integrity of the pipeline. - This assumption is incorrect as hasNext() and next() can themselves flush the pipeline and if the failure happened during the flush call, the pipeline must be failed. Change-Id: Ib9be729088bd94338ef2353333eaea34ba3da99f --- M asterixdb/asterix-app/src/main/java/org/apache/asterix/app/active/RecoveryTask.java M asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/dataflow/AbstractFeedDataFlowController.java M asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/dataflow/FeedRecordDataFlowController.java 3 files changed, 20 insertions(+), 2 deletions(-) git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb refs/changes/68/1968/2 -- To view, visit https://asterix-gerrit.ics.uci.edu/1968 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: newpatchset Gerrit-Change-Id: Ib9be729088bd94338ef2353333eaea34ba3da99f Gerrit-PatchSet: 2 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudi <[email protected]> Gerrit-Reviewer: Jenkins <[email protected]> Gerrit-Reviewer: Michael Blow <[email protected]>
