Hello Anon. E. Moose (1000171), Jenkins,
I'd like you to reexamine a change. Please visit
https://asterix-gerrit.ics.uci.edu/3423
to look at the new patch set (#3).
Change subject: [WIP] Reporting failed ingestion records
......................................................................
[WIP] Reporting failed ingestion records
- user model changes: yes
- user can use a function to read the logs containing
the failed-to-be-parsed data.
- storage format changes: no
- interface changes: no
Details:
- Dataflow controllers are now partition-aware.
- Dataflow controllers now handle the failure logging.
- Parsers can report string metadata record for the
purpose of logging.
- Failure parsing logs are stored per partition.
- Introduced a datasource function to read the parsing
failure logged data.
Change-Id: Ic3fcc6b771b4393542988cd0aa6fd992ccb81028
---
A
asterixdb/asterix-app/src/main/java/org/apache/asterix/app/function/FailedIngestionReporterDatasource.java
A
asterixdb/asterix-app/src/main/java/org/apache/asterix/app/function/FailedIngestionReporterFunction.java
A
asterixdb/asterix-app/src/main/java/org/apache/asterix/app/function/FailedIngestionReporterReader.java
A
asterixdb/asterix-app/src/main/java/org/apache/asterix/app/function/FailedIngestionReporterRewriter.java
M
asterixdb/asterix-app/src/main/java/org/apache/asterix/util/MetadataBuiltinFunctions.java
M
asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/api/IDataParser.java
M
asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/dataflow/AbstractFeedDataFlowController.java
M
asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/dataflow/ChangeFeedDataFlowController.java
M
asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/dataflow/ChangeFeedWithMetaDataFlowController.java
M
asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/dataflow/FeedRecordDataFlowController.java
M
asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/dataflow/FeedStreamDataFlowController.java
M
asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/dataflow/FeedWithMetaDataFlowController.java
M
asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/input/record/RecordWithMetadataAndPK.java
M
asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/provider/DataflowControllerProvider.java
M
asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/util/FeedLogManager.java
M
asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/util/FeedUtils.java
M
asterixdb/asterix-external-data/src/test/java/org/apache/asterix/external/library/adapter/TestTypedAdapter.java
M
asterixdb/asterix-external-data/src/test/java/org/apache/asterix/external/library/adapter/TestTypedFeedDataFlowController.java
18 files changed, 358 insertions(+), 31 deletions(-)
git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb
refs/changes/23/3423/3
--
To view, visit https://asterix-gerrit.ics.uci.edu/3423
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: Ic3fcc6b771b4393542988cd0aa6fd992ccb81028
Gerrit-Change-Number: 3423
Gerrit-PatchSet: 3
Gerrit-Owner: Hussain Towaileb <[email protected]>
Gerrit-Reviewer: Anon. E. Moose (1000171)
Gerrit-Reviewer: Jenkins <[email protected]>
