>From Peeyush Gupta <[email protected]>: Peeyush Gupta has submitted this change. ( https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/19984 )
Change subject: [NO ISSUE][EXT] Query fails on GCS external delta table ...................................................................... [NO ISSUE][EXT] Query fails on GCS external delta table - user model changes: no - storage format changes: no - interface changes: no Ext-ref: MB-67321 Change-Id: Ibd700a0c4e740139630869d98ce7cf52389ea5cf Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/19984 Integration-Tests: Jenkins <[email protected]> Reviewed-by: Hussain Towaileb <[email protected]> Reviewed-by: Peeyush Gupta <[email protected]> Tested-by: Jenkins <[email protected]> --- M asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/input/record/reader/aws/delta/DeltaReaderFactory.java 1 file changed, 20 insertions(+), 1 deletion(-) Approvals: Hussain Towaileb: Looks good to me, approved Peeyush Gupta: Looks good to me, but someone else must approve Jenkins: Verified; Verified Anon. E. Moose #1000171: diff --git a/asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/input/record/reader/aws/delta/DeltaReaderFactory.java b/asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/input/record/reader/aws/delta/DeltaReaderFactory.java index 10a527e..8328ec3 100644 --- a/asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/input/record/reader/aws/delta/DeltaReaderFactory.java +++ b/asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/input/record/reader/aws/delta/DeltaReaderFactory.java @@ -100,6 +100,7 @@ throws AlgebricksException, HyracksDataException { JobConf conf = new JobConf(); ICcApplicationContext appCtx = (ICcApplicationContext) serviceCtx.getApplicationContext(); + locationConstraints = getPartitions(appCtx); configureJobConf(appCtx, conf, configuration); confFactory = new ConfFactory(conf); String tableMetadataPath = getTablePath(configuration); @@ -156,7 +157,6 @@ scanFiles = getScanFiles(scan, engine); } LOGGER.info("Number of delta table parquet data files to scan: {}", scanFiles.size()); - locationConstraints = getPartitions(appCtx); configuration.put(ExternalDataConstants.KEY_PARSER, ExternalDataConstants.FORMAT_DELTA); distributeFiles(scanFiles, getPartitionConstraint().getLocations().length); issueWarnings(warnings, warningCollector); -- To view, visit https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/19984 To unsubscribe, or for help writing mail filters, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-Project: asterixdb Gerrit-Branch: ionic Gerrit-Change-Id: Ibd700a0c4e740139630869d98ce7cf52389ea5cf Gerrit-Change-Number: 19984 Gerrit-PatchSet: 4 Gerrit-Owner: Peeyush Gupta <[email protected]> Gerrit-Reviewer: Ali Alsuliman <[email protected]> Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Hussain Towaileb <[email protected]> Gerrit-Reviewer: Jenkins <[email protected]> Gerrit-Reviewer: Michael Blow <[email protected]> Gerrit-Reviewer: Peeyush Gupta <[email protected]> Gerrit-MessageType: merged
