>From Peeyush Gupta <[email protected]>: Peeyush Gupta has uploaded a new patch set (#2). ( https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/19093 )
Change subject: [ASTERIXDB-3503][EXT] Improve logic of distributing files to partitions ...................................................................... [ASTERIXDB-3503][EXT] Improve logic of distributing files to partitions - user model changes: no - storage format changes: no - interface changes: no Details: With this patch the files to scan are distributed among different partitions such that the total size of files to read is distributed fairly among different partitions. Ext-ref: MB-63840 Change-Id: Id2c56b707f6fd5f4cb40f4576dc12ceb2e61a193 --- M asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/input/record/reader/aws/delta/AwsS3DeltaReaderFactory.java M asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/util/ExternalDataUtils.java M asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/input/record/reader/aws/delta/AsterixTypeToDeltaTypeVisitor.java A asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/input/record/reader/aws/delta/AsterixDeltaRuntimeException.java 4 files changed, 113 insertions(+), 21 deletions(-) git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb refs/changes/93/19093/2 -- To view, visit https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/19093 To unsubscribe, or for help writing mail filters, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-Project: asterixdb Gerrit-Branch: goldfish Gerrit-Change-Id: Id2c56b707f6fd5f4cb40f4576dc12ceb2e61a193 Gerrit-Change-Number: 19093 Gerrit-PatchSet: 2 Gerrit-Owner: Peeyush Gupta <[email protected]> Gerrit-CC: Anon. E. Moose #1000171 Gerrit-MessageType: newpatchset
