[jira] [Commented] (HIVE-22609) Reduce number of FS getFileStatus calls in AcidUtils::getHdfsDirSnapshots
[ https://issues.apache.org/jira/browse/HIVE-22609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17009993#comment-17009993 ] Ashutosh Chauhan commented on HIVE-22609: - +1 > Reduce number of FS getFileStatus calls in AcidUtils::getHdfsDirSnapshots > - > > Key: HIVE-22609 > URL: https://issues.apache.org/jira/browse/HIVE-22609 > Project: Hive > Issue Type: Bug >Reporter: Rajesh Balamohan >Assignee: Rajesh Balamohan >Priority: Major > Attachments: HIVE-22609.1.patch, HIVE-22609.2.patch, > HIVE-22609.3.patch, HIVE-22609.4.patch, HIVE-22609.5.patch > > > [https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/io/AcidUtils.java#L1380] > ACID delta folder contains {{_orc_acid_version}} and {{bucket_0}} files. > For both these files, parent dir is the same. Number of getFileStatus in such > cases should be reduced by 1/2. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22609) Reduce number of FS getFileStatus calls in AcidUtils::getHdfsDirSnapshots
[ https://issues.apache.org/jira/browse/HIVE-22609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17009717#comment-17009717 ] Hive QA commented on HIVE-22609: Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12990073/HIVE-22609.5.patch {color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified. {color:red}ERROR:{color} -1 due to 1 failed/errored test(s), 17852 tests executed *Failed tests:* {noformat} org.apache.hadoop.hive.cli.TestTezPerfCliDriver.testCliDriver[cbo_query30] (batchId=303) {noformat} Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/20095/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/20095/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-20095/ Messages: {noformat} Executing org.apache.hive.ptest.execution.TestCheckPhase Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.YetusPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 1 tests failed {noformat} This message is automatically generated. ATTACHMENT ID: 12990073 - PreCommit-HIVE-Build > Reduce number of FS getFileStatus calls in AcidUtils::getHdfsDirSnapshots > - > > Key: HIVE-22609 > URL: https://issues.apache.org/jira/browse/HIVE-22609 > Project: Hive > Issue Type: Bug >Reporter: Rajesh Balamohan >Assignee: Rajesh Balamohan >Priority: Major > Attachments: HIVE-22609.1.patch, HIVE-22609.2.patch, > HIVE-22609.3.patch, HIVE-22609.4.patch, HIVE-22609.5.patch > > > [https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/io/AcidUtils.java#L1380] > ACID delta folder contains {{_orc_acid_version}} and {{bucket_0}} files. > For both these files, parent dir is the same. Number of getFileStatus in such > cases should be reduced by 1/2. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22609) Reduce number of FS getFileStatus calls in AcidUtils::getHdfsDirSnapshots
[ https://issues.apache.org/jira/browse/HIVE-22609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17009671#comment-17009671 ] Hive QA commented on HIVE-22609: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || || || || || {color:brown} Prechecks {color} || | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s{color} | {color:green} The patch does not contain any @author tags. {color} | || || || || {color:brown} master Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 9m 3s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 4s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 42s{color} | {color:green} master passed {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 4m 4s{color} | {color:blue} ql in master has 1531 extant Findbugs warnings. {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 59s{color} | {color:green} master passed {color} | || || || || {color:brown} Patch Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m 26s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 5s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m 5s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 43s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 0s{color} | {color:green} The patch has no whitespace issues. {color} | | {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 4m 20s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 2s{color} | {color:green} the patch passed {color} | || || || || {color:brown} Other Tests {color} || | {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m 14s{color} | {color:green} The patch does not generate ASF License warnings. {color} | | {color:black}{color} | {color:black} {color} | {color:black} 25m 14s{color} | {color:black} {color} | \\ \\ || Subsystem || Report/Notes || | Optional Tests | asflicense javac javadoc findbugs checkstyle compile | | uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian 3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux | | Build tool | maven | | Personality | /data/hiveptest/working/yetus_PreCommit-HIVE-Build-20095/dev-support/hive-personality.sh | | git revision | master / 47b22ce | | Default Java | 1.8.0_111 | | findbugs | v3.0.1 | | modules | C: ql U: ql | | Console output | http://104.198.109.242/logs//PreCommit-HIVE-Build-20095/yetus.txt | | Powered by | Apache Yetushttp://yetus.apache.org | This message was automatically generated. > Reduce number of FS getFileStatus calls in AcidUtils::getHdfsDirSnapshots > - > > Key: HIVE-22609 > URL: https://issues.apache.org/jira/browse/HIVE-22609 > Project: Hive > Issue Type: Bug >Reporter: Rajesh Balamohan >Assignee: Rajesh Balamohan >Priority: Major > Attachments: HIVE-22609.1.patch, HIVE-22609.2.patch, > HIVE-22609.3.patch, HIVE-22609.4.patch, HIVE-22609.5.patch > > > [https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/io/AcidUtils.java#L1380] > ACID delta folder contains {{_orc_acid_version}} and {{bucket_0}} files. > For both these files, parent dir is the same. Number of getFileStatus in such > cases should be reduced by 1/2. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22609) Reduce number of FS getFileStatus calls in AcidUtils::getHdfsDirSnapshots
[ https://issues.apache.org/jira/browse/HIVE-22609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17001610#comment-17001610 ] Hive QA commented on HIVE-22609: Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12989301/HIVE-22609.4.patch {color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified. {color:red}ERROR:{color} -1 due to 24 failed/errored test(s), 17786 tests executed *Failed tests:* {noformat} org.apache.hive.beeline.cli.TestHiveCli.testCmd (batchId=206) org.apache.hive.beeline.cli.TestHiveCli.testCommentStripping (batchId=206) org.apache.hive.beeline.cli.TestHiveCli.testDatabaseOptions (batchId=206) org.apache.hive.beeline.cli.TestHiveCli.testErrOutput (batchId=206) org.apache.hive.beeline.cli.TestHiveCli.testHelp (batchId=206) org.apache.hive.beeline.cli.TestHiveCli.testInValidCmd (batchId=206) org.apache.hive.beeline.cli.TestHiveCli.testInvalidDatabaseOptions (batchId=206) org.apache.hive.beeline.cli.TestHiveCli.testInvalidOptions (batchId=206) org.apache.hive.beeline.cli.TestHiveCli.testInvalidOptions2 (batchId=206) org.apache.hive.beeline.cli.TestHiveCli.testNoErrorDB (batchId=206) org.apache.hive.beeline.cli.TestHiveCli.testSetHeaderValue (batchId=206) org.apache.hive.beeline.cli.TestHiveCli.testSetPromptValue (batchId=206) org.apache.hive.beeline.cli.TestHiveCli.testSourceCmd (batchId=206) org.apache.hive.beeline.cli.TestHiveCli.testSourceCmd2 (batchId=206) org.apache.hive.beeline.cli.TestHiveCli.testSourceCmd3 (batchId=206) org.apache.hive.beeline.cli.TestHiveCli.testSourceCmd4 (batchId=206) org.apache.hive.beeline.cli.TestHiveCli.testSqlFromCmd (batchId=206) org.apache.hive.beeline.cli.TestHiveCli.testSqlFromCmdWithDBName (batchId=206) org.apache.hive.beeline.cli.TestHiveCli.testUseCurrentDB1 (batchId=206) org.apache.hive.beeline.cli.TestHiveCli.testUseCurrentDB2 (batchId=206) org.apache.hive.beeline.cli.TestHiveCli.testUseCurrentDB3 (batchId=206) org.apache.hive.beeline.cli.TestHiveCli.testUseInvalidDB (batchId=206) org.apache.hive.beeline.cli.TestHiveCli.testVariables (batchId=206) org.apache.hive.beeline.cli.TestHiveCli.testVariablesForSource (batchId=206) {noformat} Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/19998/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/19998/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-19998/ Messages: {noformat} Executing org.apache.hive.ptest.execution.TestCheckPhase Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.YetusPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 24 tests failed {noformat} This message is automatically generated. ATTACHMENT ID: 12989301 - PreCommit-HIVE-Build > Reduce number of FS getFileStatus calls in AcidUtils::getHdfsDirSnapshots > - > > Key: HIVE-22609 > URL: https://issues.apache.org/jira/browse/HIVE-22609 > Project: Hive > Issue Type: Bug >Reporter: Rajesh Balamohan >Priority: Major > Attachments: HIVE-22609.1.patch, HIVE-22609.2.patch, > HIVE-22609.3.patch, HIVE-22609.4.patch > > > [https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/io/AcidUtils.java#L1380] > ACID delta folder contains {{_orc_acid_version}} and {{bucket_0}} files. > For both these files, parent dir is the same. Number of getFileStatus in such > cases should be reduced by 1/2. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22609) Reduce number of FS getFileStatus calls in AcidUtils::getHdfsDirSnapshots
[ https://issues.apache.org/jira/browse/HIVE-22609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17001605#comment-17001605 ] Hive QA commented on HIVE-22609: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || || || || || {color:brown} Prechecks {color} || | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s{color} | {color:green} The patch does not contain any @author tags. {color} | || || || || {color:brown} master Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 11m 57s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 21s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 48s{color} | {color:green} master passed {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 4m 47s{color} | {color:blue} ql in master has 1531 extant Findbugs warnings. {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 6s{color} | {color:green} master passed {color} | || || || || {color:brown} Patch Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m 35s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 13s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m 13s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 43s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 0s{color} | {color:green} The patch has no whitespace issues. {color} | | {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 4m 46s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 0s{color} | {color:green} the patch passed {color} | || || || || {color:brown} Other Tests {color} || | {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m 15s{color} | {color:green} The patch does not generate ASF License warnings. {color} | | {color:black}{color} | {color:black} {color} | {color:black} 30m 0s{color} | {color:black} {color} | \\ \\ || Subsystem || Report/Notes || | Optional Tests | asflicense javac javadoc findbugs checkstyle compile | | uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian 3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux | | Build tool | maven | | Personality | /data/hiveptest/working/yetus_PreCommit-HIVE-Build-19998/dev-support/hive-personality.sh | | git revision | master / 2e930ab | | Default Java | 1.8.0_111 | | findbugs | v3.0.1 | | modules | C: ql U: ql | | Console output | http://104.198.109.242/logs//PreCommit-HIVE-Build-19998/yetus.txt | | Powered by | Apache Yetushttp://yetus.apache.org | This message was automatically generated. > Reduce number of FS getFileStatus calls in AcidUtils::getHdfsDirSnapshots > - > > Key: HIVE-22609 > URL: https://issues.apache.org/jira/browse/HIVE-22609 > Project: Hive > Issue Type: Bug >Reporter: Rajesh Balamohan >Priority: Major > Attachments: HIVE-22609.1.patch, HIVE-22609.2.patch, > HIVE-22609.3.patch, HIVE-22609.4.patch > > > [https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/io/AcidUtils.java#L1380] > ACID delta folder contains {{_orc_acid_version}} and {{bucket_0}} files. > For both these files, parent dir is the same. Number of getFileStatus in such > cases should be reduced by 1/2. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22609) Reduce number of FS getFileStatus calls in AcidUtils::getHdfsDirSnapshots
[ https://issues.apache.org/jira/browse/HIVE-22609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16995766#comment-16995766 ] Ashutosh Chauhan commented on HIVE-22609: - [~rajesh.balamohan] Failures look related? > Reduce number of FS getFileStatus calls in AcidUtils::getHdfsDirSnapshots > - > > Key: HIVE-22609 > URL: https://issues.apache.org/jira/browse/HIVE-22609 > Project: Hive > Issue Type: Bug >Reporter: Rajesh Balamohan >Priority: Major > Attachments: HIVE-22609.1.patch, HIVE-22609.2.patch > > > [https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/io/AcidUtils.java#L1380] > ACID delta folder contains {{_orc_acid_version}} and {{bucket_0}} files. > For both these files, parent dir is the same. Number of getFileStatus in such > cases should be reduced by 1/2. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22609) Reduce number of FS getFileStatus calls in AcidUtils::getHdfsDirSnapshots
[ https://issues.apache.org/jira/browse/HIVE-22609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16994464#comment-16994464 ] Hive QA commented on HIVE-22609: Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12988635/HIVE-22609.2.patch {color:red}ERROR:{color} -1 due to build exiting with an error Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/19893/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/19893/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-19893/ Messages: {noformat} Executing org.apache.hive.ptest.execution.TestCheckPhase Tests exited with: Exception: Patch URL https://issues.apache.org/jira/secure/attachment/12988635/HIVE-22609.2.patch was found in seen patch url's cache and a test was probably run already on it. Aborting... {noformat} This message is automatically generated. ATTACHMENT ID: 12988635 - PreCommit-HIVE-Build > Reduce number of FS getFileStatus calls in AcidUtils::getHdfsDirSnapshots > - > > Key: HIVE-22609 > URL: https://issues.apache.org/jira/browse/HIVE-22609 > Project: Hive > Issue Type: Bug >Reporter: Rajesh Balamohan >Priority: Major > Attachments: HIVE-22609.1.patch, HIVE-22609.2.patch > > > [https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/io/AcidUtils.java#L1380] > ACID delta folder contains {{_orc_acid_version}} and {{bucket_0}} files. > For both these files, parent dir is the same. Number of getFileStatus in such > cases should be reduced by 1/2. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22609) Reduce number of FS getFileStatus calls in AcidUtils::getHdfsDirSnapshots
[ https://issues.apache.org/jira/browse/HIVE-22609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16994462#comment-16994462 ] Hive QA commented on HIVE-22609: Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12988635/HIVE-22609.2.patch {color:red}ERROR:{color} -1 due to no test(s) being added or modified. {color:red}ERROR:{color} -1 due to 2 failed/errored test(s), 17770 tests executed *Failed tests:* {noformat} org.apache.hadoop.hive.ql.io.orc.TestInputOutputFormat.testACIDReaderFooterSerializeWithDeltas (batchId=327) org.apache.hadoop.hive.ql.io.orc.TestInputOutputFormat.testACIDReaderNoFooterSerializeWithDeltas (batchId=327) {noformat} Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/19892/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/19892/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-19892/ Messages: {noformat} Executing org.apache.hive.ptest.execution.TestCheckPhase Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.YetusPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 2 tests failed {noformat} This message is automatically generated. ATTACHMENT ID: 12988635 - PreCommit-HIVE-Build > Reduce number of FS getFileStatus calls in AcidUtils::getHdfsDirSnapshots > - > > Key: HIVE-22609 > URL: https://issues.apache.org/jira/browse/HIVE-22609 > Project: Hive > Issue Type: Bug >Reporter: Rajesh Balamohan >Priority: Major > Attachments: HIVE-22609.1.patch, HIVE-22609.2.patch > > > [https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/io/AcidUtils.java#L1380] > ACID delta folder contains {{_orc_acid_version}} and {{bucket_0}} files. > For both these files, parent dir is the same. Number of getFileStatus in such > cases should be reduced by 1/2. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22609) Reduce number of FS getFileStatus calls in AcidUtils::getHdfsDirSnapshots
[ https://issues.apache.org/jira/browse/HIVE-22609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16994411#comment-16994411 ] Hive QA commented on HIVE-22609: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || || || || || {color:brown} Prechecks {color} || | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s{color} | {color:green} The patch does not contain any @author tags. {color} | || || || || {color:brown} master Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 9m 52s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 12s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 43s{color} | {color:green} master passed {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 4m 26s{color} | {color:blue} ql in master has 1531 extant Findbugs warnings. {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 8s{color} | {color:green} master passed {color} | || || || || {color:brown} Patch Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m 34s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 11s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m 11s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 42s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 0s{color} | {color:green} The patch has no whitespace issues. {color} | | {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 4m 38s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 6s{color} | {color:green} the patch passed {color} | || || || || {color:brown} Other Tests {color} || | {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m 15s{color} | {color:green} The patch does not generate ASF License warnings. {color} | | {color:black}{color} | {color:black} {color} | {color:black} 27m 20s{color} | {color:black} {color} | \\ \\ || Subsystem || Report/Notes || | Optional Tests | asflicense javac javadoc findbugs checkstyle compile | | uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian 3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux | | Build tool | maven | | Personality | /data/hiveptest/working/yetus_PreCommit-HIVE-Build-19892/dev-support/hive-personality.sh | | git revision | master / 4a039ad | | Default Java | 1.8.0_111 | | findbugs | v3.0.1 | | modules | C: ql U: ql | | Console output | http://104.198.109.242/logs//PreCommit-HIVE-Build-19892/yetus.txt | | Powered by | Apache Yetushttp://yetus.apache.org | This message was automatically generated. > Reduce number of FS getFileStatus calls in AcidUtils::getHdfsDirSnapshots > - > > Key: HIVE-22609 > URL: https://issues.apache.org/jira/browse/HIVE-22609 > Project: Hive > Issue Type: Bug >Reporter: Rajesh Balamohan >Priority: Major > Attachments: HIVE-22609.1.patch, HIVE-22609.2.patch > > > [https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/io/AcidUtils.java#L1380] > ACID delta folder contains {{_orc_acid_version}} and {{bucket_0}} files. > For both these files, parent dir is the same. Number of getFileStatus in such > cases should be reduced by 1/2. -- This message was sent by Atlassian Jira (v8.3.4#803005)