[jira] [Commented] (HIVE-21828) Tez: Use a pre-parsed TezConfiguration from DagUtils
[ https://issues.apache.org/jira/browse/HIVE-21828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885565#comment-16885565 ] Hive QA commented on HIVE-21828: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || || || || || {color:brown} Prechecks {color} || | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s{color} | {color:green} The patch does not contain any @author tags. {color} | || || || || {color:brown} master Compile Tests {color} || | {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 1m 36s{color} | {color:blue} Maven dependency ordering for branch {color} | | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 7m 2s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 25s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 58s{color} | {color:green} master passed {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m 35s{color} | {color:blue} common in master has 62 extant Findbugs warnings. {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 4m 8s{color} | {color:blue} ql in master has 2253 extant Findbugs warnings. {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 18s{color} | {color:green} master passed {color} | || || || || {color:brown} Patch Compile Tests {color} || | {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m 28s{color} | {color:blue} Maven dependency ordering for patch {color} | | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m 49s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 32s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m 32s{color} | {color:green} the patch passed {color} | | {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m 41s{color} | {color:red} ql: The patch generated 6 new + 62 unchanged - 0 fixed = 68 total (was 62) {color} | | {color:red}-1{color} | {color:red} whitespace {color} | {color:red} 0m 0s{color} | {color:red} The patch has 2 line(s) that end in whitespace. Use git apply --whitespace=fix <>. Refer https://git-scm.com/docs/git-apply {color} | | {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 5m 1s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 16s{color} | {color:green} the patch passed {color} | || || || || {color:brown} Other Tests {color} || | {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m 14s{color} | {color:green} The patch does not generate ASF License warnings. {color} | | {color:black}{color} | {color:black} {color} | {color:black} 29m 9s{color} | {color:black} {color} | \\ \\ || Subsystem || Report/Notes || | Optional Tests | asflicense javac javadoc findbugs checkstyle compile | | uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian 3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux | | Build tool | maven | | Personality | /data/hiveptest/working/yetus_PreCommit-HIVE-Build-18034/dev-support/hive-personality.sh | | git revision | master / 0ea9fda4 | | Default Java | 1.8.0_111 | | findbugs | v3.0.0 | | checkstyle | http://104.198.109.242/logs//PreCommit-HIVE-Build-18034/yetus/diff-checkstyle-ql.txt | | whitespace | http://104.198.109.242/logs//PreCommit-HIVE-Build-18034/yetus/whitespace-eol.txt | | modules | C: common ql U: . | | Console output | http://104.198.109.242/logs//PreCommit-HIVE-Build-18034/yetus.txt | | Powered by | Apache Yetushttp://yetus.apache.org | This message was automatically generated. > Tez: Use a pre-parsed TezConfiguration from DagUtils > > > Key: HIVE-21828 > URL: https://issues.apache.org/jira/browse/HIVE-21828 > Project: Hive > Issue Type: Bug >Reporter: Gopal V >Assignee: Attila Magyar >Priority: Major > Attachments: HIVE-21828.1.patch, HIVE-21828.2.patch, > HIVE-21828.3.patch > > > The HS2 tez-site.xml does not change dynamically - the XML parsed components > of the config can be obtained statically and kept across sessions. > This allows for the replacing of "new TezConfiguration()" with a HS2 local > version instead. > The configuration object however has to reference the right resource file > (i.e location of tez-site.xml) without reparsing it for each query. -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Commented] (HIVE-21828) Tez: Use a pre-parsed TezConfiguration from DagUtils
[ https://issues.apache.org/jira/browse/HIVE-21828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885598#comment-16885598 ] Hive QA commented on HIVE-21828: Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12974679/HIVE-21828.3.patch {color:red}ERROR:{color} -1 due to no test(s) being added or modified. {color:red}ERROR:{color} -1 due to 12 failed/errored test(s), 16655 tests executed *Failed tests:* {noformat} org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[stats_part] (batchId=52) org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[mm_loaddata] (batchId=173) org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[vector_adaptor_usage_mode] (batchId=182) org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[vector_udf1] (batchId=177) org.apache.hadoop.hive.ql.plan.mapping.TestCounterMapping.org.apache.hadoop.hive.ql.plan.mapping.TestCounterMapping (batchId=346) org.apache.hadoop.hive.ql.plan.mapping.TestOperatorCmp.org.apache.hadoop.hive.ql.plan.mapping.TestOperatorCmp (batchId=346) org.apache.hadoop.hive.ql.plan.mapping.TestReOptimization.org.apache.hadoop.hive.ql.plan.mapping.TestReOptimization (batchId=347) org.apache.hadoop.hive.ql.plan.mapping.TestStatEstimations.org.apache.hadoop.hive.ql.plan.mapping.TestStatEstimations (batchId=346) org.apache.hadoop.hive.ql.txn.compactor.TestCrudCompactorOnTez.testCompactionWithSchemaEvolutionAndBuckets (batchId=273) org.apache.hadoop.hive.ql.txn.compactor.TestCrudCompactorOnTez.testCompactionWithSchemaEvolutionNoBucketsMultipleReducers (batchId=273) org.apache.hadoop.hive.ql.txn.compactor.TestCrudCompactorOnTez.testMajorCompaction (batchId=273) org.apache.hive.testutils.TestHiveTestEnvSetup.org.apache.hive.testutils.TestHiveTestEnvSetup (batchId=350) {noformat} Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/18034/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/18034/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-18034/ Messages: {noformat} Executing org.apache.hive.ptest.execution.TestCheckPhase Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.YetusPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 12 tests failed {noformat} This message is automatically generated. ATTACHMENT ID: 12974679 - PreCommit-HIVE-Build > Tez: Use a pre-parsed TezConfiguration from DagUtils > > > Key: HIVE-21828 > URL: https://issues.apache.org/jira/browse/HIVE-21828 > Project: Hive > Issue Type: Bug >Reporter: Gopal V >Assignee: Attila Magyar >Priority: Major > Attachments: HIVE-21828.1.patch, HIVE-21828.2.patch, > HIVE-21828.3.patch > > > The HS2 tez-site.xml does not change dynamically - the XML parsed components > of the config can be obtained statically and kept across sessions. > This allows for the replacing of "new TezConfiguration()" with a HS2 local > version instead. > The configuration object however has to reference the right resource file > (i.e location of tez-site.xml) without reparsing it for each query. -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Commented] (HIVE-21956) Add the list of table selected by dump in the dump folder.
[ https://issues.apache.org/jira/browse/HIVE-21956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885858#comment-16885858 ] Hive QA commented on HIVE-21956: Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12974792/HIVE-21956.04.patch {color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified. {color:green}SUCCESS:{color} +1 due to 16670 tests passed Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/18040/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/18040/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-18040/ Messages: {noformat} Executing org.apache.hive.ptest.execution.TestCheckPhase Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.YetusPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase {noformat} This message is automatically generated. ATTACHMENT ID: 12974792 - PreCommit-HIVE-Build > Add the list of table selected by dump in the dump folder. > -- > > Key: HIVE-21956 > URL: https://issues.apache.org/jira/browse/HIVE-21956 > Project: Hive > Issue Type: Sub-task >Reporter: mahesh kumar behera >Assignee: mahesh kumar behera >Priority: Major > Labels: pull-request-available > Attachments: HIVE-21956.01.patch, HIVE-21956.02.patch, > HIVE-21956.03.patch, HIVE-21956.04.patch > > Time Spent: 1h 40m > Remaining Estimate: 0h > > The list of tables selected by a dump should be kept in the dump folder as a > _tables file. This will help user to find out the tables replicated and the > list can be used by user for ranger and atlas policy replication. -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Commented] (HIVE-21956) Add the list of table selected by dump in the dump folder.
[ https://issues.apache.org/jira/browse/HIVE-21956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885386#comment-16885386 ] Hive QA commented on HIVE-21956: Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12974715/HIVE-21956.03.patch {color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified. {color:red}ERROR:{color} -1 due to 18 failed/errored test(s), 16670 tests executed *Failed tests:* {noformat} org.apache.hadoop.hive.ql.parse.TestReplicationWithTableMigrationEx.testTableLevelDumpMigration (batchId=264) org.apache.hadoop.hive.ql.parse.TestTableLevelReplicationScenarios.testBasicBootstrapWithIncludeAndExcludeList (batchId=255) org.apache.hadoop.hive.ql.parse.TestTableLevelReplicationScenarios.testBasicBootstrapWithIncludeList (batchId=255) org.apache.hadoop.hive.ql.parse.TestTableLevelReplicationScenarios.testBasicReplaceReplPolicy (batchId=255) org.apache.hadoop.hive.ql.parse.TestTableLevelReplicationScenarios.testBootstrapAcidTablesIncrementalPhaseWithIncludeAndExcludeList (batchId=255) org.apache.hadoop.hive.ql.parse.TestTableLevelReplicationScenarios.testBootstrapExternalTablesIncrementalPhaseWithIncludeAndExcludeList (batchId=255) org.apache.hadoop.hive.ql.parse.TestTableLevelReplicationScenarios.testBootstrapExternalTablesWithIncludeAndExcludeList (batchId=255) org.apache.hadoop.hive.ql.parse.TestTableLevelReplicationScenarios.testCaseInSensitiveNatureOfReplPolicy (batchId=255) org.apache.hadoop.hive.ql.parse.TestTableLevelReplicationScenarios.testFullDbBootstrapReplicationWithDifferentReplPolicyFormats (batchId=255) org.apache.hadoop.hive.ql.parse.TestTableLevelReplicationScenarios.testRenameTableScenariosAcidTable (batchId=255) org.apache.hadoop.hive.ql.parse.TestTableLevelReplicationScenarios.testRenameTableScenariosBasic (batchId=255) org.apache.hadoop.hive.ql.parse.TestTableLevelReplicationScenarios.testRenameTableScenariosExternalTable (batchId=255) org.apache.hadoop.hive.ql.parse.TestTableLevelReplicationScenarios.testRenameTableScenariosWithDmlOperations (batchId=255) org.apache.hadoop.hive.ql.parse.TestTableLevelReplicationScenarios.testRenameTableScenariosWithReplaceExternalTable (batchId=255) org.apache.hadoop.hive.ql.parse.TestTableLevelReplicationScenarios.testRenameTableScenariosWithReplacePolicyDMLOperattion (batchId=255) org.apache.hadoop.hive.ql.parse.TestTableLevelReplicationScenarios.testReplacePolicyOnBootstrapAcidTablesIncrementalPhase (batchId=255) org.apache.hadoop.hive.ql.parse.TestTableLevelReplicationScenarios.testReplacePolicyOnBootstrapExternalTablesIncrementalPhase (batchId=255) org.apache.hadoop.hive.ql.parse.TestTableLevelReplicationScenarios.testReplacePolicyWhenAcidTablesDisabledForRepl (batchId=255) {noformat} Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/18033/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/18033/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-18033/ Messages: {noformat} Executing org.apache.hive.ptest.execution.TestCheckPhase Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.YetusPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 18 tests failed {noformat} This message is automatically generated. ATTACHMENT ID: 12974715 - PreCommit-HIVE-Build > Add the list of table selected by dump in the dump folder. > -- > > Key: HIVE-21956 > URL: https://issues.apache.org/jira/browse/HIVE-21956 > Project: Hive > Issue Type: Sub-task >Reporter: mahesh kumar behera >Assignee: mahesh kumar behera >Priority: Major > Labels: pull-request-available > Attachments: HIVE-21956.01.patch, HIVE-21956.02.patch, > HIVE-21956.03.patch > > Time Spent: 1h 40m > Remaining Estimate: 0h > > The list of tables selected by a dump should be kept in the dump folder as a > _tables file. This will help user to find out the tables replicated and the > list can be used by user for ranger and atlas policy replication. -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Commented] (HIVE-21983) Cut DropTableDesc/Operation to drop table, view and materialized view
[ https://issues.apache.org/jira/browse/HIVE-21983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885421#comment-16885421 ] Jesus Camacho Rodriguez commented on HIVE-21983: +1 > Cut DropTableDesc/Operation to drop table, view and materialized view > - > > Key: HIVE-21983 > URL: https://issues.apache.org/jira/browse/HIVE-21983 > Project: Hive > Issue Type: Sub-task > Components: Hive >Affects Versions: 3.1.1 >Reporter: Miklos Gergely >Assignee: Miklos Gergely >Priority: Major > Labels: pull-request-available, refactor-ddl > Fix For: 4.0.0 > > Attachments: HIVE-21983.01.patch, HIVE-21983.02.patch, > HIVE-21983.03.patch > > Time Spent: 10m > Remaining Estimate: 0h > -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Updated] (HIVE-21983) Cut DropTableDesc/Operation to drop table, view and materialized view
[ https://issues.apache.org/jira/browse/HIVE-21983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-21983: --- Resolution: Fixed Status: Resolved (was: Patch Available) Pushed to master, thanks [~mgergely] > Cut DropTableDesc/Operation to drop table, view and materialized view > - > > Key: HIVE-21983 > URL: https://issues.apache.org/jira/browse/HIVE-21983 > Project: Hive > Issue Type: Sub-task > Components: Hive >Affects Versions: 3.1.1 >Reporter: Miklos Gergely >Assignee: Miklos Gergely >Priority: Major > Labels: pull-request-available, refactor-ddl > Fix For: 4.0.0 > > Attachments: HIVE-21983.01.patch, HIVE-21983.02.patch, > HIVE-21983.03.patch > > Time Spent: 0.5h > Remaining Estimate: 0h > -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Updated] (HIVE-21984) Clean up TruncateTable operation and desc
[ https://issues.apache.org/jira/browse/HIVE-21984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-21984: --- Resolution: Fixed Status: Resolved (was: Patch Available) Pushed to master, thanks [~mgergely] > Clean up TruncateTable operation and desc > - > > Key: HIVE-21984 > URL: https://issues.apache.org/jira/browse/HIVE-21984 > Project: Hive > Issue Type: Sub-task > Components: Hive >Affects Versions: 3.1.1 >Reporter: Miklos Gergely >Assignee: Miklos Gergely >Priority: Major > Labels: pull-request-available > Fix For: 4.0.0 > > Attachments: HIVE-21984.01.patch > > Time Spent: 20m > Remaining Estimate: 0h > > TruncateTableDesc is not immutable, should be fixed. The DDLSemanticAnalyzer > has a long and complicated function for parsing truncate commands, should e > cut to pieces. -- This message was sent by Atlassian JIRA (v7.6.14#76016)