[jira] [Commented] (HIVE-21828) Tez: Use a pre-parsed TezConfiguration from DagUtils

2019-07-15 Thread Hive QA (JIRA)


[ 
https://issues.apache.org/jira/browse/HIVE-21828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885565#comment-16885565
 ] 

Hive QA commented on HIVE-21828:


| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green}  0m  
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue}  1m 
36s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green}  7m 
 2s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green}  1m 
25s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green}  0m 
58s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue}  0m 
35s{color} | {color:blue} common in master has 62 extant Findbugs warnings. 
{color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue}  4m  
8s{color} | {color:blue} ql in master has 2253 extant Findbugs warnings. 
{color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green}  1m 
18s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue}  0m 
28s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green}  1m 
49s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green}  1m 
32s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green}  1m 
32s{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red}  0m 
41s{color} | {color:red} ql: The patch generated 6 new + 62 unchanged - 0 fixed 
= 68 total (was 62) {color} |
| {color:red}-1{color} | {color:red} whitespace {color} | {color:red}  0m  
0s{color} | {color:red} The patch has 2 line(s) that end in whitespace. Use git 
apply --whitespace=fix <>. Refer https://git-scm.com/docs/git-apply 
{color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green}  5m  
1s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green}  1m 
16s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green}  0m 
14s{color} | {color:green} The patch does not generate ASF License warnings. 
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 29m  9s{color} | 
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests |  asflicense  javac  javadoc  findbugs  checkstyle  compile  |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian 
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality | 
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-18034/dev-support/hive-personality.sh
 |
| git revision | master / 0ea9fda4 |
| Default Java | 1.8.0_111 |
| findbugs | v3.0.0 |
| checkstyle | 
http://104.198.109.242/logs//PreCommit-HIVE-Build-18034/yetus/diff-checkstyle-ql.txt
 |
| whitespace | 
http://104.198.109.242/logs//PreCommit-HIVE-Build-18034/yetus/whitespace-eol.txt
 |
| modules | C: common ql U: . |
| Console output | 
http://104.198.109.242/logs//PreCommit-HIVE-Build-18034/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |


This message was automatically generated.



> Tez: Use a pre-parsed TezConfiguration from DagUtils
> 
>
> Key: HIVE-21828
> URL: https://issues.apache.org/jira/browse/HIVE-21828
> Project: Hive
>  Issue Type: Bug
>Reporter: Gopal V
>Assignee: Attila Magyar
>Priority: Major
> Attachments: HIVE-21828.1.patch, HIVE-21828.2.patch, 
> HIVE-21828.3.patch
>
>
> The HS2 tez-site.xml does not change dynamically - the XML parsed components 
> of the config can be obtained statically and kept across sessions.
> This allows for the replacing of "new TezConfiguration()" with a HS2 local 
> version instead.
> The configuration object however has to reference the right resource file 
> (i.e location of tez-site.xml) without reparsing it for each query.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)


[jira] [Commented] (HIVE-21828) Tez: Use a pre-parsed TezConfiguration from DagUtils

2019-07-15 Thread Hive QA (JIRA)


[ 
https://issues.apache.org/jira/browse/HIVE-21828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885598#comment-16885598
 ] 

Hive QA commented on HIVE-21828:




Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12974679/HIVE-21828.3.patch

{color:red}ERROR:{color} -1 due to no test(s) being added or modified.

{color:red}ERROR:{color} -1 due to 12 failed/errored test(s), 16655 tests 
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[stats_part] (batchId=52)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[mm_loaddata]
 (batchId=173)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[vector_adaptor_usage_mode]
 (batchId=182)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[vector_udf1]
 (batchId=177)
org.apache.hadoop.hive.ql.plan.mapping.TestCounterMapping.org.apache.hadoop.hive.ql.plan.mapping.TestCounterMapping
 (batchId=346)
org.apache.hadoop.hive.ql.plan.mapping.TestOperatorCmp.org.apache.hadoop.hive.ql.plan.mapping.TestOperatorCmp
 (batchId=346)
org.apache.hadoop.hive.ql.plan.mapping.TestReOptimization.org.apache.hadoop.hive.ql.plan.mapping.TestReOptimization
 (batchId=347)
org.apache.hadoop.hive.ql.plan.mapping.TestStatEstimations.org.apache.hadoop.hive.ql.plan.mapping.TestStatEstimations
 (batchId=346)
org.apache.hadoop.hive.ql.txn.compactor.TestCrudCompactorOnTez.testCompactionWithSchemaEvolutionAndBuckets
 (batchId=273)
org.apache.hadoop.hive.ql.txn.compactor.TestCrudCompactorOnTez.testCompactionWithSchemaEvolutionNoBucketsMultipleReducers
 (batchId=273)
org.apache.hadoop.hive.ql.txn.compactor.TestCrudCompactorOnTez.testMajorCompaction
 (batchId=273)
org.apache.hive.testutils.TestHiveTestEnvSetup.org.apache.hive.testutils.TestHiveTestEnvSetup
 (batchId=350)
{noformat}

Test results: 
https://builds.apache.org/job/PreCommit-HIVE-Build/18034/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/18034/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-18034/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 12 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12974679 - PreCommit-HIVE-Build

> Tez: Use a pre-parsed TezConfiguration from DagUtils
> 
>
> Key: HIVE-21828
> URL: https://issues.apache.org/jira/browse/HIVE-21828
> Project: Hive
>  Issue Type: Bug
>Reporter: Gopal V
>Assignee: Attila Magyar
>Priority: Major
> Attachments: HIVE-21828.1.patch, HIVE-21828.2.patch, 
> HIVE-21828.3.patch
>
>
> The HS2 tez-site.xml does not change dynamically - the XML parsed components 
> of the config can be obtained statically and kept across sessions.
> This allows for the replacing of "new TezConfiguration()" with a HS2 local 
> version instead.
> The configuration object however has to reference the right resource file 
> (i.e location of tez-site.xml) without reparsing it for each query.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)


[jira] [Commented] (HIVE-21956) Add the list of table selected by dump in the dump folder.

2019-07-15 Thread Hive QA (JIRA)


[ 
https://issues.apache.org/jira/browse/HIVE-21956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885858#comment-16885858
 ] 

Hive QA commented on HIVE-21956:




Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12974792/HIVE-21956.04.patch

{color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified.

{color:green}SUCCESS:{color} +1 due to 16670 tests passed

Test results: 
https://builds.apache.org/job/PreCommit-HIVE-Build/18040/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/18040/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-18040/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12974792 - PreCommit-HIVE-Build

> Add the list of table selected by dump in the dump folder.
> --
>
> Key: HIVE-21956
> URL: https://issues.apache.org/jira/browse/HIVE-21956
> Project: Hive
>  Issue Type: Sub-task
>Reporter: mahesh kumar behera
>Assignee: mahesh kumar behera
>Priority: Major
>  Labels: pull-request-available
> Attachments: HIVE-21956.01.patch, HIVE-21956.02.patch, 
> HIVE-21956.03.patch, HIVE-21956.04.patch
>
>  Time Spent: 1h 40m
>  Remaining Estimate: 0h
>
> The list of tables selected by a dump should be kept in the dump folder as a 
> _tables file. This will help user to find out the tables replicated and the 
> list can be used by user for ranger and atlas policy replication.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)


[jira] [Commented] (HIVE-21956) Add the list of table selected by dump in the dump folder.

2019-07-15 Thread Hive QA (JIRA)


[ 
https://issues.apache.org/jira/browse/HIVE-21956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885386#comment-16885386
 ] 

Hive QA commented on HIVE-21956:




Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12974715/HIVE-21956.03.patch

{color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified.

{color:red}ERROR:{color} -1 due to 18 failed/errored test(s), 16670 tests 
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.ql.parse.TestReplicationWithTableMigrationEx.testTableLevelDumpMigration
 (batchId=264)
org.apache.hadoop.hive.ql.parse.TestTableLevelReplicationScenarios.testBasicBootstrapWithIncludeAndExcludeList
 (batchId=255)
org.apache.hadoop.hive.ql.parse.TestTableLevelReplicationScenarios.testBasicBootstrapWithIncludeList
 (batchId=255)
org.apache.hadoop.hive.ql.parse.TestTableLevelReplicationScenarios.testBasicReplaceReplPolicy
 (batchId=255)
org.apache.hadoop.hive.ql.parse.TestTableLevelReplicationScenarios.testBootstrapAcidTablesIncrementalPhaseWithIncludeAndExcludeList
 (batchId=255)
org.apache.hadoop.hive.ql.parse.TestTableLevelReplicationScenarios.testBootstrapExternalTablesIncrementalPhaseWithIncludeAndExcludeList
 (batchId=255)
org.apache.hadoop.hive.ql.parse.TestTableLevelReplicationScenarios.testBootstrapExternalTablesWithIncludeAndExcludeList
 (batchId=255)
org.apache.hadoop.hive.ql.parse.TestTableLevelReplicationScenarios.testCaseInSensitiveNatureOfReplPolicy
 (batchId=255)
org.apache.hadoop.hive.ql.parse.TestTableLevelReplicationScenarios.testFullDbBootstrapReplicationWithDifferentReplPolicyFormats
 (batchId=255)
org.apache.hadoop.hive.ql.parse.TestTableLevelReplicationScenarios.testRenameTableScenariosAcidTable
 (batchId=255)
org.apache.hadoop.hive.ql.parse.TestTableLevelReplicationScenarios.testRenameTableScenariosBasic
 (batchId=255)
org.apache.hadoop.hive.ql.parse.TestTableLevelReplicationScenarios.testRenameTableScenariosExternalTable
 (batchId=255)
org.apache.hadoop.hive.ql.parse.TestTableLevelReplicationScenarios.testRenameTableScenariosWithDmlOperations
 (batchId=255)
org.apache.hadoop.hive.ql.parse.TestTableLevelReplicationScenarios.testRenameTableScenariosWithReplaceExternalTable
 (batchId=255)
org.apache.hadoop.hive.ql.parse.TestTableLevelReplicationScenarios.testRenameTableScenariosWithReplacePolicyDMLOperattion
 (batchId=255)
org.apache.hadoop.hive.ql.parse.TestTableLevelReplicationScenarios.testReplacePolicyOnBootstrapAcidTablesIncrementalPhase
 (batchId=255)
org.apache.hadoop.hive.ql.parse.TestTableLevelReplicationScenarios.testReplacePolicyOnBootstrapExternalTablesIncrementalPhase
 (batchId=255)
org.apache.hadoop.hive.ql.parse.TestTableLevelReplicationScenarios.testReplacePolicyWhenAcidTablesDisabledForRepl
 (batchId=255)
{noformat}

Test results: 
https://builds.apache.org/job/PreCommit-HIVE-Build/18033/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/18033/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-18033/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 18 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12974715 - PreCommit-HIVE-Build

> Add the list of table selected by dump in the dump folder.
> --
>
> Key: HIVE-21956
> URL: https://issues.apache.org/jira/browse/HIVE-21956
> Project: Hive
>  Issue Type: Sub-task
>Reporter: mahesh kumar behera
>Assignee: mahesh kumar behera
>Priority: Major
>  Labels: pull-request-available
> Attachments: HIVE-21956.01.patch, HIVE-21956.02.patch, 
> HIVE-21956.03.patch
>
>  Time Spent: 1h 40m
>  Remaining Estimate: 0h
>
> The list of tables selected by a dump should be kept in the dump folder as a 
> _tables file. This will help user to find out the tables replicated and the 
> list can be used by user for ranger and atlas policy replication.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)


[jira] [Commented] (HIVE-21983) Cut DropTableDesc/Operation to drop table, view and materialized view

2019-07-15 Thread Jesus Camacho Rodriguez (JIRA)


[ 
https://issues.apache.org/jira/browse/HIVE-21983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885421#comment-16885421
 ] 

Jesus Camacho Rodriguez commented on HIVE-21983:


+1

> Cut DropTableDesc/Operation to drop table, view and materialized view
> -
>
> Key: HIVE-21983
> URL: https://issues.apache.org/jira/browse/HIVE-21983
> Project: Hive
>  Issue Type: Sub-task
>  Components: Hive
>Affects Versions: 3.1.1
>Reporter: Miklos Gergely
>Assignee: Miklos Gergely
>Priority: Major
>  Labels: pull-request-available, refactor-ddl
> Fix For: 4.0.0
>
> Attachments: HIVE-21983.01.patch, HIVE-21983.02.patch, 
> HIVE-21983.03.patch
>
>  Time Spent: 10m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v7.6.14#76016)


[jira] [Updated] (HIVE-21983) Cut DropTableDesc/Operation to drop table, view and materialized view

2019-07-15 Thread Jesus Camacho Rodriguez (JIRA)


 [ 
https://issues.apache.org/jira/browse/HIVE-21983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jesus Camacho Rodriguez updated HIVE-21983:
---
Resolution: Fixed
Status: Resolved  (was: Patch Available)

Pushed to master, thanks [~mgergely]

> Cut DropTableDesc/Operation to drop table, view and materialized view
> -
>
> Key: HIVE-21983
> URL: https://issues.apache.org/jira/browse/HIVE-21983
> Project: Hive
>  Issue Type: Sub-task
>  Components: Hive
>Affects Versions: 3.1.1
>Reporter: Miklos Gergely
>Assignee: Miklos Gergely
>Priority: Major
>  Labels: pull-request-available, refactor-ddl
> Fix For: 4.0.0
>
> Attachments: HIVE-21983.01.patch, HIVE-21983.02.patch, 
> HIVE-21983.03.patch
>
>  Time Spent: 0.5h
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v7.6.14#76016)


[jira] [Updated] (HIVE-21984) Clean up TruncateTable operation and desc

2019-07-15 Thread Jesus Camacho Rodriguez (JIRA)


 [ 
https://issues.apache.org/jira/browse/HIVE-21984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jesus Camacho Rodriguez updated HIVE-21984:
---
Resolution: Fixed
Status: Resolved  (was: Patch Available)

Pushed to master, thanks [~mgergely]

> Clean up TruncateTable operation and desc
> -
>
> Key: HIVE-21984
> URL: https://issues.apache.org/jira/browse/HIVE-21984
> Project: Hive
>  Issue Type: Sub-task
>  Components: Hive
>Affects Versions: 3.1.1
>Reporter: Miklos Gergely
>Assignee: Miklos Gergely
>Priority: Major
>  Labels: pull-request-available
> Fix For: 4.0.0
>
> Attachments: HIVE-21984.01.patch
>
>  Time Spent: 20m
>  Remaining Estimate: 0h
>
> TruncateTableDesc is not immutable, should be fixed. The DDLSemanticAnalyzer 
> has a long and complicated function for parsing truncate commands, should e 
> cut to pieces.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)


<    1   2