[jira] [Commented] (HIVE-20463) Hplsql.g4 - 'from_clause' parses the keyword `JOIN` into 'from_alias_clause' in 'from_table_clause' when parsing 'from_join_clause'
[
https://issues.apache.org/jira/browse/HIVE-20463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16592806#comment-16592806
]
Hive QA commented on HIVE-20463:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12937153/0002-HIVE-20463-Test-Modify-select-test-case.patch
{color:red}ERROR:{color} -1 due to no test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 10 failed/errored test(s), 14897 tests
executed
*Failed tests:*
{noformat}
org.apache.hive.hplsql.TestHplsqlOffline.testSelect (batchId=273)
org.apache.hive.minikdc.TestJdbcWithDBTokenStoreNoDoAs.testCancelRenewTokenFlow
(batchId=265)
org.apache.hive.minikdc.TestJdbcWithDBTokenStoreNoDoAs.testConnection
(batchId=265)
org.apache.hive.minikdc.TestJdbcWithDBTokenStoreNoDoAs.testIsValid (batchId=265)
org.apache.hive.minikdc.TestJdbcWithDBTokenStoreNoDoAs.testIsValidNeg
(batchId=265)
org.apache.hive.minikdc.TestJdbcWithDBTokenStoreNoDoAs.testNegativeProxyAuth
(batchId=265)
org.apache.hive.minikdc.TestJdbcWithDBTokenStoreNoDoAs.testNegativeTokenAuth
(batchId=265)
org.apache.hive.minikdc.TestJdbcWithDBTokenStoreNoDoAs.testProxyAuth
(batchId=265)
org.apache.hive.minikdc.TestJdbcWithDBTokenStoreNoDoAs.testRenewDelegationToken
(batchId=265)
org.apache.hive.minikdc.TestJdbcWithDBTokenStoreNoDoAs.testTokenAuth
(batchId=265)
{noformat}
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/13473/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/13473/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-13473/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 10 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12937153 - PreCommit-HIVE-Build
> Hplsql.g4 - 'from_clause' parses the keyword `JOIN` into 'from_alias_clause'
> in 'from_table_clause' when parsing 'from_join_clause'
> ---
>
> Key: HIVE-20463
> URL: https://issues.apache.org/jira/browse/HIVE-20463
> Project: Hive
> Issue Type: Bug
> Components: CLI
>Affects Versions: 3.1.0
>Reporter: Hao Zhou
>Assignee: Hao Zhou
>Priority: Major
> Labels: pull-request-available
> Fix For: 3.1.0
>
> Attachments: 0001-HIVE-20463-fix-parse-from_join_clause-error.patch,
> 0002-HIVE-20463-Test-Modify-select-test-case.patch
>
>
> 'from_clause' parses the keyword `JOIN` into 'from_alias_clause' in
> 'from_table_clause' when parsing 'from_join_clause'.
>
> example:
> Parse sql {{SELECT `k1, v1, k2, v2 FROM a JOIN b ON k1 = k2;`.}}
> Now grammar will parse `{{JOIN`}} as a `{{from_alias_clause`}}, but it should
> be
> a `{{from_join_clause`}};
>
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (HIVE-20187) Incorrect query results in hive when hive.convert.join.bucket.mapjoin.tez is set to true
[
https://issues.apache.org/jira/browse/HIVE-20187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Deepak Jaiswal updated HIVE-20187:
--
Resolution: Fixed
Status: Resolved (was: Patch Available)
Thanks for the review [~hagleitn]. Committed to master.
> Incorrect query results in hive when hive.convert.join.bucket.mapjoin.tez is
> set to true
>
>
> Key: HIVE-20187
> URL: https://issues.apache.org/jira/browse/HIVE-20187
> Project: Hive
> Issue Type: Bug
>Affects Versions: 3.1.0
> Environment: Hive 3.0 and Tez 0.91
>Reporter: Karthik
>Assignee: Deepak Jaiswal
>Priority: Blocker
> Attachments: HIVE-20187.1.patch, HIVE-20187.2.patch,
> HIVE-20187.3.patch, extended_explain.txt
>
>
> When hive.convert.join.bucket.mapjoin.tez=true and bucketed column is in
> select clause but not in where clause, hive is performing a bucket map join
> and returning incorrect results. When the bucketed column is removed from
> select clause or hive.convert.join.bucket.mapjoin.tez=false, returned query
> results are correct.
>
> create table my_fact(AMT decimal(20,3),bucket_col string ,join_col string )
> PARTITIONED BY (FISCAL_YEAR string ,ACCOUNTING_PERIOD string )
> CLUSTERED BY (bucket_col) INTO 10
> BUCKETS
> stored as ORC
> ;
> create table my_dim(join_col string,filter_col string) stored as orc;
> After populating and analyzing above tables, explain plan looks as below
> when hive.convert.join.bucket.mapjoin.tez=TRUE:
>
> explain select T4.join_col as account1,my_fact.accounting_period
> FROM my_fact JOIN my_dim T4 ON my_fact.join_col = T4.join_col
> WHERE my_fact.fiscal_year = '2015'
> AND T4.filter_col IN ( 'VAL1', 'VAL2' )
> and my_fact.accounting_period in (10);
> Vertex dependency in root stage
> Map 1 <- Map 2 (CUSTOM_EDGE)
> Stage-0
> Fetch Operator
> limit:-1
> Stage-1
> Map 1 vectorized, llap
> File Output Operator [FS_24]
> Select Operator [SEL_23] (rows=15282589 width=291)
> Output:["_col0","_col1","_col2"]
> Map Join Operator [MAPJOIN_22] (rows=15282589 width=291)
> *BucketMapJoin*:true,Conds:SEL_21._col1=RS_19._col0(Inner),Output:["_col0","_col3","_col4"]
> <-Map 2 [CUSTOM_EDGE] vectorized, llap
> MULTICAST [RS_19]
> PartitionCols:_col0
> Select Operator [SEL_18] (rows=818 width=186)
> Output:["_col0"]
> Filter Operator [FIL_17] (rows=818 width=186)
> predicate:((filter_col) IN ('VAL1', 'VAL2') and join_col is not null)
> TableScan [TS_3] (rows=1635 width=186)
> default@my_dim,t4,Tbl:COMPLETE,Col:NONE,Output:["join_col","filter_col"]
> <-Select Operator [SEL_21] (rows=13893263 width=291)
> Output:["_col0","_col1","_col3"]
> Filter Operator [FIL_20] (rows=13893263 width=291)
> predicate:join_col is not null
> TableScan [TS_0] (rows=13893263 width=291)
>
> default@my_fact,my_fact,Tbl:COMPLETE,Col:NONE,Output:["bucket_col","join_col"]
> [^extended_explain.txt] has more detailed plan.
> When hive.convert.join.bucket.mapjoin.tez=false, plan no longer has
> bucketjoin and query results are correct.
> Vertex dependency in root stage
> Map 1 <- Map 2 (BROADCAST_EDGE)
> Stage-0
> Fetch Operator
> limit:-1
> Stage-1
> Map 1 vectorized, llap
> File Output Operator [FS_24]
> Select Operator [SEL_23] (rows=15282589 width=291)
> Output:["_col0","_col1","_col2"]
> Map Join Operator [MAPJOIN_22] (rows=15282589 width=291)
> Conds:SEL_21._col1=RS_19._col0(Inner),Output:["_col0","_col3","_col4"]
> <-Map 2 [BROADCAST_EDGE] vectorized, llap
> BROADCAST [RS_19]
> PartitionCols:_col0
> Select Operator [SEL_18] (rows=818 width=186)
> Output:["_col0"]
> Filter Operator [FIL_17] (rows=818 width=186)
> predicate:((filter_col) IN ('VAL1', 'VAL2') and join_col is not null)
> TableScan [TS_3] (rows=1635 width=186)
> default@my_dim,t4,Tbl:COMPLETE,Col:NONE,Output:["join_col","filter_col"]
> <-Select Operator [SEL_21] (rows=13893263 width=291)
> Output:["_col0","_col1","_col3"]
> Filter Operator [FIL_20] (rows=13893263 width=291)
> predicate:join_col is not null
> TableScan [TS_0] (rows=13893263 width=291)
> default@my_fact,my_fact,Tbl:COMPLETE,Col:NONE,Output:
>
> Per suggestion in bug# TEZ-3971, creating this case under Hive project.
>
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HIVE-20187) Incorrect query results in hive when hive.convert.join.bucket.mapjoin.tez is set to true
[
https://issues.apache.org/jira/browse/HIVE-20187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16592788#comment-16592788
]
Gunther Hagleitner commented on HIVE-20187:
---
+1 LGTM.
> Incorrect query results in hive when hive.convert.join.bucket.mapjoin.tez is
> set to true
>
>
> Key: HIVE-20187
> URL: https://issues.apache.org/jira/browse/HIVE-20187
> Project: Hive
> Issue Type: Bug
>Affects Versions: 3.1.0
> Environment: Hive 3.0 and Tez 0.91
>Reporter: Karthik
>Assignee: Deepak Jaiswal
>Priority: Blocker
> Attachments: HIVE-20187.1.patch, HIVE-20187.2.patch,
> HIVE-20187.3.patch, extended_explain.txt
>
>
> When hive.convert.join.bucket.mapjoin.tez=true and bucketed column is in
> select clause but not in where clause, hive is performing a bucket map join
> and returning incorrect results. When the bucketed column is removed from
> select clause or hive.convert.join.bucket.mapjoin.tez=false, returned query
> results are correct.
>
> create table my_fact(AMT decimal(20,3),bucket_col string ,join_col string )
> PARTITIONED BY (FISCAL_YEAR string ,ACCOUNTING_PERIOD string )
> CLUSTERED BY (bucket_col) INTO 10
> BUCKETS
> stored as ORC
> ;
> create table my_dim(join_col string,filter_col string) stored as orc;
> After populating and analyzing above tables, explain plan looks as below
> when hive.convert.join.bucket.mapjoin.tez=TRUE:
>
> explain select T4.join_col as account1,my_fact.accounting_period
> FROM my_fact JOIN my_dim T4 ON my_fact.join_col = T4.join_col
> WHERE my_fact.fiscal_year = '2015'
> AND T4.filter_col IN ( 'VAL1', 'VAL2' )
> and my_fact.accounting_period in (10);
> Vertex dependency in root stage
> Map 1 <- Map 2 (CUSTOM_EDGE)
> Stage-0
> Fetch Operator
> limit:-1
> Stage-1
> Map 1 vectorized, llap
> File Output Operator [FS_24]
> Select Operator [SEL_23] (rows=15282589 width=291)
> Output:["_col0","_col1","_col2"]
> Map Join Operator [MAPJOIN_22] (rows=15282589 width=291)
> *BucketMapJoin*:true,Conds:SEL_21._col1=RS_19._col0(Inner),Output:["_col0","_col3","_col4"]
> <-Map 2 [CUSTOM_EDGE] vectorized, llap
> MULTICAST [RS_19]
> PartitionCols:_col0
> Select Operator [SEL_18] (rows=818 width=186)
> Output:["_col0"]
> Filter Operator [FIL_17] (rows=818 width=186)
> predicate:((filter_col) IN ('VAL1', 'VAL2') and join_col is not null)
> TableScan [TS_3] (rows=1635 width=186)
> default@my_dim,t4,Tbl:COMPLETE,Col:NONE,Output:["join_col","filter_col"]
> <-Select Operator [SEL_21] (rows=13893263 width=291)
> Output:["_col0","_col1","_col3"]
> Filter Operator [FIL_20] (rows=13893263 width=291)
> predicate:join_col is not null
> TableScan [TS_0] (rows=13893263 width=291)
>
> default@my_fact,my_fact,Tbl:COMPLETE,Col:NONE,Output:["bucket_col","join_col"]
> [^extended_explain.txt] has more detailed plan.
> When hive.convert.join.bucket.mapjoin.tez=false, plan no longer has
> bucketjoin and query results are correct.
> Vertex dependency in root stage
> Map 1 <- Map 2 (BROADCAST_EDGE)
> Stage-0
> Fetch Operator
> limit:-1
> Stage-1
> Map 1 vectorized, llap
> File Output Operator [FS_24]
> Select Operator [SEL_23] (rows=15282589 width=291)
> Output:["_col0","_col1","_col2"]
> Map Join Operator [MAPJOIN_22] (rows=15282589 width=291)
> Conds:SEL_21._col1=RS_19._col0(Inner),Output:["_col0","_col3","_col4"]
> <-Map 2 [BROADCAST_EDGE] vectorized, llap
> BROADCAST [RS_19]
> PartitionCols:_col0
> Select Operator [SEL_18] (rows=818 width=186)
> Output:["_col0"]
> Filter Operator [FIL_17] (rows=818 width=186)
> predicate:((filter_col) IN ('VAL1', 'VAL2') and join_col is not null)
> TableScan [TS_3] (rows=1635 width=186)
> default@my_dim,t4,Tbl:COMPLETE,Col:NONE,Output:["join_col","filter_col"]
> <-Select Operator [SEL_21] (rows=13893263 width=291)
> Output:["_col0","_col1","_col3"]
> Filter Operator [FIL_20] (rows=13893263 width=291)
> predicate:join_col is not null
> TableScan [TS_0] (rows=13893263 width=291)
> default@my_fact,my_fact,Tbl:COMPLETE,Col:NONE,Output:
>
> Per suggestion in bug# TEZ-3971, creating this case under Hive project.
>
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HIVE-20463) Hplsql.g4 - 'from_clause' parses the keyword `JOIN` into 'from_alias_clause' in 'from_table_clause' when parsing 'from_join_clause'
[
https://issues.apache.org/jira/browse/HIVE-20463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16592783#comment-16592783
]
Hive QA commented on HIVE-20463:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:red}-1{color} | {color:red} whitespace {color} | {color:red} 0m
1s{color} | {color:red} The patch has 8 line(s) that end in whitespace. Use git
apply --whitespace=fix <>. Refer https://git-scm.com/docs/git-apply
{color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 1m
1s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 1m 50s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.36-1+deb8u1 (2016-09-03) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-13473/dev-support/hive-personality.sh
|
| git revision | master / b627fa8 |
| whitespace |
http://104.198.109.242/logs//PreCommit-HIVE-Build-13473/yetus/whitespace-eol.txt
|
| modules | C: hplsql U: hplsql |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-13473/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Hplsql.g4 - 'from_clause' parses the keyword `JOIN` into 'from_alias_clause'
> in 'from_table_clause' when parsing 'from_join_clause'
> ---
>
> Key: HIVE-20463
> URL: https://issues.apache.org/jira/browse/HIVE-20463
> Project: Hive
> Issue Type: Bug
> Components: CLI
>Affects Versions: 3.1.0
>Reporter: Hao Zhou
>Assignee: Hao Zhou
>Priority: Major
> Labels: pull-request-available
> Fix For: 3.1.0
>
> Attachments: 0001-HIVE-20463-fix-parse-from_join_clause-error.patch,
> 0002-HIVE-20463-Test-Modify-select-test-case.patch
>
>
> 'from_clause' parses the keyword `JOIN` into 'from_alias_clause' in
> 'from_table_clause' when parsing 'from_join_clause'.
>
> example:
> Parse sql {{SELECT `k1, v1, k2, v2 FROM a JOIN b ON k1 = k2;`.}}
> Now grammar will parse `{{JOIN`}} as a `{{from_alias_clause`}}, but it should
> be
> a `{{from_join_clause`}};
>
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HIVE-20441) NPE in ExprNodeGenericFuncDesc when hive.allow.udf.load.on.demand is set to true
[
https://issues.apache.org/jira/browse/HIVE-20441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16592778#comment-16592778
]
Hive QA commented on HIVE-20441:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12937152/HIVE-20441.3.patch
{color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified.
{color:green}SUCCESS:{color} +1 due to 14898 tests passed
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/13472/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/13472/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-13472/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12937152 - PreCommit-HIVE-Build
> NPE in ExprNodeGenericFuncDesc when hive.allow.udf.load.on.demand is set to
> true
> -
>
> Key: HIVE-20441
> URL: https://issues.apache.org/jira/browse/HIVE-20441
> Project: Hive
> Issue Type: Bug
> Components: CLI, HiveServer2
>Affects Versions: 1.2.1, 2.3.3
>Reporter: Hui Huang
>Assignee: Hui Huang
>Priority: Major
> Fix For: 2.3.3
>
> Attachments: HIVE-20441.1.patch, HIVE-20441.2.patch,
> HIVE-20441.3.patch, HIVE-20441.patch
>
>
> When hive.allow.udf.load.on.demand is set to true and hiveserver2 has been
> started, the new created function from other clients or hiveserver2 will be
> loaded from the metastore at the first time.
> When the udf is used in where clause, we got a NPE like:
> {code:java}
> Error executing statement:
> org.apache.hive.service.cli.HiveSQLException: Error while compiling
> statement: FAILED: NullPointerException null
> at
> org.apache.hive.service.cli.operation.Operation.toSQLException(Operation.java:380)
> ~[hive-service-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hive.service.cli.operation.SQLOperation.prepare(SQLOperation.java:206)
> ~[hive-service-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hive.service.cli.operation.SQLOperation.runInternal(SQLOperation.java:290)
> ~[hive-service-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hive.service.cli.operation.Operation.run(Operation.java:320)
> ~[hive-service-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementInternal(HiveSessionImpl.java:530)
> ~[hive-service-2.3.4-SNAPSHOT.jar:2.3.4-SNAP
> SHOT]
> at
> org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementAsync(HiveSessionImpl.java:517)
> ~[hive-service-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHO
> T]
> at
> org.apache.hive.service.cli.CLIService.executeStatementAsync(CLIService.java:310)
> ~[hive-service-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hive.service.cli.thrift.ThriftCLIService.ExecuteStatement(ThriftCLIService.java:542)
> ~[hive-service-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hive.service.rpc.thrift.TCLIService$Processor$ExecuteStatement.getResult(TCLIService.java:1437)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.3.4-SNA
> PSHOT]
> at
> org.apache.hive.service.rpc.thrift.TCLIService$Processor$ExecuteStatement.getResult(TCLIService.java:1422)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.3.4-SNA
> PSHOT]
> at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hive.service.auth.TSetIpAddressProcessor.process(TSetIpAddressProcessor.java:57)
> ~[hive-service-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:286)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> [?:1.8.0_77]
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> [?:1.8.0_77]
> at java.lang.Thread.run(Thread.java:745) [?:1.8.0_77]
> Caused by: java.lang.NullPointerException
> at
> org.apache.hadoop.hive.ql.plan.ExprNodeGenericFuncDesc.newInstance(ExprNodeGenericFuncDesc.java:236)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
>
[jira] [Commented] (HIVE-20441) NPE in ExprNodeGenericFuncDesc when hive.allow.udf.load.on.demand is set to true
[
https://issues.apache.org/jira/browse/HIVE-20441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16592773#comment-16592773
]
Hive QA commented on HIVE-20441:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
38s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 8m
8s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
28s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
54s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 4m
4s{color} | {color:blue} ql in master has 2309 extant Findbugs warnings.
{color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
42s{color} | {color:blue} service in master has 48 extant Findbugs warnings.
{color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
18s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
9s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m
52s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
31s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m
31s{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m
12s{color} | {color:red} service: The patch generated 1 new + 0 unchanged - 0
fixed = 1 total (was 0) {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 5m
8s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
16s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
14s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 28m 56s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.36-1+deb8u1 (2016-09-03) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-13472/dev-support/hive-personality.sh
|
| git revision | master / b627fa8 |
| Default Java | 1.8.0_111 |
| findbugs | v3.0.0 |
| checkstyle |
http://104.198.109.242/logs//PreCommit-HIVE-Build-13472/yetus/diff-checkstyle-service.txt
|
| modules | C: ql service U: . |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-13472/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> NPE in ExprNodeGenericFuncDesc when hive.allow.udf.load.on.demand is set to
> true
> -
>
> Key: HIVE-20441
> URL: https://issues.apache.org/jira/browse/HIVE-20441
> Project: Hive
> Issue Type: Bug
> Components: CLI, HiveServer2
>Affects Versions: 1.2.1, 2.3.3
>Reporter: Hui Huang
>Assignee: Hui Huang
>Priority: Major
> Fix For: 2.3.3
>
> Attachments: HIVE-20441.1.patch, HIVE-20441.2.patch,
> HIVE-20441.3.patch, HIVE-20441.patch
>
>
> When hive.allow.udf.load.on.demand is set to true and hiveserver2 has been
> started, the new created function from other clients or hiveserver2 will be
> loaded from the metastore at the first time.
> When the udf is used in where clause, we got a NPE like:
> {code:java}
> Error executing statement:
> org.apache.hive.service.cli.HiveSQLException: Error while compiling
> statement: FAILED: NullPointerException null
> at
>
[jira] [Updated] (HIVE-20463) Hplsql.g4 - 'from_clause' parses the keyword `JOIN` into 'from_alias_clause' in 'from_table_clause' when parsing 'from_join_clause'
[
https://issues.apache.org/jira/browse/HIVE-20463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hao Zhou updated HIVE-20463:
Attachment: 0002-HIVE-20463-Test-Modify-select-test-case.patch
Status: Patch Available (was: Reopened)
> Hplsql.g4 - 'from_clause' parses the keyword `JOIN` into 'from_alias_clause'
> in 'from_table_clause' when parsing 'from_join_clause'
> ---
>
> Key: HIVE-20463
> URL: https://issues.apache.org/jira/browse/HIVE-20463
> Project: Hive
> Issue Type: Bug
> Components: CLI
>Affects Versions: 3.1.0
>Reporter: Hao Zhou
>Assignee: Hao Zhou
>Priority: Major
> Labels: pull-request-available
> Fix For: 3.1.0
>
> Attachments: 0001-HIVE-20463-fix-parse-from_join_clause-error.patch,
> 0002-HIVE-20463-Test-Modify-select-test-case.patch
>
>
> 'from_clause' parses the keyword `JOIN` into 'from_alias_clause' in
> 'from_table_clause' when parsing 'from_join_clause'.
>
> example:
> Parse sql {{SELECT `k1, v1, k2, v2 FROM a JOIN b ON k1 = k2;`.}}
> Now grammar will parse `{{JOIN`}} as a `{{from_alias_clause`}}, but it should
> be
> a `{{from_join_clause`}};
>
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (HIVE-20441) NPE in ExprNodeGenericFuncDesc when hive.allow.udf.load.on.demand is set to true
[
https://issues.apache.org/jira/browse/HIVE-20441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hui Huang updated HIVE-20441:
-
Status: Patch Available (was: In Progress)
> NPE in ExprNodeGenericFuncDesc when hive.allow.udf.load.on.demand is set to
> true
> -
>
> Key: HIVE-20441
> URL: https://issues.apache.org/jira/browse/HIVE-20441
> Project: Hive
> Issue Type: Bug
> Components: CLI, HiveServer2
>Affects Versions: 1.2.1, 2.3.3
>Reporter: Hui Huang
>Assignee: Hui Huang
>Priority: Major
> Fix For: 2.3.3
>
> Attachments: HIVE-20441.1.patch, HIVE-20441.2.patch,
> HIVE-20441.3.patch, HIVE-20441.patch
>
>
> When hive.allow.udf.load.on.demand is set to true and hiveserver2 has been
> started, the new created function from other clients or hiveserver2 will be
> loaded from the metastore at the first time.
> When the udf is used in where clause, we got a NPE like:
> {code:java}
> Error executing statement:
> org.apache.hive.service.cli.HiveSQLException: Error while compiling
> statement: FAILED: NullPointerException null
> at
> org.apache.hive.service.cli.operation.Operation.toSQLException(Operation.java:380)
> ~[hive-service-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hive.service.cli.operation.SQLOperation.prepare(SQLOperation.java:206)
> ~[hive-service-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hive.service.cli.operation.SQLOperation.runInternal(SQLOperation.java:290)
> ~[hive-service-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hive.service.cli.operation.Operation.run(Operation.java:320)
> ~[hive-service-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementInternal(HiveSessionImpl.java:530)
> ~[hive-service-2.3.4-SNAPSHOT.jar:2.3.4-SNAP
> SHOT]
> at
> org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementAsync(HiveSessionImpl.java:517)
> ~[hive-service-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHO
> T]
> at
> org.apache.hive.service.cli.CLIService.executeStatementAsync(CLIService.java:310)
> ~[hive-service-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hive.service.cli.thrift.ThriftCLIService.ExecuteStatement(ThriftCLIService.java:542)
> ~[hive-service-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hive.service.rpc.thrift.TCLIService$Processor$ExecuteStatement.getResult(TCLIService.java:1437)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.3.4-SNA
> PSHOT]
> at
> org.apache.hive.service.rpc.thrift.TCLIService$Processor$ExecuteStatement.getResult(TCLIService.java:1422)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.3.4-SNA
> PSHOT]
> at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hive.service.auth.TSetIpAddressProcessor.process(TSetIpAddressProcessor.java:57)
> ~[hive-service-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:286)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> [?:1.8.0_77]
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> [?:1.8.0_77]
> at java.lang.Thread.run(Thread.java:745) [?:1.8.0_77]
> Caused by: java.lang.NullPointerException
> at
> org.apache.hadoop.hive.ql.plan.ExprNodeGenericFuncDesc.newInstance(ExprNodeGenericFuncDesc.java:236)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hadoop.hive.ql.parse.TypeCheckProcFactory$DefaultExprProcessor.getXpathOrFuncExprNodeDesc(TypeCheckProcFactory.java:1104)
> ~[hive-exec-2.
> 3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hadoop.hive.ql.parse.TypeCheckProcFactory$DefaultExprProcessor.process(TypeCheckProcFactory.java:1359)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.
> 3.4-SNAPSHOT]
> at
> org.apache.hadoop.hive.ql.lib.DefaultRuleDispatcher.dispatch(DefaultRuleDispatcher.java:90)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.dispatchAndReturn(DefaultGraphWalker.java:105)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.dispatch(DefaultGraphWalker.java:89)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hadoop.hive.ql.lib.ExpressionWalker.walk(ExpressionWalker.java:76)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
>
[jira] [Updated] (HIVE-20441) NPE in ExprNodeGenericFuncDesc when hive.allow.udf.load.on.demand is set to true
[
https://issues.apache.org/jira/browse/HIVE-20441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hui Huang updated HIVE-20441:
-
Attachment: HIVE-20441.3.patch
> NPE in ExprNodeGenericFuncDesc when hive.allow.udf.load.on.demand is set to
> true
> -
>
> Key: HIVE-20441
> URL: https://issues.apache.org/jira/browse/HIVE-20441
> Project: Hive
> Issue Type: Bug
> Components: CLI, HiveServer2
>Affects Versions: 1.2.1, 2.3.3
>Reporter: Hui Huang
>Assignee: Hui Huang
>Priority: Major
> Fix For: 2.3.3
>
> Attachments: HIVE-20441.1.patch, HIVE-20441.2.patch,
> HIVE-20441.3.patch, HIVE-20441.patch
>
>
> When hive.allow.udf.load.on.demand is set to true and hiveserver2 has been
> started, the new created function from other clients or hiveserver2 will be
> loaded from the metastore at the first time.
> When the udf is used in where clause, we got a NPE like:
> {code:java}
> Error executing statement:
> org.apache.hive.service.cli.HiveSQLException: Error while compiling
> statement: FAILED: NullPointerException null
> at
> org.apache.hive.service.cli.operation.Operation.toSQLException(Operation.java:380)
> ~[hive-service-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hive.service.cli.operation.SQLOperation.prepare(SQLOperation.java:206)
> ~[hive-service-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hive.service.cli.operation.SQLOperation.runInternal(SQLOperation.java:290)
> ~[hive-service-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hive.service.cli.operation.Operation.run(Operation.java:320)
> ~[hive-service-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementInternal(HiveSessionImpl.java:530)
> ~[hive-service-2.3.4-SNAPSHOT.jar:2.3.4-SNAP
> SHOT]
> at
> org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementAsync(HiveSessionImpl.java:517)
> ~[hive-service-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHO
> T]
> at
> org.apache.hive.service.cli.CLIService.executeStatementAsync(CLIService.java:310)
> ~[hive-service-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hive.service.cli.thrift.ThriftCLIService.ExecuteStatement(ThriftCLIService.java:542)
> ~[hive-service-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hive.service.rpc.thrift.TCLIService$Processor$ExecuteStatement.getResult(TCLIService.java:1437)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.3.4-SNA
> PSHOT]
> at
> org.apache.hive.service.rpc.thrift.TCLIService$Processor$ExecuteStatement.getResult(TCLIService.java:1422)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.3.4-SNA
> PSHOT]
> at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hive.service.auth.TSetIpAddressProcessor.process(TSetIpAddressProcessor.java:57)
> ~[hive-service-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:286)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> [?:1.8.0_77]
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> [?:1.8.0_77]
> at java.lang.Thread.run(Thread.java:745) [?:1.8.0_77]
> Caused by: java.lang.NullPointerException
> at
> org.apache.hadoop.hive.ql.plan.ExprNodeGenericFuncDesc.newInstance(ExprNodeGenericFuncDesc.java:236)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hadoop.hive.ql.parse.TypeCheckProcFactory$DefaultExprProcessor.getXpathOrFuncExprNodeDesc(TypeCheckProcFactory.java:1104)
> ~[hive-exec-2.
> 3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hadoop.hive.ql.parse.TypeCheckProcFactory$DefaultExprProcessor.process(TypeCheckProcFactory.java:1359)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.
> 3.4-SNAPSHOT]
> at
> org.apache.hadoop.hive.ql.lib.DefaultRuleDispatcher.dispatch(DefaultRuleDispatcher.java:90)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.dispatchAndReturn(DefaultGraphWalker.java:105)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.dispatch(DefaultGraphWalker.java:89)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hadoop.hive.ql.lib.ExpressionWalker.walk(ExpressionWalker.java:76)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
>
[jira] [Updated] (HIVE-20441) NPE in ExprNodeGenericFuncDesc when hive.allow.udf.load.on.demand is set to true
[
https://issues.apache.org/jira/browse/HIVE-20441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hui Huang updated HIVE-20441:
-
Status: In Progress (was: Patch Available)
> NPE in ExprNodeGenericFuncDesc when hive.allow.udf.load.on.demand is set to
> true
> -
>
> Key: HIVE-20441
> URL: https://issues.apache.org/jira/browse/HIVE-20441
> Project: Hive
> Issue Type: Bug
> Components: CLI, HiveServer2
>Affects Versions: 1.2.1, 2.3.3
>Reporter: Hui Huang
>Assignee: Hui Huang
>Priority: Major
> Fix For: 2.3.3
>
> Attachments: HIVE-20441.1.patch, HIVE-20441.2.patch,
> HIVE-20441.3.patch, HIVE-20441.patch
>
>
> When hive.allow.udf.load.on.demand is set to true and hiveserver2 has been
> started, the new created function from other clients or hiveserver2 will be
> loaded from the metastore at the first time.
> When the udf is used in where clause, we got a NPE like:
> {code:java}
> Error executing statement:
> org.apache.hive.service.cli.HiveSQLException: Error while compiling
> statement: FAILED: NullPointerException null
> at
> org.apache.hive.service.cli.operation.Operation.toSQLException(Operation.java:380)
> ~[hive-service-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hive.service.cli.operation.SQLOperation.prepare(SQLOperation.java:206)
> ~[hive-service-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hive.service.cli.operation.SQLOperation.runInternal(SQLOperation.java:290)
> ~[hive-service-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hive.service.cli.operation.Operation.run(Operation.java:320)
> ~[hive-service-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementInternal(HiveSessionImpl.java:530)
> ~[hive-service-2.3.4-SNAPSHOT.jar:2.3.4-SNAP
> SHOT]
> at
> org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementAsync(HiveSessionImpl.java:517)
> ~[hive-service-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHO
> T]
> at
> org.apache.hive.service.cli.CLIService.executeStatementAsync(CLIService.java:310)
> ~[hive-service-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hive.service.cli.thrift.ThriftCLIService.ExecuteStatement(ThriftCLIService.java:542)
> ~[hive-service-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hive.service.rpc.thrift.TCLIService$Processor$ExecuteStatement.getResult(TCLIService.java:1437)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.3.4-SNA
> PSHOT]
> at
> org.apache.hive.service.rpc.thrift.TCLIService$Processor$ExecuteStatement.getResult(TCLIService.java:1422)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.3.4-SNA
> PSHOT]
> at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hive.service.auth.TSetIpAddressProcessor.process(TSetIpAddressProcessor.java:57)
> ~[hive-service-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:286)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> [?:1.8.0_77]
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> [?:1.8.0_77]
> at java.lang.Thread.run(Thread.java:745) [?:1.8.0_77]
> Caused by: java.lang.NullPointerException
> at
> org.apache.hadoop.hive.ql.plan.ExprNodeGenericFuncDesc.newInstance(ExprNodeGenericFuncDesc.java:236)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hadoop.hive.ql.parse.TypeCheckProcFactory$DefaultExprProcessor.getXpathOrFuncExprNodeDesc(TypeCheckProcFactory.java:1104)
> ~[hive-exec-2.
> 3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hadoop.hive.ql.parse.TypeCheckProcFactory$DefaultExprProcessor.process(TypeCheckProcFactory.java:1359)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.
> 3.4-SNAPSHOT]
> at
> org.apache.hadoop.hive.ql.lib.DefaultRuleDispatcher.dispatch(DefaultRuleDispatcher.java:90)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.dispatchAndReturn(DefaultGraphWalker.java:105)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.dispatch(DefaultGraphWalker.java:89)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hadoop.hive.ql.lib.ExpressionWalker.walk(ExpressionWalker.java:76)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
>
[jira] [Reopened] (HIVE-20463) Hplsql.g4 - 'from_clause' parses the keyword `JOIN` into 'from_alias_clause' in 'from_table_clause' when parsing 'from_join_clause'
[
https://issues.apache.org/jira/browse/HIVE-20463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hao Zhou reopened HIVE-20463:
-
> Hplsql.g4 - 'from_clause' parses the keyword `JOIN` into 'from_alias_clause'
> in 'from_table_clause' when parsing 'from_join_clause'
> ---
>
> Key: HIVE-20463
> URL: https://issues.apache.org/jira/browse/HIVE-20463
> Project: Hive
> Issue Type: Bug
> Components: CLI
>Affects Versions: 3.1.0
>Reporter: Hao Zhou
>Assignee: Hao Zhou
>Priority: Major
> Labels: pull-request-available
> Fix For: 3.1.0
>
> Attachments: 0001-HIVE-20463-fix-parse-from_join_clause-error.patch
>
>
> 'from_clause' parses the keyword `JOIN` into 'from_alias_clause' in
> 'from_table_clause' when parsing 'from_join_clause'.
>
> example:
> Parse sql {{SELECT `k1, v1, k2, v2 FROM a JOIN b ON k1 = k2;`.}}
> Now grammar will parse `{{JOIN`}} as a `{{from_alias_clause`}}, but it should
> be
> a `{{from_join_clause`}};
>
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (HIVE-20455) Log spew from security.authorization.PrivilegeSynchonizer.run
[
https://issues.apache.org/jira/browse/HIVE-20455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Daniel Dai updated HIVE-20455:
--
Resolution: Fixed
Hadoop Flags: Reviewed
Fix Version/s: 3.2.0
4.0.0
Status: Resolved (was: Patch Available)
Patch pushed to master/branch-3. Thanks Gopal bringing it out and reviewing the
patch!
> Log spew from security.authorization.PrivilegeSynchonizer.run
> --
>
> Key: HIVE-20455
> URL: https://issues.apache.org/jira/browse/HIVE-20455
> Project: Hive
> Issue Type: Bug
>Reporter: Gopal V
>Assignee: Daniel Dai
>Priority: Major
> Fix For: 4.0.0, 3.2.0
>
> Attachments: HIVE-20455.1.patch, HIVE-20455.2.patch
>
>
> Typo in the class name aside, this keeps running and thrashing through every
> single DB in the cluster if not all directories are actually accessible to
> the user who runs HS2.
> {code}
> 2018-08-24T03:14:41,932 INFO [PrivilegeSynchonizer] metastore.HiveMetaStore:
> 1: get_table : tbl=hive.airline_ontime.flights_raw
> 2018-08-24T03:14:41,932 INFO [PrivilegeSynchonizer] HiveMetaStore.audit:
> ugi=gopal ip=unknown-ip-addr cmd=get_table :
> tbl=hive.airline_ontime.flights_raw
> {code}
> The minimum fix needed is to move the Thread.sleep() outside of the try/catch
> block, so that the sleep is triggered even if the attempt throws an exception.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HIVE-20463) Hplsql.g4 - 'from_clause' parses the keyword `JOIN` into 'from_alias_clause' in 'from_table_clause' when parsing 'from_join_clause'
[
https://issues.apache.org/jira/browse/HIVE-20463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16592660#comment-16592660
]
Hive QA commented on HIVE-20463:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12937139/0001-HIVE-20463-fix-parse-from_join_clause-error.patch
{color:red}ERROR:{color} -1 due to no test(s) being added or modified.
{color:green}SUCCESS:{color} +1 due to 14897 tests passed
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/13471/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/13471/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-13471/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12937139 - PreCommit-HIVE-Build
> Hplsql.g4 - 'from_clause' parses the keyword `JOIN` into 'from_alias_clause'
> in 'from_table_clause' when parsing 'from_join_clause'
> ---
>
> Key: HIVE-20463
> URL: https://issues.apache.org/jira/browse/HIVE-20463
> Project: Hive
> Issue Type: Bug
> Components: CLI
>Affects Versions: 3.1.0
>Reporter: Hao Zhou
>Assignee: Hao Zhou
>Priority: Major
> Labels: pull-request-available
> Fix For: 3.1.0
>
> Attachments: 0001-HIVE-20463-fix-parse-from_join_clause-error.patch
>
>
> 'from_clause' parses the keyword `JOIN` into 'from_alias_clause' in
> 'from_table_clause' when parsing 'from_join_clause'.
>
> example:
> Parse sql {{SELECT `k1, v1, k2, v2 FROM a JOIN b ON k1 = k2;`.}}
> Now grammar will parse `{{JOIN`}} as a `{{from_alias_clause`}}, but it should
> be
> a `{{from_join_clause`}};
>
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (HIVE-20463) Hplsql.g4 - 'from_clause' parses the keyword `JOIN` into 'from_alias_clause' in 'from_table_clause' when parsing 'from_join_clause'
[
https://issues.apache.org/jira/browse/HIVE-20463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hao Zhou updated HIVE-20463:
Resolution: Fixed
Status: Resolved (was: Patch Available)
> Hplsql.g4 - 'from_clause' parses the keyword `JOIN` into 'from_alias_clause'
> in 'from_table_clause' when parsing 'from_join_clause'
> ---
>
> Key: HIVE-20463
> URL: https://issues.apache.org/jira/browse/HIVE-20463
> Project: Hive
> Issue Type: Bug
> Components: CLI
>Affects Versions: 3.1.0
>Reporter: Hao Zhou
>Assignee: Hao Zhou
>Priority: Major
> Labels: pull-request-available
> Fix For: 3.1.0
>
> Attachments: 0001-HIVE-20463-fix-parse-from_join_clause-error.patch
>
>
> 'from_clause' parses the keyword `JOIN` into 'from_alias_clause' in
> 'from_table_clause' when parsing 'from_join_clause'.
>
> example:
> Parse sql {{SELECT `k1, v1, k2, v2 FROM a JOIN b ON k1 = k2;`.}}
> Now grammar will parse `{{JOIN`}} as a `{{from_alias_clause`}}, but it should
> be
> a `{{from_join_clause`}};
>
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HIVE-20463) Hplsql.g4 - 'from_clause' parses the keyword `JOIN` into 'from_alias_clause' in 'from_table_clause' when parsing 'from_join_clause'
[
https://issues.apache.org/jira/browse/HIVE-20463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16592651#comment-16592651
]
Hive QA commented on HIVE-20463:
| (/) *{color:green}+1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 8m
32s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
17s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 0m
18s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
19s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
13s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 9m 51s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.36-1+deb8u1 (2016-09-03) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-13471/dev-support/hive-personality.sh
|
| git revision | master / fa36381 |
| Default Java | 1.8.0_111 |
| modules | C: hplsql U: hplsql |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-13471/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Hplsql.g4 - 'from_clause' parses the keyword `JOIN` into 'from_alias_clause'
> in 'from_table_clause' when parsing 'from_join_clause'
> ---
>
> Key: HIVE-20463
> URL: https://issues.apache.org/jira/browse/HIVE-20463
> Project: Hive
> Issue Type: Bug
> Components: CLI
>Affects Versions: 3.1.0
>Reporter: Hao Zhou
>Assignee: Hao Zhou
>Priority: Major
> Labels: pull-request-available
> Fix For: 3.1.0
>
> Attachments: 0001-HIVE-20463-fix-parse-from_join_clause-error.patch
>
>
> 'from_clause' parses the keyword `JOIN` into 'from_alias_clause' in
> 'from_table_clause' when parsing 'from_join_clause'.
>
> example:
> Parse sql {{SELECT `k1, v1, k2, v2 FROM a JOIN b ON k1 = k2;`.}}
> Now grammar will parse `{{JOIN`}} as a `{{from_alias_clause`}}, but it should
> be
> a `{{from_join_clause`}};
>
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (HIVE-20315) Vectorization: Fix more NULL / Wrong Results issues and avoid unnecessary casts/conversions
[ https://issues.apache.org/jira/browse/HIVE-20315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt McCline updated HIVE-20315: Resolution: Fixed Status: Resolved (was: Patch Available) > Vectorization: Fix more NULL / Wrong Results issues and avoid unnecessary > casts/conversions > --- > > Key: HIVE-20315 > URL: https://issues.apache.org/jira/browse/HIVE-20315 > Project: Hive > Issue Type: Bug > Components: Hive >Reporter: Matt McCline >Assignee: Matt McCline >Priority: Critical > Fix For: 4.0.0 > > Attachments: HIVE-20315.01.patch, HIVE-20315.02.patch, > HIVE-20315.03.patch, HIVE-20315.04.patch, HIVE-20315.05.patch, > HIVE-20315.06.patch, HIVE-20315.07.patch, HIVE-20315.08.patch, > HIVE-20315.09.patch, HIVE-20315.092.patch, HIVE-20315.093.patch > > > Generate multi-byte Unicode characters in addition to regular single byte > characters for random data. > Don't CAST from STRING/VARCHAR/CHAR TO STRING since all are stored in > vectorization without padding. > Fix vectorized BETWEEN expression work to avoid unnecessary CAST of DECIMAL > constants. > Fix NULL / Wrong Results issues in VectorElt. > Add test for vectorized STRUCT field reference. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-20315) Vectorization: Fix more NULL / Wrong Results issues and avoid unnecessary casts/conversions
[ https://issues.apache.org/jira/browse/HIVE-20315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16592641#comment-16592641 ] Matt McCline commented on HIVE-20315: - Committed to master. > Vectorization: Fix more NULL / Wrong Results issues and avoid unnecessary > casts/conversions > --- > > Key: HIVE-20315 > URL: https://issues.apache.org/jira/browse/HIVE-20315 > Project: Hive > Issue Type: Bug > Components: Hive >Reporter: Matt McCline >Assignee: Matt McCline >Priority: Critical > Fix For: 4.0.0 > > Attachments: HIVE-20315.01.patch, HIVE-20315.02.patch, > HIVE-20315.03.patch, HIVE-20315.04.patch, HIVE-20315.05.patch, > HIVE-20315.06.patch, HIVE-20315.07.patch, HIVE-20315.08.patch, > HIVE-20315.09.patch, HIVE-20315.092.patch, HIVE-20315.093.patch > > > Generate multi-byte Unicode characters in addition to regular single byte > characters for random data. > Don't CAST from STRING/VARCHAR/CHAR TO STRING since all are stored in > vectorization without padding. > Fix vectorized BETWEEN expression work to avoid unnecessary CAST of DECIMAL > constants. > Fix NULL / Wrong Results issues in VectorElt. > Add test for vectorized STRUCT field reference. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-20463) Hplsql.g4 - 'from_clause' parses the keyword `JOIN` into 'from_alias_clause' in 'from_table_clause' when parsing 'from_join_clause'
[
https://issues.apache.org/jira/browse/HIVE-20463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16592638#comment-16592638
]
ASF GitHub Bot commented on HIVE-20463:
---
GitHub user lleohao opened a pull request:
https://github.com/apache/hive/pull/422
HIVE-20463: fix parse `from_join_clause` error
Fix https://issues.apache.org/jira/browse/HIVE-20463
Signed-off-by: Hao Zhou lleo...@hotmail.com
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/lleohao/hive master
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/hive/pull/422.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #422
commit a1634bac6b65b8be5d2d4090222ec2a8aae87bf6
Author: lleohao
Date: 2018-08-25T16:04:31Z
HIVE-20463: fix parse `from_join_clause` error
> Hplsql.g4 - 'from_clause' parses the keyword `JOIN` into 'from_alias_clause'
> in 'from_table_clause' when parsing 'from_join_clause'
> ---
>
> Key: HIVE-20463
> URL: https://issues.apache.org/jira/browse/HIVE-20463
> Project: Hive
> Issue Type: Bug
> Components: CLI
>Affects Versions: 3.1.0
>Reporter: Hao Zhou
>Assignee: Hao Zhou
>Priority: Major
> Labels: pull-request-available
> Fix For: 3.1.0
>
> Attachments: 0001-HIVE-20463-fix-parse-from_join_clause-error.patch
>
>
> 'from_clause' parses the keyword `JOIN` into 'from_alias_clause' in
> 'from_table_clause' when parsing 'from_join_clause'.
>
> example:
> Parse sql {{SELECT `k1, v1, k2, v2 FROM a JOIN b ON k1 = k2;`.}}
> Now grammar will parse `{{JOIN`}} as a `{{from_alias_clause`}}, but it should
> be
> a `{{from_join_clause`}};
>
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (HIVE-20463) Hplsql.g4 - 'from_clause' parses the keyword `JOIN` into 'from_alias_clause' in 'from_table_clause' when parsing 'from_join_clause'
[
https://issues.apache.org/jira/browse/HIVE-20463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HIVE-20463:
--
Labels: pull-request-available (was: )
> Hplsql.g4 - 'from_clause' parses the keyword `JOIN` into 'from_alias_clause'
> in 'from_table_clause' when parsing 'from_join_clause'
> ---
>
> Key: HIVE-20463
> URL: https://issues.apache.org/jira/browse/HIVE-20463
> Project: Hive
> Issue Type: Bug
> Components: CLI
>Affects Versions: 3.1.0
>Reporter: Hao Zhou
>Assignee: Hao Zhou
>Priority: Major
> Labels: pull-request-available
> Fix For: 3.1.0
>
> Attachments: 0001-HIVE-20463-fix-parse-from_join_clause-error.patch
>
>
> 'from_clause' parses the keyword `JOIN` into 'from_alias_clause' in
> 'from_table_clause' when parsing 'from_join_clause'.
>
> example:
> Parse sql {{SELECT `k1, v1, k2, v2 FROM a JOIN b ON k1 = k2;`.}}
> Now grammar will parse `{{JOIN`}} as a `{{from_alias_clause`}}, but it should
> be
> a `{{from_join_clause`}};
>
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (HIVE-20463) Hplsql.g4 - 'from_clause' parses the keyword `JOIN` into 'from_alias_clause' in 'from_table_clause' when parsing 'from_join_clause'
[
https://issues.apache.org/jira/browse/HIVE-20463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hao Zhou updated HIVE-20463:
Attachment: 0001-HIVE-20463-fix-parse-from_join_clause-error.patch
Status: Patch Available (was: In Progress)
> Hplsql.g4 - 'from_clause' parses the keyword `JOIN` into 'from_alias_clause'
> in 'from_table_clause' when parsing 'from_join_clause'
> ---
>
> Key: HIVE-20463
> URL: https://issues.apache.org/jira/browse/HIVE-20463
> Project: Hive
> Issue Type: Bug
> Components: CLI
>Affects Versions: 3.1.0
>Reporter: Hao Zhou
>Assignee: Hao Zhou
>Priority: Major
> Fix For: 3.1.0
>
> Attachments: 0001-HIVE-20463-fix-parse-from_join_clause-error.patch
>
>
> 'from_clause' parses the keyword `JOIN` into 'from_alias_clause' in
> 'from_table_clause' when parsing 'from_join_clause'.
>
> example:
> Parse sql {{SELECT `k1, v1, k2, v2 FROM a JOIN b ON k1 = k2;`.}}
> Now grammar will parse `{{JOIN`}} as a `{{from_alias_clause`}}, but it should
> be
> a `{{from_join_clause`}};
>
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Assigned] (HIVE-20463) Hplsql.g4 - 'from_clause' parses the keyword `JOIN` into 'from_alias_clause' in 'from_table_clause' when parsing 'from_join_clause'
[
https://issues.apache.org/jira/browse/HIVE-20463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hao Zhou reassigned HIVE-20463:
---
> Hplsql.g4 - 'from_clause' parses the keyword `JOIN` into 'from_alias_clause'
> in 'from_table_clause' when parsing 'from_join_clause'
> ---
>
> Key: HIVE-20463
> URL: https://issues.apache.org/jira/browse/HIVE-20463
> Project: Hive
> Issue Type: Bug
> Components: CLI
>Affects Versions: 3.1.0
>Reporter: Hao Zhou
>Assignee: Hao Zhou
>Priority: Major
> Fix For: 3.1.0
>
>
> 'from_clause' parses the keyword `JOIN` into 'from_alias_clause' in
> 'from_table_clause' when parsing 'from_join_clause'.
>
> example:
> Parse sql {{SELECT `k1, v1, k2, v2 FROM a JOIN b ON k1 = k2;`.}}
> Now grammar will parse `{{JOIN`}} as a `{{from_alias_clause`}}, but it should
> be
> a `{{from_join_clause`}};
>
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Work started] (HIVE-20463) Hplsql.g4 - 'from_clause' parses the keyword `JOIN` into 'from_alias_clause' in 'from_table_clause' when parsing 'from_join_clause'
[
https://issues.apache.org/jira/browse/HIVE-20463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Work on HIVE-20463 started by Hao Zhou.
---
> Hplsql.g4 - 'from_clause' parses the keyword `JOIN` into 'from_alias_clause'
> in 'from_table_clause' when parsing 'from_join_clause'
> ---
>
> Key: HIVE-20463
> URL: https://issues.apache.org/jira/browse/HIVE-20463
> Project: Hive
> Issue Type: Bug
> Components: CLI
>Affects Versions: 3.1.0
>Reporter: Hao Zhou
>Assignee: Hao Zhou
>Priority: Major
> Fix For: 3.1.0
>
>
> 'from_clause' parses the keyword `JOIN` into 'from_alias_clause' in
> 'from_table_clause' when parsing 'from_join_clause'.
>
> example:
> Parse sql {{SELECT `k1, v1, k2, v2 FROM a JOIN b ON k1 = k2;`.}}
> Now grammar will parse `{{JOIN`}} as a `{{from_alias_clause`}}, but it should
> be
> a `{{from_join_clause`}};
>
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HIVE-20315) Vectorization: Fix more NULL / Wrong Results issues and avoid unnecessary casts/conversions
[
https://issues.apache.org/jira/browse/HIVE-20315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16592594#comment-16592594
]
Hive QA commented on HIVE-20315:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12937132/HIVE-20315.093.patch
{color:green}SUCCESS:{color} +1 due to 21 test(s) being added or modified.
{color:green}SUCCESS:{color} +1 due to 14897 tests passed
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/13470/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/13470/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-13470/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12937132 - PreCommit-HIVE-Build
> Vectorization: Fix more NULL / Wrong Results issues and avoid unnecessary
> casts/conversions
> ---
>
> Key: HIVE-20315
> URL: https://issues.apache.org/jira/browse/HIVE-20315
> Project: Hive
> Issue Type: Bug
> Components: Hive
>Reporter: Matt McCline
>Assignee: Matt McCline
>Priority: Critical
> Fix For: 4.0.0
>
> Attachments: HIVE-20315.01.patch, HIVE-20315.02.patch,
> HIVE-20315.03.patch, HIVE-20315.04.patch, HIVE-20315.05.patch,
> HIVE-20315.06.patch, HIVE-20315.07.patch, HIVE-20315.08.patch,
> HIVE-20315.09.patch, HIVE-20315.092.patch, HIVE-20315.093.patch
>
>
> Generate multi-byte Unicode characters in addition to regular single byte
> characters for random data.
> Don't CAST from STRING/VARCHAR/CHAR TO STRING since all are stored in
> vectorization without padding.
> Fix vectorized BETWEEN expression work to avoid unnecessary CAST of DECIMAL
> constants.
> Fix NULL / Wrong Results issues in VectorElt.
> Add test for vectorized STRUCT field reference.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HIVE-20315) Vectorization: Fix more NULL / Wrong Results issues and avoid unnecessary casts/conversions
[
https://issues.apache.org/jira/browse/HIVE-20315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16592577#comment-16592577
]
Hive QA commented on HIVE-20315:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
34s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 7m
39s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
19s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 1m
9s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
39s{color} | {color:blue} serde in master has 195 extant Findbugs warnings.
{color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 4m
1s{color} | {color:blue} ql in master has 2309 extant Findbugs warnings.
{color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
12s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
11s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m
45s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
21s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m
21s{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m
14s{color} | {color:red} serde: The patch generated 2 new + 4 unchanged - 0
fixed = 6 total (was 4) {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m
58s{color} | {color:red} ql: The patch generated 82 new + 1731 unchanged - 78
fixed = 1813 total (was 1809) {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 5m
6s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
13s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
13s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 28m 22s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.36-1+deb8u1 (2016-09-03) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-13470/dev-support/hive-personality.sh
|
| git revision | master / e2142b2 |
| Default Java | 1.8.0_111 |
| findbugs | v3.0.0 |
| checkstyle |
http://104.198.109.242/logs//PreCommit-HIVE-Build-13470/yetus/diff-checkstyle-serde.txt
|
| checkstyle |
http://104.198.109.242/logs//PreCommit-HIVE-Build-13470/yetus/diff-checkstyle-ql.txt
|
| modules | C: serde ql U: . |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-13470/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Vectorization: Fix more NULL / Wrong Results issues and avoid unnecessary
> casts/conversions
> ---
>
> Key: HIVE-20315
> URL: https://issues.apache.org/jira/browse/HIVE-20315
> Project: Hive
> Issue Type: Bug
> Components: Hive
>Reporter: Matt McCline
>Assignee: Matt McCline
>Priority: Critical
> Fix For: 4.0.0
>
> Attachments: HIVE-20315.01.patch, HIVE-20315.02.patch,
> HIVE-20315.03.patch, HIVE-20315.04.patch, HIVE-20315.05.patch,
> HIVE-20315.06.patch, HIVE-20315.07.patch, HIVE-20315.08.patch,
> HIVE-20315.09.patch, HIVE-20315.092.patch, HIVE-20315.093.patch
>
>
> Generate multi-byte
[jira] [Commented] (HIVE-20441) NPE in ExprNodeGenericFuncDesc when hive.allow.udf.load.on.demand is set to true
[
https://issues.apache.org/jira/browse/HIVE-20441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16592574#comment-16592574
]
Hive QA commented on HIVE-20441:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12937130/HIVE-20441.2.patch
{color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified.
{color:green}SUCCESS:{color} +1 due to 14897 tests passed
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/13469/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/13469/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-13469/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12937130 - PreCommit-HIVE-Build
> NPE in ExprNodeGenericFuncDesc when hive.allow.udf.load.on.demand is set to
> true
> -
>
> Key: HIVE-20441
> URL: https://issues.apache.org/jira/browse/HIVE-20441
> Project: Hive
> Issue Type: Bug
> Components: CLI, HiveServer2
>Affects Versions: 1.2.1, 2.3.3
>Reporter: Hui Huang
>Assignee: Hui Huang
>Priority: Major
> Fix For: 2.3.3
>
> Attachments: HIVE-20441.1.patch, HIVE-20441.2.patch, HIVE-20441.patch
>
>
> When hive.allow.udf.load.on.demand is set to true and hiveserver2 has been
> started, the new created function from other clients or hiveserver2 will be
> loaded from the metastore at the first time.
> When the udf is used in where clause, we got a NPE like:
> {code:java}
> Error executing statement:
> org.apache.hive.service.cli.HiveSQLException: Error while compiling
> statement: FAILED: NullPointerException null
> at
> org.apache.hive.service.cli.operation.Operation.toSQLException(Operation.java:380)
> ~[hive-service-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hive.service.cli.operation.SQLOperation.prepare(SQLOperation.java:206)
> ~[hive-service-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hive.service.cli.operation.SQLOperation.runInternal(SQLOperation.java:290)
> ~[hive-service-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hive.service.cli.operation.Operation.run(Operation.java:320)
> ~[hive-service-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementInternal(HiveSessionImpl.java:530)
> ~[hive-service-2.3.4-SNAPSHOT.jar:2.3.4-SNAP
> SHOT]
> at
> org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementAsync(HiveSessionImpl.java:517)
> ~[hive-service-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHO
> T]
> at
> org.apache.hive.service.cli.CLIService.executeStatementAsync(CLIService.java:310)
> ~[hive-service-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hive.service.cli.thrift.ThriftCLIService.ExecuteStatement(ThriftCLIService.java:542)
> ~[hive-service-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hive.service.rpc.thrift.TCLIService$Processor$ExecuteStatement.getResult(TCLIService.java:1437)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.3.4-SNA
> PSHOT]
> at
> org.apache.hive.service.rpc.thrift.TCLIService$Processor$ExecuteStatement.getResult(TCLIService.java:1422)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.3.4-SNA
> PSHOT]
> at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hive.service.auth.TSetIpAddressProcessor.process(TSetIpAddressProcessor.java:57)
> ~[hive-service-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:286)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> [?:1.8.0_77]
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> [?:1.8.0_77]
> at java.lang.Thread.run(Thread.java:745) [?:1.8.0_77]
> Caused by: java.lang.NullPointerException
> at
> org.apache.hadoop.hive.ql.plan.ExprNodeGenericFuncDesc.newInstance(ExprNodeGenericFuncDesc.java:236)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
>
[jira] [Commented] (HIVE-20441) NPE in ExprNodeGenericFuncDesc when hive.allow.udf.load.on.demand is set to true
[
https://issues.apache.org/jira/browse/HIVE-20441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16592564#comment-16592564
]
Hive QA commented on HIVE-20441:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
39s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 7m
44s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
28s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
52s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 4m
6s{color} | {color:blue} ql in master has 2309 extant Findbugs warnings.
{color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
38s{color} | {color:blue} service in master has 48 extant Findbugs warnings.
{color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
16s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
8s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m
53s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
31s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m
31s{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m
13s{color} | {color:red} service: The patch generated 2 new + 0 unchanged - 0
fixed = 2 total (was 0) {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 4m
59s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
16s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
15s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 28m 18s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.36-1+deb8u1 (2016-09-03) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-13469/dev-support/hive-personality.sh
|
| git revision | master / e2142b2 |
| Default Java | 1.8.0_111 |
| findbugs | v3.0.0 |
| checkstyle |
http://104.198.109.242/logs//PreCommit-HIVE-Build-13469/yetus/diff-checkstyle-service.txt
|
| modules | C: ql service U: . |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-13469/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> NPE in ExprNodeGenericFuncDesc when hive.allow.udf.load.on.demand is set to
> true
> -
>
> Key: HIVE-20441
> URL: https://issues.apache.org/jira/browse/HIVE-20441
> Project: Hive
> Issue Type: Bug
> Components: CLI, HiveServer2
>Affects Versions: 1.2.1, 2.3.3
>Reporter: Hui Huang
>Assignee: Hui Huang
>Priority: Major
> Fix For: 2.3.3
>
> Attachments: HIVE-20441.1.patch, HIVE-20441.2.patch, HIVE-20441.patch
>
>
> When hive.allow.udf.load.on.demand is set to true and hiveserver2 has been
> started, the new created function from other clients or hiveserver2 will be
> loaded from the metastore at the first time.
> When the udf is used in where clause, we got a NPE like:
> {code:java}
> Error executing statement:
> org.apache.hive.service.cli.HiveSQLException: Error while compiling
> statement: FAILED: NullPointerException null
> at
>
[jira] [Commented] (HIVE-20187) Incorrect query results in hive when hive.convert.join.bucket.mapjoin.tez is set to true
[
https://issues.apache.org/jira/browse/HIVE-20187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16592560#comment-16592560
]
Hive QA commented on HIVE-20187:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12937125/HIVE-20187.3.patch
{color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified.
{color:green}SUCCESS:{color} +1 due to 14896 tests passed
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/13468/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/13468/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-13468/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12937125 - PreCommit-HIVE-Build
> Incorrect query results in hive when hive.convert.join.bucket.mapjoin.tez is
> set to true
>
>
> Key: HIVE-20187
> URL: https://issues.apache.org/jira/browse/HIVE-20187
> Project: Hive
> Issue Type: Bug
>Affects Versions: 3.1.0
> Environment: Hive 3.0 and Tez 0.91
>Reporter: Karthik
>Assignee: Deepak Jaiswal
>Priority: Blocker
> Attachments: HIVE-20187.1.patch, HIVE-20187.2.patch,
> HIVE-20187.3.patch, extended_explain.txt
>
>
> When hive.convert.join.bucket.mapjoin.tez=true and bucketed column is in
> select clause but not in where clause, hive is performing a bucket map join
> and returning incorrect results. When the bucketed column is removed from
> select clause or hive.convert.join.bucket.mapjoin.tez=false, returned query
> results are correct.
>
> create table my_fact(AMT decimal(20,3),bucket_col string ,join_col string )
> PARTITIONED BY (FISCAL_YEAR string ,ACCOUNTING_PERIOD string )
> CLUSTERED BY (bucket_col) INTO 10
> BUCKETS
> stored as ORC
> ;
> create table my_dim(join_col string,filter_col string) stored as orc;
> After populating and analyzing above tables, explain plan looks as below
> when hive.convert.join.bucket.mapjoin.tez=TRUE:
>
> explain select T4.join_col as account1,my_fact.accounting_period
> FROM my_fact JOIN my_dim T4 ON my_fact.join_col = T4.join_col
> WHERE my_fact.fiscal_year = '2015'
> AND T4.filter_col IN ( 'VAL1', 'VAL2' )
> and my_fact.accounting_period in (10);
> Vertex dependency in root stage
> Map 1 <- Map 2 (CUSTOM_EDGE)
> Stage-0
> Fetch Operator
> limit:-1
> Stage-1
> Map 1 vectorized, llap
> File Output Operator [FS_24]
> Select Operator [SEL_23] (rows=15282589 width=291)
> Output:["_col0","_col1","_col2"]
> Map Join Operator [MAPJOIN_22] (rows=15282589 width=291)
> *BucketMapJoin*:true,Conds:SEL_21._col1=RS_19._col0(Inner),Output:["_col0","_col3","_col4"]
> <-Map 2 [CUSTOM_EDGE] vectorized, llap
> MULTICAST [RS_19]
> PartitionCols:_col0
> Select Operator [SEL_18] (rows=818 width=186)
> Output:["_col0"]
> Filter Operator [FIL_17] (rows=818 width=186)
> predicate:((filter_col) IN ('VAL1', 'VAL2') and join_col is not null)
> TableScan [TS_3] (rows=1635 width=186)
> default@my_dim,t4,Tbl:COMPLETE,Col:NONE,Output:["join_col","filter_col"]
> <-Select Operator [SEL_21] (rows=13893263 width=291)
> Output:["_col0","_col1","_col3"]
> Filter Operator [FIL_20] (rows=13893263 width=291)
> predicate:join_col is not null
> TableScan [TS_0] (rows=13893263 width=291)
>
> default@my_fact,my_fact,Tbl:COMPLETE,Col:NONE,Output:["bucket_col","join_col"]
> [^extended_explain.txt] has more detailed plan.
> When hive.convert.join.bucket.mapjoin.tez=false, plan no longer has
> bucketjoin and query results are correct.
> Vertex dependency in root stage
> Map 1 <- Map 2 (BROADCAST_EDGE)
> Stage-0
> Fetch Operator
> limit:-1
> Stage-1
> Map 1 vectorized, llap
> File Output Operator [FS_24]
> Select Operator [SEL_23] (rows=15282589 width=291)
> Output:["_col0","_col1","_col2"]
> Map Join Operator [MAPJOIN_22] (rows=15282589 width=291)
> Conds:SEL_21._col1=RS_19._col0(Inner),Output:["_col0","_col3","_col4"]
> <-Map 2 [BROADCAST_EDGE] vectorized, llap
> BROADCAST [RS_19]
> PartitionCols:_col0
> Select Operator [SEL_18] (rows=818 width=186)
> Output:["_col0"]
> Filter Operator [FIL_17] (rows=818 width=186)
> predicate:((filter_col) IN ('VAL1', 'VAL2') and join_col is not null)
> TableScan [TS_3] (rows=1635 width=186)
> default@my_dim,t4,Tbl:COMPLETE,Col:NONE,Output:["join_col","filter_col"]
> <-Select Operator [SEL_21] (rows=13893263 width=291)
> Output:["_col0","_col1","_col3"]
> Filter Operator [FIL_20]
[jira] [Commented] (HIVE-20187) Incorrect query results in hive when hive.convert.join.bucket.mapjoin.tez is set to true
[
https://issues.apache.org/jira/browse/HIVE-20187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16592550#comment-16592550
]
Hive QA commented on HIVE-20187:
| (/) *{color:green}+1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 8m
24s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
3s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
39s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 4m
6s{color} | {color:blue} ql in master has 2309 extant Findbugs warnings.
{color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
59s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m
23s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
6s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m
6s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
38s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 4m
8s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
0s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
13s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 24m 12s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.36-1+deb8u1 (2016-09-03) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-13468/dev-support/hive-personality.sh
|
| git revision | master / e2142b2 |
| Default Java | 1.8.0_111 |
| findbugs | v3.0.0 |
| modules | C: ql U: ql |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-13468/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Incorrect query results in hive when hive.convert.join.bucket.mapjoin.tez is
> set to true
>
>
> Key: HIVE-20187
> URL: https://issues.apache.org/jira/browse/HIVE-20187
> Project: Hive
> Issue Type: Bug
>Affects Versions: 3.1.0
> Environment: Hive 3.0 and Tez 0.91
>Reporter: Karthik
>Assignee: Deepak Jaiswal
>Priority: Blocker
> Attachments: HIVE-20187.1.patch, HIVE-20187.2.patch,
> HIVE-20187.3.patch, extended_explain.txt
>
>
> When hive.convert.join.bucket.mapjoin.tez=true and bucketed column is in
> select clause but not in where clause, hive is performing a bucket map join
> and returning incorrect results. When the bucketed column is removed from
> select clause or hive.convert.join.bucket.mapjoin.tez=false, returned query
> results are correct.
>
> create table my_fact(AMT decimal(20,3),bucket_col string ,join_col string )
> PARTITIONED BY (FISCAL_YEAR string ,ACCOUNTING_PERIOD string )
> CLUSTERED BY (bucket_col) INTO 10
> BUCKETS
> stored as ORC
> ;
> create table my_dim(join_col string,filter_col string) stored as orc;
> After populating and analyzing above tables, explain plan looks as below
> when hive.convert.join.bucket.mapjoin.tez=TRUE:
>
> explain select T4.join_col as account1,my_fact.accounting_period
> FROM my_fact JOIN my_dim T4 ON my_fact.join_col = T4.join_col
> WHERE my_fact.fiscal_year = '2015'
> AND T4.filter_col IN ( 'VAL1', 'VAL2' )
> and my_fact.accounting_period in (10);
> Vertex dependency in root stage
> Map 1 <- Map 2 (CUSTOM_EDGE)
> Stage-0
[jira] [Updated] (HIVE-20315) Vectorization: Fix more NULL / Wrong Results issues and avoid unnecessary casts/conversions
[ https://issues.apache.org/jira/browse/HIVE-20315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt McCline updated HIVE-20315: Status: Patch Available (was: In Progress) > Vectorization: Fix more NULL / Wrong Results issues and avoid unnecessary > casts/conversions > --- > > Key: HIVE-20315 > URL: https://issues.apache.org/jira/browse/HIVE-20315 > Project: Hive > Issue Type: Bug > Components: Hive >Reporter: Matt McCline >Assignee: Matt McCline >Priority: Critical > Fix For: 4.0.0 > > Attachments: HIVE-20315.01.patch, HIVE-20315.02.patch, > HIVE-20315.03.patch, HIVE-20315.04.patch, HIVE-20315.05.patch, > HIVE-20315.06.patch, HIVE-20315.07.patch, HIVE-20315.08.patch, > HIVE-20315.09.patch, HIVE-20315.092.patch, HIVE-20315.093.patch > > > Generate multi-byte Unicode characters in addition to regular single byte > characters for random data. > Don't CAST from STRING/VARCHAR/CHAR TO STRING since all are stored in > vectorization without padding. > Fix vectorized BETWEEN expression work to avoid unnecessary CAST of DECIMAL > constants. > Fix NULL / Wrong Results issues in VectorElt. > Add test for vectorized STRUCT field reference. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-20315) Vectorization: Fix more NULL / Wrong Results issues and avoid unnecessary casts/conversions
[ https://issues.apache.org/jira/browse/HIVE-20315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt McCline updated HIVE-20315: Attachment: HIVE-20315.093.patch > Vectorization: Fix more NULL / Wrong Results issues and avoid unnecessary > casts/conversions > --- > > Key: HIVE-20315 > URL: https://issues.apache.org/jira/browse/HIVE-20315 > Project: Hive > Issue Type: Bug > Components: Hive >Reporter: Matt McCline >Assignee: Matt McCline >Priority: Critical > Fix For: 4.0.0 > > Attachments: HIVE-20315.01.patch, HIVE-20315.02.patch, > HIVE-20315.03.patch, HIVE-20315.04.patch, HIVE-20315.05.patch, > HIVE-20315.06.patch, HIVE-20315.07.patch, HIVE-20315.08.patch, > HIVE-20315.09.patch, HIVE-20315.092.patch, HIVE-20315.093.patch > > > Generate multi-byte Unicode characters in addition to regular single byte > characters for random data. > Don't CAST from STRING/VARCHAR/CHAR TO STRING since all are stored in > vectorization without padding. > Fix vectorized BETWEEN expression work to avoid unnecessary CAST of DECIMAL > constants. > Fix NULL / Wrong Results issues in VectorElt. > Add test for vectorized STRUCT field reference. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-20315) Vectorization: Fix more NULL / Wrong Results issues and avoid unnecessary casts/conversions
[ https://issues.apache.org/jira/browse/HIVE-20315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt McCline updated HIVE-20315: Status: In Progress (was: Patch Available) > Vectorization: Fix more NULL / Wrong Results issues and avoid unnecessary > casts/conversions > --- > > Key: HIVE-20315 > URL: https://issues.apache.org/jira/browse/HIVE-20315 > Project: Hive > Issue Type: Bug > Components: Hive >Reporter: Matt McCline >Assignee: Matt McCline >Priority: Critical > Fix For: 4.0.0 > > Attachments: HIVE-20315.01.patch, HIVE-20315.02.patch, > HIVE-20315.03.patch, HIVE-20315.04.patch, HIVE-20315.05.patch, > HIVE-20315.06.patch, HIVE-20315.07.patch, HIVE-20315.08.patch, > HIVE-20315.09.patch, HIVE-20315.092.patch, HIVE-20315.093.patch > > > Generate multi-byte Unicode characters in addition to regular single byte > characters for random data. > Don't CAST from STRING/VARCHAR/CHAR TO STRING since all are stored in > vectorization without padding. > Fix vectorized BETWEEN expression work to avoid unnecessary CAST of DECIMAL > constants. > Fix NULL / Wrong Results issues in VectorElt. > Add test for vectorized STRUCT field reference. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-20315) Vectorization: Fix more NULL / Wrong Results issues and avoid unnecessary casts/conversions
[
https://issues.apache.org/jira/browse/HIVE-20315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16592545#comment-16592545
]
Hive QA commented on HIVE-20315:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12937120/HIVE-20315.092.patch
{color:green}SUCCESS:{color} +1 due to 21 test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 1 failed/errored test(s), 14897 tests
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[query_result_fileformat]
(batchId=21)
{noformat}
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/13467/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/13467/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-13467/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 1 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12937120 - PreCommit-HIVE-Build
> Vectorization: Fix more NULL / Wrong Results issues and avoid unnecessary
> casts/conversions
> ---
>
> Key: HIVE-20315
> URL: https://issues.apache.org/jira/browse/HIVE-20315
> Project: Hive
> Issue Type: Bug
> Components: Hive
>Reporter: Matt McCline
>Assignee: Matt McCline
>Priority: Critical
> Fix For: 4.0.0
>
> Attachments: HIVE-20315.01.patch, HIVE-20315.02.patch,
> HIVE-20315.03.patch, HIVE-20315.04.patch, HIVE-20315.05.patch,
> HIVE-20315.06.patch, HIVE-20315.07.patch, HIVE-20315.08.patch,
> HIVE-20315.09.patch, HIVE-20315.092.patch
>
>
> Generate multi-byte Unicode characters in addition to regular single byte
> characters for random data.
> Don't CAST from STRING/VARCHAR/CHAR TO STRING since all are stored in
> vectorization without padding.
> Fix vectorized BETWEEN expression work to avoid unnecessary CAST of DECIMAL
> constants.
> Fix NULL / Wrong Results issues in VectorElt.
> Add test for vectorized STRUCT field reference.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HIVE-18772) Make Acid Cleaner use MIN_HISTORY_LEVEL
[
https://issues.apache.org/jira/browse/HIVE-18772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16592531#comment-16592531
]
Hive QA commented on HIVE-18772:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12937099/HIVE-18772.01.patch
{color:red}ERROR:{color} -1 due to no test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 4 failed/errored test(s), 14896 tests
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.ql.txn.compactor.TestCleaner.blockedByLockPartition
(batchId=284)
org.apache.hadoop.hive.ql.txn.compactor.TestCleaner.blockedByLockTable
(batchId=284)
org.apache.hadoop.hive.ql.txn.compactor.TestCleaner2.blockedByLockPartition
(batchId=285)
org.apache.hadoop.hive.ql.txn.compactor.TestCleaner2.blockedByLockTable
(batchId=285)
{noformat}
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/13466/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/13466/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-13466/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 4 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12937099 - PreCommit-HIVE-Build
> Make Acid Cleaner use MIN_HISTORY_LEVEL
> ---
>
> Key: HIVE-18772
> URL: https://issues.apache.org/jira/browse/HIVE-18772
> Project: Hive
> Issue Type: Improvement
> Components: Transactions
>Affects Versions: 3.0.0
>Reporter: Eugene Koifman
>Assignee: Eugene Koifman
>Priority: Major
> Attachments: HIVE-18772.01.patch
>
>
> Instead of using Lock Manager state as it currently does.
> This will eliminate possible race conditions
> See this
> [comment|https://issues.apache.org/jira/browse/HIVE-18192?focusedCommentId=16338208=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-16338208]
> Suppose A is the set of all ValidTxnList across all active readers. Each
> ValidTxnList has minOpenTxnId.
> MIN_HISTORY_LEVEL allows us to determine X = min(minOpenTxnId) across all
> currently active readers
> This means that no active transaction in the system sees any txn with txnid <
> X as open.
> This means if construct ValidTxnIdList with HWM=X-1 and use that in
> getAcidState(), any files determined by this call as 'obsolete', will be seen
> as obsolete by any existing/future reader, i.e. can be physically deleted.
> This is also necessary for multi-statement transactions where relying on the
> state of Lock Manager is not sufficient. For example
> Suppose txn 17 starts at t1 and sees txnid 13 with writeID 13 open.
> 13 commits (via it's parent txn) at t2 > t1. (17 is still running).
> Compaction runs at t3 >t2 to produce base_14 (or delta_10_14 for example) on
> Table1/Part1 (17 is still running)
> Now delta_13 may be cleaned since it can be seen as obsolete and there may be
> no locks on it, i.e. no one is reading it.
> Now at t4 > t3 17 may (multi stmt txn) needs to read Table1/Part1. It cannot
> use base_14 is that may have absorbed delete events from delete_delta_14.
> Using MIN_HISTORY_LEVEL solves this.
> See description of HIVE-18747 for more details on MIN_HISTORY_LEVEL
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (HIVE-20462) "CREATE VIEW IF NOT EXISTS" fails if view already exists
[ https://issues.apache.org/jira/browse/HIVE-20462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] static-max updated HIVE-20462: -- Summary: "CREATE VIEW IF NOT EXISTS" fails if view already exists (was: "CREATE VIEW IF NOT EXISTS" fails view already exists) > "CREATE VIEW IF NOT EXISTS" fails if view already exists > > > Key: HIVE-20462 > URL: https://issues.apache.org/jira/browse/HIVE-20462 > Project: Hive > Issue Type: Bug > Components: Hive >Affects Versions: 3.1.0 > Environment: HDP 3.0 > Hive 3.1.0.3.0.0.0-1634 >Reporter: static-max >Priority: Major > > After upgrading to Hive 3.1 from Hive 1.2, I can't run my queries anymore. It > seems that "if not exists" is ignored in "create view". > *Example:* > # create view if not exists test as select 1; > # create view if not exists test as select 1; > The second call fails with "Table already exists: default.test". I changed > this to "create or replace view" as a workaround. > Also documented [link > here|https://community.hortonworks.com/questions/214772/hdp-3-hive-create-view-if-not-exists-fails.html|] -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-20306) Implement projection spec for fetching only requested fields from partitions
[
https://issues.apache.org/jira/browse/HIVE-20306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16592521#comment-16592521
]
Hive QA commented on HIVE-20306:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12937095/HIVE-20306.06.patch
{color:red}ERROR:{color} -1 due to build exiting with an error
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/13465/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/13465/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-13465/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Tests exited with: Exception: Patch URL
https://issues.apache.org/jira/secure/attachment/12937095/HIVE-20306.06.patch
was found in seen patch url's cache and a test was probably run already on it.
Aborting...
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12937095 - PreCommit-HIVE-Build
> Implement projection spec for fetching only requested fields from partitions
>
>
> Key: HIVE-20306
> URL: https://issues.apache.org/jira/browse/HIVE-20306
> Project: Hive
> Issue Type: Sub-task
>Reporter: Vihang Karajgaonkar
>Assignee: Vihang Karajgaonkar
>Priority: Major
> Attachments: HIVE-20306.02.patch, HIVE-20306.03.patch,
> HIVE-20306.04.patch, HIVE-20306.05.patch, HIVE-20306.06.patch,
> HIVE-20306.patch
>
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HIVE-20455) Log spew from security.authorization.PrivilegeSynchonizer.run
[
https://issues.apache.org/jira/browse/HIVE-20455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16592520#comment-16592520
]
Hive QA commented on HIVE-20455:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12937093/HIVE-20455.2.patch
{color:red}ERROR:{color} -1 due to no test(s) being added or modified.
{color:green}SUCCESS:{color} +1 due to 14896 tests passed
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/13464/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/13464/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-13464/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12937093 - PreCommit-HIVE-Build
> Log spew from security.authorization.PrivilegeSynchonizer.run
> --
>
> Key: HIVE-20455
> URL: https://issues.apache.org/jira/browse/HIVE-20455
> Project: Hive
> Issue Type: Bug
>Reporter: Gopal V
>Assignee: Daniel Dai
>Priority: Major
> Attachments: HIVE-20455.1.patch, HIVE-20455.2.patch
>
>
> Typo in the class name aside, this keeps running and thrashing through every
> single DB in the cluster if not all directories are actually accessible to
> the user who runs HS2.
> {code}
> 2018-08-24T03:14:41,932 INFO [PrivilegeSynchonizer] metastore.HiveMetaStore:
> 1: get_table : tbl=hive.airline_ontime.flights_raw
> 2018-08-24T03:14:41,932 INFO [PrivilegeSynchonizer] HiveMetaStore.audit:
> ugi=gopal ip=unknown-ip-addr cmd=get_table :
> tbl=hive.airline_ontime.flights_raw
> {code}
> The minimum fix needed is to move the Thread.sleep() outside of the try/catch
> block, so that the sleep is triggered even if the attempt throws an exception.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (HIVE-20441) NPE in ExprNodeGenericFuncDesc when hive.allow.udf.load.on.demand is set to true
[
https://issues.apache.org/jira/browse/HIVE-20441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hui Huang updated HIVE-20441:
-
Status: In Progress (was: Patch Available)
> NPE in ExprNodeGenericFuncDesc when hive.allow.udf.load.on.demand is set to
> true
> -
>
> Key: HIVE-20441
> URL: https://issues.apache.org/jira/browse/HIVE-20441
> Project: Hive
> Issue Type: Bug
> Components: CLI, HiveServer2
>Affects Versions: 1.2.1, 2.3.3
>Reporter: Hui Huang
>Assignee: Hui Huang
>Priority: Major
> Fix For: 2.3.3
>
> Attachments: HIVE-20441.1.patch, HIVE-20441.2.patch, HIVE-20441.patch
>
>
> When hive.allow.udf.load.on.demand is set to true and hiveserver2 has been
> started, the new created function from other clients or hiveserver2 will be
> loaded from the metastore at the first time.
> When the udf is used in where clause, we got a NPE like:
> {code:java}
> Error executing statement:
> org.apache.hive.service.cli.HiveSQLException: Error while compiling
> statement: FAILED: NullPointerException null
> at
> org.apache.hive.service.cli.operation.Operation.toSQLException(Operation.java:380)
> ~[hive-service-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hive.service.cli.operation.SQLOperation.prepare(SQLOperation.java:206)
> ~[hive-service-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hive.service.cli.operation.SQLOperation.runInternal(SQLOperation.java:290)
> ~[hive-service-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hive.service.cli.operation.Operation.run(Operation.java:320)
> ~[hive-service-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementInternal(HiveSessionImpl.java:530)
> ~[hive-service-2.3.4-SNAPSHOT.jar:2.3.4-SNAP
> SHOT]
> at
> org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementAsync(HiveSessionImpl.java:517)
> ~[hive-service-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHO
> T]
> at
> org.apache.hive.service.cli.CLIService.executeStatementAsync(CLIService.java:310)
> ~[hive-service-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hive.service.cli.thrift.ThriftCLIService.ExecuteStatement(ThriftCLIService.java:542)
> ~[hive-service-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hive.service.rpc.thrift.TCLIService$Processor$ExecuteStatement.getResult(TCLIService.java:1437)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.3.4-SNA
> PSHOT]
> at
> org.apache.hive.service.rpc.thrift.TCLIService$Processor$ExecuteStatement.getResult(TCLIService.java:1422)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.3.4-SNA
> PSHOT]
> at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hive.service.auth.TSetIpAddressProcessor.process(TSetIpAddressProcessor.java:57)
> ~[hive-service-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:286)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> [?:1.8.0_77]
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> [?:1.8.0_77]
> at java.lang.Thread.run(Thread.java:745) [?:1.8.0_77]
> Caused by: java.lang.NullPointerException
> at
> org.apache.hadoop.hive.ql.plan.ExprNodeGenericFuncDesc.newInstance(ExprNodeGenericFuncDesc.java:236)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hadoop.hive.ql.parse.TypeCheckProcFactory$DefaultExprProcessor.getXpathOrFuncExprNodeDesc(TypeCheckProcFactory.java:1104)
> ~[hive-exec-2.
> 3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hadoop.hive.ql.parse.TypeCheckProcFactory$DefaultExprProcessor.process(TypeCheckProcFactory.java:1359)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.
> 3.4-SNAPSHOT]
> at
> org.apache.hadoop.hive.ql.lib.DefaultRuleDispatcher.dispatch(DefaultRuleDispatcher.java:90)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.dispatchAndReturn(DefaultGraphWalker.java:105)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.dispatch(DefaultGraphWalker.java:89)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hadoop.hive.ql.lib.ExpressionWalker.walk(ExpressionWalker.java:76)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
>
[jira] [Updated] (HIVE-20441) NPE in ExprNodeGenericFuncDesc when hive.allow.udf.load.on.demand is set to true
[
https://issues.apache.org/jira/browse/HIVE-20441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hui Huang updated HIVE-20441:
-
Status: Patch Available (was: In Progress)
> NPE in ExprNodeGenericFuncDesc when hive.allow.udf.load.on.demand is set to
> true
> -
>
> Key: HIVE-20441
> URL: https://issues.apache.org/jira/browse/HIVE-20441
> Project: Hive
> Issue Type: Bug
> Components: CLI, HiveServer2
>Affects Versions: 1.2.1, 2.3.3
>Reporter: Hui Huang
>Assignee: Hui Huang
>Priority: Major
> Fix For: 2.3.3
>
> Attachments: HIVE-20441.1.patch, HIVE-20441.2.patch, HIVE-20441.patch
>
>
> When hive.allow.udf.load.on.demand is set to true and hiveserver2 has been
> started, the new created function from other clients or hiveserver2 will be
> loaded from the metastore at the first time.
> When the udf is used in where clause, we got a NPE like:
> {code:java}
> Error executing statement:
> org.apache.hive.service.cli.HiveSQLException: Error while compiling
> statement: FAILED: NullPointerException null
> at
> org.apache.hive.service.cli.operation.Operation.toSQLException(Operation.java:380)
> ~[hive-service-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hive.service.cli.operation.SQLOperation.prepare(SQLOperation.java:206)
> ~[hive-service-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hive.service.cli.operation.SQLOperation.runInternal(SQLOperation.java:290)
> ~[hive-service-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hive.service.cli.operation.Operation.run(Operation.java:320)
> ~[hive-service-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementInternal(HiveSessionImpl.java:530)
> ~[hive-service-2.3.4-SNAPSHOT.jar:2.3.4-SNAP
> SHOT]
> at
> org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementAsync(HiveSessionImpl.java:517)
> ~[hive-service-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHO
> T]
> at
> org.apache.hive.service.cli.CLIService.executeStatementAsync(CLIService.java:310)
> ~[hive-service-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hive.service.cli.thrift.ThriftCLIService.ExecuteStatement(ThriftCLIService.java:542)
> ~[hive-service-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hive.service.rpc.thrift.TCLIService$Processor$ExecuteStatement.getResult(TCLIService.java:1437)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.3.4-SNA
> PSHOT]
> at
> org.apache.hive.service.rpc.thrift.TCLIService$Processor$ExecuteStatement.getResult(TCLIService.java:1422)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.3.4-SNA
> PSHOT]
> at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hive.service.auth.TSetIpAddressProcessor.process(TSetIpAddressProcessor.java:57)
> ~[hive-service-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:286)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> [?:1.8.0_77]
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> [?:1.8.0_77]
> at java.lang.Thread.run(Thread.java:745) [?:1.8.0_77]
> Caused by: java.lang.NullPointerException
> at
> org.apache.hadoop.hive.ql.plan.ExprNodeGenericFuncDesc.newInstance(ExprNodeGenericFuncDesc.java:236)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hadoop.hive.ql.parse.TypeCheckProcFactory$DefaultExprProcessor.getXpathOrFuncExprNodeDesc(TypeCheckProcFactory.java:1104)
> ~[hive-exec-2.
> 3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hadoop.hive.ql.parse.TypeCheckProcFactory$DefaultExprProcessor.process(TypeCheckProcFactory.java:1359)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.
> 3.4-SNAPSHOT]
> at
> org.apache.hadoop.hive.ql.lib.DefaultRuleDispatcher.dispatch(DefaultRuleDispatcher.java:90)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.dispatchAndReturn(DefaultGraphWalker.java:105)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.dispatch(DefaultGraphWalker.java:89)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hadoop.hive.ql.lib.ExpressionWalker.walk(ExpressionWalker.java:76)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
>
[jira] [Updated] (HIVE-20441) NPE in ExprNodeGenericFuncDesc when hive.allow.udf.load.on.demand is set to true
[
https://issues.apache.org/jira/browse/HIVE-20441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hui Huang updated HIVE-20441:
-
Attachment: HIVE-20441.2.patch
> NPE in ExprNodeGenericFuncDesc when hive.allow.udf.load.on.demand is set to
> true
> -
>
> Key: HIVE-20441
> URL: https://issues.apache.org/jira/browse/HIVE-20441
> Project: Hive
> Issue Type: Bug
> Components: CLI, HiveServer2
>Affects Versions: 1.2.1, 2.3.3
>Reporter: Hui Huang
>Assignee: Hui Huang
>Priority: Major
> Fix For: 2.3.3
>
> Attachments: HIVE-20441.1.patch, HIVE-20441.2.patch, HIVE-20441.patch
>
>
> When hive.allow.udf.load.on.demand is set to true and hiveserver2 has been
> started, the new created function from other clients or hiveserver2 will be
> loaded from the metastore at the first time.
> When the udf is used in where clause, we got a NPE like:
> {code:java}
> Error executing statement:
> org.apache.hive.service.cli.HiveSQLException: Error while compiling
> statement: FAILED: NullPointerException null
> at
> org.apache.hive.service.cli.operation.Operation.toSQLException(Operation.java:380)
> ~[hive-service-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hive.service.cli.operation.SQLOperation.prepare(SQLOperation.java:206)
> ~[hive-service-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hive.service.cli.operation.SQLOperation.runInternal(SQLOperation.java:290)
> ~[hive-service-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hive.service.cli.operation.Operation.run(Operation.java:320)
> ~[hive-service-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementInternal(HiveSessionImpl.java:530)
> ~[hive-service-2.3.4-SNAPSHOT.jar:2.3.4-SNAP
> SHOT]
> at
> org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementAsync(HiveSessionImpl.java:517)
> ~[hive-service-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHO
> T]
> at
> org.apache.hive.service.cli.CLIService.executeStatementAsync(CLIService.java:310)
> ~[hive-service-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hive.service.cli.thrift.ThriftCLIService.ExecuteStatement(ThriftCLIService.java:542)
> ~[hive-service-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hive.service.rpc.thrift.TCLIService$Processor$ExecuteStatement.getResult(TCLIService.java:1437)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.3.4-SNA
> PSHOT]
> at
> org.apache.hive.service.rpc.thrift.TCLIService$Processor$ExecuteStatement.getResult(TCLIService.java:1422)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.3.4-SNA
> PSHOT]
> at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hive.service.auth.TSetIpAddressProcessor.process(TSetIpAddressProcessor.java:57)
> ~[hive-service-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:286)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> [?:1.8.0_77]
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> [?:1.8.0_77]
> at java.lang.Thread.run(Thread.java:745) [?:1.8.0_77]
> Caused by: java.lang.NullPointerException
> at
> org.apache.hadoop.hive.ql.plan.ExprNodeGenericFuncDesc.newInstance(ExprNodeGenericFuncDesc.java:236)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hadoop.hive.ql.parse.TypeCheckProcFactory$DefaultExprProcessor.getXpathOrFuncExprNodeDesc(TypeCheckProcFactory.java:1104)
> ~[hive-exec-2.
> 3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hadoop.hive.ql.parse.TypeCheckProcFactory$DefaultExprProcessor.process(TypeCheckProcFactory.java:1359)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.
> 3.4-SNAPSHOT]
> at
> org.apache.hadoop.hive.ql.lib.DefaultRuleDispatcher.dispatch(DefaultRuleDispatcher.java:90)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.dispatchAndReturn(DefaultGraphWalker.java:105)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.dispatch(DefaultGraphWalker.java:89)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
> org.apache.hadoop.hive.ql.lib.ExpressionWalker.walk(ExpressionWalker.java:76)
> ~[hive-exec-2.3.4-SNAPSHOT.jar:2.3.4-SNAPSHOT]
> at
>
[jira] [Commented] (HIVE-20451) Metastore client and server tarball issues
[
https://issues.apache.org/jira/browse/HIVE-20451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16592511#comment-16592511
]
Hive QA commented on HIVE-20451:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12937092/HIVE-20451.01.patch
{color:red}ERROR:{color} -1 due to no test(s) being added or modified.
{color:green}SUCCESS:{color} +1 due to 14896 tests passed
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/13463/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/13463/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-13463/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12937092 - PreCommit-HIVE-Build
> Metastore client and server tarball issues
> --
>
> Key: HIVE-20451
> URL: https://issues.apache.org/jira/browse/HIVE-20451
> Project: Hive
> Issue Type: Bug
> Components: Standalone Metastore
>Affects Versions: 4.0.0
>Reporter: Alan Gates
>Assignee: Alexander Kolbasov
>Priority: Major
> Attachments: HIVE-20451.01.patch
>
>
> With the split of the metastore into common and server there are now two sets
> of tarballs. There are a couple of issues here.
> # It doesn't make sense to have separate source tarballs for each. The
> source release should still be done from the standalone-metastore directory
> and include all code for the metastore.
> # The binary tarballs should have separate names. At the moment both are
> named apache-hive-metastore.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HIVE-20365) Fix warnings when regenerating thrift code
[
https://issues.apache.org/jira/browse/HIVE-20365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16592494#comment-16592494
]
Hive QA commented on HIVE-20365:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12937087/HIVE-20365.01.patch
{color:red}ERROR:{color} -1 due to no test(s) being added or modified.
{color:green}SUCCESS:{color} +1 due to 14896 tests passed
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/13462/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/13462/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-13462/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12937087 - PreCommit-HIVE-Build
> Fix warnings when regenerating thrift code
> --
>
> Key: HIVE-20365
> URL: https://issues.apache.org/jira/browse/HIVE-20365
> Project: Hive
> Issue Type: Bug
>Reporter: Vihang Karajgaonkar
>Assignee: Vihang Karajgaonkar
>Priority: Major
> Attachments: HIVE-20365.01.patch
>
>
> When you build thrift code you can see thrift warning like below.
> [exec]
> [WARNING:hive/standalone-metastore/metastore-common/src/main/thrift/hive_metastore.thrift:2167]
> No field key specified for rqst, resulting protocol may have conflicts or
> not be backwards compatible!
> [exec]
> [exec]
> [WARNING:hive/standalone-metastore/metastore-common/src/main/thrift/hive_metastore.thrift:2235]
> No field key specified for o2, resulting protocol may have conflicts or not
> be backwards compatible!
> [exec]
> [exec]
> [WARNING:hive/standalone-metastore/metastore-common/src/main/thrift/hive_metastore.thrift:2167]
> No field key specified for rqst, resulting protocol may have conflicts or
> not be backwards compatible!
> [exec]
> [exec]
> [WARNING:hive/standalone-metastore/metastore-common/src/main/thrift/hive_metastore.thrift:2235]
> No field key specified for o2, resulting protocol may have conflicts or not
> be backwards compatible!
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (HIVE-20187) Incorrect query results in hive when hive.convert.join.bucket.mapjoin.tez is set to true
[
https://issues.apache.org/jira/browse/HIVE-20187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Deepak Jaiswal updated HIVE-20187:
--
Attachment: HIVE-20187.3.patch
> Incorrect query results in hive when hive.convert.join.bucket.mapjoin.tez is
> set to true
>
>
> Key: HIVE-20187
> URL: https://issues.apache.org/jira/browse/HIVE-20187
> Project: Hive
> Issue Type: Bug
>Affects Versions: 3.1.0
> Environment: Hive 3.0 and Tez 0.91
>Reporter: Karthik
>Assignee: Deepak Jaiswal
>Priority: Blocker
> Attachments: HIVE-20187.1.patch, HIVE-20187.2.patch,
> HIVE-20187.3.patch, extended_explain.txt
>
>
> When hive.convert.join.bucket.mapjoin.tez=true and bucketed column is in
> select clause but not in where clause, hive is performing a bucket map join
> and returning incorrect results. When the bucketed column is removed from
> select clause or hive.convert.join.bucket.mapjoin.tez=false, returned query
> results are correct.
>
> create table my_fact(AMT decimal(20,3),bucket_col string ,join_col string )
> PARTITIONED BY (FISCAL_YEAR string ,ACCOUNTING_PERIOD string )
> CLUSTERED BY (bucket_col) INTO 10
> BUCKETS
> stored as ORC
> ;
> create table my_dim(join_col string,filter_col string) stored as orc;
> After populating and analyzing above tables, explain plan looks as below
> when hive.convert.join.bucket.mapjoin.tez=TRUE:
>
> explain select T4.join_col as account1,my_fact.accounting_period
> FROM my_fact JOIN my_dim T4 ON my_fact.join_col = T4.join_col
> WHERE my_fact.fiscal_year = '2015'
> AND T4.filter_col IN ( 'VAL1', 'VAL2' )
> and my_fact.accounting_period in (10);
> Vertex dependency in root stage
> Map 1 <- Map 2 (CUSTOM_EDGE)
> Stage-0
> Fetch Operator
> limit:-1
> Stage-1
> Map 1 vectorized, llap
> File Output Operator [FS_24]
> Select Operator [SEL_23] (rows=15282589 width=291)
> Output:["_col0","_col1","_col2"]
> Map Join Operator [MAPJOIN_22] (rows=15282589 width=291)
> *BucketMapJoin*:true,Conds:SEL_21._col1=RS_19._col0(Inner),Output:["_col0","_col3","_col4"]
> <-Map 2 [CUSTOM_EDGE] vectorized, llap
> MULTICAST [RS_19]
> PartitionCols:_col0
> Select Operator [SEL_18] (rows=818 width=186)
> Output:["_col0"]
> Filter Operator [FIL_17] (rows=818 width=186)
> predicate:((filter_col) IN ('VAL1', 'VAL2') and join_col is not null)
> TableScan [TS_3] (rows=1635 width=186)
> default@my_dim,t4,Tbl:COMPLETE,Col:NONE,Output:["join_col","filter_col"]
> <-Select Operator [SEL_21] (rows=13893263 width=291)
> Output:["_col0","_col1","_col3"]
> Filter Operator [FIL_20] (rows=13893263 width=291)
> predicate:join_col is not null
> TableScan [TS_0] (rows=13893263 width=291)
>
> default@my_fact,my_fact,Tbl:COMPLETE,Col:NONE,Output:["bucket_col","join_col"]
> [^extended_explain.txt] has more detailed plan.
> When hive.convert.join.bucket.mapjoin.tez=false, plan no longer has
> bucketjoin and query results are correct.
> Vertex dependency in root stage
> Map 1 <- Map 2 (BROADCAST_EDGE)
> Stage-0
> Fetch Operator
> limit:-1
> Stage-1
> Map 1 vectorized, llap
> File Output Operator [FS_24]
> Select Operator [SEL_23] (rows=15282589 width=291)
> Output:["_col0","_col1","_col2"]
> Map Join Operator [MAPJOIN_22] (rows=15282589 width=291)
> Conds:SEL_21._col1=RS_19._col0(Inner),Output:["_col0","_col3","_col4"]
> <-Map 2 [BROADCAST_EDGE] vectorized, llap
> BROADCAST [RS_19]
> PartitionCols:_col0
> Select Operator [SEL_18] (rows=818 width=186)
> Output:["_col0"]
> Filter Operator [FIL_17] (rows=818 width=186)
> predicate:((filter_col) IN ('VAL1', 'VAL2') and join_col is not null)
> TableScan [TS_3] (rows=1635 width=186)
> default@my_dim,t4,Tbl:COMPLETE,Col:NONE,Output:["join_col","filter_col"]
> <-Select Operator [SEL_21] (rows=13893263 width=291)
> Output:["_col0","_col1","_col3"]
> Filter Operator [FIL_20] (rows=13893263 width=291)
> predicate:join_col is not null
> TableScan [TS_0] (rows=13893263 width=291)
> default@my_fact,my_fact,Tbl:COMPLETE,Col:NONE,Output:
>
> Per suggestion in bug# TEZ-3971, creating this case under Hive project.
>
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
