[
https://issues.apache.org/jira/browse/HIVE-18035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Brecht Machiels updated HIVE-18035:
-----------------------------------
Description:
After creating an index on a table (sys_created_on is a STRING column):
{code:SQL}
CREATE INDEX test_sys_audit_index_sys_created_on
ON TABLE servicenow_stg.sys_audit_distinct_tmp (sys_created_on)
AS 'org.apache.hadoop.hive.ql.index.compact.CompactIndexHandler'
WITH DEFERRED REBUILD;
ALTER INDEX test_sys_audit_index_sys_created_on ON
servicenow_stg.sys_audit_distinct_tmp REBUILD;
{code}
... the following query fails:
{code:SQL}
SELECT sys_created_on FROM servicenow_stg.sys_audit_distinct_tmp
WHERE sys_created_on > '2017-01-01'
{code}
... with this stack trace:
{code}
[Cloudera][HiveJDBCDriver](500051) ERROR processing query/statement. Error
Code: 40000, SQL state: TStatus(statusCode:ERROR_STATUS,
infoMessages:[*org.apache.hive.service.cli.HiveSQLException:Error while
compiling statement: FAILED: NullPointerException null:17:16,
org.apache.hive.service.cli.operation.Operation:toSQLException:Operation.java:385,
org.apache.hive.service.cli.operation.SQLOperation:prepare:SQLOperation.java:136,
org.apache.hive.service.cli.operation.SQLOperation:runInternal:SQLOperation.java:206,
org.apache.hive.service.cli.operation.Operation:run:Operation.java:327,
org.apache.hive.service.cli.session.HiveSessionImpl:executeStatementInternal:HiveSessionImpl.java:424,
org.apache.hive.service.cli.session.HiveSessionImpl:executeStatementAsync:HiveSessionImpl.java:401,
org.apache.hive.service.cli.CLIService:executeStatementAsync:CLIService.java:258,
org.apache.hive.service.cli.thrift.ThriftCLIService:ExecuteStatement:ThriftCLIService.java:500,
org.apache.hive.service.cli.thrift.TCLIService$Processor$ExecuteStatement:getResult:TCLIService.java:1313,
org.apache.hive.service.cli.thrift.TCLIService$Processor$ExecuteStatement:getResult:TCLIService.java:1298,
org.apache.thrift.ProcessFunction:process:ProcessFunction.java:39,
org.apache.thrift.TBaseProcessor:process:TBaseProcessor.java:39,
org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge$Server$TUGIAssumingProcessor:process:HadoopThriftAuthBridge.java:746,
org.apache.thrift.server.TThreadPoolServer$WorkerProcess:run:TThreadPoolServer.java:286,
java.util.concurrent.ThreadPoolExecutor:runWorker:ThreadPoolExecutor.java:1142,
java.util.concurrent.ThreadPoolExecutor$Worker:run:ThreadPoolExecutor.java:617,
java.lang.Thread:run:Thread.java:745,
*java.lang.NullPointerException:null:40:24,
org.apache.hadoop.hive.ql.index.compact.CompactIndexHandler:generateIndexQuery:CompactIndexHandler.java:199,
org.apache.hadoop.hive.ql.optimizer.physical.index.IndexWhereProcessor:rewriteForIndexes:IndexWhereProcessor.java:215,
org.apache.hadoop.hive.ql.optimizer.physical.index.IndexWhereProcessor:process:IndexWhereProcessor.java:146,
org.apache.hadoop.hive.ql.lib.DefaultRuleDispatcher:dispatch:DefaultRuleDispatcher.java:90,
org.apache.hadoop.hive.ql.lib.DefaultGraphWalker:dispatchAndReturn:DefaultGraphWalker.java:94,
org.apache.hadoop.hive.ql.lib.DefaultGraphWalker:dispatch:DefaultGraphWalker.java:78,
org.apache.hadoop.hive.ql.lib.DefaultGraphWalker:walk:DefaultGraphWalker.java:132,
org.apache.hadoop.hive.ql.lib.DefaultGraphWalker:startWalking:DefaultGraphWalker.java:109,
org.apache.hadoop.hive.ql.optimizer.physical.index.IndexWhereTaskDispatcher:dispatch:IndexWhereTaskDispatcher.java:102,
org.apache.hadoop.hive.ql.lib.DefaultGraphWalker:dispatchAndReturn:DefaultGraphWalker.java:94,
org.apache.hadoop.hive.ql.lib.DefaultGraphWalker:dispatch:DefaultGraphWalker.java:78,
org.apache.hadoop.hive.ql.lib.DefaultGraphWalker:walk:DefaultGraphWalker.java:132,
org.apache.hadoop.hive.ql.lib.DefaultGraphWalker:startWalking:DefaultGraphWalker.java:109,
org.apache.hadoop.hive.ql.optimizer.physical.IndexWhereResolver:resolve:IndexWhereResolver.java:38,
org.apache.hadoop.hive.ql.optimizer.physical.PhysicalOptimizer:optimize:PhysicalOptimizer.java:107,
org.apache.hadoop.hive.ql.parse.MapReduceCompiler:optimizeTaskPlan:MapReduceCompiler.java:273,
org.apache.hadoop.hive.ql.parse.TaskCompiler:compile:TaskCompiler.java:225,
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer:analyzeInternal:SemanticAnalyzer.java:10109,
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer:analyzeInternal:SemanticAnalyzer.java:9902,
org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer:analyze:BaseSemanticAnalyzer.java:223,
org.apache.hadoop.hive.ql.Driver:compile:Driver.java:446,
org.apache.hadoop.hive.ql.Driver:compile:Driver.java:312,
org.apache.hadoop.hive.ql.Driver:compileInternal:Driver.java:1201,
org.apache.hadoop.hive.ql.Driver:compileAndRespond:Driver.java:1188,
org.apache.hive.service.cli.operation.SQLOperation:prepare:SQLOperation.java:134],
sqlState:42000, errorCode:40000, errorMessage:Error while compiling statement:
FAILED: NullPointerException null), Query: SELECT sys_created_on FROM
servicenow_stg.sys_audit_distinct_tmp WHERE sys_created_on >
from_unixtime(unix_timestamp('2017-01-01')).
{code}
I'll be able to test this with CDH 5.11.2 in two weeks.
was:
After creating an index on a table (sys_created_on is a STRING column):
{{CREATE INDEX test_sys_audit_index_sys_created_on
ON TABLE servicenow_stg.sys_audit_distinct_tmp (sys_created_on)
AS 'org.apache.hadoop.hive.ql.index.compact.CompactIndexHandler'
WITH DEFERRED REBUILD;
ALTER INDEX test_sys_audit_index_sys_created_on ON
servicenow_stg.sys_audit_distinct_tmp REBUILD;}}
... the following query fails:
{{SELECT sys_created_on FROM servicenow_stg.sys_audit_distinct_tmp
WHERE sys_created_on > '2017-01-01'}}
... with this stack trace:
{{[Cloudera][HiveJDBCDriver](500051) ERROR processing query/statement. Error
Code: 40000, SQL state: TStatus(statusCode:ERROR_STATUS,
infoMessages:[*org.apache.hive.service.cli.HiveSQLException:Error while
compiling statement: FAILED: NullPointerException null:17:16,
org.apache.hive.service.cli.operation.Operation:toSQLException:Operation.java:385,
org.apache.hive.service.cli.operation.SQLOperation:prepare:SQLOperation.java:136,
org.apache.hive.service.cli.operation.SQLOperation:runInternal:SQLOperation.java:206,
org.apache.hive.service.cli.operation.Operation:run:Operation.java:327,
org.apache.hive.service.cli.session.HiveSessionImpl:executeStatementInternal:HiveSessionImpl.java:424,
org.apache.hive.service.cli.session.HiveSessionImpl:executeStatementAsync:HiveSessionImpl.java:401,
org.apache.hive.service.cli.CLIService:executeStatementAsync:CLIService.java:258,
org.apache.hive.service.cli.thrift.ThriftCLIService:ExecuteStatement:ThriftCLIService.java:500,
org.apache.hive.service.cli.thrift.TCLIService$Processor$ExecuteStatement:getResult:TCLIService.java:1313,
org.apache.hive.service.cli.thrift.TCLIService$Processor$ExecuteStatement:getResult:TCLIService.java:1298,
org.apache.thrift.ProcessFunction:process:ProcessFunction.java:39,
org.apache.thrift.TBaseProcessor:process:TBaseProcessor.java:39,
org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge$Server$TUGIAssumingProcessor:process:HadoopThriftAuthBridge.java:746,
org.apache.thrift.server.TThreadPoolServer$WorkerProcess:run:TThreadPoolServer.java:286,
java.util.concurrent.ThreadPoolExecutor:runWorker:ThreadPoolExecutor.java:1142,
java.util.concurrent.ThreadPoolExecutor$Worker:run:ThreadPoolExecutor.java:617,
java.lang.Thread:run:Thread.java:745,
*java.lang.NullPointerException:null:40:24,
org.apache.hadoop.hive.ql.index.compact.CompactIndexHandler:generateIndexQuery:CompactIndexHandler.java:199,
org.apache.hadoop.hive.ql.optimizer.physical.index.IndexWhereProcessor:rewriteForIndexes:IndexWhereProcessor.java:215,
org.apache.hadoop.hive.ql.optimizer.physical.index.IndexWhereProcessor:process:IndexWhereProcessor.java:146,
org.apache.hadoop.hive.ql.lib.DefaultRuleDispatcher:dispatch:DefaultRuleDispatcher.java:90,
org.apache.hadoop.hive.ql.lib.DefaultGraphWalker:dispatchAndReturn:DefaultGraphWalker.java:94,
org.apache.hadoop.hive.ql.lib.DefaultGraphWalker:dispatch:DefaultGraphWalker.java:78,
org.apache.hadoop.hive.ql.lib.DefaultGraphWalker:walk:DefaultGraphWalker.java:132,
org.apache.hadoop.hive.ql.lib.DefaultGraphWalker:startWalking:DefaultGraphWalker.java:109,
org.apache.hadoop.hive.ql.optimizer.physical.index.IndexWhereTaskDispatcher:dispatch:IndexWhereTaskDispatcher.java:102,
org.apache.hadoop.hive.ql.lib.DefaultGraphWalker:dispatchAndReturn:DefaultGraphWalker.java:94,
org.apache.hadoop.hive.ql.lib.DefaultGraphWalker:dispatch:DefaultGraphWalker.java:78,
org.apache.hadoop.hive.ql.lib.DefaultGraphWalker:walk:DefaultGraphWalker.java:132,
org.apache.hadoop.hive.ql.lib.DefaultGraphWalker:startWalking:DefaultGraphWalker.java:109,
org.apache.hadoop.hive.ql.optimizer.physical.IndexWhereResolver:resolve:IndexWhereResolver.java:38,
org.apache.hadoop.hive.ql.optimizer.physical.PhysicalOptimizer:optimize:PhysicalOptimizer.java:107,
org.apache.hadoop.hive.ql.parse.MapReduceCompiler:optimizeTaskPlan:MapReduceCompiler.java:273,
org.apache.hadoop.hive.ql.parse.TaskCompiler:compile:TaskCompiler.java:225,
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer:analyzeInternal:SemanticAnalyzer.java:10109,
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer:analyzeInternal:SemanticAnalyzer.java:9902,
org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer:analyze:BaseSemanticAnalyzer.java:223,
org.apache.hadoop.hive.ql.Driver:compile:Driver.java:446,
org.apache.hadoop.hive.ql.Driver:compile:Driver.java:312,
org.apache.hadoop.hive.ql.Driver:compileInternal:Driver.java:1201,
org.apache.hadoop.hive.ql.Driver:compileAndRespond:Driver.java:1188,
org.apache.hive.service.cli.operation.SQLOperation:prepare:SQLOperation.java:134],
sqlState:42000, errorCode:40000, errorMessage:Error while compiling statement:
FAILED: NullPointerException null), Query: SELECT sys_created_on FROM
servicenow_stg.sys_audit_distinct_tmp WHERE sys_created_on >
from_unixtime(unix_timestamp('2017-01-01')).}}
I'll be able to test this with CDH 5.11.2 in two weeks.
> NullPointerException on querying a table with a compact index
> -------------------------------------------------------------
>
> Key: HIVE-18035
> URL: https://issues.apache.org/jira/browse/HIVE-18035
> Project: Hive
> Issue Type: Bug
> Components: Indexing
> Affects Versions: 1.1.0
> Environment: CDH 5.8.3 on RHEL Server 6.8
> Reporter: Brecht Machiels
>
> After creating an index on a table (sys_created_on is a STRING column):
> {code:SQL}
> CREATE INDEX test_sys_audit_index_sys_created_on
> ON TABLE servicenow_stg.sys_audit_distinct_tmp (sys_created_on)
> AS 'org.apache.hadoop.hive.ql.index.compact.CompactIndexHandler'
> WITH DEFERRED REBUILD;
> ALTER INDEX test_sys_audit_index_sys_created_on ON
> servicenow_stg.sys_audit_distinct_tmp REBUILD;
> {code}
> ... the following query fails:
> {code:SQL}
> SELECT sys_created_on FROM servicenow_stg.sys_audit_distinct_tmp
> WHERE sys_created_on > '2017-01-01'
> {code}
> ... with this stack trace:
> {code}
> [Cloudera][HiveJDBCDriver](500051) ERROR processing query/statement. Error
> Code: 40000, SQL state: TStatus(statusCode:ERROR_STATUS,
> infoMessages:[*org.apache.hive.service.cli.HiveSQLException:Error while
> compiling statement: FAILED: NullPointerException null:17:16,
> org.apache.hive.service.cli.operation.Operation:toSQLException:Operation.java:385,
>
> org.apache.hive.service.cli.operation.SQLOperation:prepare:SQLOperation.java:136,
>
> org.apache.hive.service.cli.operation.SQLOperation:runInternal:SQLOperation.java:206,
> org.apache.hive.service.cli.operation.Operation:run:Operation.java:327,
> org.apache.hive.service.cli.session.HiveSessionImpl:executeStatementInternal:HiveSessionImpl.java:424,
>
> org.apache.hive.service.cli.session.HiveSessionImpl:executeStatementAsync:HiveSessionImpl.java:401,
>
> org.apache.hive.service.cli.CLIService:executeStatementAsync:CLIService.java:258,
>
> org.apache.hive.service.cli.thrift.ThriftCLIService:ExecuteStatement:ThriftCLIService.java:500,
>
> org.apache.hive.service.cli.thrift.TCLIService$Processor$ExecuteStatement:getResult:TCLIService.java:1313,
>
> org.apache.hive.service.cli.thrift.TCLIService$Processor$ExecuteStatement:getResult:TCLIService.java:1298,
> org.apache.thrift.ProcessFunction:process:ProcessFunction.java:39,
> org.apache.thrift.TBaseProcessor:process:TBaseProcessor.java:39,
> org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge$Server$TUGIAssumingProcessor:process:HadoopThriftAuthBridge.java:746,
>
> org.apache.thrift.server.TThreadPoolServer$WorkerProcess:run:TThreadPoolServer.java:286,
>
> java.util.concurrent.ThreadPoolExecutor:runWorker:ThreadPoolExecutor.java:1142,
>
> java.util.concurrent.ThreadPoolExecutor$Worker:run:ThreadPoolExecutor.java:617,
> java.lang.Thread:run:Thread.java:745,
> *java.lang.NullPointerException:null:40:24,
> org.apache.hadoop.hive.ql.index.compact.CompactIndexHandler:generateIndexQuery:CompactIndexHandler.java:199,
>
> org.apache.hadoop.hive.ql.optimizer.physical.index.IndexWhereProcessor:rewriteForIndexes:IndexWhereProcessor.java:215,
>
> org.apache.hadoop.hive.ql.optimizer.physical.index.IndexWhereProcessor:process:IndexWhereProcessor.java:146,
>
> org.apache.hadoop.hive.ql.lib.DefaultRuleDispatcher:dispatch:DefaultRuleDispatcher.java:90,
>
> org.apache.hadoop.hive.ql.lib.DefaultGraphWalker:dispatchAndReturn:DefaultGraphWalker.java:94,
>
> org.apache.hadoop.hive.ql.lib.DefaultGraphWalker:dispatch:DefaultGraphWalker.java:78,
>
> org.apache.hadoop.hive.ql.lib.DefaultGraphWalker:walk:DefaultGraphWalker.java:132,
>
> org.apache.hadoop.hive.ql.lib.DefaultGraphWalker:startWalking:DefaultGraphWalker.java:109,
>
> org.apache.hadoop.hive.ql.optimizer.physical.index.IndexWhereTaskDispatcher:dispatch:IndexWhereTaskDispatcher.java:102,
>
> org.apache.hadoop.hive.ql.lib.DefaultGraphWalker:dispatchAndReturn:DefaultGraphWalker.java:94,
>
> org.apache.hadoop.hive.ql.lib.DefaultGraphWalker:dispatch:DefaultGraphWalker.java:78,
>
> org.apache.hadoop.hive.ql.lib.DefaultGraphWalker:walk:DefaultGraphWalker.java:132,
>
> org.apache.hadoop.hive.ql.lib.DefaultGraphWalker:startWalking:DefaultGraphWalker.java:109,
>
> org.apache.hadoop.hive.ql.optimizer.physical.IndexWhereResolver:resolve:IndexWhereResolver.java:38,
>
> org.apache.hadoop.hive.ql.optimizer.physical.PhysicalOptimizer:optimize:PhysicalOptimizer.java:107,
>
> org.apache.hadoop.hive.ql.parse.MapReduceCompiler:optimizeTaskPlan:MapReduceCompiler.java:273,
> org.apache.hadoop.hive.ql.parse.TaskCompiler:compile:TaskCompiler.java:225,
> org.apache.hadoop.hive.ql.parse.SemanticAnalyzer:analyzeInternal:SemanticAnalyzer.java:10109,
>
> org.apache.hadoop.hive.ql.parse.SemanticAnalyzer:analyzeInternal:SemanticAnalyzer.java:9902,
>
> org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer:analyze:BaseSemanticAnalyzer.java:223,
> org.apache.hadoop.hive.ql.Driver:compile:Driver.java:446,
> org.apache.hadoop.hive.ql.Driver:compile:Driver.java:312,
> org.apache.hadoop.hive.ql.Driver:compileInternal:Driver.java:1201,
> org.apache.hadoop.hive.ql.Driver:compileAndRespond:Driver.java:1188,
> org.apache.hive.service.cli.operation.SQLOperation:prepare:SQLOperation.java:134],
> sqlState:42000, errorCode:40000, errorMessage:Error while compiling
> statement: FAILED: NullPointerException null), Query: SELECT sys_created_on
> FROM servicenow_stg.sys_audit_distinct_tmp WHERE sys_created_on >
> from_unixtime(unix_timestamp('2017-01-01')).
> {code}
> I'll be able to test this with CDH 5.11.2 in two weeks.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
