[jira] [Created] (HIVE-24115) Kryo's instantiation strategy should use the DefaultInstantiatorStrategy instead of the dangerous StdInstantiatorStrategy
hao created HIVE-24115: -- Summary: Kryo's instantiation strategy should use the DefaultInstantiatorStrategy instead of the dangerous StdInstantiatorStrategy Key: HIVE-24115 URL: https://issues.apache.org/jira/browse/HIVE-24115 Project: Hive Issue Type: Wish Reporter: hao DefaultInstantiatorStrategy is the recommended way of creating objects with Kryo. It runs constructors just like would be done with Java code. Alternative, extralinguistic mechanisms can also be used to create objects. The [Objenesis|http://objenesis.org/] StdInstantiatorStrategy uses JVM specific APIs to create an instance of a class without calling any constructor at all. Using this is dangerous because most classes expect their constructors to be called. Creating the object by bypassing its constructors may leave the object in an uninitialized or invalid state. Classes must be designed to be created in this way. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24114) Load is not working with both staging and data copy on target
Pravin Sinha created HIVE-24114: --- Summary: Load is not working with both staging and data copy on target Key: HIVE-24114 URL: https://issues.apache.org/jira/browse/HIVE-24114 Project: Hive Issue Type: Task Reporter: Pravin Sinha Assignee: Pravin Sinha -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24113) NPE in GenericUDFToUnixTimeStamp
Rajkumar Singh created HIVE-24113:
-
Summary: NPE in GenericUDFToUnixTimeStamp
Key: HIVE-24113
URL: https://issues.apache.org/jira/browse/HIVE-24113
Project: Hive
Issue Type: Bug
Components: Hive
Affects Versions: 3.1.2
Reporter: Rajkumar Singh
Assignee: Rajkumar Singh
Following query will trigger the getPartitionsByExpr call at HMS, HMS will try
to evaluate the filter based on the PartitionExpressionForMetastore proxy, this
proxy uses the QL packages to evaluate the filter and call
GenericUDFToUnixTimeStamp.
select * from table_name where hour between
from_unixtime(unix_timestamp('2020090120', 'MMddHH') - 1*60*60,
'MMddHH') and from_unixtime(unix_timestamp('2020090122', 'MMddHH') +
2*60*60, 'MMddHH');
I think SessionState in the code path will always be NULL thats why it hit the
NPE.
{code:java}
java.lang.NullPointerException: null
at
org.apache.hadoop.hive.ql.udf.generic.GenericUDFToUnixTimeStamp.initializeInput(GenericUDFToUnixTimeStamp.java:126)
~[hive-exec-3.1.0.3.1.5.65-1.jar:3.1.0.3.1.5.65-1]
at
org.apache.hadoop.hive.ql.udf.generic.GenericUDFToUnixTimeStamp.initialize(GenericUDFToUnixTimeStamp.java:75)
~[hive-exec-3.1.0.3.1.5.65-1.jar:3.1.0.3.1.5.65-1]
at
org.apache.hadoop.hive.ql.udf.generic.GenericUDF.initializeAndFoldConstants(GenericUDF.java:148)
~[hive-exec-3.1.0.3.1.5.65-1.jar:3.1.0.3.1.5.65-1]
at
org.apache.hadoop.hive.ql.exec.ExprNodeGenericFuncEvaluator.initialize(ExprNodeGenericFuncEvaluator.java:146)
~[hive-exec-3.1.0.3.1.5.65-1.jar:3.1.0.3.1.5.65-1]
at
org.apache.hadoop.hive.ql.exec.ExprNodeGenericFuncEvaluator.initialize(ExprNodeGenericFuncEvaluator.java:140)
~[hive-exec-3.1.0.3.1.5.65-1.jar:3.1.0.3.1.5.65-1]
at
org.apache.hadoop.hive.ql.exec.ExprNodeGenericFuncEvaluator.initialize(ExprNodeGenericFuncEvaluator.java:140)
~[hive-exec-3.1.0.3.1.5.65-1.jar:3.1.0.3.1.5.65-1]
at
org.apache.hadoop.hive.ql.exec.ExprNodeGenericFuncEvaluator.initialize(ExprNodeGenericFuncEvaluator.java:140)
~[hive-exec-3.1.0.3.1.5.65-1.jar:3.1.0.3.1.5.65-1]
at
org.apache.hadoop.hive.ql.exec.ExprNodeGenericFuncEvaluator.initialize(ExprNodeGenericFuncEvaluator.java:140)
~[hive-exec-3.1.0.3.1.5.65-1.jar:3.1.0.3.1.5.65-1]
at
org.apache.hadoop.hive.ql.optimizer.ppr.PartExprEvalUtils.prepareExpr(PartExprEvalUtils.java:119)
~[hive-exec-3.1.0.3.1.5.65-1.jar:3.1.0.3.1.5.65-1]
at
org.apache.hadoop.hive.ql.optimizer.ppr.PartitionPruner.prunePartitionNames(PartitionPruner.java:551)
~[hive-exec-3.1.0.3.1.5.65-1.jar:3.1.0.3.1.5.65-1]
at
org.apache.hadoop.hive.ql.optimizer.ppr.PartitionExpressionForMetastore.filterPartitionsByExpr(PartitionExpressionForMetastore.java:82)
~[hive-exec-3.1.0.3.1.5.65-1.jar:3.1.0.3.1.5.65-1]
at
org.apache.hadoop.hive.metastore.ObjectStore.getPartitionNamesPrunedByExprNoTxn(ObjectStore.java:3527)
~[hive-exec-3.1.0.3.1.5.65-1.jar:3.1.0.3.1.5.65-1]
at
org.apache.hadoop.hive.metastore.ObjectStore.access$1400(ObjectStore.java:252)
~[hive-exec-3.1.0.3.1.5.65-1.jar:3.1.0.3.1.5.65-1]
at
org.apache.hadoop.hive.metastore.ObjectStore$10.getJdoResult(ObjectStore.java:3493)
~[hive-exec-3.1.0.3.1.5.65-1.jar:3.1.0.3.1.5.65-1]
at
org.apache.hadoop.hive.metastore.ObjectStore$10.getJdoResult(ObjectStore.java:3464)
~[hive-exec-3.1.0.3.1.5.65-1.jar:3.1.0.3.1.5.65-1]
at
org.apache.hadoop.hive.metastore.ObjectStore$GetHelper.run(ObjectStore.java:3764)
[hive-exec-3.1.0.3.1.5.65-1.jar:3.1.0.3.1.5.65-1]
at
org.apache.hadoop.hive.metastore.ObjectStore.getPartitionsByExprInternal(ObjectStore.java:3499)
[hive-exec-3.1.0.3.1.5.65-1.jar:3.1.0.3.1.5.65-1]
at
org.apache.hadoop.hive.metastore.ObjectStore.getPartitionsByExpr(ObjectStore.java:3452)
[hive-exec-3.1.0.3.1.5.65-1.jar:3.1.0.3.1.5.65-1]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
~[?:1.8.0_112]
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
~[?:1.8.0_112]
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
~[?:1.8.0_112]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_112]
at
org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:97)
[hive-exec-3.1.0.3.1.5.65-1.jar:3.1.0.3.1.5.65-1]
at com.sun.proxy.$Proxy28.getPartitionsByExpr(Unknown Source) [?:?]
at
org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_partitions_by_expr(HiveMetaStore.java:6637)
[hive-exec-3.1.0.3.1.5.65-1.jar:3.1.0.3.1.5.65-1]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
~[?:1.8.0_112]
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.ja
{code}
--
This message was sent by Atlassian Jira
[jira] [Created] (HIVE-24112) TestMiniLlapLocalCliDriver[dynamic_semijoin_reduction_on_aggcol] is flaky
Stamatis Zampetakis created HIVE-24112: -- Summary: TestMiniLlapLocalCliDriver[dynamic_semijoin_reduction_on_aggcol] is flaky Key: HIVE-24112 URL: https://issues.apache.org/jira/browse/HIVE-24112 Project: Hive Issue Type: Bug Reporter: Stamatis Zampetakis Assignee: Stamatis Zampetakis Fix For: 4.0.0 http://ci.hive.apache.org/job/hive-flaky-check/96/ -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24111) TestMmCompactorOnTez hangs when running against Tez 0.10.0 staging artifact
László Bodor created HIVE-24111: --- Summary: TestMmCompactorOnTez hangs when running against Tez 0.10.0 staging artifact Key: HIVE-24111 URL: https://issues.apache.org/jira/browse/HIVE-24111 Project: Hive Issue Type: Bug Reporter: László Bodor Assignee: László Bodor -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24110) NullPointerException occurs in some UDFs
Ryu Kobayashi created HIVE-24110:
Summary: NullPointerException occurs in some UDFs
Key: HIVE-24110
URL: https://issues.apache.org/jira/browse/HIVE-24110
Project: Hive
Issue Type: Bug
Components: Hive
Reporter: Ryu Kobayashi
Assignee: Ryu Kobayashi
Since it refers to a variable that has not been initialized,
NullPointerException occurs and the correct error message is not displayed.
{code:java}
if (arguments[0].getCategory() != ObjectInspector.Category.PRIMITIVE) {
throw new UDFArgumentException(
"OCTET_LENGTH only takes primitive types, got " +
argumentOI.getTypeName());
}
argumentOI = (PrimitiveObjectInspector) arguments[0];
{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (HIVE-24109) Load partitions in parallel for managed tables in the bootstrap phase
Aasha Medhi created HIVE-24109: -- Summary: Load partitions in parallel for managed tables in the bootstrap phase Key: HIVE-24109 URL: https://issues.apache.org/jira/browse/HIVE-24109 Project: Hive Issue Type: Task Reporter: Aasha Medhi Assignee: Aasha Medhi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24108) LlapDaemon should use TezClassLoader
László Bodor created HIVE-24108: --- Summary: LlapDaemon should use TezClassLoader Key: HIVE-24108 URL: https://issues.apache.org/jira/browse/HIVE-24108 Project: Hive Issue Type: Improvement Reporter: László Bodor Attachments: hive_log_llap.log -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24107) Fix typo in ReloadFunctionsOperation
Zhihua Deng created HIVE-24107: -- Summary: Fix typo in ReloadFunctionsOperation Key: HIVE-24107 URL: https://issues.apache.org/jira/browse/HIVE-24107 Project: Hive Issue Type: Improvement Components: HiveServer2 Reporter: Zhihua Deng Hive.get() will register all functions as doRegisterAllFns is true, so Hive.get().reloadFunctions() may load all functions from metastore twice, use Hive.get(false) instead may be better. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24106) Abort polling on the operation state when the current thread is interrupted
Zhihua Deng created HIVE-24106: -- Summary: Abort polling on the operation state when the current thread is interrupted Key: HIVE-24106 URL: https://issues.apache.org/jira/browse/HIVE-24106 Project: Hive Issue Type: Improvement Components: JDBC Reporter: Zhihua Deng If running HiveStatement asynchronously as a task like in a thread or future, if we interrupt the task, the HiveStatement would continue to poll on the operation state until finish. It's may better to provide a way to abort the executing in such case. -- This message was sent by Atlassian Jira (v8.3.4#803005)
