[jira] [Created] (HIVE-25292) to_unix_timestamp & unix_timestamp should support ENGLISH format by default
shezm created HIVE-25292: Summary: to_unix_timestamp & unix_timestamp should support ENGLISH format by default Key: HIVE-25292 URL: https://issues.apache.org/jira/browse/HIVE-25292 Project: Hive Issue Type: Improvement Components: Clients Reporter: shezm Fix For: 3.2.0 Hei The to_unix_timestamp function is implemented by GenericUDFToUnixTimeStamp. It uses SimpleDateFormat to parse the time of the string type. But SimpleDateFormat does not specify the Locale parameter, that is, the default locale of the jvm machine will be used. This will cause some non-English local machines to be unable to run similar sql like : {code:java} hive> select to_unix_timestamp('16/Mar/2017:12:25:01', 'dd/MMM/yyy:HH:mm:ss'); OK NULLhive> select unix_timestamp('16/Mar/2017:12:25:01', 'dd/MMM/yyy:HH:mm:ss'); OK NULL {code} At the same time, I found that in spark, to_unix_timestamp & unix_timestamp also use SimpleDateFormat, and spark uses Locale.US by default, but this will make it impossible to use local language syntax. For example, in the Chinese environment, I can parse this result correctly in hive, {code:java} hive> select to_unix_timestamp('16/三月/2017:12:25:01', 'dd//yyy:HH:mm:ss'); OK 1489638301 Time taken: 0.147 seconds, Fetched: 1 row(s) OK NULL {code} But spark will return Null. Because English dates are more common dates, I think two SimpleDateFormats are needed. The new SimpleDateFormat is initialized with the Locale.ENGLISH parameter. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-25291) Fix q.out files after HIVE-25240
Nikhil Gupta created HIVE-25291: --- Summary: Fix q.out files after HIVE-25240 Key: HIVE-25291 URL: https://issues.apache.org/jira/browse/HIVE-25291 Project: Hive Issue Type: Bug Components: Tests Affects Versions: 4.0.0 Reporter: Nikhil Gupta Fix For: 4.0.0 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-25290) Stabilize TestTxnHandler
Zoltan Haindrich created HIVE-25290: --- Summary: Stabilize TestTxnHandler Key: HIVE-25290 URL: https://issues.apache.org/jira/browse/HIVE-25290 Project: Hive Issue Type: Improvement Reporter: Zoltan Haindrich http://ci.hive.apache.org/job/hive-flaky-check/271/ -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-25289) Fix external_jdbc_table3 and external_jdbc_table4
Zoltan Haindrich created HIVE-25289: --- Summary: Fix external_jdbc_table3 and external_jdbc_table4 Key: HIVE-25289 URL: https://issues.apache.org/jira/browse/HIVE-25289 Project: Hive Issue Type: Improvement Reporter: Zoltan Haindrich http://ci.hive.apache.org/job/hive-flaky-check/265/ http://ci.hive.apache.org/job/hive-flaky-check/266/ -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-25288) Fix TestMmCompactorOnTez
Zoltan Haindrich created HIVE-25288: --- Summary: Fix TestMmCompactorOnTez Key: HIVE-25288 URL: https://issues.apache.org/jira/browse/HIVE-25288 Project: Hive Issue Type: Improvement Reporter: Zoltan Haindrich http://ci.hive.apache.org/job/hive-flaky-check/240/ -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-25287) NPE on insertions into Iceberg-backed tables
Ádám Szita created HIVE-25287: - Summary: NPE on insertions into Iceberg-backed tables Key: HIVE-25287 URL: https://issues.apache.org/jira/browse/HIVE-25287 Project: Hive Issue Type: Bug Components: File Formats Reporter: Ádám Szita Assignee: Ádám Szita NPE is thrown upon inserting values into an Iceberg table, as statistics generation triggers an alter table operation with undefined (alter)operation type: {code:java} INFO : Executing stats task INFO : [Warning] could not update stats.Failed with exception null java.lang.NullPointerException at org.apache.iceberg.mr.hive.HiveIcebergMetaHook.commitAlterTable(HiveIcebergMetaHook.java:283) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.alter_table(HiveMetaStoreClient.java:572) at org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient.alter_table(SessionHiveMetaStoreClient.java:500) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:218) at com.sun.proxy.$Proxy124.alter_table(Unknown Source) at org.apache.hadoop.hive.ql.metadata.Hive.alterTable(Hive.java:854) at org.apache.hadoop.hive.ql.metadata.Hive.alterTable(Hive.java:806) at org.apache.hadoop.hive.ql.metadata.Hive.alterTable(Hive.java:786) at org.apache.hadoop.hive.ql.stats.BasicStatsTask.aggregateStats(BasicStatsTask.java:279) at org.apache.hadoop.hive.ql.stats.BasicStatsTask.process(BasicStatsTask.java:100) at org.apache.hadoop.hive.ql.exec.StatsTask.execute(StatsTask.java:107) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:212) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:105) at org.apache.hadoop.hive.ql.Executor.launchTask(Executor.java:361) at org.apache.hadoop.hive.ql.Executor.launchTasks(Executor.java:334) at org.apache.hadoop.hive.ql.Executor.runTasks(Executor.java:245) at org.apache.hadoop.hive.ql.Executor.execute(Executor.java:108) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:348) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:204) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:153) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:148) at org.apache.hadoop.hive.ql.reexec.ReExecDriver.run(ReExecDriver.java:164) at org.apache.hive.service.cli.operation.SQLOperation.runQuery(SQLOperation.java:234) at org.apache.hive.service.cli.operation.SQLOperation.access$500(SQLOperation.java:89) at org.apache.hive.service.cli.operation.SQLOperation$BackgroundWork$1.run(SQLOperation.java:337) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hive.service.cli.operation.SQLOperation$BackgroundWork.run(SQLOperation.java:357) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)