HIVE-19853 and Timestamp in Arrow

2020-07-21 Thread Xuefu Zhang
Hi all, Recently I noticed that HIve serializes timestamp, which has no time zone, in Arrow as microsec in UTC. This seems a little counterintuitive on the surface. Thus, I'd like to understand it a bit more. From the JIRA [1], it seems that the choice was made for Spark because Spark does that.

[jira] [Created] (HIVE-23894) SubmitDag should not be retried incase of query cancel

2020-07-21 Thread Naresh P R (Jira)
Naresh P R created HIVE-23894: - Summary: SubmitDag should not be retried incase of query cancel Key: HIVE-23894 URL: https://issues.apache.org/jira/browse/HIVE-23894 Project: Hive Issue Type:

[jira] [Created] (HIVE-23893) Extract deterministic conditions for pdd when the predicate contains non-deterministic function

2020-07-21 Thread Zhihua Deng (Jira)
Zhihua Deng created HIVE-23893: -- Summary: Extract deterministic conditions for pdd when the predicate contains non-deterministic function Key: HIVE-23893 URL: https://issues.apache.org/jira/browse/HIVE-23893

Re: Time to Remove Hive-on-Spark

2020-07-21 Thread Chao Sun
Thanks David. FWIW Uber is still running Hive on Spark (2.3.4) on a very large scale in production right now and I don't think we have any plan to change it soon. On Tue, Jul 21, 2020 at 11:28 AM David wrote: > Hello, > > Thanks for the feedback. > > Just a quick recap: I did propose this

[jira] [Created] (HIVE-23892) Test Interpretation String fix

2020-07-21 Thread Steve Carlin (Jira)
Steve Carlin created HIVE-23892: --- Summary: Test Interpretation String fix Key: HIVE-23892 URL: https://issues.apache.org/jira/browse/HIVE-23892 Project: Hive Issue Type: Improvement

Re: Time to Remove Hive-on-Spark

2020-07-21 Thread David
Hello, Thanks for the feedback. Just a quick recap: I did propose this @dev and I received unanimous +1's from the community. After a couple months, I created the PR. Certainly open to discussion, but there hasn't been any discussion thus far because there have been no objections until this

[jira] [Created] (HIVE-23891) Using UNION sql clause and speculative execution can cause file duplication in Tez

2020-07-21 Thread George Pachitariu (Jira)
George Pachitariu created HIVE-23891: Summary: Using UNION sql clause and speculative execution can cause file duplication in Tez Key: HIVE-23891 URL: https://issues.apache.org/jira/browse/HIVE-23891

Re: Time to Remove Hive-on-Spark

2020-07-21 Thread Xuefu Zhang
Hi David, While a vendor may not support a component in an open source project, removing it or not is a decision by and for the community. I certainly understand that the vendor you mentioned has contributed a great deal (including my personal effort while working there), it's not up to the

Re: Time to Remove Hive-on-Spark

2020-07-21 Thread David
Hey, Thanks for the input. FYI. Cloudera (Cloudera + Hortonworks) have removed HoS from their latest offering. "Tez is now the only supported execution engine, existing queries that change execution mode to Spark or MapReduce within a session, for example, fail."

Re: Time to Remove Hive-on-Spark

2020-07-21 Thread Xuefu Z
Sorry for chiming in late. However, I don't think we should remove Hive on Spark just because of a technical problem. This is rather a big decision that we need to be careful about. There are users that will be left high and dry by this move. If the community decides to desupport and eventually

Re: Time to Remove Hive-on-Spark

2020-07-21 Thread David
Hello Team, https://github.com/apache/hive/pull/1285 Thanks. On Wed, Jun 3, 2020 at 11:49 PM Gopal V wrote: > > +1 > > Cheers, > Gopal > > On 6/3/20 7:48 PM, Jesus Camacho Rodriguez wrote: > > +1 > > > > -Jesús > > > > On Wed, Jun 3, 2020 at 1:58 PM Alan Gates wrote: > > > >> +1. > >> > >>

[jira] [Created] (HIVE-23890) Create HMS endpoint for querying file lists using FlatBuffers as serialization

2020-07-21 Thread Barnabas Maidics (Jira)
Barnabas Maidics created HIVE-23890: --- Summary: Create HMS endpoint for querying file lists using FlatBuffers as serialization Key: HIVE-23890 URL: https://issues.apache.org/jira/browse/HIVE-23890

[jira] [Created] (HIVE-23889) Empty bucket files are inserted with invalid schema after HIVE-21784

2020-07-21 Thread Jira
László Bodor created HIVE-23889: --- Summary: Empty bucket files are inserted with invalid schema after HIVE-21784 Key: HIVE-23889 URL: https://issues.apache.org/jira/browse/HIVE-23889 Project: Hive

[jira] [Created] (HIVE-23888) Simplify special_character_in_tabnames_1.q

2020-07-21 Thread Krisztian Kasa (Jira)
Krisztian Kasa created HIVE-23888: - Summary: Simplify special_character_in_tabnames_1.q Key: HIVE-23888 URL: https://issues.apache.org/jira/browse/HIVE-23888 Project: Hive Issue Type: Task

[jira] [Created] (HIVE-23887) numRow property of table stats is not get exported with export command

2020-07-21 Thread Ashish Sharma (Jira)
Ashish Sharma created HIVE-23887: Summary: numRow property of table stats is not get exported with export command Key: HIVE-23887 URL: https://issues.apache.org/jira/browse/HIVE-23887 Project: Hive

Re: HIVE building on ARM

2020-07-21 Thread Chinna Rao Lalam
Hi Ashutosh, I want to migrate https://builds.apache.org/view/H-L/view/Hive/job/Hive-linux-ARM-trunk/ this job to the new system https://ci-hadoop.apache.org. Please grant me rights to create jobs on the new Jenkins https://ci-builds.apache.org. My LDAP userid : chinnaraol. I have requested