[ANN] Hivemall v0.3.2 is now available

2015-06-10 Thread Makoto Yui
Hello all, We released a newer version of Hivemall, v0.3.2. Hivemall provides machine learning functionality over Hive UDFs/UDAFs/UDTFs. Hivemall is easy to use because every machine learning step is done within HiveQL. https://github.com/myui/hivemall In the latest release (v0.3.2), we

Re: Hive on Tez

2015-06-10 Thread Gopal Vijayaraghavan
Hi, There¹s no relationship between number of containers and tasks ­ well the number of tasks is the maximum number of containers you can use. You can run an entire vertex containing many task attempts in one container if there are no more available ­ because of container reuse. The memory/cpu

switching default execution engine for hiveserver2

2015-06-10 Thread Ayazur Rehman
how to make the default execution engine as Tez while running hive queries through hiveserver2 -- Thanking You, Ayazur Rehman +1 720 917 8540

Empty Table in MR with union all (created in Tez)

2015-06-10 Thread Gufran Mohammed Pathan
Hi, I'm unable to retrieve rows from a table created in Tez when using MR as execution engine. This happens only when the create table statement has union all. Here's a way to reproduce the issue: set hive.execution.engine=tez; create table test_table as select 1 from table1 union all select

Re: switching default execution engine for hiveserver2

2015-06-10 Thread Lefty Leverenz
Do you know about the configuration parameter hive.execution.engine https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-hive.execution.engine ? -- Lefty On Wed, Jun 10, 2015 at 7:25 AM, Ayazur Rehman rehman.ayazu...@gmail.com wrote: how to make the

Re: switching default execution engine for hiveserver2

2015-06-10 Thread Hari Subramaniyan
Hi ?Ayazur, Start hiveserver2 with the parameter as mentioned in the below link $HIVE_HOME/bin/hive --service hiveserver2 --hiveconf hive.execution.engine=tez. https://cwiki.apache.org/confluence/display/Hive/Setting+Up+HiveServer2#SettingUpHiveServer2-HowtoStart? An alternative way would be

Re: switching default execution engine for hiveserver2

2015-06-10 Thread Ayazur Rehman
Yes, I know about the parameter. I have the default hive execution engine as Tez for commands that run through the hive shell. However,the commands through the hiveserver2 don't execute on Tez. Where should I update the parameter for hiveserver2? On Wed, Jun 10, 2015 at 6:03 PM, Lefty Leverenz

Re: Hive on Tez

2015-06-10 Thread Yunqi Zhang
Hi Gopal, Thank you for your reply. I checked out some of the code following you suggestions and would like to double-check my understanding with you. On Wed, Jun 10, 2015 at 12:28 AM, Gopal Vijayaraghavan gop...@apache.org wrote: Hi, There’s no relationship between number of containers and

Hosting Hive User Group Meeting During Hadoop World NY

2015-06-10 Thread Xuefu Zhang
Dear Hive users, Hive community is considering a user group meeting during Hadoop World that will be held in New York at the end of September. To make this happen, your support is essential. First, I'm wondering if any user in New York area would be willing to host the meetup. Secondly, I'm

delta file compact take no effect

2015-06-10 Thread r7raul1...@163.com
I use hive 1.1.0 on hadoop 2.5.0 After I do some update operation on table u_data_txn. My table create many delta file like: drwxr-xr-x - hdfs hive 0 2015-02-06 22:52 /user/hive/warehouse/u_data_txn/delta_001_001 -rw-r--r-- 3 hdfs supergroup 346453 2015-02-06 22:52

does hive cli support concurrency?

2015-06-10 Thread Xiaomeng Huang
Hi, I found a problem when I use hive. 1. In my environment, I have many threads, and every thread fork a process to run hive job using hive -e sql(not use hiveserver2, just use hive cli). Accidentally, one hive process couldn't close when the job is fininshed. I see the job in yarn has finished,

Re: Empty Table in MR with union all (created in Tez)

2015-06-10 Thread Vaibhav Gumashta
Might be related to: https://issues.apache.org/jira/browse/HIVE-10929 Thanks, -Vaibhav From: Gufran Mohammed Pathan gufran.path...@mu-sigma.commailto:gufran.path...@mu-sigma.com Reply-To: user@hive.apache.orgmailto:user@hive.apache.org user@hive.apache.orgmailto:user@hive.apache.org Date: