Re: Hive on Spark

2015-09-03 Thread Patrick McAnneny
What is the benefit of Hive on Spark if you cannot pre-load data into memory that you know will be queried. On Mon, Aug 31, 2015 at 4:25 PM, Xuefu Zhang wrote: > What you described isn't part of the functionality of Hive on Spark. > Rather, Spark is used here as a general

Table level stats are not shown after insert starting in Hive 0.13?

2015-09-03 Thread Jim Green
*Hive 0.12:* After insert SQL: Partition default.mytablepar{id=111} stats: [num_files: 1, num_rows: 0, total_size: 4, raw_data_size: 0] Table default.mytablepar stats: [num_partitions: 1, num_files: 1, num_rows: 0, total_size: 4, raw_data_size: 0] *Hive 0.13:* After insert SQL: Partition

Re: Request for write access to the Hive wiki

2015-09-03 Thread Lefty Leverenz
You've got it. Welcome to the Hive wiki team, Aswathy! -- Lefty On Thu, Sep 3, 2015 at 1:21 PM, Aswathy C.S <2aswa...@gmail.com> wrote: > Hi Lefty, > > I have created Confluence account, same username: asreekumar. > Misunderstood Confluence account for apache account. Thanks for the signup >

Subquery in select statement

2015-09-03 Thread Daniel Lopes
Hi, There are somthing that I can do this? SELECT tb.id, (SELECT tb3.field FROM database.table2 tb2 JOIN database.table3 tb3 ON ( tb3.id = tb2.table3_id) ORDER BY tb3.date DESC LIMIT 1) AS tb3_field FROM database.table1 tb1 Best, *Daniel Lopes, B.Eng* Data Scientist - BankFacil CREA/SP

Re: Request for write access to the Hive wiki

2015-09-03 Thread Aswathy C.S
Hi Lefty, I have created Confluence account, same username: asreekumar. Misunderstood Confluence account for apache account. Thanks for the signup link. Hope you could help me with write access now. Aswathy On Thu, Sep 3, 2015 at 1:30 AM, Lefty Leverenz wrote: >

Re: ORC NPE while writing stats

2015-09-03 Thread Prasanth Jayachandran
> On Sep 2, 2015, at 10:57 PM, David Capwell wrote: > > So, very quickly looked at the JIRA and I had the following question; > if you have a pool per thread rather than global, then assuming 50% > heap will cause writer to OOM with multiple threads, which is > different

Re: ORC NPE while writing stats

2015-09-03 Thread David Capwell
Thanks, that should help moving forward On Sep 3, 2015 10:38 AM, "Prasanth Jayachandran" < pjayachand...@hortonworks.com> wrote: > > > On Sep 2, 2015, at 10:57 PM, David Capwell wrote: > > > > So, very quickly looked at the JIRA and I had the following question; > > if you

Re: Disabling local mode optimization

2015-09-03 Thread sreebalineni .
Hi, Is not it that you should set it true, by default it is disabled which is false. Hive analyzes the size of each map-reduce job in a query and may run it locally if the following thresholds are satisfied: - The total input size of the job is lower than:

Re: Request for write access to the Hive wiki

2015-09-03 Thread Lefty Leverenz
Aswathy, Confluence doesn't recognize that username (although JIRA does), nor does it recognize your actual name. Did you create the Confluence account here ? -- Lefty On Wed, Sep 2, 2015 at 6:12 PM, Aswathy C.S <2aswa...@gmail.com> wrote: >

Re: unsubscribe

2015-09-03 Thread Lefty Leverenz
Sasha, to unsubscribe please send a message to user-unsubscr...@hive.apache.org as described here: Mailing Lists . Thanks. -- Lefty On Thu, Sep 3, 2015 at 2:35 AM, Sasha Ostrikov wrote: > unsubscribe >

unsubscribe

2015-09-03 Thread Sasha Ostrikov
unsubscribe

Re: Disabling local mode optimization

2015-09-03 Thread Daniel Haviv
Excatly the info I needed. Thanks Daniel > On 3 בספט׳ 2015, at 09:02, sreebalineni . wrote: > > Hi, > > Is not it that you should set it true, by default it is disabled which is > false. > Hive analyzes the size of each map-reduce job in a query and may run it >

Error upon XML serialization.

2015-09-03 Thread Raajay
I attempted to serialize a "QueryPlan (ql/QueryPlan.java)" using Utilities.serializePlan() function, and encountered errors (pasted below); I had "hive.plan.serialization.format=javaXML". No such exception was thrown while setting serialization format to "kryo". However, I was not successful in

Re: Table level stats are not shown after insert starting in Hive 0.13?

2015-09-03 Thread Jim Green
Adding Dev user list. Could somebody help take a look? On Thu, Sep 3, 2015 at 12:25 PM, Jim Green wrote: > Also tried Hive 1.0, and the result is the same as Hive 0.13. > Is there any reason why we do not print the table level stats for > partition table? > > On Thu, Sep

Limiting with index creation on hive empty tables with tez execution engine

2015-09-03 Thread venkata srinivasarao kolla
Hi Team, In our environment we have set hive execution to Tez and tried to create/rebuild index on empty tables. Then we found that index creation is not happening. we are getting the below error: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.tez.TezTask. It seems

Index creation is failing from beeline when execution engine is set to Tez

2015-09-03 Thread venkata srinivasarao kolla
Hi Hive Team, In Hive, with execution engine is set to Tez and when we tried to rebuild index on a table (which is not empty) using beeline, index creation is not happening. It is not throwing any error too on to console. But in the corresponding tez job logs we found below error: 2015-08-24