Re: tez + union stmt

2017-01-10 Thread Rohini Palaniswamy
The implementation in hive does look wrong. The concept of VertexGroups was added in Tez specifically for the case of union to support writing to same directory from different vertices. Sub-directories should not be required as a workaround. Regards, Rohini On Sun, Dec 25, 2016 at 10:58 AM,

Re: tez + union stmt

2017-01-10 Thread Elliot West
Thanks Rohini, This is good to know. Could you perhaps raise an issue in the Hive JIRA? Thanks, Elliot. On Tue, 10 Jan 2017 at 22:55, Rohini Palaniswamy wrote: > The implementation in hive does look wrong. The concept of VertexGroups > was added in Tez specifically

Re: tez + union stmt

2017-01-10 Thread Chris Drome
Elliot, Mithun already created the following ticket to track the issue: https://issues.apache.org/jira/browse/HIVE-15575 chris On Tuesday, January 10, 2017 11:05 PM, Elliot West wrote: Thanks Rohini, This is good to know. Could you perhaps raise an issue in the Hive

Re: Query History

2017-01-10 Thread Mahender Sarangam
ping.. On 1/4/2017 4:27 PM, Mahender Sarangam wrote: > Hi Team, > > Is there a way in Resource Manager UI or location in HDFS, where i can > search for logs related to Application ID even after 1 week of > execution. I can go into Ambari URI, Tez View and Search By Application > ID, Is there a

Re: Zero Bytes Files importance

2017-01-10 Thread Mahender Sarangam
Thanks Gopal for providing detail explanation. On 1/3/2017 5:59 PM, Gopal Vijayaraghavan wrote: >> Thanks Gopal. Yeah I'm using CloudBerry. Storage is Azure. > Makes sense, only an object store would have this. > >> Are you saying this _0,1,2,3 are directories ?. > No, only the zero size

Re: Zero Bytes Files importance

2017-01-10 Thread Mahender Sarangam
Thanks Gopal for providing detail explanation. On 1/3/2017 5:59 PM, Gopal Vijayaraghavan wrote: >> Thanks Gopal. Yeah I'm using CloudBerry. Storage is Azure. > Makes sense, only an object store would have this. > >> Are you saying this _0,1,2,3 are directories ?. > No, only the zero size

Vectorised Queries in Hive

2017-01-10 Thread Mich Talebzadeh
My understanding is that Vectorized query execution is only applicable to ORC tables in Hive by processing block of 1024 rows at a time. I have also noticed that this execution mode is only applicable to single predicate search. It does not work with multiple predicates searches. Can someone