Hi Rajesh,
thanks for your quick response.
After quitting the job, no further containers are being launched.
Unfortunately I have no execution plan (EXPLAIN output) to dive into that
execution in detail.
Do you have recommendations of Tez/Hive parameters that influence the
execution of TBs of
I am pleased to announce that Sergey Shelukhin has been elected to the Hive
Project Management Committee. Please join me in congratulating Sergey!
Thanks.
- Carl
Congrats Sergey!
On 2/25/15, 8:43 AM, Carl Steinbach c...@apache.org wrote:
I am pleased to announce that Sergey Shelukhin has been elected to the
Hive
Project Management Committee. Please join me in congratulating Sergey!
Thanks.
- Carl
Hi,
There¹s a special interface in hive-1.0, which gives more information to
the input format.
https://hive.apache.org/javadocs/r1.0.0/api/ql/org/apache/hadoop/hive/ql/io
/CombineHiveInputFormat.AvoidSplitCombination.html
But entirely skipping combination results in so many performance
Hi Everyone
Lets say I have a table partitioned by period string
how to select max period?
if I run
select max(period) from invoice;
hive 0.13.1 runs MR which is slow
OK
STAGE DEPENDENCIES:
Stage-1 is a root stage
Stage-0 is a root stage
STAGE PLANS:
Stage: Stage-1
Tez
Edges:
Congrats Sergey!
On 2/25/15, 9:06 AM, Vikram Dixit vik...@hortonworks.com wrote:
Congrats Sergey!
On 2/25/15, 8:43 AM, Carl Steinbach c...@apache.org wrote:
I am pleased to announce that Sergey Shelukhin has been elected to the
Hive
Project Management Committee. Please join me in
Hi,
auth=nosasl should be only provided in JDBC url if
hive.server2.authentication” is explicitly set to NOSASL in your hive-site.
Otherwise, the jdbc client tries to open a plain socket while the the server is
expecting a sasl negotiation to happen. Due to an issue with thrift, this
results
Looks like your Kerberos authentication failed. Did you renew the ticket?
Typical expiry is 24 hours.
From: Bogala, Chandra Reddy
chandra.bog...@gs.commailto:chandra.bog...@gs.com
Reply-To: user@hive.apache.orgmailto:user@hive.apache.org
user@hive.apache.orgmailto:user@hive.apache.org
Date:
Congrats!
On Wed, Feb 25, 2015 at 12:33 PM, Vaibhav Gumashta
vgumas...@hortonworks.com wrote:
Congrats Sergey!
On 2/25/15, 9:06 AM, Vikram Dixit vik...@hortonworks.com wrote:
Congrats Sergey!
On 2/25/15, 8:43 AM, Carl Steinbach c...@apache.org wrote:
I am pleased to announce that
Congrats Sergey!
On Feb 25, 2015, at 1:50 PM, Alexander Pivovarov
apivova...@gmail.commailto:apivova...@gmail.com wrote:
Congrats!
On Wed, Feb 25, 2015 at 12:33 PM, Vaibhav Gumashta
vgumas...@hortonworks.commailto:vgumas...@hortonworks.com wrote:
Congrats Sergey!
On 2/25/15, 9:06 AM, Vikram
Thanks guys!
On 15/2/25, 16:02, Xiaobing Zhou xz...@hortonworks.com wrote:
Congrats Sergey!
On Feb 25, 2015, at 1:56 PM, Prasanth Jayachandran
pjayachand...@hortonworks.com wrote:
Congrats Sergey!
On Feb 25, 2015, at 1:50 PM, Alexander Pivovarov
Hi Team,
Here is old thread about this issue:
http://qnalist.com/questions/5091386/doubt-about-locking-mechanism-in-hive
I met the same issue that when reading one table in session A, we can not
create a table in the same database in session B. Basically it causes
database level lock in Hive
Hi,
I am trying to use a signed jar (BouncyCastle) in one of my UDFs. Since
signed jars shouldn't be extracted I am using two ADD JAR statements to add
both the UDF jar as well as BouncyCastle provider jar to the classpath.
However, hive/hadoop automatically extracts the signed jar
Use yarn logs -applicationId appId to see detail log.
r7raul1...@163.com
From: Jadhav Shweta
Date: 2015-02-26 15:00
To: user
Subject: Re: ERROR OutOfMemoryError: Java heap space
Hi,
I tried running same query from Simple JDBC Client instead of Spring Batch
framework its was working fine.
What lock manager are you using?
Alan.
Jim Green mailto:openkbi...@gmail.com
February 25, 2015 at 17:24
Hi Team,
Here is old thread about this issue:
http://qnalist.com/questions/5091386/doubt-about-locking-mechanism-in-hive
I met the same issue that when reading one table in session A, we
Hi,
I tried running same query from Simple JDBC Client instead of Spring Batch
framework its was working fine.
But now when I am running it again I am getting new error
Hadoop job information for Stage-1: number of mappers: 1; number of reducers: 0
2015-02-26 11:41:50,233 Stage-1 map = 0%,
Query is working fine if i have small data set in same table.
But its throwing error for large data set
Thanks
Shweta Jadhav
-Srinivas Thunga srinivas.thu...@gmail.com wrote: -
To: user@hive.apache.org user@hive.apache.org
From: Srinivas Thunga srinivas.thu...@gmail.com
Date:
A query like select name,count(id) from table where date='2015-01-01' or
date='2015-01-02' group by (name) takes almost forever and needs to be
cancelled after ~30min.
It should have ideally scanned only the 2 partitions. Do you see any
container launches after which you had to kill the job? Or
Hi,
You can set fetch size based certain datatype like blob, image, etc
statement.setFetchSize(1000);
Try this.
*Thanks Regards,*
*Srinivas T*
On Wed, Feb 25, 2015 at 4:10 PM, Jadhav Shweta jadhav.shw...@tcs.com
wrote:
Query is working fine if i have small data set in same table.
But
not required. Make sure there will not be unnecessary looping in your code
*Thanks Regards,*
*Srinivas T*
On Wed, Feb 25, 2015 at 2:58 PM, Jadhav Shweta jadhav.shw...@tcs.com
wrote:
Do I need to increase HADOOP_HEAPSIZE
I haven't set it.
I have cluster with 4 machines each having 8GB ram.
Hi
I am running simple select query
select * from table;
thanks
Shweta Jadhav
-Srinivas Thunga srinivas.thu...@gmail.com wrote: -
To: user@hive.apache.org user@hive.apache.org
From: Srinivas Thunga srinivas.thu...@gmail.com
Date: 02/25/2015 01:09PM
Subject: Re:
Hi,
Can you place
Hi,
Let me know how you configured Hive?
R u using cloudera?
If you are installed Hive separately then have you configured Metastore?
*Thanks Regards,*
*Srinivas T*
On Wed, Feb 25, 2015 at 2:27 PM, Jadhav Shweta jadhav.shw...@tcs.com
wrote:
Hi
I am running simple select query
select
Hi
I have installed apache hive 0.13.0.
I have configured metastore as postgres db.
Query is working fine in beeline command line interface but giving Heap space
error while executing using JDBC java client.
Thanks
Shweta Jadhav
-Srinivas Thunga srinivas.thu...@gmail.com wrote: -
To:
Hi,
Might be problem in your code.
Generally it happens when there are unnecessary looping.
Please check your java code.
*Thanks Regards,*
*Srinivas T*
On Wed, Feb 25, 2015 at 2:38 PM, Jadhav Shweta jadhav.shw...@tcs.com
wrote:
Hi
I have installed apache hive 0.13.0.
I have configured
Try select * from table limit 1;
r7raul1...@163.com
From: Jadhav Shweta
Date: 2015-02-25 17:38
To: user
Subject: Re: ERROR OutOfMemoryError: Java heap space
Hi
I have installed apache hive 0.13.0.
I have configured metastore as postgres db.
Query is working fine in beeline command line
I am running the query using spring batch framework.
Thanks
Shweta Jadhav
-Srinivas Thunga srinivas.thu...@gmail.com wrote: -
To: user@hive.apache.org user@hive.apache.org
From: Srinivas Thunga srinivas.thu...@gmail.com
Date: 02/25/2015 02:43PM
Subject: Re: ERROR OutOfMemoryError: Java
Do I need to increase HADOOP_HEAPSIZE
I haven't set it.
I have cluster with 4 machines each having 8GB ram.
I read somewhere that we should mention auth=noSasl in hive jdbc url. Is it
necessary
Thanks
Shweta Jadhav
-Jadhav Shweta jadhav.shw...@tcs.com wrote: -
To: user@hive.apache.org
Hi,
I'm a bit stuck in optimizing the hive/tez config parameters to speed up
Hive/Tez query execution.
The cluster consists of 6 worker nodes (with rather hadoop-non-ideal
component proportion, but that's given) including: 48Cores/384GB Ram/10HDDs.
The Hive table is configured as:
- partitioned
Is your problem solved?
*Thanks Regards,*
*Srinivas T*
On Wed, Feb 25, 2015 at 4:17 PM, Srinivas Thunga srinivas.thu...@gmail.com
wrote:
Hi,
You can set fetch size based certain datatype like blob, image, etc
statement.setFetchSize(1000);
Try this.
*Thanks Regards,*
*Srinivas T*
Hi,
My Hive jdbc client queries ( hiveserver2) to secured cluster fails with
below exception after one or two days running fine from tomcat. Any idea what
might be the issue? Is it a known issue?
2015-02-25 04:49:43,174 ERROR [org.apache.thrift.transport.TSaslTransport] SASL
negotiation
30 matches
Mail list logo
