Re: [Hive on Tez] Running queries in tez non-session mode not working

2017-03-14 Thread Ravi Teja Chilukuri
Hi Gopal, I have tried setting by both the means, setting after launching cli via set command and setting before launching cli using hive --hiveconf tez.am.mode.session=false. Both didn't work. Thanks, Ravi On Wed, Mar 15, 2017 at 12:44 AM, Gopal Vijayaraghavan wrote: > > >

Re: [Hive on Tez] Running queries in tez non-session mode not working

2017-03-14 Thread Gopal Vijayaraghavan
> by setting tez.am.mode.session=false in hive-cli and hive-jdbc via > hive-server2. That setting does not work if you do "set tez.am.*" parameters (any tez.am params). Can you try doing hive --hiveconf tez.am.mode.session=false instead of a set; param and see if that works? Cheers,

Re: Why direct memory should be smaller than llap size

2017-03-14 Thread Prasanth Jayachandran
The “size” here means the container size. You are requesting for a 12GB container but max container size in your cluster is configured to 8GB. Xmx + cache should be less than size which should be less than max container size. Also, set the —executors/—iothreads to a value <=max vcores. —size

[Hive on Tez] Running queries in tez non-session mode not working

2017-03-14 Thread ravi teja
Hi, We wanted to run our hive queries in non-session mode as we have a problem tracking the app ids. Until our tracking is fixed we wanted to run each dag in a separate app master. I have read that running tez in non-session mode will achieve this functionality, by setting

Re: Why direct memory should be smaller than llap size

2017-03-14 Thread 邓志华
Thanks @pjayachandran, I try to add xmx to specify the executors memory. hive --service llap --name llap_service --instances 16 --size 12g --xmx 6g --cache 5120m --executors 24 --iothreads 24 It’s ok now to generate the startup script while fail to start the daemon due to:

hive on spark - version question

2017-03-14 Thread Stephen Sprague
hi guys, wondering where we stand with Hive On Spark these days? i'm trying to run Spark 2.1.0 with Hive 2.1.0 (purely coincidental versions) and running up against this class not found: java.lang.NoClassDefFoundError: org/apache/spark/JavaSparkListener searching the Cyber i find this: 1.