Hive query starts own session for LLAP

2017-09-21 Thread Rajesh Narayanan
HI All,

When I execute the hive query , that  starts its own session and creates new 
yarn jobs rather than using the llap enabled job

Can you please provide some suggestion?

 

Thanks

Rajesh


RE: Hive LLAP service is not starting

2017-09-12 Thread Rajesh Narayanan
Hi Premal

Thanks for the reply. I am following below document. Can you please provide any 
document or steps to start LLAP through slide

https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.3/bk_command-line-installation/content/intro_new_book.html

Regards

Rajesh

From: Premal Shah [mailto:premal.j.s...@gmail.com] 
Sent: Monday, September 11, 2017 11:29 PM
To: user@hive.apache.org
Subject: Re: Hive LLAP service is not starting

 

Hi Rajesh,

I thought the recommended way to start/stop LLAP was to use Slider 

this is what we do to start

 

slider create llap --resources $BASEDIR/resources.json --template 
$BASEDIR/appConfig.json 

 

and to stop before you can start again

 

slider stop llap

slider destroy llap --force || slider destroy llap

 

 

On Mon, Sep 11, 2017 at 5:36 AM, Rajesh Narayanan mailto:rajesh.r.naraya...@oracle.com; \nrajesh.r.naraya...@oracle.com> wrote:

Hi All,

I am using Hadoop 2.7.3 and Hive 2.2.0 and TEZ 0.9.0 in linux. and able to 
execute hive query in yarn as TEZ type.

When I start hive LLAP service  -./hive --service llap --name @llap --instances 
1 --cache 1024m --xmx 2048m --size 3225m --loglevel DEBUG --args " -XX:+UseG1GC 
-XX:+ResizeTLAB -XX:+UseNUMA -XX:-ResizePLAB"

Getting below exception. Could you please suggest what missing here.

 

Failed: java.io.FileNotFoundException: 
/tmp/staging-slider-HHIwk3/lib/tez.tar.gz (Is a directory)
java.util.concurrent.ExecutionException: java.io.FileNotFoundException: 
/tmp/staging-slider-HHIwk3/lib/tez.tar.gz (Is a directory)
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
at java.util.concurrent.FutureTask.get(FutureTask.java:192)
at 
org.apache.hadoop.hive.llap.cli.LlapServiceDriver.run(LlapServiceDriver.java:605)
at 
org.apache.hadoop.hive.llap.cli.LlapServiceDriver.main(LlapServiceDriver.java:113)
Caused by: java.io.FileNotFoundException: 
/tmp/staging-slider-HHIwk3/lib/tez.tar.gz (Is a directory)
at java.io.FileInputStream.open0(Native Method)
at java.io.FileInputStream.open(FileInputStream.java:195)
at java.io.FileInputStream.(FileInputStream.java:138)
at 
org.apache.hadoop.hive.common.CompressionUtils.unTar(CompressionUtils.java:152)
at 
org.apache.hadoop.hive.llap.cli.LlapServiceDriver$1.call(LlapServiceDriver.java:361)
at 
org.apache.hadoop.hive.llap.cli.LlapServiceDriver$1.call(LlapServiceDriver.java:348)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
INFO cli.LlapServiceDriver: LLAP service driver finished

 

Thanks

Rajesh





 

-- 

Regards,
Premal Shah.


Hive LLAP service is not starting

2017-09-11 Thread Rajesh Narayanan
Hi All,

I am using Hadoop 2.7.3 and Hive 2.2.0 and TEZ 0.9.0 in linux. and able to 
execute hive query in yarn as TEZ type.

When I start hive LLAP service  -./hive --service llap --name @llap --instances 
1 --cache 1024m --xmx 2048m --size 3225m --loglevel DEBUG --args " -XX:+UseG1GC 
-XX:+ResizeTLAB -XX:+UseNUMA -XX:-ResizePLAB"

Getting below exception. Could you please suggest what missing here.

 

Failed: java.io.FileNotFoundException: 
/tmp/staging-slider-HHIwk3/lib/tez.tar.gz (Is a directory)
java.util.concurrent.ExecutionException: java.io.FileNotFoundException: 
/tmp/staging-slider-HHIwk3/lib/tez.tar.gz (Is a directory)
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
at java.util.concurrent.FutureTask.get(FutureTask.java:192)
at 
org.apache.hadoop.hive.llap.cli.LlapServiceDriver.run(LlapServiceDriver.java:605)
at 
org.apache.hadoop.hive.llap.cli.LlapServiceDriver.main(LlapServiceDriver.java:113)
Caused by: java.io.FileNotFoundException: 
/tmp/staging-slider-HHIwk3/lib/tez.tar.gz (Is a directory)
at java.io.FileInputStream.open0(Native Method)
at java.io.FileInputStream.open(FileInputStream.java:195)
at java.io.FileInputStream.(FileInputStream.java:138)
at 
org.apache.hadoop.hive.common.CompressionUtils.unTar(CompressionUtils.java:152)
at 
org.apache.hadoop.hive.llap.cli.LlapServiceDriver$1.call(LlapServiceDriver.java:361)
at 
org.apache.hadoop.hive.llap.cli.LlapServiceDriver$1.call(LlapServiceDriver.java:348)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
INFO cli.LlapServiceDriver: LLAP service driver finished

 

Thanks

Rajesh