RE: Hive +Tez+LLAP does not have obvious performance improvement than HIVE + Tez

2017-11-22 Thread Jia, Ke A
Hi Gopal, Thanks for your reply. >For the Hadoop version, we will upgrade it to 2.8 later. >In our test, we found the shuffle stage of LLAP is very slow. Whether need to >configure some related shuffle value or not? And we get the following log >from the LLAP daemon in shuffle stage:

Re: Hive +Tez+LLAP does not have obvious performance improvement than HIVE + Tez

2017-11-22 Thread Gopal Vijayaraghavan
Hi, > With these configurations, the cpu utilization of llap is very low. Low CPU usage has been observed with LLAP due to RPC starvation. I'm going to assume that the build you're testing is a raw Hadoop 2.7.3 with no additional patches? Hadoop-RPC is single-threaded & has a single mutex

Re: How to use HPL/SQL connect with impala and Hive

2017-11-22 Thread Dmitry Tolpeko
>exeception : java.lang.incompatible class change error Can you please send the entire error output? >How to make a connection between HPL/SQL and impala Connection to Impala is not pre-defined yet, so you have to create a new connection, see http://hplsql.org/connections Thanks, Dmitry On

Re: migrate hive cli to beeline

2017-11-22 Thread Furcy Pin
Hello, As the table explains, it really depends on the number of concurrent connections you will have on your HiveServer2, but I confirm that you can experience OOM failures on either the HiveServer2 or the Metastore if too many concurrent queries are run simultaneously. For larger clusters, as