Re: Hive servers in same cluster use different hive-log4j.properties files.

2017-07-28 Thread Mungeol Heo
Check https://community.hortonworks.com/questions/115159/hive-servers-in-same-cluster-use-different-hive-lo.html#answer-115162 On Fri, Jul 28, 2017 at 3:12 PM, Mungeol Heo wrote: > Hello, > > Here are logs from two hiveserver2.log file. > > --- first which is strange ---

Re: How to set the logging level of the hiveserver2.log

2017-07-28 Thread Mungeol Heo
The answer for the second question is that they use different hive-log4j.properties. Check https://community.hortonworks.com/questions/115159/hive-servers-in-same-cluster-use-different-hive-lo.html#answer-115162 On Fri, Jul 28, 2017 at 2:15 PM, Mungeol Heo wrote: > The answer for the fi

Hive servers in same cluster use different hive-log4j.properties files.

2017-07-27 Thread Mungeol Heo
Hello, Here are logs from two hiveserver2.log file. --- first which is strange --- 2017-07-28 14:46:10,051 DEBUG [main]: server.HiveServer2 (HiveServer2.java:main(586)) - Logging initialized using configuration in jar:file:/usr/hdp/2.6.0.3-8/hive/lib/hive-common-1.2.1000.2.6.0.3-8.jar!/

Re: How to set the logging level of the hiveserver2.log

2017-07-27 Thread Mungeol Heo
ogging-level-of-the-hiveserver2log.html On Fri, Jul 28, 2017 at 12:32 PM, Mungeol Heo wrote: > Hello. > > As I mentioned at the title of this question, I wonder how to set the > logging level of the hiveserver2.log file in HDP. > > And I am also curios about why one of my hi

How to set the logging level of the hiveserver2.log

2017-07-27 Thread Mungeol Heo
Hello. As I mentioned at the title of this question, I wonder how to set the logging level of the hiveserver2.log file in HDP. And I am also curios about why one of my hiveserver2.log file's logging level is debug while another is not. --- First hiveserver2.log which has debug log --- 2

The remaining connections of IPC client keeps increasing.

2017-07-27 Thread Mungeol Heo
Hello. I found the log addressed below in the hiveserver2.log file. 2017-07-10 23:35:02,389 DEBUG [IPC Client (1639759054) connection to host.name/10.10.10.18:8020 from hdfs]: ipc.Client (Client.java:run(1025)) - IPC Client (1639759054) connection to host.name/10.10.10.18:8020 from hdfs: stopped,

Re: how to customize tez query app name

2017-04-20 Thread Mungeol Heo
Try --hiveconf hive.session.id=session_id_name. Then, the job name will be HIVE-session_id_name. AFAK, this is the best option for your request. If there is a better way, please share here. Hope it helps. Thank you. On Sat, Jan 21, 2017 at 6:56 AM, Gopal Vijayaraghavan wrote: > >> So no one has a

Need suggestion for using rlike

2015-05-18 Thread Mungeol Heo
Hi, I am using hundreds of "rlike" for matching specific URLs from apache access log at a hiveql. It is really slow when the target data is large. I tried several ways to improve the performance of this kind of query. Unfortunately, nothing works as I expect. Any help will be great. Thank you. -

Re: Partition Columns

2015-05-14 Thread Mungeol Heo
Hi, Appan. you can just simply check the amount of data your query reads from the table. or the number of the mapper for running that query. then, you can know whether it filtering or scanning all table. Of course, it is a lazy approach. but, you can give a try. I think query 1 should work fine. b

[HQL] How to compare same column between rows?

2014-11-17 Thread Mungeol Heo
Hi, My question is that does Hive able to compare same column between rows. For instance, I have a table which contains data like below. name, value a, 1 a, 2 b, 1 c, 1 a, 13 b, 11 What I need is to compare 'value' columns between rows which have same 'name'. For the name 'a' first 'a' comes, t