[jira] [Commented] (HIVE-23802) “merge files” job was submited to default queue when set hive.merge.tezfiles to true
[
https://issues.apache.org/jira/browse/HIVE-23802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835718#comment-17835718
]
kongxianghe commented on HIVE-23802:
try this hive.server2.tez.default.queues?
> “merge files” job was submited to default queue when set hive.merge.tezfiles
> to true
>
>
> Key: HIVE-23802
> URL: https://issues.apache.org/jira/browse/HIVE-23802
> Project: Hive
> Issue Type: Bug
> Components: HiveServer2
>Affects Versions: 3.1.0
>Reporter: gaozhan ding
>Assignee: gaozhan ding
>Priority: Major
> Labels: pull-request-available
> Attachments: 15940042679272.png, HIVE-23802.patch
>
> Time Spent: 0.5h
> Remaining Estimate: 0h
>
> We use tez as the query engine. When hive.merge.tezfiles set to true，merge
> files task, which followed by orginal task, will be submit to default queue
> rather then the queue same with orginal task.
> I study this issue for days and found that, every time starting a container,
> "tez,queue.name" whill be unset in current session. Code are as below:
> {code:java}
> // TezSessionState.startSessionAndContainers()
> // sessionState.getQueueName() comes from cluster wide configured queue names.
> // sessionState.getConf().get("tez.queue.name") is explicitly set by user in
> a session.
> // TezSessionPoolManager sets tez.queue.name if user has specified one or
> use the one from
> // cluster wide queue names.
> // There is no way to differentiate how this was set (user vs system).
> // Unset this after opening the session so that reopening of session uses
> the correct queue
> // names i.e, if client has not died and if the user has explicitly set a
> queue name
> // then reopened session will use user specified queue name else default
> cluster queue names.
> conf.unset(TezConfiguration.TEZ_QUEUE_NAME);
> {code}
> So after the orgin task was submited to yarn, "tez.queue.name" will be unset.
> While starting merge file task, it will try use the same session with orgin
> job, but get false due to tez.queue.name was unset. Seems like we could not
> unset this property.
> {code:java}
> // TezSessionPoolManager.canWorkWithSameSession()
> if (!session.isDefault()) {
> String queueName = session.getQueueName();
> String confQueueName = conf.get(TezConfiguration.TEZ_QUEUE_NAME);
> LOG.info("Current queue name is " + queueName + " incoming queue name is "
> + confQueueName);
> return (queueName == null) ? confQueueName == null :
> queueName.equals(confQueueName);
> } else {
> // this session should never be a default session unless something has
> messed up.
> throw new HiveException("The pool session " + session + " should have been
> returned to the pool");
> }
> {code}
> !15940042679272.png!
>
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Resolved] (HIVE-17462) hive_1.2.1 hiveserver2 memory leak
[ https://issues.apache.org/jira/browse/HIVE-17462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kongxianghe resolved HIVE-17462. Fix Version/s: 1.2.1 Resolution: Won't Fix won‘t fix. > hive_1.2.1 hiveserver2 memory leak > > > Key: HIVE-17462 > URL: https://issues.apache.org/jira/browse/HIVE-17462 > Project: Hive > Issue Type: Bug >Affects Versions: 1.2.1 > Environment: hive version 1.2.1 >Reporter: gehaijiang >Assignee: kongxianghe >Priority: Major > Fix For: 1.2.1 > > > hiveserver2 memory leak > hive use third UDF （vs-1.0.2-SNAPSHOT.jar ， > alogdata-1.0.3-SNAPSHOT-jar-with-dependencies.jar . and so on ) > lr-x-- 1 data data 64 Sep 5 18:37 964 -> > /tmp/9e38cc04-5693-474b-9c7d-bfdd978bcbb4_resources/vs-1.0.2-SNAPSHOT.jar > (deleted) > lr-x-- 1 data data 64 Sep 6 10:41 965 -> > /tmp/188bbf2a-d8a5-48a7-81fc-b807f9ff201d_resources/alogdata-1.0.3-SNAPSHOT-jar-with-dependencies.jar > (deleted) > lr-x-- 1 data data 64 Sep 6 17:41 97 -> > /home/data/programs/hadoop-2.7.1/share/hadoop/hdfs/lib/jsr305-3.0.0.jar > lrwx-- 1 data data 64 Sep 5 18:37 975 -> socket:[1318353317] > lr-x-- 1 data data 64 Sep 6 02:38 977 -> > /tmp/64e309dc-352f-4ba4-b871-1aa78fe05945_resources/alogdata-1.0.3-SNAPSHOT-jar-with-dependencies.jar > (deleted) > lr-x-- 1 data data 64 Sep 6 17:41 98 -> > /home/data/programs/hadoop-2.7.1/share/hadoop/hdfs/lib/xml-apis-1.3.04.jar > lrwx-- 1 data data 64 Sep 6 08:40 983 -> socket:[1299459344] > lr-x-- 1 data data 64 Sep 5 19:37 987 -> > /tmp/c3054987-c9c6-468a-8b5c-6e20b1972e0b_resources/alogdata-1.0.3-SNAPSHOT-jar-with-dependencies.jar > (deleted) > lr-x-- 1 data data 64 Sep 6 17:41 99 -> > /home/data/programs/hadoop-2.7.1/share/hadoop/hdfs/lib/guava-11.0.2.jar > lr-x-- 1 data data 64 Sep 6 08:40 994 -> > /tmp/fc5c44b3-9bd8-4a32-a39a-66cd44032fee_resources/alogdata-1.0.3-SNAPSHOT-jar-with-dependencies.jar > (deleted) > lr-x-- 1 data data 64 Sep 6 06:39 996 -> > /tmp/3b3c2bd6-0a0e-4599-b757-4a048a968457_resources/alogdata-1.0.3-SNAPSHOT-jar-with-dependencies.jar > (deleted) > lr-x-- 1 data data 64 Sep 5 17:36 999 -> > /tmp/6ad76494-cdda-430b-b7d0-2213731655a8_resources/alogdata-1.0.3-SNAPSHOT-jar-with-dependencies.jar > (deleted) > PID USER PR NI VIRT RES SHR S %CPU %MEMTIME+ COMMAND > 20084 data 20 0 13.6g 11g 533m S 62.3 9.2 6619:16 java > /home/data/programs/jdk/jdk-current/bin/java-Djava.net.preferIPv4Stack=true-Dhadoop.log.dir=/home/data/hadoop/logs-Dhadoop.log.file=hadoop.log-Dhadoop.home.dir=/home/data/programs/hadoop-2.7.1-Dhadoop.id.str=data-Dhadoop.root.logger=INFO,DRFA-Djava.library.path=/home/data/programs/hadoop-2.7.1/lib/native-Dhadoop.policy.file=hadoop-policy.xml-Djava.net.preferIPv4Stack=true-XX:+UseConcMarkSweepGC-Xms8g-Xmx8g-Dhadoop.security.logger=INFO,NullAppenderorg.apache.hadoop.util.RunJar/home/data/programs/hive-current/lib/hive-service-1.2.1.jarorg.apache.hive.service.server.HiveServer2--hiveconfhive.log.file=hiveserver2.log -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (HIVE-17462) hive_1.2.1 hiveserver2 memory leak
[ https://issues.apache.org/jira/browse/HIVE-17462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kongxianghe reassigned HIVE-17462: -- Assignee: kongxianghe > hive_1.2.1 hiveserver2 memory leak > > > Key: HIVE-17462 > URL: https://issues.apache.org/jira/browse/HIVE-17462 > Project: Hive > Issue Type: Bug >Affects Versions: 1.2.1 > Environment: hive version 1.2.1 >Reporter: gehaijiang >Assignee: kongxianghe >Priority: Major > > hiveserver2 memory leak > hive use third UDF （vs-1.0.2-SNAPSHOT.jar ， > alogdata-1.0.3-SNAPSHOT-jar-with-dependencies.jar . and so on ) > lr-x-- 1 data data 64 Sep 5 18:37 964 -> > /tmp/9e38cc04-5693-474b-9c7d-bfdd978bcbb4_resources/vs-1.0.2-SNAPSHOT.jar > (deleted) > lr-x-- 1 data data 64 Sep 6 10:41 965 -> > /tmp/188bbf2a-d8a5-48a7-81fc-b807f9ff201d_resources/alogdata-1.0.3-SNAPSHOT-jar-with-dependencies.jar > (deleted) > lr-x-- 1 data data 64 Sep 6 17:41 97 -> > /home/data/programs/hadoop-2.7.1/share/hadoop/hdfs/lib/jsr305-3.0.0.jar > lrwx-- 1 data data 64 Sep 5 18:37 975 -> socket:[1318353317] > lr-x-- 1 data data 64 Sep 6 02:38 977 -> > /tmp/64e309dc-352f-4ba4-b871-1aa78fe05945_resources/alogdata-1.0.3-SNAPSHOT-jar-with-dependencies.jar > (deleted) > lr-x-- 1 data data 64 Sep 6 17:41 98 -> > /home/data/programs/hadoop-2.7.1/share/hadoop/hdfs/lib/xml-apis-1.3.04.jar > lrwx-- 1 data data 64 Sep 6 08:40 983 -> socket:[1299459344] > lr-x-- 1 data data 64 Sep 5 19:37 987 -> > /tmp/c3054987-c9c6-468a-8b5c-6e20b1972e0b_resources/alogdata-1.0.3-SNAPSHOT-jar-with-dependencies.jar > (deleted) > lr-x-- 1 data data 64 Sep 6 17:41 99 -> > /home/data/programs/hadoop-2.7.1/share/hadoop/hdfs/lib/guava-11.0.2.jar > lr-x-- 1 data data 64 Sep 6 08:40 994 -> > /tmp/fc5c44b3-9bd8-4a32-a39a-66cd44032fee_resources/alogdata-1.0.3-SNAPSHOT-jar-with-dependencies.jar > (deleted) > lr-x-- 1 data data 64 Sep 6 06:39 996 -> > /tmp/3b3c2bd6-0a0e-4599-b757-4a048a968457_resources/alogdata-1.0.3-SNAPSHOT-jar-with-dependencies.jar > (deleted) > lr-x-- 1 data data 64 Sep 5 17:36 999 -> > /tmp/6ad76494-cdda-430b-b7d0-2213731655a8_resources/alogdata-1.0.3-SNAPSHOT-jar-with-dependencies.jar > (deleted) > PID USER PR NI VIRT RES SHR S %CPU %MEMTIME+ COMMAND > 20084 data 20 0 13.6g 11g 533m S 62.3 9.2 6619:16 java > /home/data/programs/jdk/jdk-current/bin/java-Djava.net.preferIPv4Stack=true-Dhadoop.log.dir=/home/data/hadoop/logs-Dhadoop.log.file=hadoop.log-Dhadoop.home.dir=/home/data/programs/hadoop-2.7.1-Dhadoop.id.str=data-Dhadoop.root.logger=INFO,DRFA-Djava.library.path=/home/data/programs/hadoop-2.7.1/lib/native-Dhadoop.policy.file=hadoop-policy.xml-Djava.net.preferIPv4Stack=true-XX:+UseConcMarkSweepGC-Xms8g-Xmx8g-Dhadoop.security.logger=INFO,NullAppenderorg.apache.hadoop.util.RunJar/home/data/programs/hive-current/lib/hive-service-1.2.1.jarorg.apache.hive.service.server.HiveServer2--hiveconfhive.log.file=hiveserver2.log -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Comment Edited] (HIVE-17462) hive_1.2.1 hiveserver2 memory leak
[
https://issues.apache.org/jira/browse/HIVE-17462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17199204#comment-17199204
]
kongxianghe edited comment on HIVE-17462 at 9/21/20, 7:13 AM:
--
was fixed in https://issues.apache.org/jira/browse/HIVE-10453
you may use hdp-1.2.1000.2.6.1.0 or some other versions,this patch may be not
added into it.
decompile your hive-exec-1.2.1xxx.jar and find class SessionState.class .
{code}
public void close() throws IOException {
registry.clear();;
registry.clear();
if (txnMgr != null) txnMgr.closeTxnManager();
JavaUtils.closeClassLoadersTo(conf.getClassLoader(), parentLoader);
File resourceDir =
@@ -1493,7 +1493,7 @@ public class SessionState {
sparkSession = null;
}
}
// this line might be lost!!
registry.closeCUDFLoaders();
dropSessionPaths(conf);
}
{code}
registry.closeCUDFLoaders();
in hdp 2.6.1 hive-1.2.1 this line is missing and that might cause this
problem .
was (Author: kongxianghe):
was fixed in https://issues.apache.org/jira/browse/HIVE-10453
you may use hdp-1.2.1000.2.6.1.0 or some other versions,this patch may be not
added into it.
decompile your hive-exec-1.2.1xxx.jar and find class SessionState.class .
{code}
public void close() throws IOException {
registry.clear();;
registry.clear();
if (txnMgr != null) txnMgr.closeTxnManager();
JavaUtils.closeClassLoadersTo(conf.getClassLoader(), parentLoader);
File resourceDir =
@@ -1493,7 +1493,7 @@ public class SessionState {
sparkSession = null;
}
}
// this line might be lost!!
registry.closeCUDFLoaders();
dropSessionPaths(conf);
}
{code}
registry.closeCUDFLoaders();
in hdp 2.6.1 hive-1.2.1 this line is missing,might clause this problem
> hive_1.2.1 hiveserver2 memory leak
>
>
> Key: HIVE-17462
> URL: https://issues.apache.org/jira/browse/HIVE-17462
> Project: Hive
> Issue Type: Bug
>Affects Versions: 1.2.1
> Environment: hive version 1.2.1
>Reporter: gehaijiang
>Priority: Major
>
> hiveserver2 memory leak
> hive use third UDF （vs-1.0.2-SNAPSHOT.jar ，
> alogdata-1.0.3-SNAPSHOT-jar-with-dependencies.jar . and so on )
> lr-x-- 1 data data 64 Sep 5 18:37 964 ->
> /tmp/9e38cc04-5693-474b-9c7d-bfdd978bcbb4_resources/vs-1.0.2-SNAPSHOT.jar
> (deleted)
> lr-x-- 1 data data 64 Sep 6 10:41 965 ->
> /tmp/188bbf2a-d8a5-48a7-81fc-b807f9ff201d_resources/alogdata-1.0.3-SNAPSHOT-jar-with-dependencies.jar
> (deleted)
> lr-x-- 1 data data 64 Sep 6 17:41 97 ->
> /home/data/programs/hadoop-2.7.1/share/hadoop/hdfs/lib/jsr305-3.0.0.jar
> lrwx-- 1 data data 64 Sep 5 18:37 975 -> socket:[1318353317]
> lr-x-- 1 data data 64 Sep 6 02:38 977 ->
> /tmp/64e309dc-352f-4ba4-b871-1aa78fe05945_resources/alogdata-1.0.3-SNAPSHOT-jar-with-dependencies.jar
> (deleted)
> lr-x-- 1 data data 64 Sep 6 17:41 98 ->
> /home/data/programs/hadoop-2.7.1/share/hadoop/hdfs/lib/xml-apis-1.3.04.jar
> lrwx-- 1 data data 64 Sep 6 08:40 983 -> socket:[1299459344]
> lr-x-- 1 data data 64 Sep 5 19:37 987 ->
> /tmp/c3054987-c9c6-468a-8b5c-6e20b1972e0b_resources/alogdata-1.0.3-SNAPSHOT-jar-with-dependencies.jar
> (deleted)
> lr-x-- 1 data data 64 Sep 6 17:41 99 ->
> /home/data/programs/hadoop-2.7.1/share/hadoop/hdfs/lib/guava-11.0.2.jar
> lr-x-- 1 data data 64 Sep 6 08:40 994 ->
> /tmp/fc5c44b3-9bd8-4a32-a39a-66cd44032fee_resources/alogdata-1.0.3-SNAPSHOT-jar-with-dependencies.jar
> (deleted)
> lr-x-- 1 data data 64 Sep 6 06:39 996 ->
> /tmp/3b3c2bd6-0a0e-4599-b757-4a048a968457_resources/alogdata-1.0.3-SNAPSHOT-jar-with-dependencies.jar
> (deleted)
> lr-x-- 1 data data 64 Sep 5 17:36 999 ->
> /tmp/6ad76494-cdda-430b-b7d0-2213731655a8_resources/alogdata-1.0.3-SNAPSHOT-jar-with-dependencies.jar
> (deleted)
> PID USER PR NI VIRT RES SHR S %CPU %MEMTIME+ COMMAND
> 20084 data 20 0 13.6g 11g 533m S 62.3 9.2 6619:16 java
> /home/data/programs/jdk/jdk-current/bin/java-Djava.net.preferIPv4Stack=true-Dhadoop.log.dir=/home/data/hadoop/logs-Dhadoop.log.file=hadoop.log-Dhadoop.home.dir=/home/data/programs/hadoop-2.7.1-Dhadoop.id.str=data-Dhadoop.root.logger=INFO,DRFA-Djava.library.path=/home/data/programs/hadoop-2.7.1/lib/native-Dhadoop.policy.file=hadoop-policy.xml-Djava.net.preferIPv4Stack=true-XX:+UseConcMarkSweepGC-Xms8g-Xmx8g-Dhadoop.security.logger=INFO,NullAppenderorg.apache.hadoop.util.RunJar/home/data/programs/hive-current/lib/hive-service-1.2.1.jarorg.apache.hive.service.server.HiveServer2--hiveconfhive.log.file=hiveserver2.log
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-17462) hive_1.2.1 hiveserver2 memory leak
[
https://issues.apache.org/jira/browse/HIVE-17462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17199204#comment-17199204
]
kongxianghe commented on HIVE-17462:
was fixed in https://issues.apache.org/jira/browse/HIVE-10453
you may use hdp-1.2.1000.2.6.1.0 or some other versions,this patch may be not
added into it.
decompile your hive-exec-1.2.1xxx.jar and find class SessionState.class .
{code}
public void close() throws IOException {
registry.clear();;
registry.clear();
if (txnMgr != null) txnMgr.closeTxnManager();
JavaUtils.closeClassLoadersTo(conf.getClassLoader(), parentLoader);
File resourceDir =
@@ -1493,7 +1493,7 @@ public class SessionState {
sparkSession = null;
}
}
// this line might be lost!!
registry.closeCUDFLoaders();
dropSessionPaths(conf);
}
{code}
registry.closeCUDFLoaders();
in hdp 2.6.1 hive-1.2.1 this line is missing,might clause this problem
> hive_1.2.1 hiveserver2 memory leak
>
>
> Key: HIVE-17462
> URL: https://issues.apache.org/jira/browse/HIVE-17462
> Project: Hive
> Issue Type: Bug
>Affects Versions: 1.2.1
> Environment: hive version 1.2.1
>Reporter: gehaijiang
>Priority: Major
>
> hiveserver2 memory leak
> hive use third UDF （vs-1.0.2-SNAPSHOT.jar ，
> alogdata-1.0.3-SNAPSHOT-jar-with-dependencies.jar . and so on )
> lr-x-- 1 data data 64 Sep 5 18:37 964 ->
> /tmp/9e38cc04-5693-474b-9c7d-bfdd978bcbb4_resources/vs-1.0.2-SNAPSHOT.jar
> (deleted)
> lr-x-- 1 data data 64 Sep 6 10:41 965 ->
> /tmp/188bbf2a-d8a5-48a7-81fc-b807f9ff201d_resources/alogdata-1.0.3-SNAPSHOT-jar-with-dependencies.jar
> (deleted)
> lr-x-- 1 data data 64 Sep 6 17:41 97 ->
> /home/data/programs/hadoop-2.7.1/share/hadoop/hdfs/lib/jsr305-3.0.0.jar
> lrwx-- 1 data data 64 Sep 5 18:37 975 -> socket:[1318353317]
> lr-x-- 1 data data 64 Sep 6 02:38 977 ->
> /tmp/64e309dc-352f-4ba4-b871-1aa78fe05945_resources/alogdata-1.0.3-SNAPSHOT-jar-with-dependencies.jar
> (deleted)
> lr-x-- 1 data data 64 Sep 6 17:41 98 ->
> /home/data/programs/hadoop-2.7.1/share/hadoop/hdfs/lib/xml-apis-1.3.04.jar
> lrwx-- 1 data data 64 Sep 6 08:40 983 -> socket:[1299459344]
> lr-x-- 1 data data 64 Sep 5 19:37 987 ->
> /tmp/c3054987-c9c6-468a-8b5c-6e20b1972e0b_resources/alogdata-1.0.3-SNAPSHOT-jar-with-dependencies.jar
> (deleted)
> lr-x-- 1 data data 64 Sep 6 17:41 99 ->
> /home/data/programs/hadoop-2.7.1/share/hadoop/hdfs/lib/guava-11.0.2.jar
> lr-x-- 1 data data 64 Sep 6 08:40 994 ->
> /tmp/fc5c44b3-9bd8-4a32-a39a-66cd44032fee_resources/alogdata-1.0.3-SNAPSHOT-jar-with-dependencies.jar
> (deleted)
> lr-x-- 1 data data 64 Sep 6 06:39 996 ->
> /tmp/3b3c2bd6-0a0e-4599-b757-4a048a968457_resources/alogdata-1.0.3-SNAPSHOT-jar-with-dependencies.jar
> (deleted)
> lr-x-- 1 data data 64 Sep 5 17:36 999 ->
> /tmp/6ad76494-cdda-430b-b7d0-2213731655a8_resources/alogdata-1.0.3-SNAPSHOT-jar-with-dependencies.jar
> (deleted)
> PID USER PR NI VIRT RES SHR S %CPU %MEMTIME+ COMMAND
> 20084 data 20 0 13.6g 11g 533m S 62.3 9.2 6619:16 java
> /home/data/programs/jdk/jdk-current/bin/java-Djava.net.preferIPv4Stack=true-Dhadoop.log.dir=/home/data/hadoop/logs-Dhadoop.log.file=hadoop.log-Dhadoop.home.dir=/home/data/programs/hadoop-2.7.1-Dhadoop.id.str=data-Dhadoop.root.logger=INFO,DRFA-Djava.library.path=/home/data/programs/hadoop-2.7.1/lib/native-Dhadoop.policy.file=hadoop-policy.xml-Djava.net.preferIPv4Stack=true-XX:+UseConcMarkSweepGC-Xms8g-Xmx8g-Dhadoop.security.logger=INFO,NullAppenderorg.apache.hadoop.util.RunJar/home/data/programs/hive-current/lib/hive-service-1.2.1.jarorg.apache.hive.service.server.HiveServer2--hiveconfhive.log.file=hiveserver2.log
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-21190) hive thrift server may be blocked by session level waiting,caused by udf!
[
https://issues.apache.org/jira/browse/HIVE-21190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kongxianghe updated HIVE-21190:
---
Description:
# caused by an error UDF function！time_waiting(Long sleepSeconds)
{code}
public class UDFTimeWaiting extends UDF throws Exception{
public String evaluate(String sleepSeconds){
...
Thread.sleep(Long.parseLong(sleepSeconds) * 1000);
return "ok";
}
}
{code}
# in session_1:
{code}select time_waiting(100);{code}
# in session_2:
{code}select 1; or show tables;{code}
# session_2 will not have any response from thrift server until session_1
waiting 100 seconds!
this bug may cause hiveserver come into an unavailable status!
# session_1 run waiting 200s,
!session_1.jpg!
# session_2 run at the same time ,but blocked by session_1 , see the
pic,waiting 197s after session_1 returned then returned
!session_2.jpg!
# if someone want to attack or do sth ,hiveserver will not be down,but not
available again!
was:
# caused by an error UDF function！time_waiting(Long sleepSeconds)
{code}
public class UDFTimeWaiting extends UDF throws Exception{
public String evaluate(String sleepSeconds){
...
Thread.sleep(Long.parseLong(sleepSeconds) * 1000);
return "ok";
}
}
{code}
# in session_1:
{code}select time_waiting(100);{code}
# in session_2:
{code}select 1; or show tables;{code}
# session_2 will not have any response from thrift server util session_1
waiting 100 seconds!
this bug may cause hiveserver come into an unavailable status!
# session_1 run waiting 200s,
!session_1.jpg!
# session_2 run at the same time ,but blocked by session_1 , see the
pic,waiting 197s after session_1 returned then returned
!session_2.jpg!
# if someone want to attack or do sth ,hiveserver will not be down,but not
available again!
> hive thrift server may be blocked by session level waiting,caused by udf!
> -
>
> Key: HIVE-21190
> URL: https://issues.apache.org/jira/browse/HIVE-21190
> Project: Hive
> Issue Type: Bug
> Components: HiveServer2
> Environment: hdp ambari 26
> hive1.2.0
>Reporter: kongxianghe
>Priority: Critical
> Attachments: session_1.jpg, session_2.jpg
>
>
> # caused by an error UDF function！time_waiting(Long sleepSeconds)
> {code}
> public class UDFTimeWaiting extends UDF throws Exception{
> public String evaluate(String sleepSeconds){
> ...
> Thread.sleep(Long.parseLong(sleepSeconds) * 1000);
> return "ok";
> }
> }
> {code}
>
> # in session_1:
> {code}select time_waiting(100);{code}
> # in session_2:
> {code}select 1; or show tables;{code}
> # session_2 will not have any response from thrift server until session_1
> waiting 100 seconds!
> this bug may cause hiveserver come into an unavailable status!
>
> # session_1 run waiting 200s,
> !session_1.jpg!
> # session_2 run at the same time ,but blocked by session_1 , see the
> pic,waiting 197s after session_1 returned then returned
> !session_2.jpg!
>
> # if someone want to attack or do sth ,hiveserver will not be down,but not
> available again!
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (HIVE-21190) hive thrift server may be blocked by session level waiting,caused by udf!
[
https://issues.apache.org/jira/browse/HIVE-21190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kongxianghe updated HIVE-21190:
---
Description:
# cause by an error UDF function！time_waiting(Long sleepSeconds)
{code}
public class UDFTimeWaiting extends UDF throws Exception{
public String evaluate(Long sleepSeconds){
...
Thread.sleep(Long.parseLong(sleepSeconds) * 1000);
return "ok";
}
}
{code}
# in session_1:
{code}select time_waiting(100);{code}
# in session_2:
{code}select 1; or show tables;{code}
# session_2 will not have any response from thrift server util session_1
waiting 100 seconds!
this bug may cause hiveserver come into an available status!
# session_1 run waiting 200s,
!session_1.jpg!
# session_2 run at the same time ,but blocked by session_1 , see the
pic,waiting 197s after session_1 returned then returned
!session_2.jpg!
# if someone want to attack or do sth ,hiveserver will not be down,but not
available again!
was:
# cause by an error UDF function！time_waiting(Long sleepSeconds)
{code}
public class UDFTimeWaiting extends UDF throws Exception{
public String evaluate(Long sleepSeconds){
...
Thread.sleep(Long.parseLong(sleepSeconds) * 1000);
return "ok";
}
}
{code}
# in session_1:
{code}select time_waiting(100);{code}
# in session_2:
{code}select 1; or show tables;{code}
# session_2 will not have any response from thrift server util session_1
waiting 100 seconds!
this bug may cause hiveserver come into an available status!
# session_1 run waiting 200s,
!session_1.jpg!
# session_2 run at the same time ,but blocked by session_1 , see the
pic,waiting 197s after session_1 returned then returned
!session_2.jpg!
if someone want to attack or do sth ,hiveserver will not be down,but not
available again!
> hive thrift server may be blocked by session level waiting,caused by udf!
> -
>
> Key: HIVE-21190
> URL: https://issues.apache.org/jira/browse/HIVE-21190
> Project: Hive
> Issue Type: Bug
> Components: HiveServer2
> Environment: hdp ambari 26
> hive1.2.0
>Reporter: kongxianghe
>Assignee: Josh Elser
>Priority: Critical
> Attachments: session_1.jpg, session_2.jpg
>
>
> # cause by an error UDF function！time_waiting(Long sleepSeconds)
> {code}
> public class UDFTimeWaiting extends UDF throws Exception{
> public String evaluate(Long sleepSeconds){
> ...
> Thread.sleep(Long.parseLong(sleepSeconds) * 1000);
> return "ok";
> }
> }
> {code}
>
> # in session_1:
> {code}select time_waiting(100);{code}
> # in session_2:
> {code}select 1; or show tables;{code}
> # session_2 will not have any response from thrift server util session_1
> waiting 100 seconds!
> this bug may cause hiveserver come into an available status!
>
> # session_1 run waiting 200s,
> !session_1.jpg!
> # session_2 run at the same time ,but blocked by session_1 , see the
> pic,waiting 197s after session_1 returned then returned
> !session_2.jpg!
>
> # if someone want to attack or do sth ,hiveserver will not be down,but not
> available again!
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (HIVE-21190) hive thrift server may be blocked by session level waiting,caused by udf!
[
https://issues.apache.org/jira/browse/HIVE-21190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kongxianghe updated HIVE-21190:
---
Description:
# caused by an error UDF function！time_waiting(Long sleepSeconds)
{code}
public class UDFTimeWaiting extends UDF throws Exception{
public String evaluate(String sleepSeconds){
...
Thread.sleep(Long.parseLong(sleepSeconds) * 1000);
return "ok";
}
}
{code}
# in session_1:
{code}select time_waiting(100);{code}
# in session_2:
{code}select 1; or show tables;{code}
# session_2 will not have any response from thrift server util session_1
waiting 100 seconds!
this bug may cause hiveserver come into an unavailable status!
# session_1 run waiting 200s,
!session_1.jpg!
# session_2 run at the same time ,but blocked by session_1 , see the
pic,waiting 197s after session_1 returned then returned
!session_2.jpg!
# if someone want to attack or do sth ,hiveserver will not be down,but not
available again!
was:
# caused by an error UDF function！time_waiting(Long sleepSeconds)
{code}
public class UDFTimeWaiting extends UDF throws Exception{
public String evaluate(StringsleepSeconds){
...
Thread.sleep(Long.parseLong(sleepSeconds) * 1000);
return "ok";
}
}
{code}
# in session_1:
{code}select time_waiting(100);{code}
# in session_2:
{code}select 1; or show tables;{code}
# session_2 will not have any response from thrift server util session_1
waiting 100 seconds!
this bug may cause hiveserver come into an unavailable status!
# session_1 run waiting 200s,
!session_1.jpg!
# session_2 run at the same time ,but blocked by session_1 , see the
pic,waiting 197s after session_1 returned then returned
!session_2.jpg!
# if someone want to attack or do sth ,hiveserver will not be down,but not
available again!
> hive thrift server may be blocked by session level waiting,caused by udf!
> -
>
> Key: HIVE-21190
> URL: https://issues.apache.org/jira/browse/HIVE-21190
> Project: Hive
> Issue Type: Bug
> Components: HiveServer2
> Environment: hdp ambari 26
> hive1.2.0
>Reporter: kongxianghe
>Assignee: Josh Elser
>Priority: Critical
> Attachments: session_1.jpg, session_2.jpg
>
>
> # caused by an error UDF function！time_waiting(Long sleepSeconds)
> {code}
> public class UDFTimeWaiting extends UDF throws Exception{
> public String evaluate(String sleepSeconds){
> ...
> Thread.sleep(Long.parseLong(sleepSeconds) * 1000);
> return "ok";
> }
> }
> {code}
>
> # in session_1:
> {code}select time_waiting(100);{code}
> # in session_2:
> {code}select 1; or show tables;{code}
> # session_2 will not have any response from thrift server util session_1
> waiting 100 seconds!
> this bug may cause hiveserver come into an unavailable status!
>
> # session_1 run waiting 200s,
> !session_1.jpg!
> # session_2 run at the same time ,but blocked by session_1 , see the
> pic,waiting 197s after session_1 returned then returned
> !session_2.jpg!
>
> # if someone want to attack or do sth ,hiveserver will not be down,but not
> available again!
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (HIVE-21190) hive thrift server may be blocked by session level waiting,caused by udf!
[
https://issues.apache.org/jira/browse/HIVE-21190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kongxianghe updated HIVE-21190:
---
Description:
# caused by an error UDF function！time_waiting(Long sleepSeconds)
{code}
public class UDFTimeWaiting extends UDF throws Exception{
public String evaluate(StringsleepSeconds){
...
Thread.sleep(Long.parseLong(sleepSeconds) * 1000);
return "ok";
}
}
{code}
# in session_1:
{code}select time_waiting(100);{code}
# in session_2:
{code}select 1; or show tables;{code}
# session_2 will not have any response from thrift server util session_1
waiting 100 seconds!
this bug may cause hiveserver come into an unavailable status!
# session_1 run waiting 200s,
!session_1.jpg!
# session_2 run at the same time ,but blocked by session_1 , see the
pic,waiting 197s after session_1 returned then returned
!session_2.jpg!
# if someone want to attack or do sth ,hiveserver will not be down,but not
available again!
was:
# caused by an error UDF function！time_waiting(Long sleepSeconds)
{code}
public class UDFTimeWaiting extends UDF throws Exception{
public String evaluate(Long sleepSeconds){
...
Thread.sleep(Long.parseLong(sleepSeconds) * 1000);
return "ok";
}
}
{code}
# in session_1:
{code}select time_waiting(100);{code}
# in session_2:
{code}select 1; or show tables;{code}
# session_2 will not have any response from thrift server util session_1
waiting 100 seconds!
this bug may cause hiveserver come into an unavailable status!
# session_1 run waiting 200s,
!session_1.jpg!
# session_2 run at the same time ,but blocked by session_1 , see the
pic,waiting 197s after session_1 returned then returned
!session_2.jpg!
# if someone want to attack or do sth ,hiveserver will not be down,but not
available again!
> hive thrift server may be blocked by session level waiting,caused by udf!
> -
>
> Key: HIVE-21190
> URL: https://issues.apache.org/jira/browse/HIVE-21190
> Project: Hive
> Issue Type: Bug
> Components: HiveServer2
> Environment: hdp ambari 26
> hive1.2.0
>Reporter: kongxianghe
>Assignee: Josh Elser
>Priority: Critical
> Attachments: session_1.jpg, session_2.jpg
>
>
> # caused by an error UDF function！time_waiting(Long sleepSeconds)
> {code}
> public class UDFTimeWaiting extends UDF throws Exception{
> public String evaluate(StringsleepSeconds){
> ...
> Thread.sleep(Long.parseLong(sleepSeconds) * 1000);
> return "ok";
> }
> }
> {code}
>
> # in session_1:
> {code}select time_waiting(100);{code}
> # in session_2:
> {code}select 1; or show tables;{code}
> # session_2 will not have any response from thrift server util session_1
> waiting 100 seconds!
> this bug may cause hiveserver come into an unavailable status!
>
> # session_1 run waiting 200s,
> !session_1.jpg!
> # session_2 run at the same time ,but blocked by session_1 , see the
> pic,waiting 197s after session_1 returned then returned
> !session_2.jpg!
>
> # if someone want to attack or do sth ,hiveserver will not be down,but not
> available again!
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (HIVE-21190) hive thrift server may be blocked by session level waiting,caused by udf!
[
https://issues.apache.org/jira/browse/HIVE-21190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kongxianghe updated HIVE-21190:
---
Description:
# caused by an error UDF function！time_waiting(Long sleepSeconds)
{code}
public class UDFTimeWaiting extends UDF throws Exception{
public String evaluate(Long sleepSeconds){
...
Thread.sleep(Long.parseLong(sleepSeconds) * 1000);
return "ok";
}
}
{code}
# in session_1:
{code}select time_waiting(100);{code}
# in session_2:
{code}select 1; or show tables;{code}
# session_2 will not have any response from thrift server util session_1
waiting 100 seconds!
this bug may cause hiveserver come into an unavailable status!
# session_1 run waiting 200s,
!session_1.jpg!
# session_2 run at the same time ,but blocked by session_1 , see the
pic,waiting 197s after session_1 returned then returned
!session_2.jpg!
# if someone want to attack or do sth ,hiveserver will not be down,but not
available again!
was:
# caused by an error UDF function！time_waiting(Long sleepSeconds)
{code}
public class UDFTimeWaiting extends UDF throws Exception{
public String evaluate(Long sleepSeconds){
...
Thread.sleep(Long.parseLong(sleepSeconds) * 1000);
return "ok";
}
}
{code}
# in session_1:
{code}select time_waiting(100);{code}
# in session_2:
{code}select 1; or show tables;{code}
# session_2 will not have any response from thrift server util session_1
waiting 100 seconds!
this bug may cause hiveserver come into an available status!
# session_1 run waiting 200s,
!session_1.jpg!
# session_2 run at the same time ,but blocked by session_1 , see the
pic,waiting 197s after session_1 returned then returned
!session_2.jpg!
# if someone want to attack or do sth ,hiveserver will not be down,but not
available again!
> hive thrift server may be blocked by session level waiting,caused by udf!
> -
>
> Key: HIVE-21190
> URL: https://issues.apache.org/jira/browse/HIVE-21190
> Project: Hive
> Issue Type: Bug
> Components: HiveServer2
> Environment: hdp ambari 26
> hive1.2.0
>Reporter: kongxianghe
>Assignee: Josh Elser
>Priority: Critical
> Attachments: session_1.jpg, session_2.jpg
>
>
> # caused by an error UDF function！time_waiting(Long sleepSeconds)
> {code}
> public class UDFTimeWaiting extends UDF throws Exception{
> public String evaluate(Long sleepSeconds){
> ...
> Thread.sleep(Long.parseLong(sleepSeconds) * 1000);
> return "ok";
> }
> }
> {code}
>
> # in session_1:
> {code}select time_waiting(100);{code}
> # in session_2:
> {code}select 1; or show tables;{code}
> # session_2 will not have any response from thrift server util session_1
> waiting 100 seconds!
> this bug may cause hiveserver come into an unavailable status!
>
> # session_1 run waiting 200s,
> !session_1.jpg!
> # session_2 run at the same time ,but blocked by session_1 , see the
> pic,waiting 197s after session_1 returned then returned
> !session_2.jpg!
>
> # if someone want to attack or do sth ,hiveserver will not be down,but not
> available again!
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (HIVE-21190) hive thrift server may be blocked by session level waiting,caused by udf!
[
https://issues.apache.org/jira/browse/HIVE-21190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kongxianghe updated HIVE-21190:
---
Description:
# caused by an error UDF function！time_waiting(Long sleepSeconds)
{code}
public class UDFTimeWaiting extends UDF throws Exception{
public String evaluate(Long sleepSeconds){
...
Thread.sleep(Long.parseLong(sleepSeconds) * 1000);
return "ok";
}
}
{code}
# in session_1:
{code}select time_waiting(100);{code}
# in session_2:
{code}select 1; or show tables;{code}
# session_2 will not have any response from thrift server util session_1
waiting 100 seconds!
this bug may cause hiveserver come into an available status!
# session_1 run waiting 200s,
!session_1.jpg!
# session_2 run at the same time ,but blocked by session_1 , see the
pic,waiting 197s after session_1 returned then returned
!session_2.jpg!
# if someone want to attack or do sth ,hiveserver will not be down,but not
available again!
was:
# cause by an error UDF function！time_waiting(Long sleepSeconds)
{code}
public class UDFTimeWaiting extends UDF throws Exception{
public String evaluate(Long sleepSeconds){
...
Thread.sleep(Long.parseLong(sleepSeconds) * 1000);
return "ok";
}
}
{code}
# in session_1:
{code}select time_waiting(100);{code}
# in session_2:
{code}select 1; or show tables;{code}
# session_2 will not have any response from thrift server util session_1
waiting 100 seconds!
this bug may cause hiveserver come into an available status!
# session_1 run waiting 200s,
!session_1.jpg!
# session_2 run at the same time ,but blocked by session_1 , see the
pic,waiting 197s after session_1 returned then returned
!session_2.jpg!
# if someone want to attack or do sth ,hiveserver will not be down,but not
available again!
> hive thrift server may be blocked by session level waiting,caused by udf!
> -
>
> Key: HIVE-21190
> URL: https://issues.apache.org/jira/browse/HIVE-21190
> Project: Hive
> Issue Type: Bug
> Components: HiveServer2
> Environment: hdp ambari 26
> hive1.2.0
>Reporter: kongxianghe
>Assignee: Josh Elser
>Priority: Critical
> Attachments: session_1.jpg, session_2.jpg
>
>
> # caused by an error UDF function！time_waiting(Long sleepSeconds)
> {code}
> public class UDFTimeWaiting extends UDF throws Exception{
> public String evaluate(Long sleepSeconds){
> ...
> Thread.sleep(Long.parseLong(sleepSeconds) * 1000);
> return "ok";
> }
> }
> {code}
>
> # in session_1:
> {code}select time_waiting(100);{code}
> # in session_2:
> {code}select 1; or show tables;{code}
> # session_2 will not have any response from thrift server util session_1
> waiting 100 seconds!
> this bug may cause hiveserver come into an available status!
>
> # session_1 run waiting 200s,
> !session_1.jpg!
> # session_2 run at the same time ,but blocked by session_1 , see the
> pic,waiting 197s after session_1 returned then returned
> !session_2.jpg!
>
> # if someone want to attack or do sth ,hiveserver will not be down,but not
> available again!
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (HIVE-21190) hive thrift server may be blocked by session level waiting,caused by udf!
[
https://issues.apache.org/jira/browse/HIVE-21190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kongxianghe updated HIVE-21190:
---
Summary: hive thrift server may be blocked by session level waiting,caused
by udf! (was: hive thrift server may be blocked by session level waiting!)
> hive thrift server may be blocked by session level waiting,caused by udf!
> -
>
> Key: HIVE-21190
> URL: https://issues.apache.org/jira/browse/HIVE-21190
> Project: Hive
> Issue Type: Bug
> Components: HiveServer2
> Environment: hdp ambari 26
> hive1.2.0
>Reporter: kongxianghe
>Assignee: kongxianghe
>Priority: Critical
>
> # cause by an error UDF function！time_waiting(Long sleepSeconds)
> {code}
> public class UDFTimeWaiting extends UDF throws Exception{
> public String evaluate(Long sleepSeconds){
> ...
> Thread.sleep(Long.parseLong(sleepSeconds) * 1000);
> return "ok";
> }
> }
> {code}
> # in session_1:
> {code}select time_waiting(100);{code}
> # in session_2:
> {code}select 1; or show tables;{code}
> # session_2 will not have any response from thrift server util session_1
> waiting 100 seconds!
> this bug may cause hiveserver can into an available status!
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (HIVE-21190) hive thrift server may be blocked by session level waiting,caused by udf!
[
https://issues.apache.org/jira/browse/HIVE-21190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kongxianghe updated HIVE-21190:
---
Description:
# cause by an error UDF function！time_waiting(Long sleepSeconds)
{code}
public class UDFTimeWaiting extends UDF throws Exception{
public String evaluate(Long sleepSeconds){
...
Thread.sleep(Long.parseLong(sleepSeconds) * 1000);
return "ok";
}
}
{code}
# in session_1:
{code}select time_waiting(100);{code}
# in session_2:
{code}select 1; or show tables;{code}
# session_2 will not have any response from thrift server util session_1
waiting 100 seconds!
this bug may cause hiveserver come into an available status!
===
# session_1 run waiting 200s,
!session_1.jpg!
# session_2 run at the same time ,but blocked by session_1 , see the
pic,waiting 197s after session_1 returned then returned
!session_2.jpg!
===
if someone want to attack or do sth ,hiveserver will not be down,but not
available again!
was:
# cause by an error UDF function！time_waiting(Long sleepSeconds)
{code}
public class UDFTimeWaiting extends UDF throws Exception{
public String evaluate(Long sleepSeconds){
...
Thread.sleep(Long.parseLong(sleepSeconds) * 1000);
return "ok";
}
}
{code}
===
# in session_1:
{code}select time_waiting(100);{code}
# in session_2:
{code}select 1; or show tables;{code}
# session_2 will not have any response from thrift server util session_1
waiting 100 seconds!
this bug may cause hiveserver come into an available status!
===
# session_1 run waiting 200s,
!session_1.jpg!
# session_2 run at the same time ,but blocked by session_1 , see the
pic,waiting 197s after session_1 returned then returned
!session_2.jpg!
===
if someone want to attack or do sth ,hiveserver will not be down,but not
available again!
> hive thrift server may be blocked by session level waiting,caused by udf!
> -
>
> Key: HIVE-21190
> URL: https://issues.apache.org/jira/browse/HIVE-21190
> Project: Hive
> Issue Type: Bug
> Components: HiveServer2
> Environment: hdp ambari 26
> hive1.2.0
>Reporter: kongxianghe
>Assignee: Josh Elser
>Priority: Critical
> Attachments: session_1.jpg, session_2.jpg
>
>
> # cause by an error UDF function！time_waiting(Long sleepSeconds)
> {code}
> public class UDFTimeWaiting extends UDF throws Exception{
> public String evaluate(Long sleepSeconds){
> ...
> Thread.sleep(Long.parseLong(sleepSeconds) * 1000);
> return "ok";
> }
> }
> {code}
>
> # in session_1:
> {code}select time_waiting(100);{code}
> # in session_2:
> {code}select 1; or show tables;{code}
> # session_2 will not have any response from thrift server util session_1
> waiting 100 seconds!
> this bug may cause hiveserver come into an available status!
> ===
> # session_1 run waiting 200s,
> !session_1.jpg!
> # session_2 run at the same time ,but blocked by session_1 , see the
> pic,waiting 197s after session_1 returned then returned
> !session_2.jpg!
> ===
> if someone want to attack or do sth ,hiveserver will not be down,but not
> available again!
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (HIVE-21190) hive thrift server may be blocked by session level waiting,caused by udf!
[
https://issues.apache.org/jira/browse/HIVE-21190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kongxianghe updated HIVE-21190:
---
Description:
# cause by an error UDF function！time_waiting(Long sleepSeconds)
{code}
public class UDFTimeWaiting extends UDF throws Exception{
public String evaluate(Long sleepSeconds){
...
Thread.sleep(Long.parseLong(sleepSeconds) * 1000);
return "ok";
}
}
{code}
# in session_1:
{code}select time_waiting(100);{code}
# in session_2:
{code}select 1; or show tables;{code}
# session_2 will not have any response from thrift server util session_1
waiting 100 seconds!
this bug may cause hiveserver come into an available status!
# session_1 run waiting 200s,
!session_1.jpg!
# session_2 run at the same time ,but blocked by session_1 , see the
pic,waiting 197s after session_1 returned then returned
!session_2.jpg!
if someone want to attack or do sth ,hiveserver will not be down,but not
available again!
was:
# cause by an error UDF function！time_waiting(Long sleepSeconds)
{code}
public class UDFTimeWaiting extends UDF throws Exception{
public String evaluate(Long sleepSeconds){
...
Thread.sleep(Long.parseLong(sleepSeconds) * 1000);
return "ok";
}
}
{code}
# in session_1:
{code}select time_waiting(100);{code}
# in session_2:
{code}select 1; or show tables;{code}
# session_2 will not have any response from thrift server util session_1
waiting 100 seconds!
this bug may cause hiveserver come into an available status!
===
# session_1 run waiting 200s,
!session_1.jpg!
# session_2 run at the same time ,but blocked by session_1 , see the
pic,waiting 197s after session_1 returned then returned
!session_2.jpg!
===
if someone want to attack or do sth ,hiveserver will not be down,but not
available again!
> hive thrift server may be blocked by session level waiting,caused by udf!
> -
>
> Key: HIVE-21190
> URL: https://issues.apache.org/jira/browse/HIVE-21190
> Project: Hive
> Issue Type: Bug
> Components: HiveServer2
> Environment: hdp ambari 26
> hive1.2.0
>Reporter: kongxianghe
>Assignee: Josh Elser
>Priority: Critical
> Attachments: session_1.jpg, session_2.jpg
>
>
> # cause by an error UDF function！time_waiting(Long sleepSeconds)
> {code}
> public class UDFTimeWaiting extends UDF throws Exception{
> public String evaluate(Long sleepSeconds){
> ...
> Thread.sleep(Long.parseLong(sleepSeconds) * 1000);
> return "ok";
> }
> }
> {code}
>
> # in session_1:
> {code}select time_waiting(100);{code}
> # in session_2:
> {code}select 1; or show tables;{code}
> # session_2 will not have any response from thrift server util session_1
> waiting 100 seconds!
> this bug may cause hiveserver come into an available status!
>
> # session_1 run waiting 200s,
> !session_1.jpg!
> # session_2 run at the same time ,but blocked by session_1 , see the
> pic,waiting 197s after session_1 returned then returned
> !session_2.jpg!
>
> if someone want to attack or do sth ,hiveserver will not be down,but not
> available again!
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (HIVE-21190) hive thrift server may be blocked by session level waiting,caused by udf!
[
https://issues.apache.org/jira/browse/HIVE-21190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kongxianghe updated HIVE-21190:
---
Description:
# cause by an error UDF function！time_waiting(Long sleepSeconds)
{code}
public class UDFTimeWaiting extends UDF throws Exception{
public String evaluate(Long sleepSeconds){
...
Thread.sleep(Long.parseLong(sleepSeconds) * 1000);
return "ok";
}
}
{code}
===
# in session_1:
{code}select time_waiting(100);{code}
# in session_2:
{code}select 1; or show tables;{code}
# session_2 will not have any response from thrift server util session_1
waiting 100 seconds!
this bug may cause hiveserver come into an available status!
===
# session_1 run waiting 200s,
!session_1.jpg!
# session_2 run at the same time ,but blocked by session_1 , see the
pic,waiting 197s after session_1 returned then returned
!session_2.jpg!
===
if someone want to attack or do sth ,hiveserver will not be down,but not
available again!
was:
# cause by an error UDF function！time_waiting(Long sleepSeconds)
{code}
public class UDFTimeWaiting extends UDF throws Exception{
public String evaluate(Long sleepSeconds){
...
Thread.sleep(Long.parseLong(sleepSeconds) * 1000);
return "ok";
}
}
{code}
===
# in session_1:
{code}select time_waiting(100);{code}
# in session_2:
{code}select 1; or show tables;{code}
# session_2 will not have any response from thrift server util session_1
waiting 100 seconds!
this bug may cause hiveserver can into an available status!
===
# session_1 run waiting 200s,
!session_1.jpg!
# session_2 run at the same time ,but blocked by session_1 , see the
pic,waiting 197s after session_1 returned then returned
!session_2.jpg!
===
if someone want to attack or do sth ,hiveserver will not be down,but not
available again!
> hive thrift server may be blocked by session level waiting,caused by udf!
> -
>
> Key: HIVE-21190
> URL: https://issues.apache.org/jira/browse/HIVE-21190
> Project: Hive
> Issue Type: Bug
> Components: HiveServer2
> Environment: hdp ambari 26
> hive1.2.0
>Reporter: kongxianghe
>Assignee: Josh Elser
>Priority: Critical
> Attachments: session_1.jpg, session_2.jpg
>
>
> # cause by an error UDF function！time_waiting(Long sleepSeconds)
> {code}
> public class UDFTimeWaiting extends UDF throws Exception{
> public String evaluate(Long sleepSeconds){
> ...
> Thread.sleep(Long.parseLong(sleepSeconds) * 1000);
> return "ok";
> }
> }
> {code}
> ===
> # in session_1:
> {code}select time_waiting(100);{code}
> # in session_2:
> {code}select 1; or show tables;{code}
> # session_2 will not have any response from thrift server util session_1
> waiting 100 seconds!
> this bug may cause hiveserver come into an available status!
> ===
> # session_1 run waiting 200s,
> !session_1.jpg!
> # session_2 run at the same time ,but blocked by session_1 , see the
> pic,waiting 197s after session_1 returned then returned
> !session_2.jpg!
> ===
> if someone want to attack or do sth ,hiveserver will not be down,but not
> available again!
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (HIVE-21190) hive thrift server may be blocked by session level waiting,caused by udf!
[
https://issues.apache.org/jira/browse/HIVE-21190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kongxianghe updated HIVE-21190:
---
Description:
# cause by an error UDF function！time_waiting(Long sleepSeconds)
{code}
public class UDFTimeWaiting extends UDF throws Exception{
public String evaluate(Long sleepSeconds){
...
Thread.sleep(Long.parseLong(sleepSeconds) * 1000);
return "ok";
}
}
{code}
===
# in session_1:
{code}select time_waiting(100);{code}
# in session_2:
{code}select 1; or show tables;{code}
# session_2 will not have any response from thrift server util session_1
waiting 100 seconds!
this bug may cause hiveserver can into an available status!
===
# session_1 run waiting 200s,
!session_1.jpg!
# session_2 run at the same time ,but blocked by session_1 , see the
pic,waiting 197s after session_1 returned then returned
!session_2.jpg!
===
if someone want to attack or do sth ,hiveserver will not be down,but not
available again!
was:
# cause by an error UDF function！time_waiting(Long sleepSeconds)
{code}
public class UDFTimeWaiting extends UDF throws Exception{
public String evaluate(Long sleepSeconds){
...
Thread.sleep(Long.parseLong(sleepSeconds) * 1000);
return "ok";
}
}
{code}
# in session_1:
{code}select time_waiting(100);{code}
# in session_2:
{code}select 1; or show tables;{code}
# session_2 will not have any response from thrift server util session_1
waiting 100 seconds!
this bug may cause hiveserver can into an available status!
!session_1.jpg!
!session_2.jpg!
> hive thrift server may be blocked by session level waiting,caused by udf!
> -
>
> Key: HIVE-21190
> URL: https://issues.apache.org/jira/browse/HIVE-21190
> Project: Hive
> Issue Type: Bug
> Components: HiveServer2
> Environment: hdp ambari 26
> hive1.2.0
>Reporter: kongxianghe
>Assignee: Josh Elser
>Priority: Critical
> Attachments: session_1.jpg, session_2.jpg
>
>
> # cause by an error UDF function！time_waiting(Long sleepSeconds)
> {code}
> public class UDFTimeWaiting extends UDF throws Exception{
> public String evaluate(Long sleepSeconds){
> ...
> Thread.sleep(Long.parseLong(sleepSeconds) * 1000);
> return "ok";
> }
> }
> {code}
> ===
> # in session_1:
> {code}select time_waiting(100);{code}
> # in session_2:
> {code}select 1; or show tables;{code}
> # session_2 will not have any response from thrift server util session_1
> waiting 100 seconds!
> this bug may cause hiveserver can into an available status!
> ===
> # session_1 run waiting 200s,
> !session_1.jpg!
> # session_2 run at the same time ,but blocked by session_1 , see the
> pic,waiting 197s after session_1 returned then returned
> !session_2.jpg!
> ===
> if someone want to attack or do sth ,hiveserver will not be down,but not
> available again!
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (HIVE-21190) hive thrift server may be blocked by session level waiting,caused by udf!
[
https://issues.apache.org/jira/browse/HIVE-21190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kongxianghe updated HIVE-21190:
---
Attachment: session_1.jpg
session_2.jpg
> hive thrift server may be blocked by session level waiting,caused by udf!
> -
>
> Key: HIVE-21190
> URL: https://issues.apache.org/jira/browse/HIVE-21190
> Project: Hive
> Issue Type: Bug
> Components: HiveServer2
> Environment: hdp ambari 26
> hive1.2.0
>Reporter: kongxianghe
>Assignee: Josh Elser
>Priority: Critical
> Attachments: session_1.jpg, session_2.jpg
>
>
> # cause by an error UDF function！time_waiting(Long sleepSeconds)
> {code}
> public class UDFTimeWaiting extends UDF throws Exception{
> public String evaluate(Long sleepSeconds){
> ...
> Thread.sleep(Long.parseLong(sleepSeconds) * 1000);
> return "ok";
> }
> }
> {code}
> # in session_1:
> {code}select time_waiting(100);{code}
> # in session_2:
> {code}select 1; or show tables;{code}
> # session_2 will not have any response from thrift server util session_1
> waiting 100 seconds!
> this bug may cause hiveserver can into an available status!
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (HIVE-21190) hive thrift server may be blocked by session level waiting,caused by udf!
[
https://issues.apache.org/jira/browse/HIVE-21190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kongxianghe updated HIVE-21190:
---
Description:
# cause by an error UDF function！time_waiting(Long sleepSeconds)
{code}
public class UDFTimeWaiting extends UDF throws Exception{
public String evaluate(Long sleepSeconds){
...
Thread.sleep(Long.parseLong(sleepSeconds) * 1000);
return "ok";
}
}
{code}
# in session_1:
{code}select time_waiting(100);{code}
# in session_2:
{code}select 1; or show tables;{code}
# session_2 will not have any response from thrift server util session_1
waiting 100 seconds!
this bug may cause hiveserver can into an available status!
!session_1.jpg!
!session_2.jpg!
was:
# cause by an error UDF function！time_waiting(Long sleepSeconds)
{code}
public class UDFTimeWaiting extends UDF throws Exception{
public String evaluate(Long sleepSeconds){
...
Thread.sleep(Long.parseLong(sleepSeconds) * 1000);
return "ok";
}
}
{code}
# in session_1:
{code}select time_waiting(100);{code}
# in session_2:
{code}select 1; or show tables;{code}
# session_2 will not have any response from thrift server util session_1
waiting 100 seconds!
this bug may cause hiveserver can into an available status!
> hive thrift server may be blocked by session level waiting,caused by udf!
> -
>
> Key: HIVE-21190
> URL: https://issues.apache.org/jira/browse/HIVE-21190
> Project: Hive
> Issue Type: Bug
> Components: HiveServer2
> Environment: hdp ambari 26
> hive1.2.0
>Reporter: kongxianghe
>Assignee: Josh Elser
>Priority: Critical
> Attachments: session_1.jpg, session_2.jpg
>
>
> # cause by an error UDF function！time_waiting(Long sleepSeconds)
> {code}
> public class UDFTimeWaiting extends UDF throws Exception{
> public String evaluate(Long sleepSeconds){
> ...
> Thread.sleep(Long.parseLong(sleepSeconds) * 1000);
> return "ok";
> }
> }
> {code}
> # in session_1:
> {code}select time_waiting(100);{code}
> # in session_2:
> {code}select 1; or show tables;{code}
> # session_2 will not have any response from thrift server util session_1
> waiting 100 seconds!
> this bug may cause hiveserver can into an available status!
> !session_1.jpg!
> !session_2.jpg!
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Assigned] (HIVE-21190) hive thrift server may be blocked by session level waiting,caused by udf!
[
https://issues.apache.org/jira/browse/HIVE-21190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kongxianghe reassigned HIVE-21190:
--
Assignee: Josh Elser (was: kongxianghe)
> hive thrift server may be blocked by session level waiting,caused by udf!
> -
>
> Key: HIVE-21190
> URL: https://issues.apache.org/jira/browse/HIVE-21190
> Project: Hive
> Issue Type: Bug
> Components: HiveServer2
> Environment: hdp ambari 26
> hive1.2.0
>Reporter: kongxianghe
>Assignee: Josh Elser
>Priority: Critical
>
> # cause by an error UDF function！time_waiting(Long sleepSeconds)
> {code}
> public class UDFTimeWaiting extends UDF throws Exception{
> public String evaluate(Long sleepSeconds){
> ...
> Thread.sleep(Long.parseLong(sleepSeconds) * 1000);
> return "ok";
> }
> }
> {code}
> # in session_1:
> {code}select time_waiting(100);{code}
> # in session_2:
> {code}select 1; or show tables;{code}
> # session_2 will not have any response from thrift server util session_1
> waiting 100 seconds!
> this bug may cause hiveserver can into an available status!
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (HIVE-21190) hive thrift server may be blocked by session level waiting!
[
https://issues.apache.org/jira/browse/HIVE-21190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kongxianghe updated HIVE-21190:
---
Description:
# cause by an error UDF function！time_waiting(Long sleepSeconds)
{code}
public class UDFTimeWaiting extends UDF throws Exception{
public String evaluate(Long sleepSeconds){
...
Thread.sleep(Long.parseLong(sleepSeconds) * 1000);
return "ok";
}
}
{code}
# in session_1:
{code}select time_waiting(100);{code}
# in session_2:
{code}select 1; or show tables;{code}
# session_2 will not have any response from thrift server util session_1
waiting 100 seconds!
this bug may cause hiveserver can into an available status!
was:
# cause by an error UDF function！time_waiting(Long sleepSeconds)
{code}
public class UDFTimeWaiting extends UDF throws Exception{
public String evaluate(Long sleepSeconds){
...
Thread.sleep(Long.parseLong(sleepSeconds) * 1000);
return "ok";
}
}
{code}
# in session_1:
{code}select time_waiting(100);{code}
# in session_2:
{code}select 1; or show tables;{code}
# session_2 will not have any response from thrift server util session_1
waiting 100 seconds!
this bug may cause hiveserver become to a not available status!
> hive thrift server may be blocked by session level waiting!
> ---
>
> Key: HIVE-21190
> URL: https://issues.apache.org/jira/browse/HIVE-21190
> Project: Hive
> Issue Type: Bug
> Components: HiveServer2
> Environment: hdp ambari 26
> hive1.2.0
>Reporter: kongxianghe
>Assignee: kongxianghe
>Priority: Critical
>
> # cause by an error UDF function！time_waiting(Long sleepSeconds)
> {code}
> public class UDFTimeWaiting extends UDF throws Exception{
> public String evaluate(Long sleepSeconds){
> ...
> Thread.sleep(Long.parseLong(sleepSeconds) * 1000);
> return "ok";
> }
> }
> {code}
> # in session_1:
> {code}select time_waiting(100);{code}
> # in session_2:
> {code}select 1; or show tables;{code}
> # session_2 will not have any response from thrift server util session_1
> waiting 100 seconds!
> this bug may cause hiveserver can into an available status!
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (HIVE-21190) hive thrift server may be blocked by session level waiting!
[
https://issues.apache.org/jira/browse/HIVE-21190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kongxianghe updated HIVE-21190:
---
Description:
# cause by an error UDF function！time_waiting(Long sleepSeconds)
{code}
public class UDFTimeWaiting extends UDF throws Exception{
public String evaluate(Long sleepSeconds){
...
Thread.sleep(Long.parseLong(sleepSeconds) * 1000);
return "ok";
}
}
{code}
# in session_1:
{code}select time_waiting(100);{code}
# in session_2:
{coed}select 1; or show tables;{code}
# session_2 will not have any response from thrift server util session_1
waiting 100 seconds!
this bug may cause hiveserver become to a not available status!
was:
# cause by an error UDF function！time_waiting(Long sleepSeconds)
{code}
public class UDFTimeWaiting extends UDF throws Exception{
public String evaluate(Long sleepSeconds){
...
Thread.sleep(Long.parseLong(sleepSeconds) * 1000);
return "ok";
}
}
{code}
# in session_1:
## select time_waiting(100);
# in session_2:
## select 1; or show tables;
# session_2 will not have any response from thrift server util session_1
waiting 100 seconds!
this bug may cause hiveserver become to a not available status!
> hive thrift server may be blocked by session level waiting!
> ---
>
> Key: HIVE-21190
> URL: https://issues.apache.org/jira/browse/HIVE-21190
> Project: Hive
> Issue Type: Bug
> Components: HiveServer2
> Environment: hdp ambari 26
> hive1.2.0
>Reporter: kongxianghe
>Assignee: kongxianghe
>Priority: Critical
>
> # cause by an error UDF function！time_waiting(Long sleepSeconds)
> {code}
> public class UDFTimeWaiting extends UDF throws Exception{
> public String evaluate(Long sleepSeconds){
> ...
> Thread.sleep(Long.parseLong(sleepSeconds) * 1000);
> return "ok";
> }
> }
> {code}
> # in session_1:
> {code}select time_waiting(100);{code}
> # in session_2:
> {coed}select 1; or show tables;{code}
> # session_2 will not have any response from thrift server util session_1
> waiting 100 seconds!
> this bug may cause hiveserver become to a not available status!
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (HIVE-21190) hive thrift server may be blocked by session level waiting!
[
https://issues.apache.org/jira/browse/HIVE-21190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kongxianghe updated HIVE-21190:
---
Description:
# cause by an error UDF function！time_waiting(Long sleepSeconds)
{code}
public class UDFTimeWaiting extends UDF throws Exception{
public String evaluate(Long sleepSeconds){
...
Thread.sleep(Long.parseLong(sleepSeconds) * 1000);
return "ok";
}
}
{code}
# in session_1:
{code}select time_waiting(100);{code}
# in session_2:
{code}select 1; or show tables;{code}
# session_2 will not have any response from thrift server util session_1
waiting 100 seconds!
this bug may cause hiveserver become to a not available status!
was:
# cause by an error UDF function！time_waiting(Long sleepSeconds)
{code}
public class UDFTimeWaiting extends UDF throws Exception{
public String evaluate(Long sleepSeconds){
...
Thread.sleep(Long.parseLong(sleepSeconds) * 1000);
return "ok";
}
}
{code}
# in session_1:
{code}select time_waiting(100);{code}
# in session_2:
{coed}select 1; or show tables;{code}
# session_2 will not have any response from thrift server util session_1
waiting 100 seconds!
this bug may cause hiveserver become to a not available status!
> hive thrift server may be blocked by session level waiting!
> ---
>
> Key: HIVE-21190
> URL: https://issues.apache.org/jira/browse/HIVE-21190
> Project: Hive
> Issue Type: Bug
> Components: HiveServer2
> Environment: hdp ambari 26
> hive1.2.0
>Reporter: kongxianghe
>Assignee: kongxianghe
>Priority: Critical
>
> # cause by an error UDF function！time_waiting(Long sleepSeconds)
> {code}
> public class UDFTimeWaiting extends UDF throws Exception{
> public String evaluate(Long sleepSeconds){
> ...
> Thread.sleep(Long.parseLong(sleepSeconds) * 1000);
> return "ok";
> }
> }
> {code}
> # in session_1:
> {code}select time_waiting(100);{code}
> # in session_2:
> {code}select 1; or show tables;{code}
> # session_2 will not have any response from thrift server util session_1
> waiting 100 seconds!
> this bug may cause hiveserver become to a not available status!
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (HIVE-21190) hive thrift server may be blocked by session level waiting!
[
https://issues.apache.org/jira/browse/HIVE-21190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kongxianghe updated HIVE-21190:
---
Description:
# cause by an error UDF function！time_waiting(Long sleepSeconds)
{code}
public class UDFTimeWaiting extends UDF throws Exception{
public String evaluate(Long sleepSeconds){
...
Thread.sleep(Long.parseLong(sleepSeconds) * 1000);
return "ok";
}
}
{code}
# in session_1:
## select time_waiting(100);
# in session_2:
## select 1; or show tables;
# session_2 will not have any response from thrift server util session_1
waiting 100 seconds!
this bug may cause hiveserver become to a not available status!
was:
# cause by an error UDF function！time_waiting(Long sleepSeconds)
{code}
public class UDFTimeWaiting extends UDF throws Exception{
public String evaluate(Long sleepSeconds){
...
Thread.sleep(Long.parseLong(sleepSeconds) * 1000);
return "ok";
}
}
{code}
> hive thrift server may be blocked by session level waiting!
> ---
>
> Key: HIVE-21190
> URL: https://issues.apache.org/jira/browse/HIVE-21190
> Project: Hive
> Issue Type: Bug
> Components: HiveServer2
> Environment: hdp ambari 26
> hive1.2.0
>Reporter: kongxianghe
>Assignee: kongxianghe
>Priority: Critical
>
> # cause by an error UDF function！time_waiting(Long sleepSeconds)
> {code}
> public class UDFTimeWaiting extends UDF throws Exception{
> public String evaluate(Long sleepSeconds){
> ...
> Thread.sleep(Long.parseLong(sleepSeconds) * 1000);
> return "ok";
> }
> }
> {code}
> # in session_1:
> ## select time_waiting(100);
> # in session_2:
> ## select 1; or show tables;
> # session_2 will not have any response from thrift server util session_1
> waiting 100 seconds!
> this bug may cause hiveserver become to a not available status!
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Assigned] (HIVE-21190) hive thrift server may be blocked by session level waiting!
[
https://issues.apache.org/jira/browse/HIVE-21190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kongxianghe reassigned HIVE-21190:
--
> hive thrift server may be blocked by session level waiting!
> ---
>
> Key: HIVE-21190
> URL: https://issues.apache.org/jira/browse/HIVE-21190
> Project: Hive
> Issue Type: Bug
> Components: HiveServer2
> Environment: hdp ambari 26
> hive1.2.0
>Reporter: kongxianghe
>Assignee: kongxianghe
>Priority: Critical
>
> # cause by an error UDF function！time_waiting(Long sleepSeconds)
> {code}
> public class UDFTimeWaiting extends UDF throws Exception{
> public String evaluate(Long sleepSeconds){
> ...
> Thread.sleep(Long.parseLong(sleepSeconds) * 1000);
> return "ok";
> }
> }
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
