https://github.com/apache/spark/pull/2241), not sure if you can wait for this.
☺
From: Yin Huai [mailto:huaiyin@gmail.com]
Sent: Wednesday, September 17, 2014 1:50 AM
To: Cheng, Hao
Cc: linkpatrickliu; u...@spark.incubator.apache.org
Subject: Re: SparkSQL 1.1 hang when "DROP" or "L
sting the steps, I will look at this, hopefully come out
>> with a solution soon.
>>
>> -Original Message-
>> From: linkpatrickliu [mailto:linkpatrick...@live.com]
>> Sent: Tuesday, September 16, 2014 3:17 PM
>> To: u...@spark.incubator.apache.org
>&
lto:linkpatrick...@live.com]
> Sent: Tuesday, September 16, 2014 3:17 PM
> To: u...@spark.incubator.apache.org
> Subject: RE: SparkSQL 1.1 hang when "DROP" or "LOAD"
>
> Hi, Hao Cheng.
>
> I have done other tests. And the result shows the thriftServer ca
Thank you for pasting the steps, I will look at this, hopefully come out with a
solution soon.
-Original Message-
From: linkpatrickliu [mailto:linkpatrick...@live.com]
Sent: Tuesday, September 16, 2014 3:17 PM
To: u...@spark.incubator.apache.org
Subject: RE: SparkSQL 1.1 hang when "
Hi, Hao Cheng.
I have done other tests. And the result shows the thriftServer can connect
to Zookeeper.
However, I found some more interesting things. And I think I have found a
bug!
Test procedure:
Test1:
(0) Use beeline to connect to thriftServer.
(1) Switch database "use dw_op1"; (OK)
The log
Seems like the thriftServer cannot connect to Zookeeper, so it cannot get
lock.
This is how it the log looks when I run SparkSQL:
"load data inpath "kv1.txt" into table src;"
log:
14/09/16 14:40:47 INFO Driver:
14/09/16 14:40:47 INFO ClientCnxn: Opening socket connection to server
SVR4044HW2285.h
USTOM)
-Original Message-
From: linkpatrickliu [mailto:linkpatrick...@live.com]
Sent: Tuesday, September 16, 2014 1:10 PM
To: u...@spark.incubator.apache.org
Subject: RE: SparkSQL 1.1 hang when "DROP" or "LOAD"
Besides，
When I use bin/spark-sql, I can Load data and drop table
Besides，
When I use bin/spark-sql, I can Load data and drop table freely.
Only when I use sbin/start-thriftserver.sh and connect with beeline,
the client will hang!
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/SparkSQL-1-1-hang-when-DROP-or-LOAD-tp14222
Hi， Hao Cheng，
This is my spark assembly jar name：
spark-assembly-1.1.0-hadoop2.0.0-cdh4.6.0.jar
I compiled spark 1.1.0 with following cmd:
export MAVEN_OPTS="-Xmx2g -XX:MaxPermSize=512M
-XX:ReservedCodeCacheSize=512m"
mvn -Dhadoop.version=2.0.0-cdh4.6.0 -Phive -Pspark-ganglia-lgpl -DskipTests
pa
From: linkpatrickliu [mailto:linkpatrick...@live.com]
Sent: Tuesday, September 16, 2014 12:14 PM
To: u...@spark.incubator.apache.org
Subject: RE: SparkSQL 1.1 hang when "DROP" or "LOAD"
Hi， Hao Cheng，
Here is the Spark\Hadoop version:
Spark version = 1.1.0
Hadoop version = 2.0.0-cd
Hi， Hao Cheng，
Here is the Spark\Hadoop version:
Spark version = 1.1.0
Hadoop version = 2.0.0-cdh4.6.0
And hive-site.xml:
fs.default.name
hdfs://ns
dfs.nameservices
ns
dfs.ha.namenodes.ns
machine01,machine02
dfs.namenode.rpc-address.ns.mach
Hi， Hao Cheng，
Here is the Spark\Hadoop version:
Spark version = 1.1.0
Hadoop version = 2.0.0-cdh4.6.0
And hive-site.xml:
fs.default.name
hdfs://ns
dfs.nameservices
ns
dfs.ha.namenodes.ns
machine01,machine02
dfs.namenode.rpc-address.ns.mach
To: u...@spark.incubator.apache.org
Subject: SparkSQL 1.1 hang when "DROP" or "LOAD"
I started sparkSQL thrift server:
"sbin/start-thriftserver.sh"
Then I use beeline to connect to it:
"bin/beeline"
"!connect jdbc:hive2://localhost:1 op1 op1"
I have created
I started sparkSQL thrift server:
"sbin/start-thriftserver.sh"
Then I use beeline to connect to it:
"bin/beeline"
"!connect jdbc:hive2://localhost:1 op1 op1"
I have created a database for user op1.
"create database dw_op1";
And grant all privileges to user op1;
"grant all on database dw_op1
14 matches
Mail list logo
