Github user zuotingbing commented on the issue:
https://github.com/apache/spark/pull/16614
Thanks!
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if
GitHub user zuotingbing opened a pull request:
https://github.com/apache/spark/pull/16439
[SPARK-19026]SPARK_LOCAL_DIRS(multiple directories on different disks)
cannot be deleted
JIRA Issue: https://issues.apache.org/jira/browse/SPARK-19026
SPARK_LOCAL_DIRS (Standalone
Github user zuotingbing commented on a diff in the pull request:
https://github.com/apache/spark/pull/16439#discussion_r94352890
--- Diff: core/src/main/scala/org/apache/spark/deploy/worker/Worker.scala
---
@@ -445,12 +445,24 @@ private[deploy] class Worker
Github user zuotingbing commented on a diff in the pull request:
https://github.com/apache/spark/pull/16439#discussion_r94352892
--- Diff: core/src/main/scala/org/apache/spark/deploy/worker/Worker.scala
---
@@ -445,12 +445,24 @@ private[deploy] class Worker
Github user zuotingbing commented on the issue:
https://github.com/apache/spark/pull/16439
@srowen i do not think there should be a fatal error since some of
SPARK_LOCAL_DIRS can be written successfully, even there is only one of
SPARK_LOCAL_DIRS can be written, the application is
Github user zuotingbing commented on the issue:
https://github.com/apache/spark/pull/16439
@srowen Thanks for your advise, as @vanzin said I did not configure an
unwritable directory, but it can become unwritable for other reasons (e.g. disk
fills up or disk damaged suddenly etc
GitHub user zuotingbing opened a pull request:
https://github.com/apache/spark/pull/16484
Sh
JIRA Issue: https://issues.apache.org/jira/browse/SPARK-19083#
sbin/start-history-server.sh script use of $@ without quotes, this will
affect the length of args which used in
Github user zuotingbing commented on a diff in the pull request:
https://github.com/apache/spark/pull/16484#discussion_r94911586
--- Diff: core/src/main/scala/org/apache/spark/deploy/worker/Worker.scala
---
@@ -445,12 +445,24 @@ private[deploy] class Worker
Github user zuotingbing commented on the issue:
https://github.com/apache/spark/pull/16484
@jerryshao Thank you for your advice. I checked off all the scripts under
bin and sbin. It seems ok.
---
If your project is set up for it, you can reply to this email and have your
reply
Github user zuotingbing commented on a diff in the pull request:
https://github.com/apache/spark/pull/16439#discussion_r95052088
--- Diff: core/src/main/scala/org/apache/spark/deploy/worker/Worker.scala
---
@@ -445,12 +445,24 @@ private[deploy] class Worker
Github user zuotingbing commented on a diff in the pull request:
https://github.com/apache/spark/pull/16439#discussion_r95052089
--- Diff: core/src/main/scala/org/apache/spark/deploy/worker/Worker.scala
---
@@ -445,12 +445,24 @@ private[deploy] class Worker
GitHub user zuotingbing opened a pull request:
https://github.com/apache/spark/pull/16614
[SPARK-19260] Spaces in path parameter are not correctly handled withâ¦
JIRA Issue: https://issues.apache.org/jira/browse/SPARK-19260
## What changes were proposed in this pull
GitHub user zuotingbing opened a pull request:
https://github.com/apache/spark/pull/17452
[SPARK-20123]$SPARK_HOME variable might have spaces in it(e.g. $SPARKâ¦
JIRA Issue: https://issues.apache.org/jira/browse/SPARK-20123
## What changes were proposed in this pull
Github user zuotingbing commented on a diff in the pull request:
https://github.com/apache/spark/pull/17452#discussion_r108400132
--- Diff: R/check-cran.sh ---
@@ -20,14 +20,14 @@
set -o pipefail
set -e
-FWDIR="$(cd `dirname "${BASH_SOURCE[
Github user zuotingbing commented on a diff in the pull request:
https://github.com/apache/spark/pull/17452#discussion_r108623175
--- Diff: R/check-cran.sh ---
@@ -40,7 +40,7 @@ fi
if [ -d "$SPARK_JARS_DIR" ]; then
# Build a zip file containing the sour
Github user zuotingbing commented on the issue:
https://github.com/apache/spark/pull/17452
OKï¼will do. Thanks!
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and
Github user zuotingbing commented on a diff in the pull request:
https://github.com/apache/spark/pull/17452#discussion_r108898299
--- Diff: dev/make-distribution.sh ---
@@ -217,43 +217,43 @@ fi
# Make R package - this is used for both CRAN release and packing R layout
into
Github user zuotingbing commented on a diff in the pull request:
https://github.com/apache/spark/pull/17452#discussion_r108969951
--- Diff: dev/make-distribution.sh ---
@@ -217,43 +217,43 @@ fi
# Make R package - this is used for both CRAN release and packing R layout
into
Github user zuotingbing commented on a diff in the pull request:
https://github.com/apache/spark/pull/17452#discussion_r108978377
--- Diff: dev/make-distribution.sh ---
@@ -217,43 +217,43 @@ fi
# Make R package - this is used for both CRAN release and packing R layout
into
Github user zuotingbing commented on a diff in the pull request:
https://github.com/apache/spark/pull/17452#discussion_r109072645
--- Diff: dev/make-distribution.sh ---
@@ -217,43 +217,43 @@ fi
# Make R package - this is used for both CRAN release and packing R layout
into
GitHub user zuotingbing opened a pull request:
https://github.com/apache/spark/pull/17493
[SPARK-20173][SQL] Throw NullPointerException when HiveThriftServer2 is
shutdown
## What changes were proposed in this pull request?
Throw NullPointerException when HiveThriftServer2
Github user zuotingbing commented on the issue:
https://github.com/apache/spark/pull/17493
@srowen yes, i will fix it right now. Thanks! :)
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user zuotingbing closed the pull request at:
https://github.com/apache/spark/pull/17493
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature
GitHub user zuotingbing opened a pull request:
https://github.com/apache/spark/pull/17496
[SPARK-20173][SQL][hive-thriftserver] Throw NullPointerException when
HiveThriftServer2 is shutdown
## What changes were proposed in this pull request?
Throw NullPointerException
Github user zuotingbing commented on a diff in the pull request:
https://github.com/apache/spark/pull/17496#discussion_r109137993
--- Diff:
sql/hive-thriftserver/src/main/scala/org/apache/spark/sql/hive/thriftserver/HiveThriftServer2.scala
---
@@ -82,7 +82,9 @@ object
Github user zuotingbing commented on a diff in the pull request:
https://github.com/apache/spark/pull/16614#discussion_r97032463
--- Diff:
core/src/main/scala/org/apache/spark/deploy/history/FsHistoryProvider.scala ---
@@ -93,10 +94,12 @@ private[history] class FsHistoryProvider
Github user zuotingbing commented on the issue:
https://github.com/apache/spark/pull/16614
@srowen Happy Chinese New Year !
Sorry for the late reply. It sounds more sensible to test this behavior
everywhere since all the test cases used the directory, right? Thank you for
your
Github user zuotingbing commented on the issue:
https://github.com/apache/spark/pull/16614
Could you please merge to master and close this PR?
Thanks.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project
Github user zuotingbing commented on the issue:
https://github.com/apache/spark/pull/19989
as i debug, every time when i connect to thrift server through beeline, the
`SessionState.start(state)` will be called two times. one is in
`HiveSessionImpl:open` , **another is in
Github user zuotingbing commented on the issue:
https://github.com/apache/spark/pull/19989
we can find the cache size of FileSystem `deleteOnExit` will keep
increasing.
[
` will be called two times. one is in
`HiveSessionImpl:open` , another is in
Github user zuotingbing commented on the issue:
https://github.com/apache/spark/pull/20029
`override protected lazy val resourceLoader: HiveSessionResourceLoader = {
val client: HiveClient = externalCatalog.client.newSession()
new HiveSessionResourceLoader(session
Github user zuotingbing commented on the issue:
https://github.com/apache/spark/pull/19989
OK , please move to https://github.com/apache/spark/pull/20029. Thanks all.
---
-
To unsubscribe, e-mail: reviews-unsubscr
Github user zuotingbing commented on a diff in the pull request:
https://github.com/apache/spark/pull/20025#discussion_r158628287
--- Diff:
sql/hive-thriftserver/src/main/java/org/apache/hive/service/cli/session/SessionManager.java
---
@@ -148,6 +148,15 @@ public synchronized
Github user zuotingbing commented on the issue:
https://github.com/apache/spark/pull/20025
Could you please merge this to Master? Thanks @felixcheung
---
-
To unsubscribe, e-mail: reviews-unsubscr
Github user zuotingbing commented on the issue:
https://github.com/apache/spark/pull/20029
Could you please to check this PR? Thanks @liufengdb
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For
Github user zuotingbing commented on the issue:
https://github.com/apache/spark/pull/20025
Currently we do not call the `super.init(hiveConf)` in
`SparkSQLSessionManager.init`, it means `SessionManager.init` which includes
`createBackgroundOperationPool()` will not be called
Github user zuotingbing commented on the issue:
https://github.com/apache/spark/pull/20025
@liufengdb I think the class `SessionManager.java` is merged from Hive
originally, and in Spark we redesigned it by adding
`SparkSQLSessionManager.scala` with no affect to `SessionManager.java
Github user zuotingbing commented on the issue:
https://github.com/apache/spark/pull/20025
@rxin Could you please to review this? Thanks.
In my opinion we can create a new or follow-up PR if refactor is necessary.
This PR is to fix the bug about the Session Timeout Checker
Github user zuotingbing commented on the issue:
https://github.com/apache/spark/pull/19989
@gatorsmile @liufengdb Could you please also check this PR ? it
[BACKPORT-2.0] from master/2.3 about
[?](https://github.com/apache/spark/pull/20029
Github user zuotingbing commented on the issue:
https://github.com/apache/spark/pull/19989
ok, got it. Thanks!
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail
Github user zuotingbing commented on the issue:
https://github.com/apache/spark/pull/20025
@gatorsmile What is your opinion about this? Thanks!
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For
Github user zuotingbing closed the pull request at:
https://github.com/apache/spark/pull/19989
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h
Github user zuotingbing commented on the issue:
https://github.com/apache/spark/pull/20025
ping gatorsmile
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews
Github user zuotingbing commented on the issue:
https://github.com/apache/spark/pull/20025
ping @liufengdb
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews
GitHub user zuotingbing opened a pull request:
https://github.com/apache/spark/pull/20864
[SPARK-23745][SQL]Remove the directories of the
âÂÂhive.downloaded.resources.dirâ when HiveThriftServer2 stopped
## What changes were proposed in this pull request
Github user zuotingbing commented on the issue:
https://github.com/apache/spark/pull/20864
@liufengdb would you please take a review. Thanks!
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For
Github user zuotingbing commented on the issue:
https://github.com/apache/spark/pull/20864
i take a look at [https://github.com/apache/spark/pull/18666]. i find it
can not clean all the ***_resources directories. because when we start
HiveThriftServer2, we created two resource
Github user zuotingbing commented on the issue:
https://github.com/apache/spark/pull/20864
`add jar 'hdfs:///xxx.jar'`
or create UDF will download jars to the resource dir:
`CREATE FUNCTION xxx AS 'xxx' USING JAR 'hdfs:/
Github user zuotingbing commented on the issue:
https://github.com/apache/spark/pull/20864
@felixcheung Thanks. The test result is 0 failed, what is meaning of
> This patch fails due to an unknown error code, -9
? what should i do to fix the test fa
Github user zuotingbing commented on the issue:
https://github.com/apache/spark/pull/20025
@cloud-fan @gatorsmile @liufengdb @felixcheung @srowen @vanzin Is anybody
could make further contact and discuss this PR? Thanks
Github user zuotingbing commented on a diff in the pull request:
https://github.com/apache/spark/pull/20025#discussion_r162528506
--- Diff:
sql/hive-thriftserver/src/main/java/org/apache/hive/service/cli/session/SessionManager.java
---
@@ -79,35 +75,19 @@ public synchronized void
Github user zuotingbing commented on a diff in the pull request:
https://github.com/apache/spark/pull/20025#discussion_r163127098
--- Diff:
sql/hive-thriftserver/src/main/java/org/apache/hive/service/cli/session/SessionManager.java
---
@@ -23,11 +23,7 @@
import
Github user zuotingbing commented on a diff in the pull request:
https://github.com/apache/spark/pull/20025#discussion_r163136632
--- Diff:
sql/hive-thriftserver/src/main/java/org/apache/hive/service/cli/session/SessionManager.java
---
@@ -80,7 +76,6 @@ public synchronized void
Github user zuotingbing commented on the issue:
https://github.com/apache/spark/pull/20025
@gatorsmile @liufengdb Anything else? Thanks!
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For
GitHub user zuotingbing opened a pull request:
https://github.com/apache/spark/pull/20702
[SPARK-23547][SQL]Cleanup the .pipeout file when the Hive Session closed
## What changes were proposed in this pull request?
when the hive session closed, we should also cleanup the
Github user zuotingbing commented on a diff in the pull request:
https://github.com/apache/spark/pull/20702#discussion_r171749296
--- Diff:
sql/hive-thriftserver/src/main/java/org/apache/hive/service/cli/session/HiveSessionImpl.java
---
@@ -665,6 +667,25 @@ public void close
Github user zuotingbing commented on a diff in the pull request:
https://github.com/apache/spark/pull/20702#discussion_r172166003
--- Diff:
sql/hive-thriftserver/src/main/java/org/apache/hive/service/cli/session/HiveSessionImpl.java
---
@@ -665,6 +667,25 @@ public void close
Github user zuotingbing commented on the issue:
https://github.com/apache/spark/pull/20702
Jenkins, ok to test
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail
Github user zuotingbing commented on the issue:
https://github.com/apache/spark/pull/20702
@gatorsmile @liufengdb please take a look at this, thanks!
---
-
To unsubscribe, e-mail: reviews-unsubscr
Github user zuotingbing commented on the issue:
https://github.com/apache/spark/pull/20702
@cloud-fan @felixcheung would you please take a review. Thanks!
---
-
To unsubscribe, e-mail: reviews-unsubscr
GitHub user zuotingbing opened a pull request:
https://github.com/apache/spark/pull/18619
[SPARK-21397][BUILD]Maven shade plugin adding dependency-reduced-pom.xml to
â¦
â¦base directory
## What changes were proposed in this pull request?
1. run `./build/mvn
Github user zuotingbing commented on the issue:
https://github.com/apache/spark/pull/18619
@srowen Thanks for your time. I am not sure the open issue, which is
mentioned in the note, whether has bean resolved. as the note said
> setting a value for this parameter wit
Github user zuotingbing commented on the issue:
https://github.com/apache/spark/pull/18619
I just use `mvn checkstyle:check` ,which contains output files with
`basedir`, to check whether the `basedir` is correct with this PR.
Could you please specify the affect exactly as you
Github user zuotingbing commented on the issue:
https://github.com/apache/spark/pull/18619
Yes this PR is a trivial Improvement for me. i will closed it if this has
side-effects exactly. Thanks.
---
If your project is set up for it, you can reply to this email and have your
reply
GitHub user zuotingbing opened a pull request:
https://github.com/apache/spark/pull/21789
[SPARK-24829][SQL]CAST AS FLOAT inconsistent with Hive
## What changes were proposed in this pull request?
SELECT CAST('4.56' AS FLOAT)
the result is 4.559427
Github user zuotingbing closed the pull request at:
https://github.com/apache/spark/pull/20864
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h
Github user zuotingbing closed the pull request at:
https://github.com/apache/spark/pull/18812
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h
Github user zuotingbing commented on a diff in the pull request:
https://github.com/apache/spark/pull/21789#discussion_r203239370
--- Diff:
sql/hive-thriftserver/src/test/scala/org/apache/spark/sql/hive/thriftserver/HiveThriftServer2Suites.scala
---
@@ -766,6 +774,14 @@ class
Github user zuotingbing commented on the issue:
https://github.com/apache/spark/pull/21789
yes, only in STS, i will update the title
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user zuotingbing commented on a diff in the pull request:
https://github.com/apache/spark/pull/21789#discussion_r203610279
--- Diff:
sql/hive-thriftserver/src/main/java/org/apache/hive/service/cli/Column.java ---
@@ -349,7 +349,7 @@ public void addValue(Type type, Object
Github user zuotingbing commented on a diff in the pull request:
https://github.com/apache/spark/pull/21789#discussion_r203613567
--- Diff:
sql/hive-thriftserver/src/test/scala/org/apache/spark/sql/hive/thriftserver/HiveThriftServer2Suites.scala
---
@@ -766,6 +774,14 @@ class
Github user zuotingbing commented on a diff in the pull request:
https://github.com/apache/spark/pull/21789#discussion_r203675324
--- Diff:
sql/hive-thriftserver/src/main/java/org/apache/hive/service/cli/Column.java ---
@@ -349,7 +349,7 @@ public void addValue(Type type, Object
Github user zuotingbing commented on a diff in the pull request:
https://github.com/apache/spark/pull/21789#discussion_r203682086
--- Diff:
sql/hive-thriftserver/src/test/scala/org/apache/spark/sql/hive/thriftserver/HiveThriftServer2Suites.scala
---
@@ -766,6 +774,14 @@ class
Github user zuotingbing commented on the issue:
https://github.com/apache/spark/pull/21789
@mgaido91 yes , update it. Thanks.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user zuotingbing commented on the issue:
https://github.com/apache/spark/pull/21789
@HyukjinKwon i am not sure what is the reason about the tests failed. i
checked the `unit-tests.log` and it seems the test "SPARK-24829 Checks cast as
float" , which i added, hav
Github user zuotingbing commented on the issue:
https://github.com/apache/spark/pull/21789
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail
Github user zuotingbing commented on the issue:
https://github.com/apache/spark/pull/21789
@gatorsmile `org.apache.spark.sql.hive.thriftserver.UISeleniumSuite.(It is
not a test it is a sbt.testing.SuiteSelector)` , Could you give a help to check
it please? i find you are the latest
Github user zuotingbing commented on the issue:
https://github.com/apache/spark/pull/21789
@HyukjinKwon could you help to merge this to master branch? Thanks.
---
-
To unsubscribe, e-mail: reviews-unsubscr
GitHub user zuotingbing opened a pull request:
https://github.com/apache/spark/pull/19841
[SPARK-22642][SQL] the createdTempDir will not be deleted if an exception
occurs
## What changes were proposed in this pull request?
We found staging directories will not be
Github user zuotingbing commented on the issue:
https://github.com/apache/spark/pull/19841
Yes i am also confused why the diff is so big but it reported by git
originally.
---
-
To unsubscribe, e-mail: reviews
Github user zuotingbing commented on the issue:
https://github.com/apache/spark/pull/19841
I extract a separate function but it has too many parameters. Could i
extract several separate functions?
---
-
To
Github user zuotingbing commented on the issue:
https://github.com/apache/spark/pull/19841
please review it again, thanks all.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user zuotingbing commented on the issue:
https://github.com/apache/spark/pull/19841
It would be great if someone help to merge it to master, Thanks!
@gatorsmile @srowen @HyukjinKwon @wangyum
---
-
To
Github user zuotingbing commented on the issue:
https://github.com/apache/spark/pull/19841
Thanks srowen.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h
GitHub user zuotingbing opened a pull request:
https://github.com/apache/spark/pull/19989
[SPARK-22793][SQL]Memory leak in Spark Thrift Server
## What changes were proposed in this pull request?
1. Start HiveThriftServer2.
2. Connect to thriftserver through beeline
GitHub user zuotingbing opened a pull request:
https://github.com/apache/spark/pull/19275
[SPARK-22057][CORE]Provide to update the applications in the HistoryPage
which the event log files have not been existed.
## What changes were proposed in this pull request
GitHub user zuotingbing opened a pull request:
https://github.com/apache/spark/pull/19277
[SPARK-22058][COREthe BufferedInputStream will not be closed if an
exception occurs.
## What changes were proposed in this pull request?
EventLoggingListener use `val in = new
Github user zuotingbing commented on a diff in the pull request:
https://github.com/apache/spark/pull/19277#discussion_r139665504
--- Diff:
core/src/main/scala/org/apache/spark/scheduler/EventLoggingListener.scala ---
@@ -347,15 +347,14 @@ private[spark] object
Github user zuotingbing commented on a diff in the pull request:
https://github.com/apache/spark/pull/19277#discussion_r139878136
--- Diff:
core/src/main/scala/org/apache/spark/scheduler/EventLoggingListener.scala ---
@@ -351,11 +351,11 @@ private[spark] object
Github user zuotingbing commented on the issue:
https://github.com/apache/spark/pull/19277
I am not sure. If we move this line `val in = new
BufferedInputStream(fs.open(log))` into try~catch, we should define `var in:
BufferedInputStream = null` before, and use `catch { case e
Github user zuotingbing commented on the issue:
https://github.com/apache/spark/pull/19277
@jerryshao if this line `new BufferedInputStream(fs.open(log))` throws
exception, it mean we do not need to close the object of BufferedInputStream
because it new failed
Github user zuotingbing commented on a diff in the pull request:
https://github.com/apache/spark/pull/19277#discussion_r139902219
--- Diff:
core/src/main/scala/org/apache/spark/scheduler/EventLoggingListener.scala ---
@@ -351,11 +351,11 @@ private[spark] object
GitHub user zuotingbing opened a pull request:
https://github.com/apache/spark/pull/19300
[SPARK-22082][SparkR]Spelling mistake: choosen in API doc of R.
## What changes were proposed in this pull request?
"choosen" should be "chosen" in AP
Github user zuotingbing commented on a diff in the pull request:
https://github.com/apache/spark/pull/19277#discussion_r140137420
--- Diff:
core/src/main/scala/org/apache/spark/scheduler/EventLoggingListener.scala ---
@@ -351,14 +351,14 @@ private[spark] object
Github user zuotingbing closed the pull request at:
https://github.com/apache/spark/pull/19275
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h
1 - 100 of 159 matches
Mail list logo
