[GitHub] spark issue #18102: [SPARK-20875] Spark should print the log when the direct...

2017-05-25 Thread jerryshao
Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/18102 I would doubt it will be too verbose to print out the path. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #17770: [SPARK-20392][SQL] Set barrier to prevent re-entering a ...

2017-05-25 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/17770 @cloud-fan @gatorsmile Please let me know if you have more comments on this change. Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark issue #18103: [SPARK-20876][SQL]if the input parameter is float type f...

2017-05-25 Thread sameeragarwal
Github user sameeragarwal commented on the issue: https://github.com/apache/spark/pull/18103 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #18103: [SPARK-20876][SQL]if the input parameter is float type f...

2017-05-25 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/18103 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark issue #17113: [SPARK-13669][Core] Improve the blacklist mechanism to h...

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17113 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77344/ Test FAILed. ---

[GitHub] spark issue #18025: [WIP][SparkR] Grouped documentation for sql functions

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18025 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77343/ Test FAILed. ---

[GitHub] spark issue #16578: [SPARK-4502][SQL] Parquet nested column pruning

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16578 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77342/ Test FAILed. ---

[GitHub] spark issue #18025: [WIP][SparkR] Grouped documentation for sql functions

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18025 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16578: [SPARK-4502][SQL] Parquet nested column pruning

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16578 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18097: [Spark-20873][SQL] Improve the error message for unsuppo...

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18097 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18097: [Spark-20873][SQL] Improve the error message for unsuppo...

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18097 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77340/ Test FAILed. ---

[GitHub] spark issue #17113: [SPARK-13669][Core] Improve the blacklist mechanism to h...

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17113 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18091: [SPARK-20868][CORE] UnsafeShuffleWriter should verify th...

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18091 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18091: [SPARK-20868][CORE] UnsafeShuffleWriter should verify th...

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18091 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77338/ Test FAILed. ---

[GitHub] spark issue #18103: [SPARK-20876][SQL]if the input parameter is float type f...

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18103 **[Test build #77345 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77345/testReport)** for PR 18103 at commit [`37f0ff3`](https://github.com/apache/spark/commit/37

[GitHub] spark issue #17113: [SPARK-13669][Core] Improve the blacklist mechanism to h...

2017-05-25 Thread jerryshao
Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/17113 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #18015: [SAPRK-20785][WEB-UI][SQL]Spark should provide jump link...

2017-05-25 Thread guoxiaolongzte
Github user guoxiaolongzte commented on the issue: https://github.com/apache/spark/pull/18015 @HyukjinKwon Help to merge to master and modify the status about https://issues.apache.org/jira/browse/SPARK-20785.Thank you. --- If your project is set up for it, you can reply to this

[GitHub] spark issue #18102: [SPARK-20875] Spark should print the log when the direct...

2017-05-25 Thread liu-zhaokun
Github user liu-zhaokun commented on the issue: https://github.com/apache/spark/pull/18102 @jerryshao Thanks for your reply.Do you mean that I need to streamline the content? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark issue #18102: [SPARK-20875] Spark should print the log when the direct...

2017-05-25 Thread sameeragarwal
Github user sameeragarwal commented on the issue: https://github.com/apache/spark/pull/18102 Agree -- logging at INFO level is an overkill. At the very least it should be at the TRACE level. --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] spark issue #17113: [SPARK-13669][Core] Improve the blacklist mechanism to h...

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17113 **[Test build #77346 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77346/testReport)** for PR 17113 at commit [`44c7108`](https://github.com/apache/spark/commit/44

[GitHub] spark pull request #18083: [SPARK-20863] Add metrics/instrumentation to Live...

2017-05-25 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/18083#discussion_r118431597 --- Diff: core/src/main/scala/org/apache/spark/scheduler/LiveListenerBus.scala --- @@ -33,25 +37,24 @@ import org.apache.spark.util.Utils * has star

[GitHub] spark pull request #18083: [SPARK-20863] Add metrics/instrumentation to Live...

2017-05-25 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/18083#discussion_r118431688 --- Diff: core/src/main/scala/org/apache/spark/scheduler/LiveListenerBus.scala --- @@ -124,11 +136,13 @@ private[spark] class LiveListenerBus(val sparkCo

[GitHub] spark issue #18074: [DOCS][MINOR] Scaladoc fixes (aka typo hunting)

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18074 **[Test build #77347 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77347/testReport)** for PR 18074 at commit [`6a95691`](https://github.com/apache/spark/commit/6a

[GitHub] spark pull request #18083: [SPARK-20863] Add metrics/instrumentation to Live...

2017-05-25 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/18083#discussion_r118431897 --- Diff: core/src/main/scala/org/apache/spark/scheduler/LiveListenerBus.scala --- @@ -226,3 +240,34 @@ private[spark] object LiveListenerBus { val

[GitHub] spark issue #18102: [SPARK-20875] Spark should print the log when the direct...

2017-05-25 Thread liu-zhaokun
Github user liu-zhaokun commented on the issue: https://github.com/apache/spark/pull/18102 @sameeragarwal Thanks for your reply. I will make changes based on your opinion. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as we

[GitHub] spark pull request #18083: [SPARK-20863] Add metrics/instrumentation to Live...

2017-05-25 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/18083#discussion_r118432135 --- Diff: core/src/main/scala/org/apache/spark/scheduler/LiveListenerBus.scala --- @@ -226,3 +240,34 @@ private[spark] object LiveListenerBus { val

[GitHub] spark pull request #14269: [SPARK-15703] [Scheduler][Core][WebUI] Make Liste...

2017-05-25 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/14269#discussion_r118432313 --- Diff: core/src/main/scala/org/apache/spark/internal/config/package.scala --- @@ -103,4 +103,9 @@ package object config { .stringConf

[GitHub] spark issue #18074: [DOCS][MINOR] Scaladoc fixes (aka typo hunting)

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18074 **[Test build #77347 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77347/testReport)** for PR 18074 at commit [`6a95691`](https://github.com/apache/spark/commit/6

[GitHub] spark issue #18074: [DOCS][MINOR] Scaladoc fixes (aka typo hunting)

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18074 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77347/ Test FAILed. ---

[GitHub] spark issue #18074: [DOCS][MINOR] Scaladoc fixes (aka typo hunting)

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18074 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request #18083: [SPARK-20863] Add metrics/instrumentation to Live...

2017-05-25 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/18083#discussion_r118432570 --- Diff: core/src/main/scala/org/apache/spark/scheduler/LiveListenerBus.scala --- @@ -124,11 +136,13 @@ private[spark] class LiveListenerBus(val sparkCo

[GitHub] spark issue #18102: [SPARK-20875] Spark should print the log when the direct...

2017-05-25 Thread liu-zhaokun
Github user liu-zhaokun commented on the issue: https://github.com/apache/spark/pull/18102 @jerryshao Hi, I think change the log level also can make the logfile more concise.would this change eliminate your concerns? --- If your project is set up for it, you can reply to this em

[GitHub] spark issue #17471: [SPARK-3577] Report Spill size on disk for UnsafeExterna...

2017-05-25 Thread sameeragarwal
Github user sameeragarwal commented on the issue: https://github.com/apache/spark/pull/17471 @sitalkedia any updates here? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request #18015: [SAPRK-20785][WEB-UI][SQL]Spark should provide ju...

2017-05-25 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/18015#discussion_r118432984 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/ui/AllExecutionsPage.scala --- @@ -38,19 +38,19 @@ private[ui] class AllExecutionsPage

[GitHub] spark issue #18015: [SAPRK-20785][WEB-UI][SQL]Spark should provide jump link...

2017-05-25 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/18015 @guoxiaolongzte I can't. I am just a contributor like yo. I could say +1 :). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If yo

[GitHub] spark issue #18015: [SAPRK-20785][WEB-UI][SQL]Spark should provide jump link...

2017-05-25 Thread guoxiaolongzte
Github user guoxiaolongzte commented on the issue: https://github.com/apache/spark/pull/18015 @HyukjinKwon Thanks. @srowen Help to merge to master and modify the status about https://issues.apache.org/jira/browse/SPARK-20785.Thanks. --- If your project is set up for it, you can

[GitHub] spark issue #18059: [SPARK-20834][SQL]TypeCoercion:loss of precision when wi...

2017-05-25 Thread 10110346
Github user 10110346 commented on the issue: https://github.com/apache/spark/pull/18059 @cloud-fan Hive use Float: select if(true, 123456789, cast(1.23 as float)); ++--+ | (IF(true, CAST(123456789 AS FLOAT), CAST

[GitHub] spark issue #18074: [DOCS][MINOR] Scaladoc fixes (aka typo hunting)

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18074 **[Test build #77348 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77348/testReport)** for PR 18074 at commit [`9479ccc`](https://github.com/apache/spark/commit/94

[GitHub] spark issue #18102: [SPARK-20875] Spark should print the log when the direct...

2017-05-25 Thread jerryshao
Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/18102 Looks like it will only print out the path of directory, not file, is that on purpose? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as w

[GitHub] spark issue #18059: [SPARK-20834][SQL]TypeCoercion:loss of precision when wi...

2017-05-25 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/18059 Then I don't think we can change this behavior, or users from hive will be confused. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well

[GitHub] spark issue #18067: [SPARK-20849][DOC][SPARKR] Document R DecisionTree

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18067 **[Test build #77349 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77349/testReport)** for PR 18067 at commit [`48a9686`](https://github.com/apache/spark/commit/48

[GitHub] spark pull request #18083: [SPARK-20863] Add metrics/instrumentation to Live...

2017-05-25 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18083#discussion_r118434907 --- Diff: core/src/main/scala/org/apache/spark/scheduler/LiveListenerBus.scala --- @@ -226,3 +240,34 @@ private[spark] object LiveListenerBus { val

[GitHub] spark issue #18091: [SPARK-20868][CORE] UnsafeShuffleWriter should verify th...

2017-05-25 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/18091 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #18016: [SPARK-20786][SQL]Improve ceil and floor handle the valu...

2017-05-25 Thread ueshin
Github user ueshin commented on the issue: https://github.com/apache/spark/pull/18016 @heary-cao Hi, I found `Ceil` and `Floor` modified by this pr produce different results between interpret and codegen. We also need to modify `doGenCode()` to handle `LongType` correctly. Can

[GitHub] spark pull request #18059: [SPARK-20834][SQL]TypeCoercion:loss of precision ...

2017-05-25 Thread 10110346
Github user 10110346 closed the pull request at: https://github.com/apache/spark/pull/18059 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is e

[GitHub] spark issue #18102: [SPARK-20875] Spark should print the log when the direct...

2017-05-25 Thread liu-zhaokun
Github user liu-zhaokun commented on the issue: https://github.com/apache/spark/pull/18102 @jerryshao Yes, I only want to provided a method to judge whether the spark.work.dir is removing or has been cleaned. --- If your project is set up for it, you can reply to this email and

[GitHub] spark issue #18059: [SPARK-20834][SQL]TypeCoercion:loss of precision when wi...

2017-05-25 Thread 10110346
Github user 10110346 commented on the issue: https://github.com/apache/spark/pull/18059 ok,I will close it,thanks @cloud-fan --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature en

[GitHub] spark issue #18051: [SPARK-18825][SPARKR][DOCS][WIP] Eliminate duplicate lin...

2017-05-25 Thread zero323
Github user zero323 commented on the issue: https://github.com/apache/spark/pull/18051 To be honest I thought mostly about online docs here. Duplicate links in the bundled documentation never bothered me before (in SparkR, or any other package for that matter) and don't I think these

[GitHub] spark issue #18067: [SPARK-20849][DOC][SPARKR] Document R DecisionTree

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18067 **[Test build #77351 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77351/testReport)** for PR 18067 at commit [`1a97e42`](https://github.com/apache/spark/commit/1a

[GitHub] spark issue #18091: [SPARK-20868][CORE] UnsafeShuffleWriter should verify th...

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18091 **[Test build #77350 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77350/testReport)** for PR 18091 at commit [`c79de07`](https://github.com/apache/spark/commit/c7

[GitHub] spark pull request #18090: [SPARK-20250][Core]Improper OOM error when a task...

2017-05-25 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/18090 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request #18074: [DOCS][MINOR] Scaladoc fixes (aka typo hunting)

2017-05-25 Thread jaceklaskowski
Github user jaceklaskowski commented on a diff in the pull request: https://github.com/apache/spark/pull/18074#discussion_r118436041 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/RelationalGroupedDataset.scala --- @@ -35,12 +35,13 @@ import org.apache.spark.sql.types.Numer

[GitHub] spark issue #18074: [DOCS][MINOR] Scaladoc fixes (aka typo hunting)

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18074 **[Test build #77352 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77352/testReport)** for PR 18074 at commit [`10104f2`](https://github.com/apache/spark/commit/10

[GitHub] spark issue #18090: [SPARK-20250][Core]Improper OOM error when a task been k...

2017-05-25 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/18090 thanks, merging to master/2.2/2.1/2.0! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature en

[GitHub] spark issue #18079: [SPARK-20841][SQL] Support column aliases for catalog ta...

2017-05-25 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/18079 yea, I think so. I mean, in the name conflict case you described above, postgresql throws an error; ``` postgres=# select * from testTable; col1 | col2 --+-- (0 rows)

[GitHub] spark pull request #18084: [SPARK-19900][core]Remove driver when relaunching...

2017-05-25 Thread liyichao
Github user liyichao commented on a diff in the pull request: https://github.com/apache/spark/pull/18084#discussion_r118436939 --- Diff: core/src/test/scala/org/apache/spark/deploy/master/MasterSuite.scala --- @@ -499,4 +500,103 @@ class MasterSuite extends SparkFunSuite

[GitHub] spark issue #18084: [SPARK-19900][core]Remove driver when relaunching.

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18084 **[Test build #77353 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77353/testReport)** for PR 18084 at commit [`6ab9a0f`](https://github.com/apache/spark/commit/6a

[GitHub] spark pull request #18057: [SPARK-20786][SQL][Backport-2.2]Improve ceil and ...

2017-05-25 Thread ueshin
Github user ueshin commented on a diff in the pull request: https://github.com/apache/spark/pull/18057#discussion_r118437741 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/mathExpressions.scala --- @@ -232,9 +232,10 @@ case class Ceil(child: Expres

[GitHub] spark issue #18041: [SPARK-20816][CORE] MetricsConfig doen't trim the proper...

2017-05-25 Thread jerryshao
Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/18041 @LantaoJin I don't think you have to do trim for metrics conf coming from `SparkConf`: 1. `SparkConf` already handles `trim` when reading from spark-defaults.conf file. 2. If you deli

[GitHub] spark pull request #16989: [SPARK-19659] Fetch big blocks to disk when shuff...

2017-05-25 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16989#discussion_r118437769 --- Diff: common/network-common/src/main/java/org/apache/spark/network/server/OneForOneStreamManager.java --- @@ -95,6 +97,25 @@ public ManagedBuffer get

[GitHub] spark issue #18064: [SPARK-20213][SQL] Fix DataFrameWriter operations in SQL...

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18064 **[Test build #77354 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77354/testReport)** for PR 18064 at commit [`60a064d`](https://github.com/apache/spark/commit/60

[GitHub] spark pull request #16989: [SPARK-19659] Fetch big blocks to disk when shuff...

2017-05-25 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16989#discussion_r118438313 --- Diff: core/src/test/scala/org/apache/spark/storage/ShuffleBlockFetcherIteratorSuite.scala --- @@ -401,4 +413,64 @@ class ShuffleBlockFetcherIteratorS

[GitHub] spark issue #18090: [SPARK-20250][Core]Improper OOM error when a task been k...

2017-05-25 Thread ConeyLiu
Github user ConeyLiu commented on the issue: https://github.com/apache/spark/pull/18090 thanks @cloud-fan @viirya for review. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enab

[GitHub] spark issue #16989: [SPARK-19659] Fetch big blocks to disk when shuffle-read...

2017-05-25 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/16989 good job! merging to master/2.2! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #18092: [SPARK-20640][CORE]Make rpc timeout and retry for shuffl...

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18092 **[Test build #77355 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77355/testReport)** for PR 18092 at commit [`aa51261`](https://github.com/apache/spark/commit/aa

[GitHub] spark issue #18092: [SPARK-20640][CORE]Make rpc timeout and retry for shuffl...

2017-05-25 Thread liyichao
Github user liyichao commented on the issue: https://github.com/apache/spark/pull/18092 Sorry, I thought it not necessary to duplicate message in JIRA, thanks for the suggestion. PR is updated. As to the test plan, the modification seems straightforward, and I can not think of mea

[GitHub] spark pull request #16989: [SPARK-19659] Fetch big blocks to disk when shuff...

2017-05-25 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16989 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #18092: [SPARK-20640][CORE]Make rpc timeout and retry for shuffl...

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18092 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18092: [SPARK-20640][CORE]Make rpc timeout and retry for shuffl...

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18092 **[Test build #77355 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77355/testReport)** for PR 18092 at commit [`aa51261`](https://github.com/apache/spark/commit/a

[GitHub] spark issue #18092: [SPARK-20640][CORE]Make rpc timeout and retry for shuffl...

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18092 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77355/ Test FAILed. ---

[GitHub] spark pull request #18094: [Spark-20775][SQL] Added scala support from_json

2017-05-25 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18094#discussion_r118439975 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/functions.scala --- @@ -3072,6 +3072,22 @@ object functions { * @since 2.1.0 */

[GitHub] spark issue #18057: [SPARK-20786][SQL][Backport-2.2]Improve ceil and floor h...

2017-05-25 Thread heary-cao
Github user heary-cao commented on the issue: https://github.com/apache/spark/pull/18057 the patch by #18103 merge together. close pr. thanks. @10110346 @hvanhovell --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] spark pull request #18057: [SPARK-20786][SQL][Backport-2.2]Improve ceil and ...

2017-05-25 Thread heary-cao
Github user heary-cao closed the pull request at: https://github.com/apache/spark/pull/18057 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #18092: [SPARK-20640][CORE]Make rpc timeout and retry for shuffl...

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18092 **[Test build #77356 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77356/testReport)** for PR 18092 at commit [`bb1801e`](https://github.com/apache/spark/commit/bb

[GitHub] spark pull request #18064: [SPARK-20213][SQL] Fix DataFrameWriter operations...

2017-05-25 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/18064#discussion_r118440922 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSource.scala --- @@ -426,36 +418,35 @@ case class DataSource( // F

[GitHub] spark issue #18088: [Minor] document edge case of updateFunc usage

2017-05-25 Thread wselwood
Github user wselwood commented on the issue: https://github.com/apache/spark/pull/18088 Good catch @HyukjinKwon Sorry about that. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this featur

[GitHub] spark issue #18067: [SPARK-20849][DOC][SPARKR] Document R DecisionTree

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18067 **[Test build #77349 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77349/testReport)** for PR 18067 at commit [`48a9686`](https://github.com/apache/spark/commit/4

[GitHub] spark issue #18067: [SPARK-20849][DOC][SPARKR] Document R DecisionTree

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18067 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77349/ Test PASSed. ---

[GitHub] spark issue #18067: [SPARK-20849][DOC][SPARKR] Document R DecisionTree

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18067 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request #18064: [SPARK-20213][SQL] Fix DataFrameWriter operations...

2017-05-25 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/18064#discussion_r118443224 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSource.scala --- @@ -426,36 +418,35 @@ case class DataSource( // F

[GitHub] spark issue #17308: [SPARK-19968][SS] Use a cached instance of `KafkaProduce...

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17308 **[Test build #77357 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77357/testReport)** for PR 17308 at commit [`588fa03`](https://github.com/apache/spark/commit/58

[GitHub] spark issue #17308: [SPARK-19968][SS] Use a cached instance of `KafkaProduce...

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17308 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17308: [SPARK-19968][SS] Use a cached instance of `KafkaProduce...

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17308 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77357/ Test FAILed. ---

[GitHub] spark issue #17308: [SPARK-19968][SS] Use a cached instance of `KafkaProduce...

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17308 **[Test build #77357 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77357/testReport)** for PR 17308 at commit [`588fa03`](https://github.com/apache/spark/commit/5

[GitHub] spark issue #18102: [SPARK-20875] Spark should print the log when the direct...

2017-05-25 Thread liu-zhaokun
Github user liu-zhaokun commented on the issue: https://github.com/apache/spark/pull/18102 @jerryshao Hello,thanks for your attention,is there any suggestion? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your p

[GitHub] spark issue #17308: [SPARK-19968][SS] Use a cached instance of `KafkaProduce...

2017-05-25 Thread ScrapCodes
Github user ScrapCodes commented on the issue: https://github.com/apache/spark/pull/17308 Jenkins, retest this please ! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled an

[GitHub] spark issue #17308: [SPARK-19968][SS] Use a cached instance of `KafkaProduce...

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17308 **[Test build #77358 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77358/testReport)** for PR 17308 at commit [`588fa03`](https://github.com/apache/spark/commit/58

[GitHub] spark issue #17308: [SPARK-19968][SS] Use a cached instance of `KafkaProduce...

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17308 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17308: [SPARK-19968][SS] Use a cached instance of `KafkaProduce...

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17308 **[Test build #77358 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77358/testReport)** for PR 17308 at commit [`588fa03`](https://github.com/apache/spark/commit/5

[GitHub] spark issue #17308: [SPARK-19968][SS] Use a cached instance of `KafkaProduce...

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17308 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77358/ Test FAILed. ---

[GitHub] spark issue #17308: [SPARK-19968][SS] Use a cached instance of `KafkaProduce...

2017-05-25 Thread ScrapCodes
Github user ScrapCodes commented on the issue: https://github.com/apache/spark/pull/17308 Build is failing due to "Our attempt to download sbt locally to build/sbt-launch-0.13.13.jar failed. Please install sbt manually from http://www.scala-sbt.org/"; --- If your project is set up f

[GitHub] spark issue #18042: [SPARK-20817][core] Fix to return "Unknown processor" on...

2017-05-25 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/18042 Does it matter that the format of the output isn't quite in the same format - is it just used for display? --- If your project is set up for it, you can reply to this email and have your reply appea

[GitHub] spark issue #18064: [SPARK-20213][SQL] Fix DataFrameWriter operations in SQL...

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18064 **[Test build #77354 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77354/testReport)** for PR 18064 at commit [`60a064d`](https://github.com/apache/spark/commit/6

[GitHub] spark issue #18064: [SPARK-20213][SQL] Fix DataFrameWriter operations in SQL...

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18064 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18064: [SPARK-20213][SQL] Fix DataFrameWriter operations in SQL...

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18064 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77354/ Test FAILed. ---

[GitHub] spark pull request #18105: [SPARK-20881] [SQL] Use Hive's stats in metastore...

2017-05-25 Thread wzhfy
GitHub user wzhfy opened a pull request: https://github.com/apache/spark/pull/18105 [SPARK-20881] [SQL] Use Hive's stats in metastore when cbo is disabled ## What changes were proposed in this pull request? Spark's statistics are generated by "analyze command". How

[GitHub] spark issue #17113: [SPARK-13669][Core] Improve the blacklist mechanism to h...

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17113 **[Test build #77346 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77346/testReport)** for PR 17113 at commit [`44c7108`](https://github.com/apache/spark/commit/4

[GitHub] spark issue #17113: [SPARK-13669][Core] Improve the blacklist mechanism to h...

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17113 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18105: [SPARK-20881] [SQL] Use Hive's stats in metastore when c...

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18105 **[Test build #77359 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77359/testReport)** for PR 18105 at commit [`4655292`](https://github.com/apache/spark/commit/46

[GitHub] spark issue #17113: [SPARK-13669][Core] Improve the blacklist mechanism to h...

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17113 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77346/ Test FAILed. ---

  1   2   3   4   5   6   >