[GitHub] spark issue #13036: [SPARK-15243][ML][SQL][PYSPARK] Param methods should use...

2016-10-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13036 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67093/ Test PASSed. ---

[GitHub] spark pull request #15492: [DO NOT MERGE][TEST] Testing flakiness of Streami...

2016-10-17 Thread tdas
Github user tdas closed the pull request at: https://github.com/apache/spark/pull/15492 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #13036: [SPARK-15243][ML][SQL][PYSPARK] Param methods should use...

2016-10-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13036 **[Test build #67093 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67093/consoleFull)** for PR 13036 at commit

[GitHub] spark issue #15520: [SPARK-13747][SQL]Fix concurrent executions in ForkJoinP...

2016-10-17 Thread jodersky
Github user jodersky commented on the issue: https://github.com/apache/spark/pull/15520 > Yes, I think so. It just needs more lines :) I think the solution you propose is sound. Do you think that a quick mention about avoiding the `BlockingContext` in a comment would help in

[GitHub] spark issue #15520: [SPARK-13747][SQL]Fix concurrent executions in ForkJoinP...

2016-10-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15520 **[Test build #67094 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67094/consoleFull)** for PR 15520 at commit

[GitHub] spark issue #15519: [WIP][SQL][STREAMING][TEST] Fix flaky tests in Streaming...

2016-10-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15519 **[Test build #3358 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3358/consoleFull)** for PR 15519 at commit

[GitHub] spark issue #15520: [SPARK-13747][SQL]Fix concurrent executions in ForkJoinP...

2016-10-17 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/15520 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #15520: [SPARK-13747][SQL]Fix concurrent executions in ForkJoinP...

2016-10-17 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/15520 > Would installing a custom BlockingContext on threads that run tasks also work? Yes, I think so. It just needs more lines :) --- If your project is set up for it, you can reply to this

[GitHub] spark pull request #15285: [SPARK-17711] Compress rolled executor log

2016-10-17 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/15285#discussion_r83752553 --- Diff: core/src/test/scala/org/apache/spark/util/UtilsSuite.scala --- @@ -274,65 +276,102 @@ class UtilsSuite extends SparkFunSuite with

[GitHub] spark pull request #15512: [SPARK-17930][CORE]The SerializerInstance instanc...

2016-10-17 Thread mridulm
Github user mridulm commented on a diff in the pull request: https://github.com/apache/spark/pull/15512#discussion_r83752469 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskResultGetter.scala --- @@ -84,6 +90,7 @@ private[spark] class TaskResultGetter(sparkEnv:

[GitHub] spark issue #15520: [SPARK-13747][SQL]Fix concurrent executions in ForkJoinP...

2016-10-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15520 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15520: [SPARK-13747][SQL]Fix concurrent executions in ForkJoinP...

2016-10-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15520 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67088/ Test FAILed. ---

[GitHub] spark issue #15520: [SPARK-13747][SQL]Fix concurrent executions in ForkJoinP...

2016-10-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15520 **[Test build #67088 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67088/consoleFull)** for PR 15520 at commit

[GitHub] spark issue #15421: [SPARK-17811] SparkR cannot parallelize data.frame with ...

2016-10-17 Thread shivaram
Github user shivaram commented on the issue: https://github.com/apache/spark/pull/15421 Cool - @falaki lets see if @wangmiao1981 debugging finds anything in the next day or so ? The only thing that would be good is to get this in for 2.0.2 cut if that is happening soon.

[GitHub] spark pull request #15285: [SPARK-17711] Compress rolled executor log

2016-10-17 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/15285#discussion_r83749687 --- Diff: core/src/main/scala/org/apache/spark/util/Utils.scala --- @@ -1448,14 +1450,35 @@ private[spark] object Utils extends Logging {

[GitHub] spark pull request #15285: [SPARK-17711] Compress rolled executor log

2016-10-17 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/15285#discussion_r83748039 --- Diff: core/src/main/scala/org/apache/spark/util/logging/RollingFileAppender.scala --- @@ -142,6 +172,12 @@ private[spark] object RollingFileAppender {

[GitHub] spark pull request #15285: [SPARK-17711] Compress rolled executor log

2016-10-17 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/15285#discussion_r83742279 --- Diff: core/src/main/scala/org/apache/spark/deploy/worker/ui/LogPage.scala --- @@ -115,6 +117,19 @@ private[ui] class LogPage(parent: WorkerWebUI) extends

[GitHub] spark pull request #15285: [SPARK-17711] Compress rolled executor log

2016-10-17 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/15285#discussion_r83751049 --- Diff: core/src/main/scala/org/apache/spark/deploy/worker/ui/LogPage.scala --- @@ -115,6 +117,19 @@ private[ui] class LogPage(parent: WorkerWebUI) extends

[GitHub] spark issue #15520: [SPARK-13747][SQL]Fix concurrent executions in ForkJoinP...

2016-10-17 Thread jodersky
Github user jodersky commented on the issue: https://github.com/apache/spark/pull/15520 That makes sense, thanks for explaining. Would installing a custom `BlockingContext` on threads that run tasks also work? I'm not very familiar with the internals of the Awaitable api so I'm just

[GitHub] spark issue #13036: [SPARK-15243][ML][SQL][PYSPARK] Param methods should use...

2016-10-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13036 **[Test build #67093 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67093/consoleFull)** for PR 13036 at commit

[GitHub] spark issue #13036: [SPARK-15243][ML][SQL][PYSPARK] Param methods should use...

2016-10-17 Thread sethah
Github user sethah commented on the issue: https://github.com/apache/spark/pull/13036 ping @holdenk @viirya I think this is ready now :) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #15522: [MINOR][DOC] Add more built-in sources in sql-programmin...

2016-10-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15522 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #15522: [MINOR][DOC] Add more built-in sources in sql-pro...

2016-10-17 Thread weiqingy
GitHub user weiqingy opened a pull request: https://github.com/apache/spark/pull/15522 [MINOR][DOC] Add more built-in sources in sql-programming-guide.md ## What changes were proposed in this pull request? Add more built-in sources in sql-programming-guide.md. ## How

[GitHub] spark issue #15520: [SPARK-13747][SQL]Fix concurrent executions in ForkJoinP...

2016-10-17 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/15520 > Is it to avoid the blocking() call in Await? Yep. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #15520: [SPARK-13747][SQL]Fix concurrent executions in ForkJoinP...

2016-10-17 Thread jodersky
Github user jodersky commented on the issue: https://github.com/apache/spark/pull/15520 I'm not sure I completely understand why you have to use `Awaitable` instead of `Await`. Is it to avoid the [`blocking()` call in

[GitHub] spark issue #13775: [SPARK-16060][SQL] Vectorized Orc reader

2016-10-17 Thread tejasapatil
Github user tejasapatil commented on the issue: https://github.com/apache/spark/pull/13775 Earlier this year I had spent some time trying out Presto's ORC reader with Spark. In standalone benchmark, Presto's ORC reader is 3x faster than the one in Hive. My experimental

[GitHub] spark issue #15518: [SPARK-17974] Refactor FileCatalog classes to simplify t...

2016-10-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15518 **[Test build #67092 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67092/consoleFull)** for PR 15518 at commit

[GitHub] spark pull request #15518: [SPARK-17974] Refactor FileCatalog classes to sim...

2016-10-17 Thread ericl
Github user ericl commented on a diff in the pull request: https://github.com/apache/spark/pull/15518#discussion_r83747245 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetPartitionDiscoverySuite.scala --- @@ -626,8 +626,9 @@ class

[GitHub] spark pull request #15518: [SPARK-17974] Refactor FileCatalog classes to sim...

2016-10-17 Thread ericl
Github user ericl commented on a diff in the pull request: https://github.com/apache/spark/pull/15518#discussion_r83747236 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/FileCatalog.scala --- @@ -0,0 +1,66 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request #15518: [SPARK-17974] Refactor FileCatalog classes to sim...

2016-10-17 Thread ericl
Github user ericl commented on a diff in the pull request: https://github.com/apache/spark/pull/15518#discussion_r83747244 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/FileCatalog.scala --- @@ -0,0 +1,66 @@ +/* + * Licensed to the Apache

[GitHub] spark issue #15472: [SPARK-17731][SQL][STREAMING] Metrics for structured str...

2016-10-17 Thread tdas
Github user tdas commented on the issue: https://github.com/apache/spark/pull/15472 ^^ The test failure above seems to be unrelated. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #15519: [WIP][SQL][STREAMING][TEST] Fix flaky tests in Streaming...

2016-10-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15519 **[Test build #3359 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3359/consoleFull)** for PR 15519 at commit

[GitHub] spark issue #15471: [SPARK-17919] Make timeout to RBackend configurable in S...

2016-10-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15471 **[Test build #67091 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67091/consoleFull)** for PR 15471 at commit

[GitHub] spark issue #15471: [SPARK-17919] Make timeout to RBackend configurable in S...

2016-10-17 Thread shivaram
Github user shivaram commented on the issue: https://github.com/apache/spark/pull/15471 Jenkins, retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #15521: [SPARK-17980] [SQL] Fix refreshByPath for converted Hive...

2016-10-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15521 **[Test build #67090 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67090/consoleFull)** for PR 15521 at commit

[GitHub] spark issue #15471: [SPARK-17919] Make timeout to RBackend configurable in S...

2016-10-17 Thread falaki
Github user falaki commented on the issue: https://github.com/apache/spark/pull/15471 @shivaram I think they are unrelated. Can you trigger another test? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request #15521: [SPARK-17980] [SQL] Fix refreshByPath for convert...

2016-10-17 Thread ericl
GitHub user ericl opened a pull request: https://github.com/apache/spark/pull/15521 [SPARK-17980] [SQL] Fix refreshByPath for converted Hive tables ## What changes were proposed in this pull request? There was a bug introduced in https://github.com/apache/spark/pull/14690

[GitHub] spark pull request #15009: [SPARK-17443][SPARK-11035] Stop Spark Application...

2016-10-17 Thread kishorvpatil
Github user kishorvpatil commented on a diff in the pull request: https://github.com/apache/spark/pull/15009#discussion_r83744591 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala --- @@ -760,7 +787,7 @@ private[spark] class Client( .foreach { case

[GitHub] spark issue #15450: [SPARK-3261] [MLLIB] KMeans clusterer can return duplica...

2016-10-17 Thread sethah
Github user sethah commented on the issue: https://github.com/apache/spark/pull/15450 The cases you enumerated are the ones I was thinking of. The changes introduced here would alleviate those problems, I agree. What I'm wondering is if this problem still exists in other cases. If

[GitHub] spark pull request #15518: [SPARK-17974] Refactor FileCatalog classes to sim...

2016-10-17 Thread mallman
Github user mallman commented on a diff in the pull request: https://github.com/apache/spark/pull/15518#discussion_r83741391 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetPartitionDiscoverySuite.scala --- @@ -626,8 +626,9 @@ class

[GitHub] spark issue #15472: [SPARK-17731][SQL][STREAMING] Metrics for structured str...

2016-10-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15472 **[Test build #3357 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3357/consoleFull)** for PR 15472 at commit

[GitHub] spark issue #15519: [WIP][SQL][STREAMING][TEST] Fix flaky tests in Streaming...

2016-10-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15519 **[Test build #3358 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3358/consoleFull)** for PR 15519 at commit

[GitHub] spark issue #15519: [WIP][SQL][STREAMING][TEST] Fix flaky tests in Streaming...

2016-10-17 Thread tdas
Github user tdas commented on the issue: https://github.com/apache/spark/pull/15519 @lw-lin please take a look. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #15497: [Test][SPARK-16002][Follow-up] Fix flaky test in Streami...

2016-10-17 Thread tdas
Github user tdas commented on the issue: https://github.com/apache/spark/pull/15497 I opened a PR after modifying your branch #15519. Since you did the initial investigation, I will mark you as the author when I merge it. --- If your project is set up for it, you can reply to this

[GitHub] spark pull request #15518: [SPARK-17974] Refactor FileCatalog classes to sim...

2016-10-17 Thread mallman
Github user mallman commented on a diff in the pull request: https://github.com/apache/spark/pull/15518#discussion_r83738938 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/FileCatalog.scala --- @@ -0,0 +1,66 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request #15518: [SPARK-17974] Refactor FileCatalog classes to sim...

2016-10-17 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/15518#discussion_r83738846 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/FileCatalog.scala --- @@ -0,0 +1,66 @@ +/* + * Licensed to the Apache

[GitHub] spark issue #15495: [SPARK-17620][SQL] Determine Serde by hive.default.filef...

2016-10-17 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/15495 Thank you! Will do it soon. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #15518: [SPARK-17974] Refactor FileCatalog classes to simplify t...

2016-10-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15518 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67084/ Test PASSed. ---

[GitHub] spark issue #15518: [SPARK-17974] Refactor FileCatalog classes to simplify t...

2016-10-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15518 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15518: [SPARK-17974] Refactor FileCatalog classes to simplify t...

2016-10-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15518 **[Test build #67084 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67084/consoleFull)** for PR 15518 at commit

[GitHub] spark issue #15495: [SPARK-17620][SQL] Determine Serde by hive.default.filef...

2016-10-17 Thread yhuai
Github user yhuai commented on the issue: https://github.com/apache/spark/pull/15495 @gatorsmile If this pr fixes the problem related to the build, I am fine to merge it. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark issue #15376: [SPARK-17796][SQL] Support wildcard character in filenam...

2016-10-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15376 **[Test build #67089 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67089/consoleFull)** for PR 15376 at commit

[GitHub] spark issue #15376: [SPARK-17796][SQL] Support wildcard character in filenam...

2016-10-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15376 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15376: [SPARK-17796][SQL] Support wildcard character in filenam...

2016-10-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15376 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67083/ Test PASSed. ---

[GitHub] spark issue #15376: [SPARK-17796][SQL] Support wildcard character in filenam...

2016-10-17 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/15376 Retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #15376: [SPARK-17796][SQL] Support wildcard character in filenam...

2016-10-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15376 **[Test build #67083 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67083/consoleFull)** for PR 15376 at commit

[GitHub] spark pull request #15518: [SPARK-17974] Refactor FileCatalog classes to sim...

2016-10-17 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/15518#discussion_r83737706 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/FileCatalog.scala --- @@ -0,0 +1,66 @@ +/* + * Licensed to the Apache

[GitHub] spark issue #15421: [SPARK-17811] SparkR cannot parallelize data.frame with ...

2016-10-17 Thread wangmiao1981
Github user wangmiao1981 commented on the issue: https://github.com/apache/spark/pull/15421 @shivaram Thanks for your explanation! I can continue debugging this as you pointed and I can constantly reproduce the issue. For this PR, I think it is fine for handling the `NA` in the

[GitHub] spark issue #15490: [SPARK-10541] [Web UI] Allow ApplicationHistoryProviders...

2016-10-17 Thread ajbozarth
Github user ajbozarth commented on the issue: https://github.com/apache/spark/pull/15490 @steveloughran Since you opened the JIRA do you mind taking a look? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark issue #15472: [SPARK-17731][SQL][STREAMING] Metrics for structured str...

2016-10-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15472 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15472: [SPARK-17731][SQL][STREAMING] Metrics for structured str...

2016-10-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15472 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67086/ Test FAILed. ---

[GitHub] spark issue #15472: [SPARK-17731][SQL][STREAMING] Metrics for structured str...

2016-10-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15472 **[Test build #67086 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67086/consoleFull)** for PR 15472 at commit

[GitHub] spark issue #15492: [DO NOT MERGE][TEST] Testing flakiness of StreamingQuery...

2016-10-17 Thread tdas
Github user tdas commented on the issue: https://github.com/apache/spark/pull/15492 I am closing this. I opened a new PR for more testing of a fix - https://github.com/apache/spark/pull/15497 --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark issue #15520: [SPARK-13747][SQL]Fix concurrent executions in ForkJoinP...

2016-10-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15520 **[Test build #67088 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67088/consoleFull)** for PR 15520 at commit

[GitHub] spark issue #11105: [SPARK-12469][CORE] Data Property accumulators for Spark

2016-10-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/11105 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67068/ Test PASSed. ---

[GitHub] spark issue #15519: [SQL][STREAMING][TEST] Fix flaky tests in StreamingQuery...

2016-10-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15519 **[Test build #67087 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67087/consoleFull)** for PR 15519 at commit

[GitHub] spark pull request #15519: [SQL][STREAMING][TEST] Fix flaky tests in Streami...

2016-10-17 Thread tdas
GitHub user tdas opened a pull request: https://github.com/apache/spark/pull/15519 [SQL][STREAMING][TEST] Fix flaky tests in StreamingQueryListenerSuite This work has largely been done by @lw-lin in his PR #15497. This is a slightly refactoring of it. ## What changes were

[GitHub] spark pull request #15520: [SPARK-13747][SQL]Fix concurrent executions in Fo...

2016-10-17 Thread zsxwing
GitHub user zsxwing opened a pull request: https://github.com/apache/spark/pull/15520 [SPARK-13747][SQL]Fix concurrent executions in ForkJoinPool for SQL ## What changes were proposed in this pull request? Calling `Await.result` will allow other tasks to be run on the same

[GitHub] spark issue #11119: [SPARK-10780][ML] Add an initial model to kmeans

2016-10-17 Thread MLnick
Github user MLnick commented on the issue: https://github.com/apache/spark/pull/9 Good points. Perhaps a solution - while slightly "verbose", is to introduce another param `initialModelWriteMode` which governs what is saved - `full`, `params` or `none`. Full is obviously the

[GitHub] spark issue #11105: [SPARK-12469][CORE] Data Property accumulators for Spark

2016-10-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/11105 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67082/ Test FAILed. ---

[GitHub] spark issue #15514: [SPARK-17960][PySpark] [Upgrade to Py4J 0.10.4]

2016-10-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15514 **[Test build #3356 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3356/consoleFull)** for PR 15514 at commit

[GitHub] spark issue #11105: [SPARK-12469][CORE] Data Property accumulators for Spark

2016-10-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/11105 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #11105: [SPARK-12469][CORE] Data Property accumulators for Spark

2016-10-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/11105 **[Test build #67082 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67082/consoleFull)** for PR 11105 at commit

[GitHub] spark issue #15421: [SPARK-17811] SparkR cannot parallelize data.frame with ...

2016-10-17 Thread shivaram
Github user shivaram commented on the issue: https://github.com/apache/spark/pull/15421 Thanks @wangmiao1981 - There are two different kinds of serializations that happen in SparkR - one is the RPC style serialization where function arguments are serialized using `writeDate`,

[GitHub] spark issue #11105: [SPARK-12469][CORE] Data Property accumulators for Spark

2016-10-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/11105 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #11105: [SPARK-12469][CORE] Data Property accumulators for Spark

2016-10-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/11105 **[Test build #67068 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67068/consoleFull)** for PR 11105 at commit

[GitHub] spark issue #14847: [SPARK-17254][SQL] Add StopAfter physical plan for the f...

2016-10-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14847 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14847: [SPARK-17254][SQL] Add StopAfter physical plan for the f...

2016-10-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14847 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67073/ Test PASSed. ---

[GitHub] spark issue #11105: [SPARK-12469][CORE] Data Property accumulators for Spark

2016-10-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/11105 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #11105: [SPARK-12469][CORE] Data Property accumulators for Spark

2016-10-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/11105 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67069/ Test PASSed. ---

[GitHub] spark issue #14847: [SPARK-17254][SQL] Add StopAfter physical plan for the f...

2016-10-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14847 **[Test build #67073 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67073/consoleFull)** for PR 14847 at commit

[GitHub] spark issue #14650: [SPARK-17062][MESOS] add conf option to mesos dispatcher

2016-10-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14650 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14650: [SPARK-17062][MESOS] add conf option to mesos dispatcher

2016-10-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14650 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67066/ Test PASSed. ---

[GitHub] spark issue #11105: [SPARK-12469][CORE] Data Property accumulators for Spark

2016-10-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/11105 **[Test build #67069 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67069/consoleFull)** for PR 11105 at commit

[GitHub] spark issue #14650: [SPARK-17062][MESOS] add conf option to mesos dispatcher

2016-10-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14650 **[Test build #67066 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67066/consoleFull)** for PR 14650 at commit

[GitHub] spark issue #15410: [SPARK-17843][Web UI] Indicate event logs pending for pr...

2016-10-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15410 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15410: [SPARK-17843][Web UI] Indicate event logs pending for pr...

2016-10-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15410 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67070/ Test PASSed. ---

[GitHub] spark issue #15410: [SPARK-17843][Web UI] Indicate event logs pending for pr...

2016-10-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15410 **[Test build #67070 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67070/consoleFull)** for PR 15410 at commit

[GitHub] spark issue #15471: [SPARK-17919] Make timeout to RBackend configurable in S...

2016-10-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15471 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15471: [SPARK-17919] Make timeout to RBackend configurable in S...

2016-10-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15471 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67079/ Test FAILed. ---

[GitHub] spark issue #15471: [SPARK-17919] Make timeout to RBackend configurable in S...

2016-10-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15471 **[Test build #67079 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67079/consoleFull)** for PR 15471 at commit

[GitHub] spark issue #15497: [Test][SPARK-16002][Follow-up] Fix flaky test in Streami...

2016-10-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15497 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15497: [Test][SPARK-16002][Follow-up] Fix flaky test in Streami...

2016-10-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15497 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67074/ Test FAILed. ---

[GitHub] spark issue #15512: [SPARK-17930][CORE]The SerializerInstance instance used ...

2016-10-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15512 **[Test build #67065 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67065/consoleFull)** for PR 15512 at commit

[GitHub] spark issue #15302: [SPARK-17732][SQL] ALTER TABLE DROP PARTITION should sup...

2016-10-17 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/15302 With today's master, it's like the following. Should we use expression in `AlterTableDropPartitionCommand`? ```scala org.apache.spark.sql.AnalysisException: cannot resolve '`country`'

[GitHub] spark issue #15497: [Test][SPARK-16002][Follow-up] Fix flaky test in Streami...

2016-10-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15497 **[Test build #67074 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67074/consoleFull)** for PR 15497 at commit

[GitHub] spark issue #15481: [SPARK-17929] [CORE] Fix deadlock when CoarseGrainedSche...

2016-10-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15481 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15481: [SPARK-17929] [CORE] Fix deadlock when CoarseGrainedSche...

2016-10-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15481 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67067/ Test FAILed. ---

[GitHub] spark issue #15512: [SPARK-17930][CORE]The SerializerInstance instance used ...

2016-10-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15512 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15512: [SPARK-17930][CORE]The SerializerInstance instance used ...

2016-10-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15512 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67065/ Test FAILed. ---

<    1   2   3   4   5   6   >