[GitHub] spark issue #16307: [MINOR][BUILD] Fix lint-check failures and javadoc8 brea...

2016-12-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16307 **[Test build #70241 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70241/testReport)** for PR 16307 at commit

[GitHub] spark pull request #16307: [MINOR][BUILD] Fix lint-check failures and javado...

2016-12-15 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/16307#discussion_r92765013 --- Diff: common/unsafe/src/main/java/org/apache/spark/unsafe/types/CalendarInterval.java --- @@ -252,7 +252,7 @@ public static long

[GitHub] spark pull request #16307: [MINOR][BUILD] Fix lint-check failures and javado...

2016-12-15 Thread HyukjinKwon
GitHub user HyukjinKwon opened a pull request: https://github.com/apache/spark/pull/16307 [MINOR][BUILD] Fix lint-check failures and javadoc8 break ## What changes were proposed in this pull request? This PR proposes to fix lint-check failures and javadoc8 break.

[GitHub] spark issue #16271: [SPARK-18845][GraphX] PageRank has incorrect initializat...

2016-12-15 Thread ankurdave
Github user ankurdave commented on the issue: https://github.com/apache/spark/pull/16271 Merged into master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #16304: [SPARK-18894][SS] Disallow went time watermark delay thr...

2016-12-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16304 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16304: [SPARK-18894][SS] Disallow went time watermark delay thr...

2016-12-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16304 **[Test build #70233 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70233/testReport)** for PR 16304 at commit

[GitHub] spark issue #16304: [SPARK-18894][SS] Disallow went time watermark delay thr...

2016-12-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16304 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70233/ Test FAILed. ---

[GitHub] spark pull request #16271: [SPARK-18845][GraphX] PageRank has incorrect init...

2016-12-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16271 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #16306: Branch 2.1

2016-12-15 Thread qhhan
Github user qhhan closed the pull request at: https://github.com/apache/spark/pull/16306 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #16306: Branch 2.1

2016-12-15 Thread qhhan
GitHub user qhhan opened a pull request: https://github.com/apache/spark/pull/16306 Branch 2.1 ## What changes were proposed in this pull request? (Please fill in changes proposed in this fix) ## How was this patch tested? (Please explain how this patch

[GitHub] spark issue #16271: [SPARK-18845][GraphX] PageRank has incorrect initializat...

2016-12-15 Thread ankurdave
Github user ankurdave commented on the issue: https://github.com/apache/spark/pull/16271 Thanks @aray for the explanation. I agree with @srowen - this looks reasonable to me. I'm going to merge it. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark issue #16305: [SPARK-18895][TESTS] Fix resource-closing-related and pa...

2016-12-15 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/16305 cc @srowen, Could you please take a look? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #16282: [DO_NOT_MERGE]Try to fix kafka

2016-12-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16282 **[Test build #70240 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70240/testReport)** for PR 16282 at commit

[GitHub] spark pull request #16305: [SPARK-18895][TESTS] Fix resource-closing-related...

2016-12-15 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/16305#discussion_r92762998 --- Diff: core/src/main/scala/org/apache/spark/deploy/RPackageUtils.scala --- @@ -231,8 +236,10 @@ private[deploy] object RPackageUtils extends Logging

[GitHub] spark issue #16305: [SPARK-18895][TESTS] Fix resource-closing-related and pa...

2016-12-15 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/16305 Build started: [TESTS] `org.apache.spark.scheduler.EventLoggingListenerSuite`

[GitHub] spark issue #16305: [SPARK-18895][TESTS] Fix resource-closing-related and pa...

2016-12-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16305 **[Test build #70238 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70238/testReport)** for PR 16305 at commit

[GitHub] spark issue #16261: [SPARK-18836] [CORE] Serialize one copy of task metrics ...

2016-12-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16261 **[Test build #70239 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70239/testReport)** for PR 16261 at commit

[GitHub] spark issue #16261: [SPARK-18836] [CORE] Serialize one copy of task metrics ...

2016-12-15 Thread shivaram
Github user shivaram commented on the issue: https://github.com/apache/spark/pull/16261 Jenkins, retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #16305: [SPARK-18895][TESTS] Fix resource-closing-related...

2016-12-15 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/16305#discussion_r92761800 --- Diff: core/src/main/scala/org/apache/spark/deploy/RPackageUtils.scala --- @@ -231,8 +236,10 @@ private[deploy] object RPackageUtils extends Logging

[GitHub] spark pull request #16261: [SPARK-18836] [CORE] Serialize one copy of task m...

2016-12-15 Thread shivaram
Github user shivaram commented on a diff in the pull request: https://github.com/apache/spark/pull/16261#discussion_r92761816 --- Diff: core/src/main/scala/org/apache/spark/scheduler/Task.scala --- @@ -58,13 +60,17 @@ private[spark] abstract class Task[T]( val stageId:

[GitHub] spark pull request #16305: [SPARK-18895][TESTS] Fix resource-closing-related...

2016-12-15 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/16305#discussion_r92761717 --- Diff: core/src/main/scala/org/apache/spark/deploy/RPackageUtils.scala --- @@ -176,26 +176,31 @@ private[deploy] object RPackageUtils extends Logging

[GitHub] spark pull request #16305: [SPARK-18895][TESTS] Fix resource-closing-related...

2016-12-15 Thread HyukjinKwon
GitHub user HyukjinKwon opened a pull request: https://github.com/apache/spark/pull/16305 [SPARK-18895][TESTS] Fix resource-closing-related and path-related test failures in identified ones on Windows ## What changes were proposed in this pull request? There are several

[GitHub] spark issue #16261: [SPARK-18836] [CORE] Serialize one copy of task metrics ...

2016-12-15 Thread shivaram
Github user shivaram commented on the issue: https://github.com/apache/spark/pull/16261 With the help of @kayousterhout I ran a scheduling microbenchmark (Code [1]) with 1 tasks per stage on 20 m2.4xlarge machines on EC2 (160 cores). From 10 trials, I measured the average time

[GitHub] spark pull request #16290: [SPARK-18817] [SPARKR] [SQL] Set default warehous...

2016-12-15 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16290#discussion_r92761572 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala --- @@ -964,11 +970,17 @@ object StaticSQLConf { } }

[GitHub] spark issue #16233: [SPARK-18801][SQL] Add `View` operator to help resolve a...

2016-12-15 Thread jiangxb1987
Github user jiangxb1987 commented on the issue: https://github.com/apache/spark/pull/16233 cc @yhuai @cloud-fan Please have a look at this when you have time. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark issue #16135: [SPARK-18700][SQL] Add StripedLock for each table's rela...

2016-12-15 Thread xuanyuanking
Github user xuanyuanking commented on the issue: https://github.com/apache/spark/pull/16135 cc @rxin thanks for check. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #15211: [SPARK-14709][ML] spark.ml API for linear SVM

2016-12-15 Thread hhbyyh
Github user hhbyyh commented on the issue: https://github.com/apache/spark/pull/15211 Remove WIP. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark pull request #16294: [SPARK-18669][SS][DOCS] Update Apache docs for St...

2016-12-15 Thread wangmiao1981
Github user wangmiao1981 commented on a diff in the pull request: https://github.com/apache/spark/pull/16294#discussion_r92757455 --- Diff: docs/structured-streaming-programming-guide.md --- @@ -671,12 +678,114 @@ windowedCounts = words.groupBy( +### Handling

[GitHub] spark issue #14868: [SPARK-16283][SQL] Implements percentile_approx aggregat...

2016-12-15 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/14868 Although the function returns the approximate percentile, the result is still deterministic. Is my understanding right? --- If your project is set up for it, you can reply to this email and

[GitHub] spark pull request #16304: [SPARK-18894][SS] Disallow went time watermark de...

2016-12-15 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/16304#discussion_r92756861 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala --- @@ -572,6 +572,10 @@ class Dataset[T] private[sql]( val parsedDelay =

[GitHub] spark pull request #16300: [SPARK-18892][SQL] Alias percentile_approx approx...

2016-12-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16300 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #16300: [SPARK-18892][SQL] Alias percentile_approx approx_percen...

2016-12-15 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/16300 Merging in master/branch-2.1. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #16300: [SPARK-18892][SQL] Alias percentile_approx approx_percen...

2016-12-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16300 **[Test build #70237 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70237/testReport)** for PR 16300 at commit

[GitHub] spark issue #16300: [SPARK-18892][SQL] Alias percentile_approx approx_percen...

2016-12-15 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16300 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #16300: [SPARK-18892][SQL] Alias percentile_approx approx_percen...

2016-12-15 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/16300 updated. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #16300: [SPARK-18892][SQL] Alias percentile_approx approx_percen...

2016-12-15 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/16300 hm weird that we hard coded the name. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16290: [SPARK-18817] [SPARKR] [SQL] Set default warehouse dir t...

2016-12-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16290 **[Test build #70236 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70236/testReport)** for PR 16290 at commit

[GitHub] spark issue #16300: [SPARK-18892][SQL] Alias percentile_approx approx_percen...

2016-12-15 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16300 Could we also update [another two more

[GitHub] spark issue #16249: [SPARK-18828][SPARKR] Refactor scripts for R

2016-12-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16249 **[Test build #70235 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70235/testReport)** for PR 16249 at commit

[GitHub] spark issue #16249: [SPARK-18828][SPARKR] Refactor scripts for R

2016-12-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16249 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16249: [SPARK-18828][SPARKR] Refactor scripts for R

2016-12-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16249 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70235/ Test FAILed. ---

[GitHub] spark issue #16282: [DO_NOT_MERGE]Try to fix kafka

2016-12-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16282 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16282: [DO_NOT_MERGE]Try to fix kafka

2016-12-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16282 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70229/ Test FAILed. ---

[GitHub] spark issue #16282: [DO_NOT_MERGE]Try to fix kafka

2016-12-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16282 **[Test build #70229 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70229/testReport)** for PR 16282 at commit

[GitHub] spark issue #16291: [SPARK-18838][WIP] Use separate executor service for eac...

2016-12-15 Thread sitalkedia
Github user sitalkedia commented on the issue: https://github.com/apache/spark/pull/16291 @vanzin - Thanks for taking a look and sorry about putting my unfinished sloppy code out there. I updated the bug and the PR with the overall design idea, which hopefully will answer your

[GitHub] spark issue #16301: [SPARK-18849][ML][SPARKR][DOC] vignettes final check reo...

2016-12-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16301 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16301: [SPARK-18849][ML][SPARKR][DOC] vignettes final check reo...

2016-12-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16301 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70234/ Test PASSed. ---

[GitHub] spark issue #16301: [SPARK-18849][ML][SPARKR][DOC] vignettes final check reo...

2016-12-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16301 **[Test build #70234 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70234/testReport)** for PR 16301 at commit

[GitHub] spark issue #16300: [SPARK-18892][SQL] Alias percentile_approx approx_percen...

2016-12-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16300 **[Test build #3502 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3502/testReport)** for PR 16300 at commit

[GitHub] spark pull request #16304: [SPARK-18894][SS] Disallow went time watermark de...

2016-12-15 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/16304#discussion_r92754420 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala --- @@ -572,6 +572,10 @@ class Dataset[T] private[sql]( val parsedDelay =

[GitHub] spark issue #16249: [SPARK-18828][SPARKR] Refactor scripts for R

2016-12-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16249 Build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #16249: [SPARK-18828][SPARKR] Refactor scripts for R

2016-12-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16249 **[Test build #70226 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70226/consoleFull)** for PR 16249 at commit

[GitHub] spark issue #16249: [SPARK-18828][SPARKR] Refactor scripts for R

2016-12-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16249 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70226/ Test FAILed. ---

[GitHub] spark pull request #16304: [SPARK-18894][SS] Disallow went time watermark de...

2016-12-15 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/16304#discussion_r92753969 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala --- @@ -572,6 +572,10 @@ class Dataset[T] private[sql]( val parsedDelay =

[GitHub] spark pull request #16304: [SPARK-18894][SS] Disallow went time watermark de...

2016-12-15 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/16304#discussion_r92753590 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala --- @@ -572,6 +572,10 @@ class Dataset[T] private[sql]( val parsedDelay =

[GitHub] spark issue #16249: [SPARK-18828][SPARKR] Refactor scripts for R

2016-12-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16249 **[Test build #70235 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70235/testReport)** for PR 16249 at commit

[GitHub] spark issue #16304: [SPARK-18894][SS] Disallow went time watermark delay thr...

2016-12-15 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/16304 event time? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #16301: [SPARK-18849][ML][SPARKR][DOC] vignettes final check reo...

2016-12-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16301 **[Test build #70234 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70234/testReport)** for PR 16301 at commit

[GitHub] spark issue #16303: [SPARK-17807][core] Demote scalatest to "provided" in sp...

2016-12-15 Thread ryan-williams
Github user ryan-williams commented on the issue: https://github.com/apache/spark/pull/16303 I appreciate the quick turn-around on this, though it seems like a mis-use of the `provided` scope. FWIW, I am advocating for: - `mv

[GitHub] spark issue #16142: [SPARK-18716][CORE] Restrict the disk usage of spark eve...

2016-12-15 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/16142 > I just add a new clean-up mode, but not add the cleaner itself. But that's kinda the point. How many different ways of cleaning need to be added? Will this one be enough? Will people ask

[GitHub] spark issue #16281: [SPARK-13127][SQL] Update Parquet to 1.9.0

2016-12-15 Thread rdblue
Github user rdblue commented on the issue: https://github.com/apache/spark/pull/16281 The improvement is in how row groups are garbage collected. G1GC puts humongous allocations directly into the old generation, so you end up needing a full GC to reclaim the space. That just

[GitHub] spark issue #15211: [SPARK-14709][ML] [WIP] spark.ml API for linear SVM

2016-12-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15211 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15211: [SPARK-14709][ML] [WIP] spark.ml API for linear SVM

2016-12-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15211 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70232/ Test PASSed. ---

[GitHub] spark issue #15211: [SPARK-14709][ML] [WIP] spark.ml API for linear SVM

2016-12-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15211 **[Test build #70232 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70232/testReport)** for PR 15211 at commit

[GitHub] spark issue #16303: [SPARK-17807][core] Demote scalatest to "provided" in sp...

2016-12-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16303 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70228/ Test PASSed. ---

[GitHub] spark issue #16303: [SPARK-17807][core] Demote scalatest to "provided" in sp...

2016-12-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16303 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16303: [SPARK-17807][core] Demote scalatest to "provided" in sp...

2016-12-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16303 **[Test build #70228 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70228/testReport)** for PR 16303 at commit

[GitHub] spark issue #16173: [SPARK-18742][CORE]readd spark.broadcast.factory conf to...

2016-12-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16173 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16173: [SPARK-18742][CORE]readd spark.broadcast.factory conf to...

2016-12-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16173 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70227/ Test PASSed. ---

[GitHub] spark issue #16282: [DO_NOT_MERGE]Try to fix kafka

2016-12-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16282 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16282: [DO_NOT_MERGE]Try to fix kafka

2016-12-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16282 **[Test build #70219 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70219/testReport)** for PR 16282 at commit

[GitHub] spark issue #16282: [DO_NOT_MERGE]Try to fix kafka

2016-12-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16282 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70219/ Test FAILed. ---

[GitHub] spark issue #16173: [SPARK-18742][CORE]readd spark.broadcast.factory conf to...

2016-12-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16173 **[Test build #70227 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70227/testReport)** for PR 16173 at commit

[GitHub] spark issue #16232: [SPARK-18800][SQL] Fix UnsafeKVExternalSorter by correct...

2016-12-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16232 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70230/ Test PASSed. ---

[GitHub] spark issue #16232: [SPARK-18800][SQL] Fix UnsafeKVExternalSorter by correct...

2016-12-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16232 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16232: [SPARK-18800][SQL] Fix UnsafeKVExternalSorter by correct...

2016-12-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16232 **[Test build #70230 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70230/testReport)** for PR 16232 at commit

[GitHub] spark issue #16281: [SPARK-13127][SQL] Update Parquet to 1.9.0

2016-12-15 Thread kiszk
Github user kiszk commented on the issue: https://github.com/apache/spark/pull/16281 @rdblue Interesting, do you have any estimated or actual data for performance improvement? I am interested in how you can achieve performance improvement over `byte[]`. - Usage of

[GitHub] spark issue #15109: [SPARK-17501][CORE] Record executor heartbeat timestamp ...

2016-12-15 Thread cenyuhai
Github user cenyuhai commented on the issue: https://github.com/apache/spark/pull/15109 Ok, I will close this PR. This is not a big problem --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request #15109: [SPARK-17501][CORE] Record executor heartbeat tim...

2016-12-15 Thread cenyuhai
Github user cenyuhai closed the pull request at: https://github.com/apache/spark/pull/15109 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #16304: [SPARK-18894][SS] Disallow went time watermark delay thr...

2016-12-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16304 **[Test build #70233 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70233/testReport)** for PR 16304 at commit

[GitHub] spark pull request #16304: [SPARK-18894][SS] Disallow went time watermark de...

2016-12-15 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/16304#discussion_r92746039 --- Diff: common/unsafe/src/main/java/org/apache/spark/unsafe/types/CalendarInterval.java --- @@ -252,6 +252,9 @@ public static long parseSecondNano(String

[GitHub] spark pull request #16304: [SPARK-18894][SS] Follow-up bug fix

2016-12-15 Thread tdas
GitHub user tdas opened a pull request: https://github.com/apache/spark/pull/16304 [SPARK-18894][SS] Follow-up bug fix ## What changes were proposed in this pull request? Two changes - Disallow went time watermark delay threshold be specified in months or years -

[GitHub] spark issue #15211: [SPARK-14709][ML] [WIP] spark.ml API for linear SVM

2016-12-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15211 **[Test build #70232 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70232/testReport)** for PR 15211 at commit

[GitHub] spark issue #16300: [SPARK-18892][SQL] Alias percentile_approx approx_percen...

2016-12-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16300 **[Test build #3502 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3502/testReport)** for PR 16300 at commit

[GitHub] spark issue #16285: [SPARK-18867] [SQL] Throw cause if IsolatedClientLoad ca...

2016-12-15 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/16285 Thanks for looking into it. In that case, maybe we should just keep the thing as is and don't change it? --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] spark issue #16253: [SPARK-18537][Web UI] Add a REST api to serve spark stre...

2016-12-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16253 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70231/ Test FAILed. ---

[GitHub] spark issue #16253: [SPARK-18537][Web UI] Add a REST api to serve spark stre...

2016-12-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16253 **[Test build #70231 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70231/testReport)** for PR 16253 at commit

[GitHub] spark issue #16253: [SPARK-18537][Web UI] Add a REST api to serve spark stre...

2016-12-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16253 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16300: [SPARK-18892][SQL] Alias percentile_approx approx_percen...

2016-12-15 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/16300 cc @cloud-fan --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark issue #16299: [MINOR] Only rename SparkR tar.gz if names mismatch

2016-12-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16299 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16299: [MINOR] Only rename SparkR tar.gz if names mismatch

2016-12-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16299 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70222/ Test PASSed. ---

[GitHub] spark issue #16299: [MINOR] Only rename SparkR tar.gz if names mismatch

2016-12-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16299 **[Test build #70222 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70222/testReport)** for PR 16299 at commit

[GitHub] spark issue #16300: [SPARK-18892][SQL] Alias percentile_approx approx_percen...

2016-12-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16300 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16300: [SPARK-18892][SQL] Alias percentile_approx approx_percen...

2016-12-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16300 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70223/ Test FAILed. ---

[GitHub] spark issue #16300: [SPARK-18892][SQL] Alias percentile_approx approx_percen...

2016-12-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16300 **[Test build #70223 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70223/testReport)** for PR 16300 at commit

[GitHub] spark issue #16299: [MINOR] Only rename SparkR tar.gz if names mismatch

2016-12-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16299 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70220/ Test PASSed. ---

[GitHub] spark issue #16299: [MINOR] Only rename SparkR tar.gz if names mismatch

2016-12-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16299 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16299: [MINOR] Only rename SparkR tar.gz if names mismatch

2016-12-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16299 **[Test build #70220 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70220/testReport)** for PR 16299 at commit

[GitHub] spark issue #16253: [SPARK-18537][Web UI] Add a REST api to serve spark stre...

2016-12-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16253 **[Test build #70231 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70231/testReport)** for PR 16253 at commit

[GitHub] spark issue #16272: [SPARK-18850][SS]Make StreamExecution and progress class...

2016-12-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16272 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70221/ Test PASSed. ---

  1   2   3   4   5   >