[GitHub] spark issue #16272: [SPARK-18850][SS]Make StreamExecution serializable

2016-12-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16272 **[Test build #70107 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70107/consoleFull)** for PR 16272 at commit

[GitHub] spark issue #16270: [SPARK-18846][Scheduler] Fix flakiness in SchedulerInteg...

2016-12-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16270 **[Test build #70108 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70108/consoleFull)** for PR 16270 at commit

[GitHub] spark pull request #14079: [SPARK-8425][CORE] Application Level Blacklisting

2016-12-13 Thread kayousterhout
Github user kayousterhout commented on a diff in the pull request: https://github.com/apache/spark/pull/14079#discussion_r92286111 --- Diff: core/src/test/scala/org/apache/spark/scheduler/TaskSchedulerImplSuite.scala --- @@ -455,15 +458,10 @@ class TaskSchedulerImplSuite extends

[GitHub] spark pull request #16232: [SPARK-18800][SQL] Fix UnsafeKVExternalSorter by ...

2016-12-13 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/16232#discussion_r92289268 --- Diff: sql/core/src/main/java/org/apache/spark/sql/execution/UnsafeKVExternalSorter.java --- @@ -96,13 +98,35 @@ public UnsafeKVExternalSorter(

[GitHub] spark pull request #16232: [SPARK-18800][SQL] Fix UnsafeKVExternalSorter by ...

2016-12-13 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/16232#discussion_r92289384 --- Diff: sql/core/src/main/java/org/apache/spark/sql/execution/UnsafeKVExternalSorter.java --- @@ -96,13 +98,35 @@ public UnsafeKVExternalSorter(

[GitHub] spark pull request #16247: [SPARK-18817][SparkR] set default spark-warehouse...

2016-12-13 Thread bdwyer2
Github user bdwyer2 commented on a diff in the pull request: https://github.com/apache/spark/pull/16247#discussion_r92289217 --- Diff: R/pkg/R/sparkR.R --- @@ -362,6 +362,10 @@ sparkR.session <- function( enableHiveSupport = TRUE, ...) { + if

[GitHub] spark issue #16270: [SPARK-18846][Scheduler] Fix flakiness in SchedulerInteg...

2016-12-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16270 **[Test build #70099 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70099/consoleFull)** for PR 16270 at commit

[GitHub] spark issue #16270: [SPARK-18846][Scheduler] Fix flakiness in SchedulerInteg...

2016-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16270 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16270: [SPARK-18846][Scheduler] Fix flakiness in SchedulerInteg...

2016-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16270 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70104/ Test FAILed. ---

[GitHub] spark issue #16266: [WIP][SPARK-18842][TESTS][LAUNCHER] De-duplicate paths i...

2016-12-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16266 **[Test build #70111 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70111/consoleFull)** for PR 16266 at commit

[GitHub] spark pull request #16272: [SPARK-18850][SS]Make StreamExecution serializabl...

2016-12-13 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/16272#discussion_r92279982 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/streaming/progress.scala --- @@ -38,7 +38,7 @@ import

[GitHub] spark issue #16270: [SPARK-18846][Scheduler] Fix flakiness in SchedulerInteg...

2016-12-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16270 **[Test build #70104 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70104/consoleFull)** for PR 16270 at commit

[GitHub] spark issue #16271: [SPARK-18845][GraphX] PageRank has incorrect initializat...

2016-12-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16271 **[Test build #70100 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70100/consoleFull)** for PR 16271 at commit

[GitHub] spark issue #16158: [SPARK-18724][ML] Add TuningSummary for TrainValidationS...

2016-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16158 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16273: [SPARK-18852][SS]StreamingQuery.lastProgress should be n...

2016-12-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16273 **[Test build #70106 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70106/consoleFull)** for PR 16273 at commit

[GitHub] spark pull request #16246: [SPARK-18814][SQL] CheckAnalysis rejects TPCDS qu...

2016-12-13 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/16246#discussion_r92286561 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/CheckAnalysis.scala --- @@ -136,24 +142,36 @@ trait CheckAnalysis extends

[GitHub] spark issue #16189: [SPARK-18761][CORE] Introduce "task reaper" to oversee t...

2016-12-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16189 **[Test build #70096 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70096/consoleFull)** for PR 16189 at commit

[GitHub] spark issue #16189: [SPARK-18761][CORE] Introduce "task reaper" to oversee t...

2016-12-13 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/16189 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #15018: [SPARK-17455][MLlib] Improve PAVA implementation in Isot...

2016-12-13 Thread jkbradley
Github user jkbradley commented on the issue: https://github.com/apache/spark/pull/15018 Thanks for pinging about this---it looks important! One request: Do you know if there is a resource with a clearer statement of this precise algorithm for the L2 norm? That'd be nice to

[GitHub] spark issue #16270: [SPARK-18846][Scheduler] Fix flakiness in SchedulerInteg...

2016-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16270 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70098/ Test PASSed. ---

[GitHub] spark issue #16270: [SPARK-18846][Scheduler] Fix flakiness in SchedulerInteg...

2016-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16270 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16270: [SPARK-18846][Scheduler] Fix flakiness in SchedulerInteg...

2016-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16270 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16270: [SPARK-18846][Scheduler] Fix flakiness in SchedulerInteg...

2016-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16270 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70099/ Test PASSed. ---

[GitHub] spark issue #16149: [SPARK-18715][ML]Fix AIC calculations in Binomial GLM

2016-12-13 Thread actuaryzhang
Github user actuaryzhang commented on the issue: https://github.com/apache/spark/pull/16149 @srowen @sethah Thanks for all the helpful discussions! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark issue #16158: [SPARK-18724][ML] Add TuningSummary for TrainValidationS...

2016-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16158 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70097/ Test PASSed. ---

[GitHub] spark issue #16195: [Spark-18765] [CORE] Make values for spark.yarn.{am|driv...

2016-12-13 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/16195 @daisukebe can you close the PR please? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #16270: [SPARK-18846][Scheduler] Fix flakiness in Schedul...

2016-12-13 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/16270#discussion_r92284372 --- Diff: core/src/test/scala/org/apache/spark/scheduler/SchedulerIntegrationSuite.scala --- @@ -27,6 +27,8 @@ import scala.language.existentials

[GitHub] spark pull request #16195: [Spark-18765] [CORE] Make values for spark.yarn.{...

2016-12-13 Thread daisukebe
Github user daisukebe closed the pull request at: https://github.com/apache/spark/pull/16195 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #16255: [SPARK-18609][SQL]Fix when CTE with Join between ...

2016-12-13 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/16255#discussion_r92293834 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala --- @@ -416,8 +418,8 @@ object ColumnPruning extends

[GitHub] spark pull request #15018: [SPARK-17455][MLlib] Improve PAVA implementation ...

2016-12-13 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/15018#discussion_r92298204 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/regression/IsotonicRegression.scala --- @@ -344,27 +344,30 @@ class IsotonicRegression private

[GitHub] spark issue #14079: [SPARK-8425][CORE] Application Level Blacklisting

2016-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14079 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14079: [SPARK-8425][CORE] Application Level Blacklisting

2016-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14079 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70122/ Test PASSed. ---

[GitHub] spark issue #16274: [SPARK-18853][SQL] Project (UnaryNode) is way too aggres...

2016-12-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16274 **[Test build #70123 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70123/consoleFull)** for PR 16274 at commit

[GitHub] spark issue #16274: [SPARK-18853][SQL] Project (UnaryNode) is way too aggres...

2016-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16274 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16274: [SPARK-18853][SQL] Project (UnaryNode) is way too aggres...

2016-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16274 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70123/ Test PASSed. ---

[GitHub] spark issue #16030: [SPARK-18108][SQL] Fix a bug to fail partition schema in...

2016-12-13 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/16030 okay, I'll try to fix in that way, thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14079: [SPARK-8425][CORE] Application Level Blacklisting

2016-12-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14079 **[Test build #70122 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70122/consoleFull)** for PR 14079 at commit

[GitHub] spark issue #16277: [SPARK-18854][SQL] numberedTreeString and apply(i) incon...

2016-12-13 Thread yhuai
Github user yhuai commented on the issue: https://github.com/apache/spark/pull/16277 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark pull request #13909: [SPARK-16213][SQL] Reduce runtime overhead of a p...

2016-12-13 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/13909#discussion_r92335449 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/complexTypeCreator.scala --- @@ -56,33 +58,93 @@ case class

[GitHub] spark pull request #16263: [SPARK-18281][SQL][PySpark] Consumes the returned...

2016-12-13 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/16263#discussion_r92337930 --- Diff: python/pyspark/sql/dataframe.py --- @@ -400,10 +402,19 @@ def toLocalIterator(self): >>> list(df.toLocalIterator())

[GitHub] spark issue #16194: [SPARK-18767][ML] Unify Models' toString methods

2016-12-13 Thread zhengruifeng
Github user zhengruifeng commented on the issue: https://github.com/apache/spark/pull/16194 Good point. This make me think of the usage of `instr.logParams(params: _*)` in training instrumentation [https://github.com/apache/spark/pull/15671]. IMIO, params are copied from its

[GitHub] spark pull request #16277: [SPARK-18854][SQL] numberedTreeString and apply(i...

2016-12-13 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/16277#discussion_r92331760 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/trees/TreeNode.scala --- @@ -557,9 +562,10 @@ abstract class TreeNode[BaseType <:

[GitHub] spark issue #16277: [SPARK-18854][SQL] numberedTreeString and apply(i) incon...

2016-12-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16277 **[Test build #70125 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70125/consoleFull)** for PR 16277 at commit

[GitHub] spark pull request #16263: [SPARK-18281][SQL][PySpark] Consumes the returned...

2016-12-13 Thread holdenk
Github user holdenk commented on a diff in the pull request: https://github.com/apache/spark/pull/16263#discussion_r92332668 --- Diff: python/pyspark/sql/dataframe.py --- @@ -400,10 +402,19 @@ def toLocalIterator(self): >>> list(df.toLocalIterator())

[GitHub] spark issue #16266: [SPARK-18842][TESTS][LAUNCHER] De-duplicate paths in cla...

2016-12-13 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/16266 @srowen, I think it is ready for a second look. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark issue #16030: [SPARK-18108][SQL] Fix a bug to fail partition schema in...

2016-12-13 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/16030 After an offline discussion with @liancheng , here is the result: **Why does the test fail?** 1. We write a parquet file with schema `[a: long, b: int]` to path `/data/a=1`. 2.

[GitHub] spark issue #16266: [WIP][SPARK-18842][TESTS][LAUNCHER] De-duplicate paths i...

2016-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16266 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70121/ Test PASSed. ---

[GitHub] spark issue #16266: [WIP][SPARK-18842][TESTS][LAUNCHER] De-duplicate paths i...

2016-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16266 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #16277: [SPARK-18854][SQL] numberedTreeString and apply(i...

2016-12-13 Thread rxin
GitHub user rxin opened a pull request: https://github.com/apache/spark/pull/16277 [SPARK-18854][SQL] numberedTreeString and apply(i) inconsistent for subqueries ## What changes were proposed in this pull request? This is a bug introduced by subquery handling.

[GitHub] spark pull request #15018: [SPARK-17455][MLlib] Improve PAVA implementation ...

2016-12-13 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/15018#discussion_r92331409 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/regression/IsotonicRegression.scala --- @@ -344,27 +344,30 @@ class IsotonicRegression private

[GitHub] spark pull request #16277: [SPARK-18854][SQL] numberedTreeString and apply(i...

2016-12-13 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/16277#discussion_r92331508 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/trees/TreeNode.scala --- @@ -534,19 +539,16 @@ abstract class TreeNode[BaseType <:

[GitHub] spark issue #16277: [SPARK-18854][SQL] numberedTreeString and apply(i) incon...

2016-12-13 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/16277 cc @yhuai @liancheng @davies --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #16119: [SPARK-18687][Pyspark][SQL]Backward compatibility...

2016-12-13 Thread vijoshi
Github user vijoshi commented on a diff in the pull request: https://github.com/apache/spark/pull/16119#discussion_r92333556 --- Diff: python/pyspark/sql/context.py --- @@ -72,8 +72,13 @@ def __init__(self, sparkContext, sparkSession=None, jsqlContext=None): self._sc

[GitHub] spark issue #16142: [SPARK-18716][CORE] Restrict the disk usage of spark eve...

2016-12-13 Thread uncleGen
Github user uncleGen commented on the issue: https://github.com/apache/spark/pull/16142 cc @vanzin --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark pull request #16176: [SPARK-18746][SQL] Add implicit encoder for BigDe...

2016-12-13 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16176 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #16257: [SPARK-18752][sql] Follow-up: add scaladoc explai...

2016-12-13 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16257 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #16246: [SPARK-18814][SQL] CheckAnalysis rejects TPCDS query 32

2016-12-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16246 **[Test build #70110 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70110/consoleFull)** for PR 16246 at commit

[GitHub] spark issue #16246: [SPARK-18814][SQL] CheckAnalysis rejects TPCDS query 32

2016-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16246 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70110/ Test PASSed. ---

[GitHub] spark issue #16246: [SPARK-18814][SQL] CheckAnalysis rejects TPCDS query 32

2016-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16246 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16189: [SPARK-18761][CORE] Introduce "task reaper" to oversee t...

2016-12-13 Thread JoshRosen
Github user JoshRosen commented on the issue: https://github.com/apache/spark/pull/16189 Jenkins retest this please On Tue, Dec 13, 2016 at 6:13 PM UCB AMPLab wrote: > Test FAILed. > > > Refer to this link for build results (access

[GitHub] spark issue #16247: [SPARK-18817][SparkR] set default spark-warehouse path t...

2016-12-13 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/16247 But yes other Spark config properties would be set by the user in sparkConfig parameter of sparkR.session method. We would just add to that without adding another parameter to sparkR.session

[GitHub] spark issue #15915: [SPARK-18485][CORE] Underlying integer overflow when cre...

2016-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15915 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70115/ Test PASSed. ---

[GitHub] spark issue #15915: [SPARK-18485][CORE] Underlying integer overflow when cre...

2016-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15915 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16176: [SPARK-18746][SQL] Add implicit encoder for BigDecimal, ...

2016-12-13 Thread weiqingy
Github user weiqingy commented on the issue: https://github.com/apache/spark/pull/16176 Thanks for the review. @cloud-fan --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14079: [SPARK-8425][CORE] Application Level Blacklisting

2016-12-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14079 **[Test build #70122 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70122/consoleFull)** for PR 14079 at commit

[GitHub] spark pull request #15915: [SPARK-18485][CORE] Underlying integer overflow w...

2016-12-13 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/15915#discussion_r92322708 --- Diff: core/src/test/scala/org/apache/spark/storage/MemoryStoreSuite.scala --- @@ -303,6 +303,34 @@ class MemoryStoreSuite

[GitHub] spark issue #16274: [SPARK-18853][SQL] Project (UnaryNode) is way too aggres...

2016-12-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16274 **[Test build #70123 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70123/consoleFull)** for PR 16274 at commit

[GitHub] spark issue #16030: [SPARK-18108][SQL] Fix a bug to fail partition schema in...

2016-12-13 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/16030 @maropu @brkyvz Sorry for the delay, I was blocked by some other tasks during the last a few days. @cloud-fan and I just did some investigation and we think we came up with a minimal fix

[GitHub] spark issue #16273: [SPARK-18852][SS]StreamingQuery.lastProgress should be n...

2016-12-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16273 **[Test build #70106 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70106/consoleFull)** for PR 16273 at commit

[GitHub] spark issue #15915: [SPARK-18485][CORE] Underlying integer overflow when cre...

2016-12-13 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/15915 Can you also add a test into MemoryStoreSuite? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #16252: [SPARK-18827][Core] Fix cannot read broadcast on disk

2016-12-13 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/16252 Thanks for submitting this. We need a much better description for both the JIRA ticket and the pull request. If I understand it correctly, you are fixing an issue to support broadcasting blocks that

[GitHub] spark issue #16252: [SPARK-18827][Core] Fix cannot read broadcast on disk

2016-12-13 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/16252 cc @zsxwing also --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark pull request #16275: [SPARK-18588][Tests]Ignore KafkaSourceStressForDo...

2016-12-13 Thread zsxwing
GitHub user zsxwing opened a pull request: https://github.com/apache/spark/pull/16275 [SPARK-18588][Tests]Ignore KafkaSourceStressForDontFailOnDataLossSuite ## What changes were proposed in this pull request? Disable KafkaSourceStressForDontFailOnDataLossSuite for now.

[GitHub] spark issue #16253: [SPARK-18537][Web UI] Add a REST api to serve spark stre...

2016-12-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16253 **[Test build #70117 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70117/consoleFull)** for PR 16253 at commit

[GitHub] spark issue #16266: [WIP][SPARK-18842][TESTS][LAUNCHER] De-duplicate paths i...

2016-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16266 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16266: [WIP][SPARK-18842][TESTS][LAUNCHER] De-duplicate paths i...

2016-12-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16266 **[Test build #70111 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70111/consoleFull)** for PR 16266 at commit

[GitHub] spark issue #16273: [SPARK-18852][SS]StreamingQuery.lastProgress should be n...

2016-12-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16273 **[Test build #70112 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70112/consoleFull)** for PR 16273 at commit

[GitHub] spark issue #16273: [SPARK-18852][SS]StreamingQuery.lastProgress should be n...

2016-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16273 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16274: [SPARK-18853][SQL] Project (UnaryNode) is way too aggres...

2016-12-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16274 **[Test build #70113 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70113/consoleFull)** for PR 16274 at commit

[GitHub] spark issue #16266: [WIP][SPARK-18842][TESTS][LAUNCHER] De-duplicate paths i...

2016-12-13 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/16266 Build started: [TESTS] `org.apache.spark.ShuffleSuite`

[GitHub] spark issue #15915: [SPARK-18485][CORE] Underlying integer overflow when cre...

2016-12-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15915 **[Test build #70115 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70115/consoleFull)** for PR 15915 at commit

[GitHub] spark issue #16253: [SPARK-18537][Web UI] Add a REST api to serve spark stre...

2016-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16253 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16253: [SPARK-18537][Web UI] Add a REST api to serve spark stre...

2016-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16253 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70117/ Test FAILed. ---

[GitHub] spark issue #16255: [SPARK-18609][SQL]Fix when CTE with Join between two tab...

2016-12-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16255 **[Test build #70114 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70114/consoleFull)** for PR 16255 at commit

[GitHub] spark issue #16255: [SPARK-18609][SQL]Fix when CTE with Join between two tab...

2016-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16255 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70114/ Test PASSed. ---

[GitHub] spark issue #16255: [SPARK-18609][SQL]Fix when CTE with Join between two tab...

2016-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16255 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14079: [SPARK-8425][CORE] Application Level Blacklisting

2016-12-13 Thread squito
Github user squito commented on the issue: https://github.com/apache/spark/pull/14079 Jenkins, retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #15915: [SPARK-18485][CORE] Underlying integer overflow when cre...

2016-12-13 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/15915 Current change looks good to me. cc @JoshRosen @srowen to check it again. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #16247: [SPARK-18817][SparkR] set default spark-warehouse path t...

2016-12-13 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/16247 But yes _other_ Spark config properties would be set by the user in sparkConfig parameter of sparkR.session method. We would just add to that like ```

[GitHub] spark pull request #15717: [SPARK-17910][SQL] Allow users to update the comm...

2016-12-13 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/15717#discussion_r92329696 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkSqlParser.scala --- @@ -877,6 +877,35 @@ class SparkSqlAstBuilder(conf: SQLConf)

[GitHub] spark issue #16273: [SPARK-18852][SS]StreamingQuery.lastProgress should be n...

2016-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16273 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70106/ Test PASSed. ---

[GitHub] spark issue #16270: [SPARK-18846][Scheduler] Fix flakiness in SchedulerInteg...

2016-12-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16270 **[Test build #70108 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70108/consoleFull)** for PR 16270 at commit

[GitHub] spark issue #16273: [SPARK-18852][SS]StreamingQuery.lastProgress should be n...

2016-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16273 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70105/ Test PASSed. ---

[GitHub] spark issue #16273: [SPARK-18852][SS]StreamingQuery.lastProgress should be n...

2016-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16273 Build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #16274: [SPARK-18853][SQL] Project (UnaryNode) is way too aggres...

2016-12-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16274 **[Test build #70113 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70113/consoleFull)** for PR 16274 at commit

[GitHub] spark issue #16255: [SPARK-18609][SQL]Fix when CTE with Join between two tab...

2016-12-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16255 **[Test build #70114 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70114/consoleFull)** for PR 16255 at commit

[GitHub] spark issue #16275: [SPARK-18588][Tests]Ignore KafkaSourceStressForDontFailO...

2016-12-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16275 **[Test build #70116 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70116/consoleFull)** for PR 16275 at commit

[GitHub] spark issue #16189: [SPARK-18761][CORE] Introduce "task reaper" to oversee t...

2016-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16189 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70109/ Test FAILed. ---

[GitHub] spark issue #16189: [SPARK-18761][CORE] Introduce "task reaper" to oversee t...

2016-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16189 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16253: [SPARK-18537][Web UI] Add a REST api to serve spark stre...

2016-12-13 Thread saturday-shi
Github user saturday-shi commented on the issue: https://github.com/apache/spark/pull/16253 > Looks like a compile-time check for the listener API. I think that's right. I was confused with the test suites in Scala. But this is for Java. --- If your project is set up for

<    1   2   3   4   5   >