[GitHub] spark pull request #16155: [SPARK-18722][SS]Move no data rate limit from Str...

2016-12-05 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16155 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #16142: [SPARK-18716][CORE] Restrict the disk usage of spark eve...

2016-12-05 Thread uncleGen
Github user uncleGen commented on the issue: https://github.com/apache/spark/pull/16142 cc @srowen --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark pull request #16164: [SPARK-18732][WEB-UI] The Y axis ranges of "sched...

2016-12-05 Thread uncleGen
GitHub user uncleGen opened a pull request: https://github.com/apache/spark/pull/16164 [SPARK-18732][WEB-UI] The Y axis ranges of "schedulingDelay", "processingTime"… ## What changes were proposed in this pull request? Currently, the Y axis ranges of "schedulingDelay",

[GitHub] spark pull request #13909: [SPARK-16213][SQL] Reduce runtime overhead of a p...

2016-12-05 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/13909#discussion_r91002601 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/complexTypeCreator.scala --- @@ -132,50 +153,80 @@ case class

[GitHub] spark pull request #13909: [SPARK-16213][SQL] Reduce runtime overhead of a p...

2016-12-05 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/13909#discussion_r91002427 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/complexTypeCreator.scala --- @@ -132,50 +153,80 @@ case class

[GitHub] spark pull request #16006: [SPARK-18580] [DStreams] [external/kafka-0-10] Us...

2016-12-05 Thread koeninger
Github user koeninger commented on a diff in the pull request: https://github.com/apache/spark/pull/16006#discussion_r91001763 --- Diff: external/kafka-0-10/src/main/scala/org/apache/spark/streaming/kafka010/DirectKafkaInputDStream.scala --- @@ -67,6 +67,10 @@ private[spark]

[GitHub] spark pull request #16006: [SPARK-18580] [DStreams] [external/kafka-0-10] Us...

2016-12-05 Thread koeninger
Github user koeninger commented on a diff in the pull request: https://github.com/apache/spark/pull/16006#discussion_r91002372 --- Diff: external/kafka-0-10/src/main/scala/org/apache/spark/streaming/kafka010/DirectKafkaInputDStream.scala --- @@ -143,9 +147,14 @@ private[spark]

[GitHub] spark pull request #15994: [SPARK-18555][SQL]DataFrameNaFunctions.fill miss ...

2016-12-05 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15994 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #13909: [SPARK-16213][SQL] Reduce runtime overhead of a p...

2016-12-05 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/13909#discussion_r91002161 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/ExpressionEvalHelper.scala --- @@ -59,12 +59,36 @@ trait

[GitHub] spark issue #15994: [SPARK-18555][SQL]DataFrameNaFunctions.fill miss up orig...

2016-12-05 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/15994 @windpiger you should use a proper email on your github commit next time. It is currently shown as: ``` Enter primary author in the format of "name " [root

[GitHub] spark issue #15994: [SPARK-18555][SQL]DataFrameNaFunctions.fill miss up orig...

2016-12-05 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/15994 Thanks - merging in master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #16147: [SPARK-18718][TESTS] Skip some test failures due to path...

2016-12-05 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/16147 Thank you so much @srowen . --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request #16157: [SPARK-18723][DOC] Expanded programming guide inf...

2016-12-05 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/16157#discussion_r91002001 --- Diff: docs/programming-guide.md --- @@ -347,7 +347,7 @@ Some notes on reading files with Spark: Apart from text files, Spark's Scala API also

[GitHub] spark pull request #13909: [SPARK-16213][SQL] Reduce runtime overhead of a p...

2016-12-05 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/13909#discussion_r91001752 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/complexTypeCreator.scala --- @@ -56,28 +56,49 @@ case class

[GitHub] spark pull request #13909: [SPARK-16213][SQL] Reduce runtime overhead of a p...

2016-12-05 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/13909#discussion_r91001488 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/complexTypeCreator.scala --- @@ -56,28 +56,49 @@ case class

[GitHub] spark pull request #13909: [SPARK-16213][SQL] Reduce runtime overhead of a p...

2016-12-05 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/13909#discussion_r91001362 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/encoders/ExpressionEncoder.scala --- @@ -50,7 +50,7 @@ object ExpressionEncoder {

[GitHub] spark issue #16155: [SPARK-18722][SS]Move no data rate limit from StreamExec...

2016-12-05 Thread tdas
Github user tdas commented on the issue: https://github.com/apache/spark/pull/16155 Merging to master and 2.1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #16155: [SPARK-18722][SS]Move no data rate limit from StreamExec...

2016-12-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16155 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69700/ Test PASSed. ---

[GitHub] spark issue #16155: [SPARK-18722][SS]Move no data rate limit from StreamExec...

2016-12-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16155 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #15998: [SPARK-18572][SQL] Add a method `listPartitionNam...

2016-12-05 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/15998#discussion_r91001189 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/catalog/ExternalCatalogSuite.scala --- @@ -346,6 +346,31 @@ abstract class

[GitHub] spark issue #16155: [SPARK-18722][SS]Move no data rate limit from StreamExec...

2016-12-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16155 **[Test build #69700 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69700/consoleFull)** for PR 16155 at commit

[GitHub] spark pull request #16120: [SPARK-18634][PySpark][SQL] Corruption and Correc...

2016-12-05 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16120#discussion_r91000921 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/basicLogicalOperators.scala --- @@ -93,13 +93,13 @@ case class

[GitHub] spark pull request #16152: [SPARK-18720] [SQL] [MINOR] Code Refactoring of w...

2016-12-05 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16152 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #16131: [SPARK-18701][ML] Fix Poisson GLM failure due to ...

2016-12-05 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/16131#discussion_r91000876 --- Diff: mllib/src/main/scala/org/apache/spark/ml/regression/GeneralizedLinearRegression.scala --- @@ -505,7 +505,8 @@ object GeneralizedLinearRegression

[GitHub] spark issue #16152: [SPARK-18720] [SQL] [MINOR] Code Refactoring of withColu...

2016-12-05 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/16152 LGTM, merging to master! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #16161: [SPARK-18717][SQL] Make code generation for Scala...

2016-12-05 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/16161#discussion_r91000691 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/encoders/RowEncoder.scala --- @@ -288,7 +287,7 @@ object RowEncoder {

[GitHub] spark pull request #16068: [SPARK-18637][SQL]Stateful UDF should be consider...

2016-12-05 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16068#discussion_r91000387 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveUDFSuite.scala --- @@ -487,6 +488,45 @@ class HiveUDFSuite extends QueryTest

[GitHub] spark pull request #16113: [SPARK-18657][SPARK-18668] Make StreamingQuery.id...

2016-12-05 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16113 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #16120: [SPARK-18634][PySpark][SQL] Corruption and Correc...

2016-12-05 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/16120#discussion_r91000126 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/basicLogicalOperators.scala --- @@ -93,13 +93,13 @@ case class Generate(

[GitHub] spark issue #16163: [SPARK-18730] Post Jenkins test report page instead of t...

2016-12-05 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/16163 It might not be exactly the same thing, but I remember we changed something like this in the opposite way -- to link straight to the full output since typically you need that to debug a failure, and

[GitHub] spark pull request #16162: [SPARK-18729][SS]Move DataFrame.collect out of sy...

2016-12-05 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16162 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #16113: [SPARK-18657][SPARK-18668] Make StreamingQuery.id persis...

2016-12-05 Thread tdas
Github user tdas commented on the issue: https://github.com/apache/spark/pull/16113 Merging to master and 2.1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #16162: [SPARK-18729][SS]Move DataFrame.collect out of synchroni...

2016-12-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16162 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69699/ Test PASSed. ---

[GitHub] spark pull request #16120: [SPARK-18634][PySpark][SQL] Corruption and Correc...

2016-12-05 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/16120#discussion_r9021 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/basicLogicalOperators.scala --- @@ -93,13 +93,13 @@ case class Generate(

[GitHub] spark issue #16162: [SPARK-18729][SS]Move DataFrame.collect out of synchroni...

2016-12-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16162 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16162: [SPARK-18729][SS]Move DataFrame.collect out of synchroni...

2016-12-05 Thread tdas
Github user tdas commented on the issue: https://github.com/apache/spark/pull/16162 Merging to master and 2.1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #16162: [SPARK-18729][SS]Move DataFrame.collect out of synchroni...

2016-12-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16162 **[Test build #69699 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69699/consoleFull)** for PR 16162 at commit

[GitHub] spark pull request #16159: [SPARK-18697][BUILD] Upgrade sbt plugins

2016-12-05 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/16159#discussion_r90999547 --- Diff: project/SparkBuild.scala --- @@ -596,19 +596,17 @@ object Hive { } object Assembly { - import sbtassembly.AssemblyUtils._ -

[GitHub] spark pull request #16120: [SPARK-18634][PySpark][SQL] Corruption and Correc...

2016-12-05 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16120#discussion_r90999177 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/basicLogicalOperators.scala --- @@ -93,13 +93,13 @@ case class

[GitHub] spark issue #15998: [SPARK-18572][SQL] Add a method `listPartitionNames` to ...

2016-12-05 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/15998 Yea this one seems like directly related to the work we did in 2.1 for large table handling. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark issue #16147: [SPARK-18718][TESTS] Skip some test failures due to path...

2016-12-05 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/16147 Hi @srowen I just manually downloaded spark 2.1.0 rc1 and then tested as below: I tested both ``` .\bin\spark-shell.cmd --master local-cluster[2,1,1024] ```

[GitHub] spark issue #15998: [SPARK-18572][SQL] Add a method `listPartitionNames` to ...

2016-12-05 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15998 LGTM, @rxin shall we backport this? Although it's not a bug, it's a scalability issue. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark issue #16120: [SPARK-18634][PySpark][SQL] Corruption and Correctness i...

2016-12-05 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/16120 Thank you! @hvanhovell --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark pull request #16128: [SPARK-18671][SS][TEST] Added tests to ensure sta...

2016-12-05 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/16128#discussion_r90997809 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/streaming/FileStreamSourceSuite.scala --- @@ -1022,6 +1021,33 @@ class FileStreamSourceSuite extends

[GitHub] spark pull request #16128: [SPARK-18671][SS][TEST] Added tests to ensure sta...

2016-12-05 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/16128#discussion_r90997211 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/JsonUtils.scala --- @@ -81,7 +81,14 @@ private object JsonUtils { */

[GitHub] spark pull request #16128: [SPARK-18671][SS][TEST] Added tests to ensure sta...

2016-12-05 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/16128#discussion_r9099 --- Diff: external/kafka-0-10-sql/src/test/scala/org/apache/spark/sql/kafka010/KafkaSourceOffsetSuite.scala --- @@ -89,4 +89,16 @@ class

[GitHub] spark pull request #16120: [SPARK-18634][PySpark][SQL] Corruption and Correc...

2016-12-05 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16120 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #16120: [SPARK-18634][PySpark][SQL] Corruption and Correctness i...

2016-12-05 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/16120 LGTM - merging to master/2.1/2.0 (if possible). Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request #16120: [SPARK-18634][PySpark][SQL] Corruption and Correc...

2016-12-05 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/16120#discussion_r90997370 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/basicLogicalOperators.scala --- @@ -93,13 +93,13 @@ case class

[GitHub] spark issue #16092: [SPARK-18662] Move resource managers to separate directo...

2016-12-05 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/16092 @foxish this need to be rebased. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #16113: [SPARK-18657][SPARK-18668] Make StreamingQuery.id persis...

2016-12-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16113 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16113: [SPARK-18657][SPARK-18668] Make StreamingQuery.id persis...

2016-12-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16113 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69695/ Test PASSed. ---

[GitHub] spark issue #16113: [SPARK-18657][SPARK-18668] Make StreamingQuery.id persis...

2016-12-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16113 **[Test build #69695 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69695/consoleFull)** for PR 16113 at commit

[GitHub] spark issue #16162: [SPARK-18729][SS]Move DataFrame.collect out of synchroni...

2016-12-05 Thread brkyvz
Github user brkyvz commented on the issue: https://github.com/apache/spark/pull/16162 Thanks @zsxwing LGTM2! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark pull request #16000: [SPARK-18537][Web UI]Add a REST api to spark stre...

2016-12-05 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/16000#discussion_r90996869 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/scheduler/StreamingListener.scala --- @@ -66,6 +69,9 @@ case class

[GitHub] spark issue #16160: [SPARK-18721][SS]Fix ForeachSink with watermark + append

2016-12-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16160 **[Test build #69706 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69706/consoleFull)** for PR 16160 at commit

[GitHub] spark pull request #16120: [SPARK-18634][PySpark][SQL] Corruption and Correc...

2016-12-05 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/16120#discussion_r90996775 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/basicLogicalOperators.scala --- @@ -93,13 +93,13 @@ case class Generate(

[GitHub] spark issue #16162: [SPARK-18729][SS]Move DataFrame.collect out of synchroni...

2016-12-05 Thread tdas
Github user tdas commented on the issue: https://github.com/apache/spark/pull/16162 LGTM. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #16146: [SPARK-18091] [SQL] [BACKPORT-1.6] Deep if expressions c...

2016-12-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16146 **[Test build #69707 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69707/consoleFull)** for PR 16146 at commit

[GitHub] spark issue #16160: [SPARK-18721][SS]Fix ForeachSink with watermark + append

2016-12-05 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/16160 Forgot that `lastProgress` may be the batch without data. Updated the test to drop no data progress. --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark issue #16160: [SPARK-18721][SS]Fix ForeachSink with watermark + append

2016-12-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16160 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16160: [SPARK-18721][SS]Fix ForeachSink with watermark + append

2016-12-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16160 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69697/ Test PASSed. ---

[GitHub] spark issue #16146: [SPARK-18091] [SQL] [BACKPORT-1.6] Deep if expressions c...

2016-12-05 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/16146 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark issue #16160: [SPARK-18721][SS]Fix ForeachSink with watermark + append

2016-12-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16160 **[Test build #69697 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69697/consoleFull)** for PR 16160 at commit

[GitHub] spark issue #15780: [SPARK-18284][SQL] Make ExpressionEncoder.serializer.nul...

2016-12-05 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15780 oh sorry I thought incorrect nullability is also a bug... yea this change is too large to backport, I'll be more careful in the future. --- If your project is set up for it, you can reply to

[GitHub] spark issue #16053: [SPARK-17931] Eliminate unncessary task (de) serializati...

2016-12-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16053 Build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #16053: [SPARK-17931] Eliminate unncessary task (de) serializati...

2016-12-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16053 **[Test build #69702 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69702/consoleFull)** for PR 16053 at commit

[GitHub] spark issue #16053: [SPARK-17931] Eliminate unncessary task (de) serializati...

2016-12-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16053 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69702/ Test FAILed. ---

[GitHub] spark issue #16160: [SPARK-18721][SS]Fix ForeachSink with watermark + append

2016-12-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16160 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69698/ Test FAILed. ---

[GitHub] spark issue #16160: [SPARK-18721][SS]Fix ForeachSink with watermark + append

2016-12-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16160 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16128: [WIP][SPARK-18671][SS] Added tests to ensure stability o...

2016-12-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16128 **[Test build #69705 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69705/consoleFull)** for PR 16128 at commit

[GitHub] spark issue #16159: [SPARK-18697][BUILD] Upgrade sbt plugins

2016-12-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16159 **[Test build #69704 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69704/consoleFull)** for PR 16159 at commit

[GitHub] spark issue #16160: [SPARK-18721][SS]Fix ForeachSink with watermark + append

2016-12-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16160 **[Test build #69698 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69698/consoleFull)** for PR 16160 at commit

[GitHub] spark issue #16159: [SPARK-18697][BUILD] Upgrade sbt plugins

2016-12-05 Thread weiqingy
Github user weiqingy commented on the issue: https://github.com/apache/spark/pull/16159 Retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #16159: [SPARK-18697][BUILD] Upgrade sbt plugins

2016-12-05 Thread weiqingy
Github user weiqingy commented on the issue: https://github.com/apache/spark/pull/16159 It failed the unit test: `org.apache.spark.sql.streaming.StreamingQueryListenerSuite.single listener, check trigger events are generated correctly`. However, I just ran it locally, and it passed.

[GitHub] spark issue #16163: [SPARK-18730] Post Jenkins test report page instead of t...

2016-12-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16163 **[Test build #69703 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69703/testReport)** for PR 16163 at commit

[GitHub] spark pull request #16163: [SPARK-18730] Post Jenkins test report page inste...

2016-12-05 Thread liancheng
GitHub user liancheng opened a pull request: https://github.com/apache/spark/pull/16163 [SPARK-18730] Post Jenkins test report page instead of the full console output page to GitHub ## What changes were proposed in this pull request? Currently, the full console output page

[GitHub] spark issue #16053: [SPARK-17931] Eliminate unncessary task (de) serializati...

2016-12-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16053 **[Test build #69702 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69702/consoleFull)** for PR 16053 at commit

[GitHub] spark issue #16155: [SPARK-18722][SS]Move no data rate limit from StreamExec...

2016-12-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16155 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16155: [SPARK-18722][SS]Move no data rate limit from StreamExec...

2016-12-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16155 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69694/ Test PASSed. ---

[GitHub] spark issue #16155: [SPARK-18722][SS]Move no data rate limit from StreamExec...

2016-12-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16155 **[Test build #69694 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69694/consoleFull)** for PR 16155 at commit

[GitHub] spark pull request #15992: [SPARK-18560][CORE][STREAMING][WIP] Receiver data...

2016-12-05 Thread uncleGen
Github user uncleGen closed the pull request at: https://github.com/apache/spark/pull/15992 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #15998: [SPARK-18572][SQL] Add a method `listPartitionNames` to ...

2016-12-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15998 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69691/ Test PASSed. ---

[GitHub] spark issue #15998: [SPARK-18572][SQL] Add a method `listPartitionNames` to ...

2016-12-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15998 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15998: [SPARK-18572][SQL] Add a method `listPartitionNames` to ...

2016-12-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15998 **[Test build #69691 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69691/consoleFull)** for PR 15998 at commit

[GitHub] spark issue #16160: [SPARK-18721][SS]Fix ForeachSink with watermark + append

2016-12-05 Thread tdas
Github user tdas commented on the issue: https://github.com/apache/spark/pull/16160 LGTM. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark pull request #16160: [SPARK-18721][SS]Fix ForeachSink with watermark +...

2016-12-05 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/16160#discussion_r90992578 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/streaming/ForeachSinkSuite.scala --- @@ -204,6 +204,55 @@ class ForeachSinkSuite extends

[GitHub] spark issue #16154: [SPARK-17822] [R] Make JVMObjectTracker a member variabl...

2016-12-05 Thread mengxr
Github user mengxr commented on the issue: https://github.com/apache/spark/pull/16154 @shivaram PR seems ready for you to make a pass:) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #16053: [SPARK-17931] Eliminate unncessary task (de) serializati...

2016-12-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16053 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69701/ Test FAILed. ---

[GitHub] spark issue #16053: [SPARK-17931] Eliminate unncessary task (de) serializati...

2016-12-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16053 **[Test build #69701 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69701/consoleFull)** for PR 16053 at commit

[GitHub] spark issue #16053: [SPARK-17931] Eliminate unncessary task (de) serializati...

2016-12-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16053 Build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #16159: [SPARK-18697][BUILD] Upgrade sbt plugins

2016-12-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16159 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16159: [SPARK-18697][BUILD] Upgrade sbt plugins

2016-12-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16159 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69692/ Test FAILed. ---

[GitHub] spark issue #16053: [SPARK-17931] Eliminate unncessary task (de) serializati...

2016-12-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16053 **[Test build #69701 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69701/consoleFull)** for PR 16053 at commit

[GitHub] spark issue #16159: [SPARK-18697][BUILD] Upgrade sbt plugins

2016-12-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16159 **[Test build #69692 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69692/consoleFull)** for PR 16159 at commit

[GitHub] spark pull request #16160: [SPARK-18721][SS]Fix ForeachSink with watermark +...

2016-12-05 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/16160#discussion_r90990663 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/streaming/ForeachSinkSuite.scala --- @@ -204,6 +204,55 @@ class ForeachSinkSuite extends

[GitHub] spark issue #16161: [SPARK-18717][SQL] Make code generation for Scala Map wo...

2016-12-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16161 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69696/ Test FAILed. ---

[GitHub] spark issue #16161: [SPARK-18717][SQL] Make code generation for Scala Map wo...

2016-12-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16161 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16161: [SPARK-18717][SQL] Make code generation for Scala Map wo...

2016-12-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16161 **[Test build #69696 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69696/consoleFull)** for PR 16161 at commit

[GitHub] spark issue #16155: [SPARK-18722][SS]Move no data rate limit from StreamExec...

2016-12-05 Thread tdas
Github user tdas commented on the issue: https://github.com/apache/spark/pull/16155 Still LGTM. Merge when tests pass on the latest commit. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

<    1   2   3   4   5   6   >