[GitHub] spark issue #16089: [SPARK-18658][SQL] Write text records directly to a File...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16089 **[Test build #69457 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69457/consoleFull)** for PR 16089 at commit [`56667bd`](https://github.com/apache/spark/commit/

[GitHub] spark issue #16089: [SPARK-18658][SQL] Write text records directly to a File...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16089 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16089: [SPARK-18658][SQL] Write text records directly to a File...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16089 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69457/ Test PASSed. ---

[GitHub] spark pull request #15620: [SPARK-18091] [SQL] Deep if expressions cause Gen...

2016-12-01 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/15620#discussion_r90399036 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/CodeGenerationSuite.scala --- @@ -97,6 +97,38 @@ class CodeGenerationSuite

[GitHub] spark issue #16000: [SPARK-18537][Web UI]Add a REST api to spark streaming

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16000 **[Test build #69458 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69458/consoleFull)** for PR 16000 at commit [`651dc67`](https://github.com/apache/spark/commit/

[GitHub] spark issue #16000: [SPARK-18537][Web UI]Add a REST api to spark streaming

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16000 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69458/ Test PASSed. ---

[GitHub] spark issue #16000: [SPARK-18537][Web UI]Add a REST api to spark streaming

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16000 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16093: [SPARK-18663][SQL] Simplify CountMinSketch aggregate imp...

2016-12-01 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/16093 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the fea

[GitHub] spark pull request #16093: [SPARK-18663][SQL] Simplify CountMinSketch aggreg...

2016-12-01 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16093#discussion_r90400227 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/CountMinSketchAgg.scala --- @@ -75,13 +73,13 @@ case class Count

[GitHub] spark issue #15915: [SPARK-18485][CORE] Underlying integer overflow when cre...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15915 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69461/ Test FAILed. ---

[GitHub] spark issue #15915: [SPARK-18485][CORE] Underlying integer overflow when cre...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15915 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request #16086: [SPARK-18653][SQL] Fix incorrect space padding fo...

2016-12-01 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/16086#discussion_r90402700 --- Diff: sql/core/pom.xml --- @@ -92,6 +92,11 @@ ${fasterxml.jackson.version} + com.ibm.icu --- End diff --

[GitHub] spark issue #16071: [SPARK-18635] [SQL] Partition name/values not escaped co...

2016-12-01 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/16071 LGTM, merging to master/2.1! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #16071: [SPARK-18635] [SQL] Partition name/values not esc...

2016-12-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16071 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #15915: [SPARK-18485][CORE] Underlying integer overflow when cre...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15915 **[Test build #69460 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69460/consoleFull)** for PR 15915 at commit [`fffd5f5`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15915: [SPARK-18485][CORE] Underlying integer overflow when cre...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15915 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15915: [SPARK-18485][CORE] Underlying integer overflow when cre...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15915 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69460/ Test PASSed. ---

[GitHub] spark pull request #16089: [SPARK-18658][SQL] Write text records directly to...

2016-12-01 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/16089#discussion_r90408942 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/CodecStreams.scala --- @@ -0,0 +1,73 @@ +/* + * Licensed to the Apache Sof

[GitHub] spark pull request #16089: [SPARK-18658][SQL] Write text records directly to...

2016-12-01 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/16089#discussion_r90409094 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/CodecStreams.scala --- @@ -0,0 +1,73 @@ +/* + * Licensed to the Apache Sof

[GitHub] spark pull request #16089: [SPARK-18658][SQL] Write text records directly to...

2016-12-01 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/16089#discussion_r90409064 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/CodecStreams.scala --- @@ -0,0 +1,73 @@ +/* + * Licensed to the Apache Sof

[GitHub] spark pull request #16089: [SPARK-18658][SQL] Write text records directly to...

2016-12-01 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/16089#discussion_r90409731 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/CSVRelation.scala --- @@ -245,24 +230,12 @@ private[csv] class CsvOutputWriter

[GitHub] spark pull request #15620: [SPARK-18091] [SQL] Deep if expressions cause Gen...

2016-12-01 Thread kapilsingh5050
Github user kapilsingh5050 commented on a diff in the pull request: https://github.com/apache/spark/pull/15620#discussion_r90409976 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/conditionalExpressions.scala --- @@ -64,19 +64,74 @@ case class If(pr

[GitHub] spark pull request #15620: [SPARK-18091] [SQL] Deep if expressions cause Gen...

2016-12-01 Thread kapilsingh5050
Github user kapilsingh5050 commented on a diff in the pull request: https://github.com/apache/spark/pull/15620#discussion_r90410001 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/CodeGenerationSuite.scala --- @@ -97,6 +97,38 @@ class CodeGeneration

[GitHub] spark issue #16092: [SPARK-18662] Move resource managers to separate directo...

2016-12-01 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/16092 Hm, is this really necessary? I know it's just a move but for 2-3 modules, does it matter enough? --- If your project is set up for it, you can reply to this email and have your reply appear on GitH

[GitHub] spark issue #16037: [SPARK-18471][MLLIB] In LBFGS, avoid sending huge vector...

2016-12-01 Thread AnthonyTruchet
Github user AnthonyTruchet commented on the issue: https://github.com/apache/spark/pull/16037 Scala style checks fixed, and spurious cast removed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark issue #16037: [SPARK-18471][MLLIB] In LBFGS, avoid sending huge vector...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16037 **[Test build #69466 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69466/consoleFull)** for PR 16037 at commit [`0ce8c64`](https://github.com/apache/spark/commit/0

[GitHub] spark issue #16092: [SPARK-18662] Move resource managers to separate directo...

2016-12-01 Thread tnachen
Github user tnachen commented on the issue: https://github.com/apache/spark/pull/16092 Changed suggested by @rxin --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wis

[GitHub] spark pull request #16098: [WIP][SPARK-18672][CORE] Close recordwriter in Sp...

2016-12-01 Thread HyukjinKwon
GitHub user HyukjinKwon opened a pull request: https://github.com/apache/spark/pull/16098 [WIP][SPARK-18672][CORE] Close recordwriter in SparkHadoopMapReduceWriter before committing ## What changes were proposed in this pull request? It seems some APIs such as `PairRDDFunct

[GitHub] spark issue #16093: [SPARK-18663][SQL] Simplify CountMinSketch aggregate imp...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16093 **[Test build #69464 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69464/consoleFull)** for PR 16093 at commit [`b2985c4`](https://github.com/apache/spark/commit/

[GitHub] spark issue #16093: [SPARK-18663][SQL] Simplify CountMinSketch aggregate imp...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16093 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69464/ Test FAILed. ---

[GitHub] spark issue #16098: [WIP][SPARK-18672][CORE] Close recordwriter in SparkHado...

2016-12-01 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/16098 Build started: [CORE] `org.apache.spark.JavaAPISuite` [![PR-16098](https://ci.appveyor.com/api/projects/status/github/spark-test/spark?branch=5DFF30F9-0FAB-4B27-8BE1-377D64B5B653&svg=true)](https

[GitHub] spark issue #16093: [SPARK-18663][SQL] Simplify CountMinSketch aggregate imp...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16093 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16098: [WIP][SPARK-18672][CORE] Close recordwriter in SparkHado...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16098 **[Test build #69467 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69467/consoleFull)** for PR 16098 at commit [`7d76472`](https://github.com/apache/spark/commit/7

[GitHub] spark issue #16098: [WIP][SPARK-18672][CORE] Close recordwriter in SparkHado...

2016-12-01 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/16098 I see, so the writer should be closed before committing? Can the writer be closed before aborting too? In that case, maybe it's cleaner to use nested try-finally? an inner try-finally ma

[GitHub] spark issue #16093: [SPARK-18663][SQL] Simplify CountMinSketch aggregate imp...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16093 **[Test build #3449 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3449/consoleFull)** for PR 16093 at commit [`b2985c4`](https://github.com/apache/spark/commit/

[GitHub] spark issue #16095: [SPARK-18666][Web UI] Remove the codes checking deprecat...

2016-12-01 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/16095 Merging in master/branch-2.1. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wis

[GitHub] spark issue #16080: [SPARK-18647][SQL] do not put provider in table properti...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16080 **[Test build #69465 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69465/consoleFull)** for PR 16080 at commit [`5ee6489`](https://github.com/apache/spark/commit/

[GitHub] spark issue #16098: [WIP][SPARK-18672][CORE] Close recordwriter in SparkHado...

2016-12-01 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/16098 Yes, it seems so because the output seems written in temp dir first and then it is being renamed as the task is committed. Yes, let me try to neat up as possible as I can. --- If your project

[GitHub] spark issue #16080: [SPARK-18647][SQL] do not put provider in table properti...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16080 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69465/ Test PASSed. ---

[GitHub] spark issue #16098: [WIP][SPARK-18672][CORE] Close recordwriter in SparkHado...

2016-12-01 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/16098 (cc @mridulm as well who I guess is interested in this issue.) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project doe

[GitHub] spark issue #16080: [SPARK-18647][SQL] do not put provider in table properti...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16080 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request #16095: [SPARK-18666][Web UI] Remove the codes checking d...

2016-12-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16095 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request #16086: [SPARK-18653][SQL] Fix incorrect space padding fo...

2016-12-01 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/16086#discussion_r90415866 --- Diff: sql/core/pom.xml --- @@ -92,6 +92,11 @@ ${fasterxml.jackson.version} + com.ibm.icu --- End diff --

[GitHub] spark issue #16037: [SPARK-18471][MLLIB] In LBFGS, avoid sending huge vector...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16037 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69466/ Test FAILed. ---

[GitHub] spark issue #16037: [SPARK-18471][MLLIB] In LBFGS, avoid sending huge vector...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16037 **[Test build #69466 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69466/consoleFull)** for PR 16037 at commit [`0ce8c64`](https://github.com/apache/spark/commit/

[GitHub] spark issue #16037: [SPARK-18471][MLLIB] In LBFGS, avoid sending huge vector...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16037 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15780: [SPARK-18284][SQL] Make ExpressionEncoder.serializer.nul...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15780 **[Test build #69468 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69468/consoleFull)** for PR 15780 at commit [`737b21f`](https://github.com/apache/spark/commit/7

[GitHub] spark issue #16037: [SPARK-18471][MLLIB] In LBFGS, avoid sending huge vector...

2016-12-01 Thread AnthonyTruchet
Github user AnthonyTruchet commented on the issue: https://github.com/apache/spark/pull/16037 This seems very related to the change. I know nothing wrt the way PySpark interfaces Python and Scala and I'm surprised that changing an internal f the Scala lib causes this ? Ready to learn

[GitHub] spark pull request #16037: [SPARK-18471][MLLIB] In LBFGS, avoid sending huge...

2016-12-01 Thread MLnick
Github user MLnick commented on a diff in the pull request: https://github.com/apache/spark/pull/16037#discussion_r90421008 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/optimization/LBFGS.scala --- @@ -241,16 +241,27 @@ object LBFGS extends Logging { val bcW = d

[GitHub] spark issue #16037: [SPARK-18471][MLLIB] In LBFGS, avoid sending huge vector...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16037 **[Test build #69469 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69469/consoleFull)** for PR 16037 at commit [`ec183a2`](https://github.com/apache/spark/commit/e

[GitHub] spark pull request #16037: [SPARK-18471][MLLIB] In LBFGS, avoid sending huge...

2016-12-01 Thread AnthonyTruchet
Github user AnthonyTruchet commented on a diff in the pull request: https://github.com/apache/spark/pull/16037#discussion_r90422375 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/optimization/LBFGS.scala --- @@ -241,16 +241,27 @@ object LBFGS extends Logging { val

[GitHub] spark issue #16037: [SPARK-18471][MLLIB] In LBFGS, avoid sending huge vector...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16037 **[Test build #69470 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69470/consoleFull)** for PR 16037 at commit [`9b30c5c`](https://github.com/apache/spark/commit/9

[GitHub] spark issue #16037: [SPARK-18471][MLLIB] In LBFGS, avoid sending huge vector...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16037 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16037: [SPARK-18471][MLLIB] In LBFGS, avoid sending huge vector...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16037 **[Test build #69469 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69469/consoleFull)** for PR 16037 at commit [`ec183a2`](https://github.com/apache/spark/commit/

[GitHub] spark issue #16037: [SPARK-18471][MLLIB] In LBFGS, avoid sending huge vector...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16037 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69469/ Test FAILed. ---

[GitHub] spark issue #16037: [SPARK-18471][MLLIB] In LBFGS, avoid sending huge vector...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16037 **[Test build #69470 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69470/consoleFull)** for PR 16037 at commit [`9b30c5c`](https://github.com/apache/spark/commit/

[GitHub] spark issue #16037: [SPARK-18471][MLLIB] In LBFGS, avoid sending huge vector...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16037 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16037: [SPARK-18471][MLLIB] In LBFGS, avoid sending huge vector...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16037 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69470/ Test PASSed. ---

[GitHub] spark issue #16093: [SPARK-18663][SQL] Simplify CountMinSketch aggregate imp...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16093 **[Test build #3449 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3449/consoleFull)** for PR 16093 at commit [`b2985c4`](https://github.com/apache/spark/commit

[GitHub] spark issue #15994: [SPARK-18555][SQL]DataFrameNaFunctions.fill miss up orig...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15994 **[Test build #69471 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69471/consoleFull)** for PR 15994 at commit [`7e799fc`](https://github.com/apache/spark/commit/7

[GitHub] spark pull request #16099: [SPARK-18665][SQL] set statement state to error a...

2016-12-01 Thread cenyuhai
GitHub user cenyuhai opened a pull request: https://github.com/apache/spark/pull/16099 [SPARK-18665][SQL] set statement state to error after user canceled job ## What changes were proposed in this pull request? set statement state to error after user canceled job You can m

[GitHub] spark issue #16099: [SPARK-18665][SQL] set statement state to error after us...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16099 **[Test build #69472 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69472/consoleFull)** for PR 16099 at commit [`e3a9b08`](https://github.com/apache/spark/commit/e

[GitHub] spark issue #16098: [WIP][SPARK-18672][CORE] Close recordwriter in SparkHado...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16098 **[Test build #69467 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69467/consoleFull)** for PR 16098 at commit [`7d76472`](https://github.com/apache/spark/commit/

[GitHub] spark issue #16098: [WIP][SPARK-18672][CORE] Close recordwriter in SparkHado...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16098 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16098: [WIP][SPARK-18672][CORE] Close recordwriter in SparkHado...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16098 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69467/ Test PASSed. ---

[GitHub] spark pull request #15780: [SPARK-18284][SQL] Make ExpressionEncoder.seriali...

2016-12-01 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/15780#discussion_r90437003 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/objects/objects.scala --- @@ -171,15 +171,17 @@ case class StaticInvoke(

[GitHub] spark issue #15780: [SPARK-18284][SQL] Make ExpressionEncoder.serializer.nul...

2016-12-01 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15780 looks pretty good, left 2 minor comments, thanks for working on it! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark issue #15780: [SPARK-18284][SQL] Make ExpressionEncoder.serializer.nul...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15780 **[Test build #69468 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69468/consoleFull)** for PR 15780 at commit [`737b21f`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15780: [SPARK-18284][SQL] Make ExpressionEncoder.serializer.nul...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15780 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69468/ Test PASSed. ---

[GitHub] spark issue #15780: [SPARK-18284][SQL] Make ExpressionEncoder.serializer.nul...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15780 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16099: [SPARK-18665][SQL] set statement state to "ERROR" after ...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16099 **[Test build #69472 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69472/consoleFull)** for PR 16099 at commit [`e3a9b08`](https://github.com/apache/spark/commit/

[GitHub] spark issue #16099: [SPARK-18665][SQL] set statement state to "ERROR" after ...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16099 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69472/ Test PASSed. ---

[GitHub] spark issue #16099: [SPARK-18665][SQL] set statement state to "ERROR" after ...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16099 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16089: [SPARK-18658][SQL] Write text records directly to a File...

2016-12-01 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/16089 I was going to say, hm, are we sure we want to reimplement / go around the Hadoop support for this? but in practice it looks like it actually simplifies some things. At the moment I can't think of an

[GitHub] spark pull request #15480: [SPARK-16845][SQL] `GeneratedClass$SpecificOrderi...

2016-12-01 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/15480#discussion_r90441646 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/codegen/GenerateOrdering.scala --- @@ -118,7 +118,42 @@ object GenerateOrd

[GitHub] spark issue #16037: [SPARK-18471][MLLIB] In LBFGS, avoid sending huge vector...

2016-12-01 Thread AnthonyTruchet
Github user AnthonyTruchet commented on the issue: https://github.com/apache/spark/pull/16037 @MLnick there it is all tests passing :-) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this fe

[GitHub] spark pull request #16079: [SPARK-18645][Deploy] Fix spark-daemon.sh argumen...

2016-12-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16079 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #15780: [SPARK-18284][SQL] Make ExpressionEncoder.serializer.nul...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15780 **[Test build #69473 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69473/consoleFull)** for PR 15780 at commit [`c925666`](https://github.com/apache/spark/commit/c

[GitHub] spark issue #16079: [SPARK-18645][Deploy] Fix spark-daemon.sh arguments erro...

2016-12-01 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/16079 Merged to master/2.1. This doesn't actually affect earlier versions because it seems to be introduced by https://issues.apache.org/jira/browse/SPARK-11653 I didn't realize the 'local' would have thi

[GitHub] spark issue #16098: [WIP][SPARK-18672][CORE] Close recordwriter in SparkHado...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16098 **[Test build #69474 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69474/consoleFull)** for PR 16098 at commit [`3a66a74`](https://github.com/apache/spark/commit/3

[GitHub] spark pull request #15780: [SPARK-18284][SQL] Make ExpressionEncoder.seriali...

2016-12-01 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/15780#discussion_r90446944 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/objects/objects.scala --- @@ -171,15 +171,18 @@ case class StaticInvoke(

[GitHub] spark issue #16098: [WIP][SPARK-18672][CORE] Close recordwriter in SparkHado...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16098 **[Test build #69475 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69475/consoleFull)** for PR 16098 at commit [`66ff918`](https://github.com/apache/spark/commit/6

[GitHub] spark issue #15780: [SPARK-18284][SQL] Make ExpressionEncoder.serializer.nul...

2016-12-01 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/15780 LGTM except a very minor style comment. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enab

[GitHub] spark issue #16098: [WIP][SPARK-18672][CORE] Close recordwriter in SparkHado...

2016-12-01 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/16098 Build started: [CORE] `org.apache.spark.JavaAPISuite` [![PR-16098](https://ci.appveyor.com/api/projects/status/github/spark-test/spark?branch=B67F4C09-43DD-44D7-90F3-058FB436CA44&svg=true)](https

[GitHub] spark pull request #15780: [SPARK-18284][SQL] Make ExpressionEncoder.seriali...

2016-12-01 Thread ueshin
Github user ueshin commented on a diff in the pull request: https://github.com/apache/spark/pull/15780#discussion_r90447908 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/ScalaReflection.scala --- @@ -498,7 +498,8 @@ object ScalaReflection extends ScalaReflect

[GitHub] spark pull request #15780: [SPARK-18284][SQL] Make ExpressionEncoder.seriali...

2016-12-01 Thread ueshin
Github user ueshin commented on a diff in the pull request: https://github.com/apache/spark/pull/15780#discussion_r90447815 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/JavaTypeInference.scala --- @@ -396,12 +396,14 @@ object JavaTypeInference {

[GitHub] spark issue #16056: [SPARK-18623][SQL] Add `returnNullable` to `StaticInvoke...

2016-12-01 Thread ueshin
Github user ueshin commented on the issue: https://github.com/apache/spark/pull/16056 I will update the comment again after #15780 is merged. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have t

[GitHub] spark pull request #16086: [SPARK-18653][SQL] Fix incorrect space padding fo...

2016-12-01 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/16086#discussion_r90448773 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala --- @@ -236,6 +238,37 @@ class Dataset[T] private[sql]( } } +

[GitHub] spark issue #15843: [SPARK-18274][ML][PYSPARK] Memory leak in PySpark JavaWr...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15843 **[Test build #69476 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69476/consoleFull)** for PR 15843 at commit [`37e83e8`](https://github.com/apache/spark/commit/3

[GitHub] spark pull request #16086: [SPARK-18653][SQL] Fix incorrect space padding fo...

2016-12-01 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/16086#discussion_r90449169 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala --- @@ -236,6 +238,37 @@ class Dataset[T] private[sql]( } } +

[GitHub] spark issue #15219: [SPARK-14098][SQL] Generate Java code to build CachedCol...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15219 **[Test build #69477 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69477/consoleFull)** for PR 15219 at commit [`e6f5a4e`](https://github.com/apache/spark/commit/e

[GitHub] spark pull request #16086: [SPARK-18653][SQL] Fix incorrect space padding fo...

2016-12-01 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/16086#discussion_r90451294 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala --- @@ -275,36 +308,43 @@ class Dataset[T] private[sql]( val numCols = schema.fie

[GitHub] spark pull request #16086: [SPARK-18653][SQL] Fix incorrect space padding fo...

2016-12-01 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/16086#discussion_r90451485 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala --- @@ -275,36 +308,43 @@ class Dataset[T] private[sql]( val numCols = schema.fiel

[GitHub] spark issue #15219: [SPARK-14098][SQL] Generate Java code to build CachedCol...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15219 **[Test build #69478 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69478/consoleFull)** for PR 15219 at commit [`a4beed2`](https://github.com/apache/spark/commit/a

[GitHub] spark issue #15219: [SPARK-14098][SQL] Generate Java code to build CachedCol...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15219 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69477/ Test FAILed. ---

[GitHub] spark issue #15219: [SPARK-14098][SQL] Generate Java code to build CachedCol...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15219 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15219: [SPARK-14098][SQL] Generate Java code to build CachedCol...

2016-12-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15219 **[Test build #69477 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69477/consoleFull)** for PR 15219 at commit [`e6f5a4e`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #16086: [SPARK-18653][SQL] Fix incorrect space padding fo...

2016-12-01 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/16086#discussion_r90452307 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala --- @@ -275,36 +308,43 @@ class Dataset[T] private[sql]( val numCols = schema.fie

[GitHub] spark issue #15219: [SPARK-14098][SQL] Generate Java code to build CachedCol...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15219 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69478/ Test FAILed. ---

[GitHub] spark issue #15219: [SPARK-14098][SQL] Generate Java code to build CachedCol...

2016-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15219 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

  1   2   3   4   5   6   7   >