[GitHub] spark issue #15706: [SPARK-18189] [SQL] Fix serialization issue in KeyValueG...

2016-11-01 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/15706 Thanks! LGTM pending Jenkins. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #15711: [SPARK-18192] Support all file formats in structured str...

2016-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15711 **[Test build #67876 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67876/consoleFull)** for PR 15711 at commit

[GitHub] spark issue #15710: [SPARK-18025] Use commit protocol API in structured stre...

2016-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15710 **[Test build #67877 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67877/consoleFull)** for PR 15710 at commit

[GitHub] spark pull request #15541: [SPARK-17637][Scheduler]Packed scheduling for Spa...

2016-11-01 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/15541#discussion_r85882792 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskAssigner.scala --- @@ -0,0 +1,232 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark issue #15681: [SPARK-18176][Streaming][Kafka] Kafka010 .createRDD() sc...

2016-11-01 Thread lw-lin
Github user lw-lin commented on the issue: https://github.com/apache/spark/pull/15681 Reverted all changes and added another createRDD overload ! :-) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark issue #15667: [SPARK-18107][SQL] Insert overwrite statement runs much ...

2016-11-01 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/15667 @rxin @ericl Thanks! @snodawn I will address dynamic partition in a follow-up pr. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark issue #13575: [SPARK-15472][SQL] Add support for writing in `csv`, `js...

2016-11-01 Thread lw-lin
Github user lw-lin commented on the issue: https://github.com/apache/spark/pull/13575 No problem here. Spark-17924 is super great (I've been watching it all the time) and thank you for bringing that up! --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark issue #15710: [SPARK-18025] Use commit protocol API in structured stre...

2016-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15710 **[Test build #3387 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3387/consoleFull)** for PR 15710 at commit

[GitHub] spark issue #15710: [SPARK-18025] Use commit protocol API in structured stre...

2016-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15710 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15710: [SPARK-18025] Use commit protocol API in structured stre...

2016-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15710 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15172: [SPARK-13331] AES support for over-the-wire encryption

2016-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15172 **[Test build #67870 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67870/consoleFull)** for PR 15172 at commit

[GitHub] spark issue #15667: [SPARK-18107][SQL] Insert overwrite statement runs much ...

2016-11-01 Thread snodawn
Github user snodawn commented on the issue: https://github.com/apache/spark/pull/15667 @viirya @ericl Thanks a lot. The new patch is also passed in my test. And I sincerely hope dynamic partition could be completed in the future, thanks. --- If your project is set up for it, you

[GitHub] spark issue #15667: [SPARK-18107][SQL] Insert overwrite statement runs much ...

2016-11-01 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/15667 Merging in master. Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #15024: [SPARK-17470][SQL] unify path for data source tab...

2016-11-01 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/15024#discussion_r85888109 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveExternalCatalog.scala --- @@ -418,21 +424,41 @@ private[spark] class

[GitHub] spark issue #15688: [SPARK-18173][SQL] data source tables should support tru...

2016-11-01 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15688 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #15669: [SPARK-18160][CORE][YARN] spark.files should not be pass...

2016-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15669 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15669: [SPARK-18160][CORE][YARN] spark.files should not be pass...

2016-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15669 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67868/ Test FAILed. ---

[GitHub] spark issue #15669: [SPARK-18160][CORE][YARN] spark.files should not be pass...

2016-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15669 **[Test build #67868 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67868/consoleFull)** for PR 15669 at commit

[GitHub] spark issue #15702: [SPARK-18124] Observed delay based Event Time Watermarks

2016-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15702 **[Test build #67866 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67866/consoleFull)** for PR 15702 at commit

[GitHub] spark issue #15709: [SPARK-18190][Build][SparkR] Fix R version to not the la...

2016-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15709 **[Test build #67867 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67867/consoleFull)** for PR 15709 at commit

[GitHub] spark issue #15702: [SPARK-18124] Observed delay based Event Time Watermarks

2016-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15702 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #15711: [SPARK-18192] Support all file formats in structu...

2016-11-01 Thread rxin
GitHub user rxin opened a pull request: https://github.com/apache/spark/pull/15711 [SPARK-18192] Support all file formats in structured streaming - WIP ## What changes were proposed in this pull request? I just want to run Jenkins for now. ## How was this patch tested?

[GitHub] spark issue #15688: [SPARK-18173][SQL] data source tables should support tru...

2016-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15688 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15688: [SPARK-18173][SQL] data source tables should support tru...

2016-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15688 **[Test build #67871 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67871/consoleFull)** for PR 15688 at commit

[GitHub] spark issue #15706: [SPARK-18189] [SQL] Fix serialization issue in KeyValueG...

2016-11-01 Thread seyfe
Github user seyfe commented on the issue: https://github.com/apache/spark/pull/15706 Hi @rxin , I added a unittest in [DatasetSuite](https://github.com/apache/spark/blob/master/sql/core/src/test/scala/org/apache/spark/sql/DatasetSuite.scala) but I wasn't able to repro it.

[GitHub] spark issue #15688: [SPARK-18173][SQL] data source tables should support tru...

2016-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15688 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67871/ Test FAILed. ---

[GitHub] spark issue #15710: [SPARK-18025] Use commit protocol API in structured stre...

2016-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15710 **[Test build #67874 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67874/consoleFull)** for PR 15710 at commit

[GitHub] spark issue #15710: [SPARK-18025] Use commit protocol API in structured stre...

2016-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15710 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67874/ Test FAILed. ---

[GitHub] spark issue #15703: [SPARK-18186] Migrate HiveUDAFFunction to TypedImperativ...

2016-11-01 Thread tejasapatil
Github user tejasapatil commented on the issue: https://github.com/apache/spark/pull/15703 This will surely improve performance for the UDAFs where the data shrinks (eg. `max` as you pointed out). I am not sure if it would be better for UDAFs like `GenericUDAFCollectSet`,

[GitHub] spark pull request #15709: [SPARK-18190][Build][SparkR] Fix R version to not...

2016-11-01 Thread HyukjinKwon
Github user HyukjinKwon closed the pull request at: https://github.com/apache/spark/pull/15709 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark issue #15709: [SPARK-18190][Build][SparkR] Fix R version to not the la...

2016-11-01 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/15709 It seems fine now. Closing this. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15711: [SPARK-18192] Support all file formats in structured str...

2016-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15711 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67875/ Test FAILed. ---

[GitHub] spark issue #15711: [SPARK-18192] Support all file formats in structured str...

2016-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15711 **[Test build #67875 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67875/consoleFull)** for PR 15711 at commit

[GitHub] spark issue #15711: [SPARK-18192] Support all file formats in structured str...

2016-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15711 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15659: [SPARK-1267][SPARK-18129] Allow PySpark to be pip instal...

2016-11-01 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/15659 Build started: [SparkR] `ALL`

[GitHub] spark issue #15681: [SPARK-18176][Streaming][Kafka] Kafka010 .createRDD() sc...

2016-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15681 **[Test build #67879 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67879/consoleFull)** for PR 15681 at commit

[GitHub] spark issue #15671: [SPARK-14567][ML]Add instrumentation logs to ML training...

2016-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15671 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #15705: [SPARK-18183] [SPARK-18184] Fix INSERT [INTO|OVER...

2016-11-01 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/15705#discussion_r85890184 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/CatalogFileIndex.scala --- @@ -67,7 +67,10 @@ class CatalogFileIndex(

[GitHub] spark pull request #15542: [SPARK-17996][SQL] Fix unqualified catalog.getFun...

2016-11-01 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/15542#discussion_r85895743 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/internal/CatalogImpl.scala --- @@ -133,11 +133,11 @@ class CatalogImpl(sparkSession: SparkSession)

[GitHub] spark issue #15542: [SPARK-17996][SQL] Fix unqualified catalog.getFunction(....

2016-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15542 **[Test build #67883 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67883/consoleFull)** for PR 15542 at commit

[GitHub] spark issue #13575: [SPARK-15472][SQL] Add support for writing in `csv`, `js...

2016-11-01 Thread lw-lin
Github user lw-lin commented on the issue: https://github.com/apache/spark/pull/13575 No problem here. Spark-17924 is super great (I've been watching it all the time) and @rxin thank you for bringing that up! :-D --- If your project is set up for it, you can reply to this email and

[GitHub] spark issue #15702: [SPARK-18124] Observed delay based Event Time Watermarks

2016-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15702 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67866/ Test PASSed. ---

[GitHub] spark issue #15711: [SPARK-18192] Support all file formats in structured str...

2016-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15711 **[Test build #67875 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67875/consoleFull)** for PR 15711 at commit

[GitHub] spark issue #15709: [SPARK-18190][Build][SparkR] Fix R version to not the la...

2016-11-01 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/15709 Oh, it seems 3.3.1 is just right now released for Windows as well. It seems fine now - https://ci.appveyor.com/project/spark-test/spark/build/45-test1122 I will close this if the tests pass

[GitHub] spark issue #15709: [SPARK-18190][Build][SparkR] Fix R version to not the la...

2016-11-01 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/15709 Oh wait. Please do not merge this. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15709: [SPARK-18190][Build][SparkR] Fix R version to not the la...

2016-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15709 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15709: [SPARK-18190][Build][SparkR] Fix R version to not the la...

2016-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15709 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67867/ Test PASSed. ---

[GitHub] spark issue #15709: [SPARK-18190][Build][SparkR] Fix R version to not the la...

2016-11-01 Thread shivaram
Github user shivaram commented on the issue: https://github.com/apache/spark/pull/15709 Yeah I'm fine with fixing a version - but as you said its sometimes helpful to find if we have some problems with a newly released R version. But yeah we should have a stable download URL

[GitHub] spark issue #15671: [SPARK-14567][ML]Add instrumentation logs to ML training...

2016-11-01 Thread zhengruifeng
Github user zhengruifeng commented on the issue: https://github.com/apache/spark/pull/15671 @sethah Thanks for your reviewing. I have made changes according to your comments. And I will create JIRAs for meta algos. --- If your project is set up for it, you can reply to this email

[GitHub] spark issue #15671: [SPARK-14567][ML]Add instrumentation logs to ML training...

2016-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15671 **[Test build #67878 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67878/consoleFull)** for PR 15671 at commit

[GitHub] spark issue #15541: [SPARK-17637][Scheduler]Packed scheduling for Spark task...

2016-11-01 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/15541 To be honest, I find the current API pretty weird (it is some stateful object that has to be reset every time). I suspect you designed this API by just abstracting out the logic you wanted to change

[GitHub] spark issue #15666: [SPARK-11421] [Core][Python][R] Added ability for addJar...

2016-11-01 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/15666 Build started: [SparkR] `ALL`

[GitHub] spark pull request #15667: [SPARK-18107][SQL] Insert overwrite statement run...

2016-11-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15667 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #15681: [SPARK-18176][Streaming][Kafka] Kafka010 .createRDD() sc...

2016-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15681 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15681: [SPARK-18176][Streaming][Kafka] Kafka010 .createRDD() sc...

2016-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15681 **[Test build #67879 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67879/consoleFull)** for PR 15681 at commit

[GitHub] spark issue #15681: [SPARK-18176][Streaming][Kafka] Kafka010 .createRDD() sc...

2016-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15681 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67879/ Test PASSed. ---

[GitHub] spark issue #15024: [SPARK-17470][SQL] unify path for data source table and ...

2016-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15024 **[Test build #67881 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67881/consoleFull)** for PR 15024 at commit

[GitHub] spark issue #15671: [SPARK-14567][ML]Add instrumentation logs to ML training...

2016-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15671 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67878/ Test PASSed. ---

[GitHub] spark issue #15671: [SPARK-14567][ML]Add instrumentation logs to ML training...

2016-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15671 **[Test build #67878 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67878/consoleFull)** for PR 15671 at commit

[GitHub] spark issue #15688: [SPARK-18173][SQL] data source tables should support tru...

2016-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15688 **[Test build #67882 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67882/consoleFull)** for PR 15688 at commit

[GitHub] spark issue #15691: [SPARK-18175] [SQL] Improve the test case coverage of im...

2016-11-01 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15691 LGTM, should we put the matrix in the test suite? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark issue #15706: [SPARK-18189] [SQL] Fix serialization issue in KeyValueG...

2016-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15706 **[Test build #3388 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3388/consoleFull)** for PR 15706 at commit

[GitHub] spark pull request #15542: [SPARK-17996][SQL] Fix unqualified catalog.getFun...

2016-11-01 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/15542#discussion_r85896229 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/functions.scala --- @@ -118,14 +118,16 @@ case class DescribeFunctionCommand(

[GitHub] spark issue #15707: [SPARK-18024][SQL] Introduce an internal commit protocol...

2016-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15707 **[Test build #3386 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3386/consoleFull)** for PR 15707 at commit

[GitHub] spark issue #15710: [SPARK-18025] Use commit protocol API in structured stre...

2016-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15710 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67873/ Test FAILed. ---

[GitHub] spark issue #15710: [SPARK-18025] Use commit protocol API in structured stre...

2016-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15710 **[Test build #67873 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67873/consoleFull)** for PR 15710 at commit

[GitHub] spark issue #15697: [SparkR][Test]:remove unnecessary suppressWarnings

2016-11-01 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/15697 Build started: [SparkR] `ALL`

[GitHub] spark issue #15706: [SPARK-18189] [SQL] Fix serialization issue in KeyValueG...

2016-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15706 **[Test build #3388 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3388/consoleFull)** for PR 15706 at commit

[GitHub] spark issue #15710: [SPARK-18025] Use commit protocol API in structured stre...

2016-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15710 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67877/ Test FAILed. ---

[GitHub] spark issue #15710: [SPARK-18025] Use commit protocol API in structured stre...

2016-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15710 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #15691: [SPARK-18175] [SQL] Improve the test case coverag...

2016-11-01 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/15691#discussion_r85890813 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/analysis/TypeCoercionSuite.scala --- @@ -30,37 +30,185 @@ import

[GitHub] spark issue #15172: [SPARK-13331] AES support for over-the-wire encryption

2016-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15172 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67870/ Test PASSed. ---

[GitHub] spark issue #15172: [SPARK-13331] AES support for over-the-wire encryption

2016-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15172 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15024: [SPARK-17470][SQL] unify path for data source table and ...

2016-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15024 **[Test build #67880 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67880/consoleFull)** for PR 15024 at commit

[GitHub] spark issue #15024: [SPARK-17470][SQL] unify path for data source table and ...

2016-11-01 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15024 @yhuai 3 places. It's easy to track it via code diff, as if we miss it somewhere, the test will fail because no path is specified.(data source tables never pass the `paths` parameter to

[GitHub] spark issue #15711: [SPARK-18192] Support all file formats in structured str...

2016-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15711 **[Test build #67876 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67876/consoleFull)** for PR 15711 at commit

[GitHub] spark issue #15710: [SPARK-18025] Use commit protocol API in structured stre...

2016-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15710 **[Test build #67877 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67877/consoleFull)** for PR 15710 at commit

[GitHub] spark issue #15711: [SPARK-18192] Support all file formats in structured str...

2016-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15711 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67876/ Test FAILed. ---

[GitHub] spark issue #15711: [SPARK-18192] Support all file formats in structured str...

2016-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15711 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #15542: [SPARK-17996][SQL] Fix unqualified catalog.getFun...

2016-11-01 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/15542#discussion_r85895982 --- Diff: sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/ExpressionInfo.java --- @@ -42,14 +43,23 @@ public String getExtended() {

[GitHub] spark issue #15687: Update SparkPi.scala

2016-11-01 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/15687 Out of curiosity do you remember how many times one was bigger than the other? if it was 10/10 then you probably have a point, and that there's something about the way the example actually executes

[GitHub] spark issue #15688: [SPARK-18173][SQL] data source tables should support tru...

2016-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15688 **[Test build #67882 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67882/consoleFull)** for PR 15688 at commit

[GitHub] spark issue #14375: [SPARK-15194] [ML] Add Python ML API for MultivariateGau...

2016-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14375 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #15669: [SPARK-18160][CORE][YARN] spark.files should not be pass...

2016-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15669 **[Test build #67885 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67885/consoleFull)** for PR 15669 at commit

[GitHub] spark pull request #13599: [SPARK-13587] [PYSPARK] Support virtualenv in pys...

2016-11-01 Thread Stibbons
Github user Stibbons commented on a diff in the pull request: https://github.com/apache/spark/pull/13599#discussion_r85907139 --- Diff: core/src/main/scala/org/apache/spark/api/python/PythonWorkerFactory.scala --- @@ -69,6 +84,66 @@ private[spark] class

[GitHub] spark issue #15688: [SPARK-18173][SQL] data source tables should support tru...

2016-11-01 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15688 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #15687: Update SparkPi.scala

2016-11-01 Thread mrydzy
Github user mrydzy commented on the issue: https://github.com/apache/spark/pull/15687 It was exactly 7/10. Realising '<=' made the concept clearer to me (as I'm a beginner following examples), but it might be it's just me, so I'm not insisting. 2016-11-01 10:40

[GitHub] spark issue #15672: [SPARK-18148][SQL] Misleading Error Message for Aggregat...

2016-11-01 Thread jiangxb1987
Github user jiangxb1987 commented on the issue: https://github.com/apache/spark/pull/15672 @rxin I've updated test sqls to use one dataset. Thank you! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark issue #15538: [SPARK-17993][SQL] Fix Parquet log output redirection

2016-11-01 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/15538 Yeah there's a ticket for it to solve a different parquet bug. That might be the path of least resistance. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark issue #15024: [SPARK-17470][SQL] unify path for data source table and ...

2016-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15024 **[Test build #67880 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67880/consoleFull)** for PR 15024 at commit

[GitHub] spark issue #13599: [SPARK-13587] [PYSPARK] Support virtualenv in pyspark

2016-11-01 Thread Stibbons
Github user Stibbons commented on the issue: https://github.com/apache/spark/pull/13599 Maybe we can try to split this work in several parts to ease merge. I clearly think python job should be deployed a bit like jar dependencies are specified for scala (with `--packages`), and this

[GitHub] spark issue #15542: [SPARK-17996][SQL] Fix unqualified catalog.getFunction(....

2016-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15542 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15542: [SPARK-17996][SQL] Fix unqualified catalog.getFunction(....

2016-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15542 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67883/ Test PASSed. ---

[GitHub] spark pull request #15669: [SPARK-18160][CORE][YARN] spark.files should not ...

2016-11-01 Thread zjffdu
Github user zjffdu closed the pull request at: https://github.com/apache/spark/pull/15669 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #15024: [SPARK-17470][SQL] unify path for data source table and ...

2016-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15024 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15024: [SPARK-17470][SQL] unify path for data source table and ...

2016-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15024 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67881/ Test PASSed. ---

[GitHub] spark issue #14444: [SPARK-16839] [SQL] redundant aliases after cleanupAlias...

2016-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/1 **[Test build #67886 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67886/consoleFull)** for PR 1 at commit

[GitHub] spark pull request #13599: [SPARK-13587] [PYSPARK] Support virtualenv in pys...

2016-11-01 Thread Stibbons
Github user Stibbons commented on a diff in the pull request: https://github.com/apache/spark/pull/13599#discussion_r85907419 --- Diff: core/src/main/scala/org/apache/spark/api/python/PythonWorkerFactory.scala --- @@ -69,6 +84,67 @@ private[spark] class

[GitHub] spark issue #15542: [SPARK-17996][SQL] Fix unqualified catalog.getFunction(....

2016-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15542 **[Test build #67883 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67883/consoleFull)** for PR 15542 at commit

[GitHub] spark issue #15712: [SPARK-18103][Follow-up][SQL] Rename `MetadataLogFileCat...

2016-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15712 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

  1   2   3   4   5   6   7   8   >