[GitHub] spark pull request #13560: [SPARK-15823][PySpark][ML] Add @property for 'acc...

2016-06-09 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/13560#discussion_r66415310 --- Diff: python/pyspark/mllib/evaluation.py --- @@ -183,7 +183,7 @@ class MulticlassMetrics(JavaModelWrapper): 0.66... >>> metrics.recall()

[GitHub] spark pull request #13552: [SPARK-15813] Use past tense for the cancel conta...

2016-06-09 Thread peterableda
Github user peterableda commented on a diff in the pull request: https://github.com/apache/spark/pull/13552#discussion_r66394240 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/YarnAllocator.scala --- @@ -353,7 +353,7 @@ private[yarn] class YarnAllocator(

[GitHub] spark pull request #13518: [WIP][SPARK-15472][SQL] Add support for writing i...

2016-06-09 Thread lw-lin
Github user lw-lin closed the pull request at: https://github.com/apache/spark/pull/13518 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #11887: [SPARK-13041][Mesos]add driver sandbox uri to the...

2016-06-09 Thread skonto
Github user skonto commented on a diff in the pull request: https://github.com/apache/spark/pull/11887#discussion_r66418456 --- Diff: core/src/main/scala/org/apache/spark/deploy/mesos/ui/MesosClusterPage.scala --- @@ -68,6 +75,25 @@ private[mesos] class MesosClusterPage(parent:

[GitHub] spark issue #13574: [SPARK-15841] REPLSuite has incorrect env set for a coup...

2016-06-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13574 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13574: [SPARK-15841] REPLSuite has incorrect env set for a coup...

2016-06-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13574 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60228/ Test PASSed. ---

[GitHub] spark issue #13323: [SPARK-15555] [Mesos] Driver with --supervise option can...

2016-06-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13323 **[Test build #60231 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60231/consoleFull)** for PR 13323 at commit

[GitHub] spark issue #13574: [SPARK-15841] REPLSuite has incorrect env set for a coup...

2016-06-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13574 **[Test build #60228 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60228/consoleFull)** for PR 13574 at commit

[GitHub] spark issue #13575: [SPARK-15472][SQL] Add support for writing in `csv`, `js...

2016-06-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13575 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60230/ Test PASSed. ---

[GitHub] spark issue #13575: [SPARK-15472][SQL] Add support for writing in `csv`, `js...

2016-06-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13575 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13575: [SPARK-15472][SQL] Add support for writing in `csv`, `js...

2016-06-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13575 **[Test build #60230 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60230/consoleFull)** for PR 13575 at commit

[GitHub] spark pull request #11887: [SPARK-13041][Mesos]add driver sandbox uri to the...

2016-06-09 Thread skonto
Github user skonto commented on a diff in the pull request: https://github.com/apache/spark/pull/11887#discussion_r66418116 --- Diff: core/src/main/scala/org/apache/spark/deploy/mesos/ui/MesosClusterPage.scala --- @@ -68,6 +75,25 @@ private[mesos] class MesosClusterPage(parent:

[GitHub] spark pull request #11887: [SPARK-13041][Mesos]add driver sandbox uri to the...

2016-06-09 Thread skonto
Github user skonto commented on a diff in the pull request: https://github.com/apache/spark/pull/11887#discussion_r66418140 --- Diff: core/src/main/scala/org/apache/spark/deploy/mesos/ui/MesosClusterPage.scala --- @@ -68,6 +75,25 @@ private[mesos] class MesosClusterPage(parent:

[GitHub] spark pull request #11887: [SPARK-13041][Mesos]add driver sandbox uri to the...

2016-06-09 Thread skonto
Github user skonto commented on a diff in the pull request: https://github.com/apache/spark/pull/11887#discussion_r66418166 --- Diff: core/src/main/scala/org/apache/spark/deploy/mesos/ui/MesosClusterPage.scala --- @@ -68,6 +75,25 @@ private[mesos] class MesosClusterPage(parent:

[GitHub] spark pull request #11887: [SPARK-13041][Mesos]add driver sandbox uri to the...

2016-06-09 Thread skonto
Github user skonto commented on a diff in the pull request: https://github.com/apache/spark/pull/11887#discussion_r66418176 --- Diff: core/src/main/scala/org/apache/spark/deploy/mesos/ui/MesosClusterPage.scala --- @@ -115,4 +142,58 @@ private[mesos] class MesosClusterPage(parent:

[GitHub] spark issue #13575: [SPARK-15472][SQL] Add support for writing in `csv`, `js...

2016-06-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13575 **[Test build #60230 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60230/consoleFull)** for PR 13575 at commit

[GitHub] spark pull request #13576: [SPARK-15840][SQL] Add missing options in documen...

2016-06-09 Thread HyukjinKwon
GitHub user HyukjinKwon opened a pull request: https://github.com/apache/spark/pull/13576 [SPARK-15840][SQL] Add missing options in documentation, inferSchema for CSV and mergeSchema for Parquet ## What changes were proposed in this pull request? This PR 1. Adds

[GitHub] spark pull request #13575: [SPARK-15472][SQL] Add support for writing in `cs...

2016-06-09 Thread lw-lin
GitHub user lw-lin opened a pull request: https://github.com/apache/spark/pull/13575 [SPARK-15472][SQL] Add support for writing in `csv`, `json`, `text` formats in Structured Streaming ## What changes were proposed in this pull request? This patch adds support for writing

[GitHub] spark issue #11887: [SPARK-13041][Mesos]add driver sandbox uri to the dispat...

2016-06-09 Thread skonto
Github user skonto commented on the issue: https://github.com/apache/spark/pull/11887 @tnachen i will fix those. I am also waiting for the fix. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #13437: [SPARK-15697] [REPL] Unblock some of the useful repl com...

2016-06-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13437 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13437: [SPARK-15697] [REPL] Unblock some of the useful repl com...

2016-06-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13437 **[Test build #60229 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60229/consoleFull)** for PR 13437 at commit

[GitHub] spark issue #13437: [SPARK-15697] [REPL] Unblock some of the useful repl com...

2016-06-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13437 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60229/ Test PASSed. ---

[GitHub] spark issue #13575: [SPARK-15472][SQL] Add support for writing in `csv`, `js...

2016-06-09 Thread lw-lin
Github user lw-lin commented on the issue: https://github.com/apache/spark/pull/13575 @marmbrus @tdas @zsxwing , would you mind taking a look? Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request #13575: [SPARK-15472][SQL] Add support for writing in `cs...

2016-06-09 Thread ScrapCodes
Github user ScrapCodes commented on a diff in the pull request: https://github.com/apache/spark/pull/13575#discussion_r66433407 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSource.scala --- @@ -246,7 +247,12 @@ case class DataSource(

[GitHub] spark pull request #13556: [SPARK-15818] [BUILD] Upgrade to Hadoop 2.7.2

2016-06-09 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/13556 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #13483: [SPARK-15688][SQL] RelationalGroupedDataset.toDF should ...

2016-06-09 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/13483 Thank you @marmbrus @dilipbiswal and @viirya ! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #13558: [SPARK-15820][PySpark][SQL]Add Catalog.refreshTable into...

2016-06-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13558 **[Test build #60226 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60226/consoleFull)** for PR 13558 at commit

[GitHub] spark issue #13558: [SPARK-15820][PySpark][SQL]Add Catalog.refreshTable into...

2016-06-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13558 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60226/ Test FAILed. ---

[GitHub] spark issue #13558: [SPARK-15820][PySpark][SQL]Add Catalog.refreshTable into...

2016-06-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13558 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13558: [SPARK-15820][PySpark][SQL]Add Catalog.refreshTable into...

2016-06-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13558 **[Test build #60226 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60226/consoleFull)** for PR 13558 at commit

[GitHub] spark issue #13562: [SPARK-15821] [DOCS] Include parallel build info

2016-06-09 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/13562 OK fair enough, worth keeping in mind as I know any little helps for build times. For machines that aren't loaded, any parallelism could help, even `-T 2`. For machines that are, in theory things

[GitHub] spark issue #13573: [SPARK-15839] Fix Maven doc-jar generation when JAVA_7_H...

2016-06-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13573 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60227/ Test FAILed. ---

[GitHub] spark issue #13573: [SPARK-15839] Fix Maven doc-jar generation when JAVA_7_H...

2016-06-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13573 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13573: [SPARK-15839] Fix Maven doc-jar generation when JAVA_7_H...

2016-06-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13573 **[Test build #60227 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60227/consoleFull)** for PR 13573 at commit

[GitHub] spark pull request #13573: [SPARK-15839] Fix Maven doc-jar generation when J...

2016-06-09 Thread JoshRosen
GitHub user JoshRosen opened a pull request: https://github.com/apache/spark/pull/13573 [SPARK-15839] Fix Maven doc-jar generation when JAVA_7_HOME is set ## What changes were proposed in this pull request? It looks like the nightly Maven snapshots broke after we set

[GitHub] spark issue #13574: [SPARK-15841] REPLSuite has incorrect env set for a coup...

2016-06-09 Thread ScrapCodes
Github user ScrapCodes commented on the issue: https://github.com/apache/spark/pull/13574 @zsxwing Please take a look ! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #12836: [SPARK-12922][SparkR][WIP] Implement gapply() on DataFra...

2016-06-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/12836 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13403: [SPARK-15660][CORE] RDD and Dataset should show the cons...

2016-06-09 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/13403 What about just adding an explicit note on old `StatCounter.stdev`? http://spark.apache.org/docs/2.0.0-preview/api/scala/index.html#org.apache.spark.util.StatCounter MLLIB

[GitHub] spark issue #13574: [SPARK-15841] REPLSuite has incorrect env set for a coup...

2016-06-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13574 **[Test build #60228 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60228/consoleFull)** for PR 13574 at commit

[GitHub] spark issue #13573: [SPARK-15839] Fix Maven doc-jar generation when JAVA_7_H...

2016-06-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13573 **[Test build #60227 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60227/consoleFull)** for PR 13573 at commit

[GitHub] spark issue #13568: [SPARK-12712] Fix failure in ./dev/test-dependencies whe...

2016-06-09 Thread JoshRosen
Github user JoshRosen commented on the issue: https://github.com/apache/spark/pull/13568 Merging to master, 2.0, and branch-1.6. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13403: [SPARK-15660][CORE] RDD and Dataset should show the cons...

2016-06-09 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/13403 Although we can not change old API, I think it's a good idea to add `popVariance` and `popStdev` clearly. If everything in this PR is now allowed, what about just adding an explicit

[GitHub] spark issue #12836: [SPARK-12922][SparkR][WIP] Implement gapply() on DataFra...

2016-06-09 Thread NarineK
Github user NarineK commented on the issue: https://github.com/apache/spark/pull/12836 Hi @sun-rui, hi @shivaram, I've overwritten the stringArgs - I've pushed my changes in the following branch. I haven't created a jira yet.

[GitHub] spark issue #13572: [SPARK-15838] [SQL] CACHE TABLE AS SELECT should not rep...

2016-06-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13572 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60224/ Test PASSed. ---

[GitHub] spark issue #13572: [SPARK-15838] [SQL] CACHE TABLE AS SELECT should not rep...

2016-06-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13572 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60225/ Test PASSed. ---

[GitHub] spark pull request #13552: [SPARK-15813] Use past tense for the cancel conta...

2016-06-09 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/13552#discussion_r66404015 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/YarnAllocator.scala --- @@ -353,7 +353,7 @@ private[yarn] class YarnAllocator( }

[GitHub] spark issue #13572: [SPARK-15838] [SQL] CACHE TABLE AS SELECT should not rep...

2016-06-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13572 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13572: [SPARK-15838] [SQL] CACHE TABLE AS SELECT should not rep...

2016-06-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13572 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13572: [SPARK-15838] [SQL] CACHE TABLE AS SELECT should not rep...

2016-06-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13572 **[Test build #60225 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60225/consoleFull)** for PR 13572 at commit

[GitHub] spark issue #12836: [SPARK-12922][SparkR][WIP] Implement gapply() on DataFra...

2016-06-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/12836 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60223/ Test FAILed. ---

[GitHub] spark pull request #13574: [SPARK-15841] REPLSuite has incorrect env set for...

2016-06-09 Thread ScrapCodes
GitHub user ScrapCodes opened a pull request: https://github.com/apache/spark/pull/13574 [SPARK-15841] REPLSuite has incorrect env set for a couple of tests. ## What changes were proposed in this pull request? Description from JIRA. In ReplSuite, for a test that can be

[GitHub] spark issue #13556: [SPARK-15818] [BUILD] Upgrade to Hadoop 2.7.2

2016-06-09 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/13556 Merged to master/2.0 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark pull request #13568: [SPARK-12712] Fix failure in ./dev/test-dependenc...

2016-06-09 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/13568 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #13572: [SPARK-15838] [SQL] CACHE TABLE AS SELECT should not rep...

2016-06-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13572 **[Test build #60224 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60224/consoleFull)** for PR 13572 at commit

[GitHub] spark issue #13437: [SPARK-15697] [REPL] Unblock some of the useful repl com...

2016-06-09 Thread ScrapCodes
Github user ScrapCodes commented on the issue: https://github.com/apache/spark/pull/13437 I have decided to leave out reset as blocked as we can discuss the semantics of having it in an another issue. @zsxwing Please take a look ! --- If your project is set up for it, you

[GitHub] spark issue #13437: [SPARK-15697] [REPL] Unblock some of the useful repl com...

2016-06-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13437 **[Test build #60229 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60229/consoleFull)** for PR 13437 at commit

[GitHub] spark issue #13577: [Minor][Doc] Improve SQLContext Documentation and Fix Sp...

2016-06-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13577 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60233/ Test PASSed. ---

[GitHub] spark issue #13577: [Minor][Doc] Improve SQLContext Documentation and Fix Sp...

2016-06-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13577 **[Test build #60234 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60234/consoleFull)** for PR 13577 at commit

[GitHub] spark issue #13576: [SPARK-15840][SQL] Add missing options in documentation,...

2016-06-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13576 **[Test build #60235 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60235/consoleFull)** for PR 13576 at commit

[GitHub] spark issue #13323: [SPARK-15555] [Mesos] Driver with --supervise option can...

2016-06-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13323 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13323: [SPARK-15555] [Mesos] Driver with --supervise option can...

2016-06-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13323 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60231/ Test PASSed. ---

[GitHub] spark pull request #13577: [Minor][Doc] Improve SQLContext Documentation and...

2016-06-09 Thread techaddict
GitHub user techaddict opened a pull request: https://github.com/apache/spark/pull/13577 [Minor][Doc] Improve SQLContext Documentation and Fix SparkSession and sql.functions Documentation ## What changes were proposed in this pull request? 1. In SparkSession, add emptyDataset

[GitHub] spark issue #13323: [SPARK-15555] [Mesos] Driver with --supervise option can...

2016-06-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13323 **[Test build #60231 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60231/consoleFull)** for PR 13323 at commit

[GitHub] spark issue #13576: [SPARK-15840][SQL] Add missing options in documentation,...

2016-06-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13576 **[Test build #60232 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60232/consoleFull)** for PR 13576 at commit

[GitHub] spark issue #13576: [SPARK-15840][SQL] Add missing options in documentation,...

2016-06-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13576 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13576: [SPARK-15840][SQL] Add missing options in documentation,...

2016-06-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13576 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60235/ Test PASSed. ---

[GitHub] spark issue #13577: [Minor][Doc] Improve SQLContext Documentation and Fix Sp...

2016-06-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13577 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13577: [Minor][Doc] Improve SQLContext Documentation and Fix Sp...

2016-06-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13577 **[Test build #60234 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60234/consoleFull)** for PR 13577 at commit

[GitHub] spark issue #13577: [Minor][Doc] Improve SQLContext Documentation and Fix Sp...

2016-06-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13577 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13577: [Minor][Doc] Improve SQLContext Documentation and Fix Sp...

2016-06-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13577 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60234/ Test PASSed. ---

[GitHub] spark issue #13577: [Minor][Doc] Improve SQLContext Documentation and Fix Sp...

2016-06-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13577 **[Test build #60233 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60233/consoleFull)** for PR 13577 at commit

[GitHub] spark issue #13557: [SPARK-15819][PYSPARK] Add KMeanSummary in KMeans of PyS...

2016-06-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13557 **[Test build #60236 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60236/consoleFull)** for PR 13557 at commit

[GitHub] spark issue #13576: [SPARK-15840][SQL] Add missing options in documentation,...

2016-06-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13576 **[Test build #60235 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60235/consoleFull)** for PR 13576 at commit

[GitHub] spark pull request #13575: [SPARK-15472][SQL] Add support for writing in `cs...

2016-06-09 Thread lw-lin
Github user lw-lin commented on a diff in the pull request: https://github.com/apache/spark/pull/13575#discussion_r66466310 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/CSVRelation.scala --- @@ -143,39 +146,99 @@ object CSVRelation extends

[GitHub] spark issue #13578: [SPARK-15837][ML][PySpark]Word2vec python add maxsentenc...

2016-06-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13578 **[Test build #60237 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60237/consoleFull)** for PR 13578 at commit

[GitHub] spark pull request #13575: [SPARK-15472][SQL] Add support for writing in `cs...

2016-06-09 Thread lw-lin
Github user lw-lin commented on a diff in the pull request: https://github.com/apache/spark/pull/13575#discussion_r66467191 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/text/TextFileFormat.scala --- @@ -120,24 +109,31 @@ class TextFileFormat

[GitHub] spark issue #13578: [SPARK-15837][ML][PySpark]Word2vec python add maxsentenc...

2016-06-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13578 **[Test build #60237 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60237/consoleFull)** for PR 13578 at commit

[GitHub] spark pull request #13578: [SPARK-15837][ML][PySpark]Word2vec python add max...

2016-06-09 Thread WeichenXu123
GitHub user WeichenXu123 opened a pull request: https://github.com/apache/spark/pull/13578 [SPARK-15837][ML][PySpark]Word2vec python add maxsentence parameter ## What changes were proposed in this pull request? Word2vec python add maxsentence parameter. ## How was

[GitHub] spark pull request #13575: [SPARK-15472][SQL] Add support for writing in `cs...

2016-06-09 Thread lw-lin
Github user lw-lin commented on a diff in the pull request: https://github.com/apache/spark/pull/13575#discussion_r66466672 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/json/JsonFileFormat.scala --- @@ -146,16 +173,53 @@ class JsonFileFormat

[GitHub] spark issue #13578: [SPARK-15837][ML][PySpark]Word2vec python add maxsentenc...

2016-06-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13578 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13578: [SPARK-15837][ML][PySpark]Word2vec python add maxsentenc...

2016-06-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13578 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60237/ Test PASSed. ---

[GitHub] spark issue #13557: [SPARK-15819][PYSPARK] Add KMeanSummary in KMeans of PyS...

2016-06-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13557 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13557: [SPARK-15819][PYSPARK] Add KMeanSummary in KMeans of PyS...

2016-06-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13557 **[Test build #60236 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60236/consoleFull)** for PR 13557 at commit

[GitHub] spark issue #13557: [SPARK-15819][PYSPARK] Add KMeanSummary in KMeans of PyS...

2016-06-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13557 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60236/ Test PASSed. ---

[GitHub] spark pull request #13575: [SPARK-15472][SQL] Add support for writing in `cs...

2016-06-09 Thread lw-lin
Github user lw-lin commented on a diff in the pull request: https://github.com/apache/spark/pull/13575#discussion_r66466502 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/CSVRelation.scala --- @@ -143,39 +146,99 @@ object CSVRelation extends

[GitHub] spark pull request #13575: [SPARK-15472][SQL] Add support for writing in `cs...

2016-06-09 Thread lw-lin
Github user lw-lin commented on a diff in the pull request: https://github.com/apache/spark/pull/13575#discussion_r66467095 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetFileFormat.scala --- @@ -488,7 +488,12 @@ private[sql] class

[GitHub] spark pull request #13575: [SPARK-15472][SQL] Add support for writing in `cs...

2016-06-09 Thread lw-lin
Github user lw-lin commented on a diff in the pull request: https://github.com/apache/spark/pull/13575#discussion_r66465201 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSource.scala --- @@ -246,7 +247,12 @@ case class DataSource(

[GitHub] spark issue #13578: [SPARK-15837][ML][PySpark]Word2vec python add maxsentenc...

2016-06-09 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/13578 Seems OK --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #13578: [SPARK-15837][ML][PySpark]Word2vec python add maxsentenc...

2016-06-09 Thread WeichenXu123
Github user WeichenXu123 commented on the issue: https://github.com/apache/spark/pull/13578 @srowen Hi srowen, I have another similar PR #13558 which past test on my machine, but the official test fail. It seems to be the test server's problem, can you help to check it ? --- If

[GitHub] spark pull request #13580: Revert "[SPARK-14485][CORE] ignore task finished ...

2016-06-09 Thread kayousterhout
GitHub user kayousterhout opened a pull request: https://github.com/apache/spark/pull/13580 Revert "[SPARK-14485][CORE] ignore task finished for executor lost an… ## What changes were proposed in this pull request? This reverts commit

[GitHub] spark issue #13580: Revert "[SPARK-14485][CORE] ignore task finished for exe...

2016-06-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13580 **[Test build #60241 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60241/consoleFull)** for PR 13580 at commit

[GitHub] spark issue #13540: [SPARK-15788][PYSPARK][ML] PySpark IDFModel missing "idf...

2016-06-09 Thread MLnick
Github user MLnick commented on the issue: https://github.com/apache/spark/pull/13540 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #13555: [SPARK-15804][SQL]Include metadata in the toStructType

2016-06-09 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/13555 thanks, merging to master and 2.0! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13400: [SPARK-15655] [SQL] Fix Wrong Partition Column Order whe...

2016-06-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13400 **[Test build #60240 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60240/consoleFull)** for PR 13400 at commit

[GitHub] spark pull request #13555: [SPARK-15804][SQL]Include metadata in the toStruc...

2016-06-09 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/13555 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #13549: [SPARK-15812][SQ][Streaming] Added support for so...

2016-06-09 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/13549#discussion_r66491058 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/UnsupportedOperationChecker.scala --- @@ -43,6 +43,41 @@ object

[GitHub] spark issue #13573: [SPARK-15839] Fix Maven doc-jar generation when JAVA_7_H...

2016-06-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13573 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13573: [SPARK-15839] Fix Maven doc-jar generation when JAVA_7_H...

2016-06-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13573 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60239/ Test PASSed. ---

[GitHub] spark issue #13549: [SPARK-15812][SQ][Streaming] Added support for sorting a...

2016-06-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13549 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60242/ Test FAILed. ---

[GitHub] spark issue #13549: [SPARK-15812][SQ][Streaming] Added support for sorting a...

2016-06-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13549 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

  1   2   3   4   5   >