[GitHub] spark issue #13541: [SPARK-15803][PYSPARK] Support with statement syntax for...

[davies]

Github user davies commented on the issue:

https://github.com/apache/spark/pull/13541
  
Merging this into master and 2.0, thanks!


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13541: [SPARK-15803][PYSPARK] Support with statement syntax for...

[davies]

Github user davies commented on the issue:

https://github.com/apache/spark/pull/13541
  
LGTM


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13734: [SPARK-14995][R] Add `since` tag in Roxygen documentatio...

[dongjoon-hyun]

Github user dongjoon-hyun commented on the issue:

https://github.com/apache/spark/pull/13734
  
Hi, @shivaram and @felixcheung .
Now the document is updated with master and shows merged notes correctly. I 
manually checked all the merged notes and used function signatures for 
overloaded functions.
```
Note
sparkR.stop since 1.4.0
sparkR.session.stop since 2.0.0
```

https://home.apache.org/~dongjoon/spark-2.0.0-docs/api/R/sparkR.session.stop.html


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13592: [SPARK-15863][SQL][DOC] Initial SQL programming guide up...

[maropu]

Github user maropu commented on the issue:

https://github.com/apache/spark/pull/13592
  
@liancheng Is it worth adding  two parameters 
`spark.sql.files.maxPartitionBytes` and `spark.sql.files.openCostInBytes` in 
`Other Configuration Options`? They are kinds of internal parameters though, it 
seems they are useful for the users that would like to control #partitions. 
https://issues.apache.org/jira/browse/SPARK-15894


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13752: [SPARK-16028][SPARKR] spark.lapply can work with active ...

[AmplabJenkins]

Github user AmplabJenkins commented on the issue:

https://github.com/apache/spark/pull/13752
  
Test PASSed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60763/
Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13752: [SPARK-16028][SPARKR] spark.lapply can work with active ...

[AmplabJenkins]

Github user AmplabJenkins commented on the issue:

https://github.com/apache/spark/pull/13752
  
Merged build finished. Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13752: [SPARK-16028][SPARKR] spark.lapply can work with active ...

[SparkQA]

Github user SparkQA commented on the issue:

https://github.com/apache/spark/pull/13752
  
**[Test build #60763 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60763/consoleFull)**
 for PR 13752 at commit 
[`f5f401c`](https://github.com/apache/spark/commit/f5f401c42034396a45015cd558f62cbf83af1719).
 * This patch passes all tests.
 * This patch merges cleanly.
 * This patch adds no public classes.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13753: [SPARK-16029][SPARKR] SparkR add dropTempView and deprec...

[AmplabJenkins]

Github user AmplabJenkins commented on the issue:

https://github.com/apache/spark/pull/13753
  
Test PASSed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60762/
Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13753: [SPARK-16029][SPARKR] SparkR add dropTempView and deprec...

[AmplabJenkins]

Github user AmplabJenkins commented on the issue:

https://github.com/apache/spark/pull/13753
  
Merged build finished. Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13753: [SPARK-16029][SPARKR] SparkR add dropTempView and deprec...

[SparkQA]

Github user SparkQA commented on the issue:

https://github.com/apache/spark/pull/13753
  
**[Test build #60762 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60762/consoleFull)**
 for PR 13753 at commit 
[`d70154c`](https://github.com/apache/spark/commit/d70154cee47ca9fe803e79d673396a833b057fa7).
 * This patch passes all tests.
 * This patch merges cleanly.
 * This patch adds no public classes.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13734: [SPARK-14995][R] Add `since` tag in Roxygen documentatio...

[SparkQA]

Github user SparkQA commented on the issue:

https://github.com/apache/spark/pull/13734
  
**[Test build #60765 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60765/consoleFull)**
 for PR 13734 at commit 
[`0092967`](https://github.com/apache/spark/commit/0092967df878bbaaf5ad2a007d56cc68146daea2).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request #13750: [SPARK-16035][PYSPARK] Fix SparseVector parser as...

[asfgit]

Github user asfgit closed the pull request at:

https://github.com/apache/spark/pull/13750


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13750: [SPARK-16035][PYSPARK] Fix SparseVector parser assertion...

[mengxr]

Github user mengxr commented on the issue:

https://github.com/apache/spark/pull/13750
  
Merged into master and branch-2.0. Thanks!


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request #13641: [SPARK-10258][DOC][ML] Add @Since annotations to ...

[mengxr]

Github user mengxr commented on a diff in the pull request:

https://github.com/apache/spark/pull/13641#discussion_r67596152
  
--- Diff: 
mllib/src/main/scala/org/apache/spark/ml/feature/ElementwiseProduct.scala ---
@@ -33,21 +33,26 @@ import org.apache.spark.sql.types.DataType
  * multiplier.
  */
 @Experimental
-class ElementwiseProduct(override val uid: String)
+@Since("1.4.0")
+class ElementwiseProduct @Since("1.4.0") (@Since("1.4.0") override val 
uid: String)
   extends UnaryTransformer[Vector, Vector, ElementwiseProduct] with 
DefaultParamsWritable {
 
+  @Since("1.4.0")
   def this() = this(Identifiable.randomUID("elemProd"))
 
   /**
* the vector to multiply with input vectors
* @group param
*/
+  @Since("1.4.0")
   val scalingVec: Param[Vector] = new Param(this, "scalingVec", "vector 
for hadamard product")
 
   /** @group setParam */
+  @Since("1.4.0")
--- End diff --

ditto


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request #13641: [SPARK-10258][DOC][ML] Add @Since annotations to ...

[mengxr]

Github user mengxr commented on a diff in the pull request:

https://github.com/apache/spark/pull/13641#discussion_r67596150
  
--- Diff: 
mllib/src/main/scala/org/apache/spark/ml/feature/ElementwiseProduct.scala ---
@@ -33,21 +33,26 @@ import org.apache.spark.sql.types.DataType
  * multiplier.
  */
 @Experimental
-class ElementwiseProduct(override val uid: String)
+@Since("1.4.0")
+class ElementwiseProduct @Since("1.4.0") (@Since("1.4.0") override val 
uid: String)
   extends UnaryTransformer[Vector, Vector, ElementwiseProduct] with 
DefaultParamsWritable {
 
+  @Since("1.4.0")
   def this() = this(Identifiable.randomUID("elemProd"))
 
   /**
* the vector to multiply with input vectors
* @group param
*/
+  @Since("1.4.0")
--- End diff --

This uses the new `Vector`. So ideally it is since `2.0.0`. I'm not sure 
about whether we should change the class since version to 2.0 as well.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13755: [SPARK-16040][MLlib][DOC]:spark.mllib PIC document extra...

[AmplabJenkins]

Github user AmplabJenkins commented on the issue:

https://github.com/apache/spark/pull/13755
  
Merged build finished. Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13755: [SPARK-16040][MLlib][DOC]:spark.mllib PIC document extra...

[AmplabJenkins]

Github user AmplabJenkins commented on the issue:

https://github.com/apache/spark/pull/13755
  
Test PASSed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60761/
Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13755: [SPARK-16040][MLlib][DOC]:spark.mllib PIC document extra...

[SparkQA]

Github user SparkQA commented on the issue:

https://github.com/apache/spark/pull/13755
  
**[Test build #60761 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60761/consoleFull)**
 for PR 13755 at commit 
[`4262ad3`](https://github.com/apache/spark/commit/4262ad30ea347f78d42990d0a39bb5db56648821).
 * This patch passes all tests.
 * This patch merges cleanly.
 * This patch adds no public classes.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13753: [SPARK-16029][SPARKR] SparkR add dropTempView and deprec...

[AmplabJenkins]

Github user AmplabJenkins commented on the issue:

https://github.com/apache/spark/pull/13753
  
Merged build finished. Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13753: [SPARK-16029][SPARKR] SparkR add dropTempView and deprec...

[AmplabJenkins]

Github user AmplabJenkins commented on the issue:

https://github.com/apache/spark/pull/13753
  
Test PASSed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60757/
Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13753: [SPARK-16029][SPARKR] SparkR add dropTempView and deprec...

[SparkQA]

Github user SparkQA commented on the issue:

https://github.com/apache/spark/pull/13753
  
**[Test build #60757 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60757/consoleFull)**
 for PR 13753 at commit 
[`0b2fe6f`](https://github.com/apache/spark/commit/0b2fe6fbb80599a00ab32b00d0ea256739682519).
 * This patch passes all tests.
 * This patch merges cleanly.
 * This patch adds no public classes.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13751: [SPARK-15159][SPARKR] SparkSession roxygen2 doc, program...

[AmplabJenkins]

Github user AmplabJenkins commented on the issue:

https://github.com/apache/spark/pull/13751
  
Test PASSed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60756/
Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13751: [SPARK-15159][SPARKR] SparkSession roxygen2 doc, program...

[AmplabJenkins]

Github user AmplabJenkins commented on the issue:

https://github.com/apache/spark/pull/13751
  
Merged build finished. Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13751: [SPARK-15159][SPARKR] SparkSession roxygen2 doc, program...

[SparkQA]

Github user SparkQA commented on the issue:

https://github.com/apache/spark/pull/13751
  
**[Test build #60756 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60756/consoleFull)**
 for PR 13751 at commit 
[`c434614`](https://github.com/apache/spark/commit/c434614321a3650a18b228f6333ffe245b6ea7ee).
 * This patch passes all tests.
 * This patch merges cleanly.
 * This patch adds no public classes.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13752: [SPARK-16028][SPARKR] spark.lapply can work with active ...

[AmplabJenkins]

Github user AmplabJenkins commented on the issue:

https://github.com/apache/spark/pull/13752
  
Test PASSed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60755/
Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13752: [SPARK-16028][SPARKR] spark.lapply can work with active ...

[AmplabJenkins]

Github user AmplabJenkins commented on the issue:

https://github.com/apache/spark/pull/13752
  
Merged build finished. Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13752: [SPARK-16028][SPARKR] spark.lapply can work with active ...

[SparkQA]

Github user SparkQA commented on the issue:

https://github.com/apache/spark/pull/13752
  
**[Test build #60755 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60755/consoleFull)**
 for PR 13752 at commit 
[`179fbdc`](https://github.com/apache/spark/commit/179fbdc7f93a929e00aaeeb575eb404038385252).
 * This patch passes all tests.
 * This patch merges cleanly.
 * This patch adds no public classes.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13745: [Spark 15997][DOC][ML] Update user guide for HashingTF, ...

[AmplabJenkins]

Github user AmplabJenkins commented on the issue:

https://github.com/apache/spark/pull/13745
  
Test PASSed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60758/
Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13745: [Spark 15997][DOC][ML] Update user guide for HashingTF, ...

[AmplabJenkins]

Github user AmplabJenkins commented on the issue:

https://github.com/apache/spark/pull/13745
  
Merged build finished. Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13756: [SPARK-16041][SQL] Disallow Duplicate Columns in partiti...

[SparkQA]

Github user SparkQA commented on the issue:

https://github.com/apache/spark/pull/13756
  
**[Test build #60764 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60764/consoleFull)**
 for PR 13756 at commit 
[`83082ff`](https://github.com/apache/spark/commit/83082ffb9dae922374b2d2f6051cce4bf24cb1de).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13745: [Spark 15997][DOC][ML] Update user guide for HashingTF, ...

[SparkQA]

Github user SparkQA commented on the issue:

https://github.com/apache/spark/pull/13745
  
**[Test build #60758 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60758/consoleFull)**
 for PR 13745 at commit 
[`3b01f11`](https://github.com/apache/spark/commit/3b01f111a417b398c659637b7b977df5c387011d).
 * This patch passes all tests.
 * This patch merges cleanly.
 * This patch adds no public classes.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request #13756: [SPARK-16041][SQL] Disallow Duplicate Columns in ...

[gatorsmile]

GitHub user gatorsmile opened a pull request:

https://github.com/apache/spark/pull/13756

[SPARK-16041][SQL] Disallow Duplicate Columns in partitionBy, blockBy and 
sortBy in DataFrameWriter

 What changes were proposed in this pull request?
Duplicate columns are not allowed in `partitionBy`, `blockBy`, `sortBy` in 
`DataFrameWriter`. The duplicate columns could cause unpredictable results. For 
example, the resolution failure. 

This PR is to detect the duplicates and issue exceptions with appropriate 
messages.

 How was this patch tested?
Added test cases in `DataFrameReaderWriterSuite`


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/gatorsmile/spark dedup

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/spark/pull/13756.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #13756


commit 83082ffb9dae922374b2d2f6051cce4bf24cb1de
Author: gatorsmile 
Date:   2016-06-18T05:13:36Z

fix




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13745: [Spark 15997][DOC][ML] Update user guide for HashingTF, ...

[AmplabJenkins]

Github user AmplabJenkins commented on the issue:

https://github.com/apache/spark/pull/13745
  
Merged build finished. Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13745: [Spark 15997][DOC][ML] Update user guide for HashingTF, ...

[AmplabJenkins]

Github user AmplabJenkins commented on the issue:

https://github.com/apache/spark/pull/13745
  
Test PASSed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60752/
Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13745: [Spark 15997][DOC][ML] Update user guide for HashingTF, ...

[SparkQA]

Github user SparkQA commented on the issue:

https://github.com/apache/spark/pull/13745
  
**[Test build #60752 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60752/consoleFull)**
 for PR 13745 at commit 
[`01e4a08`](https://github.com/apache/spark/commit/01e4a08b3a6154a0e04391fa8299821894109bb3).
 * This patch passes all tests.
 * This patch merges cleanly.
 * This patch adds no public classes.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13752: [SPARK-16028][SPARKR] spark.lapply can work with active ...

[SparkQA]

Github user SparkQA commented on the issue:

https://github.com/apache/spark/pull/13752
  
**[Test build #60763 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60763/consoleFull)**
 for PR 13752 at commit 
[`f5f401c`](https://github.com/apache/spark/commit/f5f401c42034396a45015cd558f62cbf83af1719).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13753: [SPARK-16029][SPARKR] SparkR add dropTempView and deprec...

[SparkQA]

Github user SparkQA commented on the issue:

https://github.com/apache/spark/pull/13753
  
**[Test build #60762 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60762/consoleFull)**
 for PR 13753 at commit 
[`d70154c`](https://github.com/apache/spark/commit/d70154cee47ca9fe803e79d673396a833b057fa7).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13755: [SPARK-16040][MLlib][DOC]:spark.mllib PIC document extra...

[SparkQA]

Github user SparkQA commented on the issue:

https://github.com/apache/spark/pull/13755
  
**[Test build #60761 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60761/consoleFull)**
 for PR 13755 at commit 
[`4262ad3`](https://github.com/apache/spark/commit/4262ad30ea347f78d42990d0a39bb5db56648821).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request #13755: [SPARK-16040][MLlib][DOC]:spark.mllib PIC documen...

[wangmiao1981]

GitHub user wangmiao1981 opened a pull request:

https://github.com/apache/spark/pull/13755

[SPARK-16040][MLlib][DOC]:spark.mllib PIC document extra line of refernece

## What changes were proposed in this pull request?



In the 2.0 document, Line "A full example that produces the experiment 
described in the PIC paper can be found under examples/." is redundant.

There is already "Find full example code at 
"examples/src/main/scala/org/apache/spark/examples/mllib/PowerIterationClusteringExample.scala"
 in the Spark repo.".

We should remove the first line, which is consistent with other documents.



## How was this patch tested?

(Please explain how this patch was tested. E.g. unit tests, integration 
tests, manual tests)

Manual test

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/wangmiao1981/spark doc

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/spark/pull/13755.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #13755


commit 4262ad30ea347f78d42990d0a39bb5db56648821
Author: wm...@hotmail.com 
Date:   2016-06-18T05:04:20Z

remove extra line




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13753: [SPARK-16029][SPARKR] SparkR add dropTempView and deprec...

[liancheng]

Github user liancheng commented on the issue:

https://github.com/apache/spark/pull/13753
  
LGTM pending Jenkins. Thanks!


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13635: [SPARK-15159][SPARKR] SparkR SparkSession API

[dongjoon-hyun]

Github user dongjoon-hyun commented on the issue:

https://github.com/apache/spark/pull/13635
  
Oh, great!!


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13718: [SPARK-16002][SQL]Sleep when no new data arrives to avoi...

[zsxwing]

Github user zsxwing commented on the issue:

https://github.com/apache/spark/pull/13718
  
@tdas I fixed the test. Could you take another look?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13746: [SPARK-16030] [SQL] Allow specifying static partitions w...

[SparkQA]

Github user SparkQA commented on the issue:

https://github.com/apache/spark/pull/13746
  
**[Test build #60760 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60760/consoleFull)**
 for PR 13746 at commit 
[`b1adc7a`](https://github.com/apache/spark/commit/b1adc7aa8a217d18ac0ab6eb89306e23d82c8f86).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13754: [SPARK-16036][SPARK-16037][SQL] fix various table insert...

[SparkQA]

Github user SparkQA commented on the issue:

https://github.com/apache/spark/pull/13754
  
**[Test build #60759 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60759/consoleFull)**
 for PR 13754 at commit 
[`52e67d4`](https://github.com/apache/spark/commit/52e67d48019c5b27cb5f59584a7de15e0a1869c9).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request #13740: [SPARK-16020][SQL]Fix complete mode aggregation w...

[asfgit]

Github user asfgit closed the pull request at:

https://github.com/apache/spark/pull/13740


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request #13754: [SPARK-16036][SPARK-16037][SQL] fix various table...

[cloud-fan]

GitHub user cloud-fan opened a pull request:

https://github.com/apache/spark/pull/13754

[SPARK-16036][SPARK-16037][SQL] fix various table insertion semantics

## What changes were proposed in this pull request?

The current table insertion has some weird behaviours:

1. inserting into a partitioned table with mismatch columns has confusing 
error message for hive table, and wrong result for datasource table
2. inserting into a partitioned table without partition list has wrong 
result for hive table.

This PR fixes these 2 problems.

## How was this patch tested?

new test in hive `SQLQuerySuite`


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/cloud-fan/spark insert2

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/spark/pull/13754.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #13754


commit 52e67d48019c5b27cb5f59584a7de15e0a1869c9
Author: Wenchen Fan 
Date:   2016-06-17T21:37:31Z

fix table insertion semantics




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13754: [SPARK-16036][SPARK-16037][SQL] fix various table insert...

[cloud-fan]

Github user cloud-fan commented on the issue:

https://github.com/apache/spark/pull/13754
  
cc @yhuai @marmbrus @rxin 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13740: [SPARK-16020][SQL]Fix complete mode aggregation with con...

[zsxwing]

Github user zsxwing commented on the issue:

https://github.com/apache/spark/pull/13740
  
The added test passed. I'm going to merge it into master and 2.0 to make 
sure it's in rc1.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13745: [Spark 15997][DOC][ML] Update user guide for HashingTF, ...

[SparkQA]

Github user SparkQA commented on the issue:

https://github.com/apache/spark/pull/13745
  
**[Test build #60758 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60758/consoleFull)**
 for PR 13745 at commit 
[`3b01f11`](https://github.com/apache/spark/commit/3b01f111a417b398c659637b7b977df5c387011d).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13753: [SPARK-16029][SPARKR] SparkR add dropTempView and deprec...

[SparkQA]

Github user SparkQA commented on the issue:

https://github.com/apache/spark/pull/13753
  
**[Test build #60757 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60757/consoleFull)**
 for PR 13753 at commit 
[`0b2fe6f`](https://github.com/apache/spark/commit/0b2fe6fbb80599a00ab32b00d0ea256739682519).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13752: [SPARK-16028][SPARKR] spark.lapply can work with active ...

[SparkQA]

Github user SparkQA commented on the issue:

https://github.com/apache/spark/pull/13752
  
**[Test build #60755 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60755/consoleFull)**
 for PR 13752 at commit 
[`179fbdc`](https://github.com/apache/spark/commit/179fbdc7f93a929e00aaeeb575eb404038385252).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13751: [SPARK-15159][SPARKR] SparkSession roxygen2 doc, program...

[SparkQA]

Github user SparkQA commented on the issue:

https://github.com/apache/spark/pull/13751
  
**[Test build #60756 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60756/consoleFull)**
 for PR 13751 at commit 
[`c434614`](https://github.com/apache/spark/commit/c434614321a3650a18b228f6333ffe245b6ea7ee).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request #13753: [SPARK-16029][SPARKR] SparkR add dropTempView and...

[felixcheung]

GitHub user felixcheung opened a pull request:

https://github.com/apache/spark/pull/13753

[SPARK-16029][SPARKR] SparkR add dropTempView and deprecate dropTempTable

## What changes were proposed in this pull request?

Add dropTempView and deprecate dropTempTable

## How was this patch tested?

unit tests

@shivaram @liancheng


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/felixcheung/spark rdroptempview

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/spark/pull/13753.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #13753


commit 0b2fe6fbb80599a00ab32b00d0ea256739682519
Author: Felix Cheung 
Date:   2016-06-18T04:50:53Z

Add dropTempView and deprecate dropTempTable




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13752: [SPARK-16028][SPARKR] spark.lapply can work with active ...

[felixcheung]

Github user felixcheung commented on the issue:

https://github.com/apache/spark/pull/13752
  
example update in the other PR.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request #13752: [SPARK-16028][SPARKR] spark.lapply can work with ...

[felixcheung]

GitHub user felixcheung opened a pull request:

https://github.com/apache/spark/pull/13752

[SPARK-16028][SPARKR] spark.lapply can work with active context

## What changes were proposed in this pull request?

spark.lapply and setLogLevel


## How was this patch tested?

unit test

@shivaram @thunterdb 


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/felixcheung/spark rlapply

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/spark/pull/13752.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #13752


commit 179fbdc7f93a929e00aaeeb575eb404038385252
Author: Felix Cheung 
Date:   2016-06-18T04:48:05Z

lapply should not need spark context




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request #13751: [SPARK-15159][SPARKR] SparkSession roxygen2 doc, ...

[felixcheung]

GitHub user felixcheung opened a pull request:

https://github.com/apache/spark/pull/13751

[SPARK-15159][SPARKR] SparkSession roxygen2 doc, programming guide, example 
updates

## What changes were proposed in this pull request?

roxygen2 doc, programming guide, example updates

## How was this patch tested?

manual checks
@shivaram 


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/felixcheung/spark rsparksessiondoc

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/spark/pull/13751.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #13751


commit c434614321a3650a18b228f6333ffe245b6ea7ee
Author: Felix Cheung 
Date:   2016-06-18T04:39:44Z

roxygen2 doc, programming guide, example updates




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13725: [SPARK-15892][ML] Backport correctly merging AFTAggregat...

[HyukjinKwon]

Github user HyukjinKwon commented on the issue:

https://github.com/apache/spark/pull/13725
  
I am closing this as this is merged. Thank you @mengxr again!


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request #13725: [SPARK-15892][ML] Backport correctly merging AFTA...

[HyukjinKwon]

Github user HyukjinKwon closed the pull request at:

https://github.com/apache/spark/pull/13725


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13750: [SPARK-16035][PYSPARK] Fix SparseVector parser assertion...

[AmplabJenkins]

Github user AmplabJenkins commented on the issue:

https://github.com/apache/spark/pull/13750
  
Test PASSed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60749/
Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13749: [SPARK-16034][SQL] Checks the partition columns when cal...

[SparkQA]

Github user SparkQA commented on the issue:

https://github.com/apache/spark/pull/13749
  
**[Test build #60754 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60754/consoleFull)**
 for PR 13749 at commit 
[`7a4293b`](https://github.com/apache/spark/commit/7a4293bd68896701e4ca61a9df06133357bc0f8a).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13750: [SPARK-16035][PYSPARK] Fix SparseVector parser assertion...

[AmplabJenkins]

Github user AmplabJenkins commented on the issue:

https://github.com/apache/spark/pull/13750
  
Merged build finished. Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13750: [SPARK-16035][PYSPARK] Fix SparseVector parser assertion...

[SparkQA]

Github user SparkQA commented on the issue:

https://github.com/apache/spark/pull/13750
  
**[Test build #60749 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60749/consoleFull)**
 for PR 13750 at commit 
[`9df1499`](https://github.com/apache/spark/commit/9df14994eb757897b7fd099e126fef7013ee08cc).
 * This patch passes all tests.
 * This patch merges cleanly.
 * This patch adds no public classes.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13635: [SPARK-15159][SPARKR] SparkR SparkSession API

[felixcheung]

Github user felixcheung commented on the issue:

https://github.com/apache/spark/pull/13635
  
awesome!


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request #13635: [SPARK-15159][SPARKR] SparkR SparkSession API

[asfgit]

Github user asfgit closed the pull request at:

https://github.com/apache/spark/pull/13635


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13749: [SPARK-16034][SQL][WIP] Checks the partition columns whe...

[SparkQA]

Github user SparkQA commented on the issue:

https://github.com/apache/spark/pull/13749
  
**[Test build #60753 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60753/consoleFull)**
 for PR 13749 at commit 
[`5224802`](https://github.com/apache/spark/commit/5224802418a2917ae09f64d8bffce80a0c4d5201).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13635: [SPARK-15159][SPARKR] SparkR SparkSession API

[shivaram]

Github user shivaram commented on the issue:

https://github.com/apache/spark/pull/13635
  
LGTM. Merging this to master and branch-2.0


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request #13731: [SPARK-15946] [MLLIB] Conversion between old/new ...

[asfgit]

Github user asfgit closed the pull request at:

https://github.com/apache/spark/pull/13731


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13745: [Spark 15997][DOC][ML] Update user guide for HashingTF, ...

[SparkQA]

Github user SparkQA commented on the issue:

https://github.com/apache/spark/pull/13745
  
**[Test build #60752 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60752/consoleFull)**
 for PR 13745 at commit 
[`01e4a08`](https://github.com/apache/spark/commit/01e4a08b3a6154a0e04391fa8299821894109bb3).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request #13745: [Spark 15997][DOC][ML] Update user guide for Hash...

[mengxr]

Github user mengxr commented on a diff in the pull request:

https://github.com/apache/spark/pull/13745#discussion_r67595234
  
--- Diff: docs/ml-features.md ---
@@ -46,14 +46,16 @@ In MLlib, we separate TF and IDF to make them flexible.
 `HashingTF` is a `Transformer` which takes sets of terms and converts 
those sets into 
 fixed-length feature vectors.  In text processing, a "set of terms" might 
be a bag of words.
 `HashingTF` utilizes the [hashing 
trick](http://en.wikipedia.org/wiki/Feature_hashing).
-A raw feature is mapped into an index (term) by applying a hash function. 
Then term frequencies 
+A raw feature is mapped into an index (term) by applying a hash function. 
The hash function used here is [MurmurHash 
3](https://en.wikipedia.org/wiki/MurmurHash).Then term frequencies
--- End diff --

Could you limit the line width to 100?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13731: [SPARK-15946] [MLLIB] Conversion between old/new vector ...

[yanboliang]

Github user yanboliang commented on the issue:

https://github.com/apache/spark/pull/13731
  
LGTM, merged into master and branch-2.0. Thanks!


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13745: [Spark 15997][DOC][ML] Update user guide for HashingTF, ...

[mengxr]

Github user mengxr commented on the issue:

https://github.com/apache/spark/pull/13745
  
add to whitelist


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13749: [SPARK-16034][SQL][WIP] Checks the partition columns whe...

[SparkQA]

Github user SparkQA commented on the issue:

https://github.com/apache/spark/pull/13749
  
**[Test build #60750 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60750/consoleFull)**
 for PR 13749 at commit 
[`72fdeaf`](https://github.com/apache/spark/commit/72fdeaf188a17d63bb22eb5a3136770b698c57b7).
 * This patch **fails Scala style tests**.
 * This patch merges cleanly.
 * This patch adds no public classes.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13749: [SPARK-16034][SQL][WIP] Checks the partition columns whe...

[AmplabJenkins]

Github user AmplabJenkins commented on the issue:

https://github.com/apache/spark/pull/13749
  
Test FAILed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60750/
Test FAILed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13749: [SPARK-16034][SQL][WIP] Checks the partition columns whe...

[AmplabJenkins]

Github user AmplabJenkins commented on the issue:

https://github.com/apache/spark/pull/13749
  
Merged build finished. Test FAILed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13750: [SPARK-16035][PYSPARK] Fix SparseVector parser assertion...

[mengxr]

Github user mengxr commented on the issue:

https://github.com/apache/spark/pull/13750
  
LGTM. It is bad that we don't have full coverage here. Given the fact that 
`parse` is more like an internal feature paired with `str`, it is probably okay 
to manual test this.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13749: [SPARK-16034][SQL][WIP] Checks the partition columns whe...

[SparkQA]

Github user SparkQA commented on the issue:

https://github.com/apache/spark/pull/13749
  
**[Test build #60750 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60750/consoleFull)**
 for PR 13749 at commit 
[`72fdeaf`](https://github.com/apache/spark/commit/72fdeaf188a17d63bb22eb5a3136770b698c57b7).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #12268: [SPARK-14480][SQL] Simplify CSV parsing process with a b...

[SparkQA]

Github user SparkQA commented on the issue:

https://github.com/apache/spark/pull/12268
  
**[Test build #60751 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60751/consoleFull)**
 for PR 12268 at commit 
[`7abdfc1`](https://github.com/apache/spark/commit/7abdfc66f2bf275fc4318c0ffe8836dcbb70).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13750: [SPARK-16035][PYSPARK] Fix SparseVector parser assertion...

[SparkQA]

Github user SparkQA commented on the issue:

https://github.com/apache/spark/pull/13750
  
**[Test build #60749 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60749/consoleFull)**
 for PR 13750 at commit 
[`9df1499`](https://github.com/apache/spark/commit/9df14994eb757897b7fd099e126fef7013ee08cc).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13750: [SPARK-16035][PYSPARK] Fix SparseVector parser assertion...

[mengxr]

Github user mengxr commented on the issue:

https://github.com/apache/spark/pull/13750
  
ok to test


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request #13285: [Spark-15129][R][DOC]R API changes in ML

[asfgit]

Github user asfgit closed the pull request at:

https://github.com/apache/spark/pull/13285


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13285: [Spark-15129][R][DOC]R API changes in ML

[mengxr]

Github user mengxr commented on the issue:

https://github.com/apache/spark/pull/13285
  
Merged into master and branch-2.0. Saw some very minor issues. I make 
another pass and fix them in a follow-up PR. Thanks!


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13725: [SPARK-15892][ML] Backport correctly merging AFTAggregat...

[mengxr]

Github user mengxr commented on the issue:

https://github.com/apache/spark/pull/13725
  
LGTM. Merged into branch-1.6. Thanks for backporting the patch!


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13734: [SPARK-14995][R] Add `since` tag in Roxygen documentatio...

[dongjoon-hyun]

Github user dongjoon-hyun commented on the issue:

https://github.com/apache/spark/pull/13734
  
Thank you for opinions! I'll revise and update the html doc.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13721: [SPARK-16005][R] Add `randomSplit` to SparkR

[dongjoon-hyun]

Github user dongjoon-hyun commented on the issue:

https://github.com/apache/spark/pull/13721
  
Thank you for merging, @shivaram .


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #12675: [SPARK-14894][PySpark] Add result summary api to Gaussia...

[SparkQA]

Github user SparkQA commented on the issue:

https://github.com/apache/spark/pull/12675
  
**[Test build #60748 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60748/consoleFull)**
 for PR 12675 at commit 
[`3cf080a`](https://github.com/apache/spark/commit/3cf080a54899ad164dc5ad0643ff2dc6ba69743f).
 * This patch **fails PySpark unit tests**.
 * This patch merges cleanly.
 * This patch adds no public classes.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #12675: [SPARK-14894][PySpark] Add result summary api to Gaussia...

[AmplabJenkins]

Github user AmplabJenkins commented on the issue:

https://github.com/apache/spark/pull/12675
  
Test FAILed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60748/
Test FAILed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #12675: [SPARK-14894][PySpark] Add result summary api to Gaussia...

[AmplabJenkins]

Github user AmplabJenkins commented on the issue:

https://github.com/apache/spark/pull/12675
  
Merged build finished. Test FAILed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13727: [SPARK-15982][SPARK-16009][SPARK-16007][SQL] Harmonize t...

[AmplabJenkins]

Github user AmplabJenkins commented on the issue:

https://github.com/apache/spark/pull/13727
  
Test PASSed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60747/
Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13727: [SPARK-15982][SPARK-16009][SPARK-16007][SQL] Harmonize t...

[AmplabJenkins]

Github user AmplabJenkins commented on the issue:

https://github.com/apache/spark/pull/13727
  
Merged build finished. Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13727: [SPARK-15982][SPARK-16009][SPARK-16007][SQL] Harmonize t...

[SparkQA]

Github user SparkQA commented on the issue:

https://github.com/apache/spark/pull/13727
  
**[Test build #60747 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60747/consoleFull)**
 for PR 13727 at commit 
[`29524b1`](https://github.com/apache/spark/commit/29524b1201fb3e028a2875397feba5c0e577365f).
 * This patch passes all tests.
 * This patch merges cleanly.
 * This patch adds no public classes.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13635: [SPARK-15159][SPARKR] SparkR SparkSession API

[felixcheung]

Github user felixcheung commented on the issue:

https://github.com/apache/spark/pull/13635
  
Test passed and merge cleanly.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #12675: [SPARK-14894][PySpark] Add result summary api to Gaussia...

[SparkQA]

Github user SparkQA commented on the issue:

https://github.com/apache/spark/pull/12675
  
**[Test build #60748 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60748/consoleFull)**
 for PR 12675 at commit 
[`3cf080a`](https://github.com/apache/spark/commit/3cf080a54899ad164dc5ad0643ff2dc6ba69743f).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13748: [SPARK-16031] Add debug-only socket source in Structured...

[AmplabJenkins]

Github user AmplabJenkins commented on the issue:

https://github.com/apache/spark/pull/13748
  
Merged build finished. Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13748: [SPARK-16031] Add debug-only socket source in Structured...

[AmplabJenkins]

Github user AmplabJenkins commented on the issue:

https://github.com/apache/spark/pull/13748
  
Test PASSed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60746/
Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13748: [SPARK-16031] Add debug-only socket source in Structured...

[SparkQA]

Github user SparkQA commented on the issue:

https://github.com/apache/spark/pull/13748
  
**[Test build #60746 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60746/consoleFull)**
 for PR 13748 at commit 
[`189e409`](https://github.com/apache/spark/commit/189e4096d8460626af9b259acbd14da64303ca7d).
 * This patch passes all tests.
 * This patch merges cleanly.
 * This patch adds no public classes.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request #13747: [SPARK-16033][SQL] insertInto() can't be used tog...

[asfgit]

Github user asfgit closed the pull request at:

https://github.com/apache/spark/pull/13747


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13747: [SPARK-16033][SQL] insertInto() can't be used together w...

[yhuai]

Github user yhuai commented on the issue:

https://github.com/apache/spark/pull/13747
  
LGTM. Merging to master and branch 2.0.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request #13635: [SPARK-15159][SPARKR] SparkR SparkSession API

[felixcheung]

Github user felixcheung commented on a diff in the pull request:

https://github.com/apache/spark/pull/13635#discussion_r67594224
  
--- Diff: R/pkg/R/SQLContext.R ---
@@ -615,11 +619,12 @@ clearCache <- function() {
 #' @method dropTempTable default
 
 dropTempTable.default <- function(tableName) {
-  sqlContext <- getSqlContext()
+  sparkSession <- getSparkSession()
   if (class(tableName) != "character") {
 stop("tableName must be a string.")
   }
-  callJMethod(sqlContext, "dropTempTable", tableName)
+  catalog <- callJMethod(sparkSession, "catalog")
+  callJMethod(catalog, "dropTempView", tableName)
--- End diff --

Will open a JIRA on this, I have the fix.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13734: [SPARK-14995][R] Add `since` tag in Roxygen documentatio...

[felixcheung]

Github user felixcheung commented on the issue:

https://github.com/apache/spark/pull/13734
  
hopefully we don't have a lot of these...


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #13748: [SPARK-16031] Add debug-only socket source in Structured...

[AmplabJenkins]

Github user AmplabJenkins commented on the issue:

https://github.com/apache/spark/pull/13748
  
Test PASSed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60740/
Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org