[GitHub] spark pull request: [SPARK-12199][DOC] Follow-up: Refine example c...

2015-12-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10193#issuecomment-163527805 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12199][DOC] Follow-up: Refine example c...

2015-12-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10193#issuecomment-163527722 **[Test build #47493 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47493/consoleFull)** for PR 10193 at commit [`51b42b7`](https://g

[GitHub] spark pull request: [SPARK-12256] [SQL] Code refactoring: naming b...

2015-12-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10243#issuecomment-163527616 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12256] [SQL] Code refactoring: naming b...

2015-12-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10243#issuecomment-163527615 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12256] [SQL] Code refactoring: naming b...

2015-12-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10243#issuecomment-163527520 **[Test build #47489 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47489/consoleFull)** for PR 10243 at commit [`a71d5b1`](https://g

[GitHub] spark pull request: [SPARK-12227][SQL] Support drop multiple colum...

2015-12-09 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/10218#discussion_r47197511 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/DataFrame.scala --- @@ -1271,10 +1271,11 @@ class DataFrame private[sql]( * @since 1.6.0

[GitHub] spark pull request: [SPARK-12199][DOC] Follow-up: Refine example c...

2015-12-09 Thread yinxusen
Github user yinxusen commented on the pull request: https://github.com/apache/spark/pull/10193#issuecomment-163527097 Faint! OSX's file name is not case sensitive... that's why I miss the Element[W|w]iseProductExample.scala error. --- If your project is set up for it, you can reply t

[GitHub] spark pull request: Small doc change on how to use dynamic partiti...

2015-12-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10248#issuecomment-163526526 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: Small doc change on how to use dynamic partiti...

2015-12-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10248#issuecomment-163526528 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: Small doc change on how to use dynamic partiti...

2015-12-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10248#issuecomment-163526432 **[Test build #47492 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47492/consoleFull)** for PR 10248 at commit [`8684706`](https://g

[GitHub] spark pull request: [SPARK-12199][DOC] Follow-up: Refine example c...

2015-12-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10193#issuecomment-163525424 **[Test build #47493 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47493/consoleFull)** for PR 10193 at commit [`51b42b7`](https://gi

[GitHub] spark pull request: [SPARK-12199][DOC] Follow-up: Refine example c...

2015-12-09 Thread yinxusen
Github user yinxusen commented on the pull request: https://github.com/apache/spark/pull/10193#issuecomment-163524896 @BenFradet All clear now. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: Small doc change on how to use dynamic partiti...

2015-12-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10248#issuecomment-163524116 **[Test build #47492 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47492/consoleFull)** for PR 10248 at commit [`8684706`](https://gi

[GitHub] spark pull request: Small doc change on how to use dynamic partiti...

2015-12-09 Thread markgrover
GitHub user markgrover opened a pull request: https://github.com/apache/spark/pull/10248 Small doc change on how to use dynamic partitioning in Spark SQL You can merge this pull request into a Git repository by running: $ git pull https://github.com/markgrover/spark spark_sql_

[GitHub] spark pull request: [SPARK-11962] Added getAsOpt functions to Row ...

2015-12-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10247#issuecomment-163522426 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your p

[GitHub] spark pull request: [SPARK-11962] Add optional getAs functions to ...

2015-12-09 Thread aa8y
Github user aa8y commented on the pull request: https://github.com/apache/spark/pull/10028#issuecomment-163522315 @JoshRosen I've created a new pull request, #10247 with a fresh new commit which should merge. @srowen I would really appreciate it if you could get Jenkins to test it. Pl

[GitHub] spark pull request: [SPARK-11962] Add optional getAs functions to ...

2015-12-09 Thread aa8y
Github user aa8y closed the pull request at: https://github.com/apache/spark/pull/10028 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[GitHub] spark pull request: [SPARK-11962] Added getAsOpt functions to Row ...

2015-12-09 Thread aa8y
GitHub user aa8y opened a pull request: https://github.com/apache/spark/pull/10247 [SPARK-11962] Added getAsOpt functions to Row and tests for it. getAsOpt[T] functions have been added to Row and GeneicRowWithSchema to get the values present in a row object optionally. Corresponding

[GitHub] spark pull request: SPARK-12200 Add __contains__ implementation to...

2015-12-09 Thread maver1ck
Github user maver1ck commented on the pull request: https://github.com/apache/spark/pull/10194#issuecomment-163521876 OK. I will add few words to documentation. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your proj

[GitHub] spark pull request: [SPARK-12242][SQL] Add DataFrame.transform met...

2015-12-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10226#issuecomment-163521579 **[Test build #2192 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2192/consoleFull)** for PR 10226 at commit [`a1fac56`](https://

[GitHub] spark pull request: [SPARK-12199][DOC] Follow-up: Refine example c...

2015-12-09 Thread BenFradet
Github user BenFradet commented on the pull request: https://github.com/apache/spark/pull/10193#issuecomment-163521017 Plus, there is inconsistent naming between the docs and the example file for Element[W|w]iseProductExample.scala --- If your project is set up for it, you can reply

[GitHub] spark pull request: [SPARK-12252][SPARK-12131][SQL] refactor MapOb...

2015-12-09 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/10239 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request: [SPARK-12252][SPARK-12131][SQL] refactor MapOb...

2015-12-09 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/10239#issuecomment-163519992 Thanks, merging to master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not ha

[GitHub] spark pull request: [DOCS][ML][SPARK-11964] Add in Pipeline Import...

2015-12-09 Thread anabranch
Github user anabranch commented on the pull request: https://github.com/apache/spark/pull/10179#issuecomment-163519922 @BenFradet integrated your feedback thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pr

[GitHub] spark pull request: [SPARK-12252][SQL] refactor MapObjects to make...

2015-12-09 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/10239#issuecomment-163519747 @cloud-fan Could you please mention SPARK-12131 in the PR title and description since it's also fixed in this PR? Then I can merge it to master. --- If your project

[GitHub] spark pull request: [SPARK-12251] Document and improve off-heap me...

2015-12-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10237#issuecomment-163519491 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12251] Document and improve off-heap me...

2015-12-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10237#issuecomment-163519451 **[Test build #47486 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47486/consoleFull)** for PR 10237 at commit [`216fc46`](https://g

[GitHub] spark pull request: [SPARK-12251] Document and improve off-heap me...

2015-12-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10237#issuecomment-163519489 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12155] [SPARK-12253] Fix executor OOM i...

2015-12-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10240#issuecomment-163519195 **[Test build #47491 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47491/consoleFull)** for PR 10240 at commit [`d8be669`](https://gi

[GitHub] spark pull request: [DOCS][ML][SPARK-11964] Add in Pipeline Import...

2015-12-09 Thread BenFradet
Github user BenFradet commented on the pull request: https://github.com/apache/spark/pull/10179#issuecomment-163518690 LGTM except one minor comment. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does no

[GitHub] spark pull request: [DOCS][ML][SPARK-11964] Add in Pipeline Import...

2015-12-09 Thread BenFradet
Github user BenFradet commented on a diff in the pull request: https://github.com/apache/spark/pull/10179#discussion_r47194469 --- Diff: docs/ml-guide.md --- @@ -613,7 +613,49 @@ for row in selected.collect(): {% endhighlight %} + + +## Example: Saving a

[GitHub] spark pull request: [SPARK-12153][MLlib]add support of arbitrary l...

2015-12-09 Thread ygcao
Github user ygcao commented on the pull request: https://github.com/apache/spark/pull/10152#issuecomment-163517944 To see is to believe, comparison is the key. You are encouraged to use my version(using a simple sentence splitter by dot and question mark. Btw:if your data is not text,

[GitHub] spark pull request: SPARK-12200 Add __contains__ implementation to...

2015-12-09 Thread holdenk
Github user holdenk commented on the pull request: https://github.com/apache/spark/pull/10194#issuecomment-163517495 Being consistent with the python datamodel is probably good, just important not to surprise anyone whose code may have been written against the old assumptions. --- I

[GitHub] spark pull request: [SPARK-12199][DOC] Follow-up: Refine example c...

2015-12-09 Thread BenFradet
Github user BenFradet commented on the pull request: https://github.com/apache/spark/pull/10193#issuecomment-163517061 There is one nit in [polynomial_expansion_example.py](https://github.com/apache/spark/blob/master/examples/src/main/python/ml/polynomial_expansion_example.py#L33) wit

[GitHub] spark pull request: [SPARK-12155] [SPARK-12253] Fix executor OOM i...

2015-12-09 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/10240#discussion_r47193976 --- Diff: core/src/main/scala/org/apache/spark/memory/ExecutionMemoryPool.scala --- @@ -91,23 +108,34 @@ private[memory] class ExecutionMemoryPool(

[GitHub] spark pull request: [Streaming][Doc][Minor] Update the description...

2015-12-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10246#issuecomment-163516569 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [Streaming][Doc][Minor] Update the description...

2015-12-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10246#issuecomment-163516572 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [Streaming][Doc][Minor] Update the description...

2015-12-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10246#issuecomment-163516459 **[Test build #47490 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47490/consoleFull)** for PR 10246 at commit [`5c5cd95`](https://g

[GitHub] spark pull request: [SPARK-9026] [SPARK-4514] Modifications to Job...

2015-12-09 Thread markhamstra
Github user markhamstra commented on a diff in the pull request: https://github.com/apache/spark/pull/9264#discussion_r47193488 --- Diff: core/src/test/scala/org/apache/spark/rdd/AsyncRDDActionsSuite.scala --- @@ -197,4 +197,34 @@ class AsyncRDDActionsSuite extends SparkFunSuite wi

[GitHub] spark pull request: [Streaming][Doc][Minor] Update the description...

2015-12-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10246#issuecomment-163514970 **[Test build #47490 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47490/consoleFull)** for PR 10246 at commit [`5c5cd95`](https://gi

[GitHub] spark pull request: [SPARK-12252][SQL] refactor MapObjects to make...

2015-12-09 Thread gatorsmile
Github user gatorsmile commented on the pull request: https://github.com/apache/spark/pull/10239#issuecomment-163514629 @cloud-fan Sure, let me open it now. Thank you! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If yo

[GitHub] spark pull request: [SPARK-9372] [SQL] For joins, insert IS NOT NU...

2015-12-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10209#issuecomment-163514568 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12242][SQL] Add DataFrame.transform met...

2015-12-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10226#issuecomment-163514573 **[Test build #2193 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2193/consoleFull)** for PR 10226 at commit [`a1fac56`](https://

[GitHub] spark pull request: [SPARK-9372] [SQL] For joins, insert IS NOT NU...

2015-12-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10209#issuecomment-163514567 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-9372] [SQL] For joins, insert IS NOT NU...

2015-12-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10209#issuecomment-163514549 **[Test build #47488 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47488/consoleFull)** for PR 10209 at commit [`00e957c`](https://g

[GitHub] spark pull request: [SPARK-12256] [SQL] Code refactoring: naming b...

2015-12-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10243#issuecomment-163514427 **[Test build #47489 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47489/consoleFull)** for PR 10243 at commit [`a71d5b1`](https://gi

[GitHub] spark pull request: SPARK-12200 Add __contains__ implementation to...

2015-12-09 Thread maver1ck
Github user maver1ck commented on the pull request: https://github.com/apache/spark/pull/10194#issuecomment-163514237 Yes. Now, it'll be consistent with Python documentation: https://docs.python.org/3/reference/datamodel.html --- If your project is set up for it, you can reply

[GitHub] spark pull request: [Streaming][Doc][Minor] Update the description...

2015-12-09 Thread jerryshao
GitHub user jerryshao opened a pull request: https://github.com/apache/spark/pull/10246 [Streaming][Doc][Minor] Update the description of direct Kafka stream doc With the merge of [SPARK-8337](https://issues.apache.org/jira/browse/SPARK-8337), now the Python API has the same functi

[GitHub] spark pull request: [SPARK-12252][SQL] refactor MapObjects to make...

2015-12-09 Thread cloud-fan
Github user cloud-fan commented on the pull request: https://github.com/apache/spark/pull/10239#issuecomment-163513683 @gatorsmile , the problem is: currently kryo/javaSerialization encoder is not composable, so it's another story, feel free to open a JIRA for it. --- If your project

[GitHub] spark pull request: [SPARK-12153][MLlib]add support of arbitrary l...

2015-12-09 Thread ygcao
Github user ygcao commented on the pull request: https://github.com/apache/spark/pull/10152#issuecomment-163512458 I have to say word2vec or skip gram can be absolutely affected by training data just like any other ML algorithm. I also can tell you I observed big differences when I a

[GitHub] spark pull request: [SPARK-9026] [SPARK-4514] Modifications to Job...

2015-12-09 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/9264#discussion_r47192789 --- Diff: core/src/test/scala/org/apache/spark/rdd/AsyncRDDActionsSuite.scala --- @@ -197,4 +197,34 @@ class AsyncRDDActionsSuite extends SparkFunSuite with

[GitHub] spark pull request: [SPARK-12256] [SQL] Code refactoring: naming b...

2015-12-09 Thread gatorsmile
Github user gatorsmile commented on the pull request: https://github.com/apache/spark/pull/10243#issuecomment-163510257 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-9026] [SPARK-4514] Modifications to Job...

2015-12-09 Thread markhamstra
Github user markhamstra commented on a diff in the pull request: https://github.com/apache/spark/pull/9264#discussion_r47192089 --- Diff: core/src/test/scala/org/apache/spark/rdd/AsyncRDDActionsSuite.scala --- @@ -197,4 +197,34 @@ class AsyncRDDActionsSuite extends SparkFunSuite wi

[GitHub] spark pull request: [SPARK-9372] [SQL] For joins, insert IS NOT NU...

2015-12-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10209#issuecomment-163507143 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-9372] [SQL] For joins, insert IS NOT NU...

2015-12-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10209#issuecomment-163507134 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-9372] [SQL] For joins, insert IS NOT NU...

2015-12-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10209#issuecomment-163507570 **[Test build #47488 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47488/consoleFull)** for PR 10209 at commit [`00e957c`](https://gi

[GitHub] spark pull request: [SPARK-12155] [SPARK-12253] Fix executor OOM i...

2015-12-09 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/10240#discussion_r47192018 --- Diff: core/src/main/scala/org/apache/spark/memory/ExecutionMemoryPool.scala --- @@ -91,23 +108,34 @@ private[memory] class ExecutionMemoryPool(

[GitHub] spark pull request: [SPARK-12251] Document and improve off-heap me...

2015-12-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10237#issuecomment-163503144 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12251] Document and improve off-heap me...

2015-12-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10237#issuecomment-163503148 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12251] Document and improve off-heap me...

2015-12-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10237#issuecomment-163502870 **[Test build #47482 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47482/consoleFull)** for PR 10237 at commit [`216fc46`](https://g

[GitHub] spark pull request: [SPARK-12155] [SPARK-12253] Fix executor OOM i...

2015-12-09 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/10240#discussion_r47191802 --- Diff: core/src/main/scala/org/apache/spark/memory/ExecutionMemoryPool.scala --- @@ -91,23 +108,34 @@ private[memory] class ExecutionMemoryPool(

[GitHub] spark pull request: [SPARK-12252][SQL] refactor MapObjects to make...

2015-12-09 Thread gatorsmile
Github user gatorsmile commented on the pull request: https://github.com/apache/spark/pull/10239#issuecomment-163496616 Regarding the JIRA SPARK-12131, how about the following statement? ```scala implicit val kryoEncoder = Encoders.kryo[KryoClassData] val ds = Seq((KryoClas

[GitHub] spark pull request: [SPARK-12131][SQL] Fixes ExpressionEncoder for...

2015-12-09 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/10133#issuecomment-163493682 Closing this one in favor of #10239. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project d

[GitHub] spark pull request: [SPARK-12252][SQL] refactor MapObjects to make...

2015-12-09 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/10239#issuecomment-163493628 Great, so the inner class issue is also resolved. I'm closing #10133 then. --- If your project is set up for it, you can reply to this email and have your reply appea

[GitHub] spark pull request: [SPARK-12131][SQL] Fixes ExpressionEncoder for...

2015-12-09 Thread liancheng
Github user liancheng closed the pull request at: https://github.com/apache/spark/pull/10133 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK] [API DOC] rdd's aggregate function

2015-12-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10245#issuecomment-163493188 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your p

[GitHub] spark pull request: [SPARK-9026] [SPARK-4514] Modifications to Job...

2015-12-09 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/9264#discussion_r47190819 --- Diff: core/src/test/scala/org/apache/spark/rdd/AsyncRDDActionsSuite.scala --- @@ -197,4 +197,34 @@ class AsyncRDDActionsSuite extends SparkFunSuite with

[GitHub] spark pull request: [SPARK] [API DOC] rdd's aggregate function

2015-12-09 Thread Wenpei
GitHub user Wenpei opened a pull request: https://github.com/apache/spark/pull/10245 [SPARK] [API DOC] rdd's aggregate function More accurate for RDD's aggregate function, especially for zeroValue parameter. In old version, people may misunderstand and thought zeroValue may us

[GitHub] spark pull request: [SPARK-12215][ML][DOC] User guide section for ...

2015-12-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10244#issuecomment-163492163 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12215][ML][DOC] User guide section for ...

2015-12-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10244#issuecomment-163492165 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12215][ML][DOC] User guide section for ...

2015-12-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10244#issuecomment-163491941 **[Test build #47485 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47485/consoleFull)** for PR 10244 at commit [`e8e9c14`](https://g

[GitHub] spark pull request: [SPARK-12251] Document and improve off-heap me...

2015-12-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10237#issuecomment-163490878 **[Test build #47486 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47486/consoleFull)** for PR 10237 at commit [`216fc46`](https://gi

[GitHub] spark pull request: [SPARK-12220][Core]Make Utils.fetchFile suppor...

2015-12-09 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/10208#discussion_r47190317 --- Diff: core/src/main/scala/org/apache/spark/util/Utils.scala --- @@ -331,6 +331,30 @@ private[spark] object Utils extends Logging { } /

[GitHub] spark pull request: [SPARK-12251] Document and improve off-heap me...

2015-12-09 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/10237#issuecomment-163490047 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-12220][Core]Make Utils.fetchFile suppor...

2015-12-09 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/10208#discussion_r47190051 --- Diff: core/src/main/scala/org/apache/spark/util/Utils.scala --- @@ -331,6 +331,30 @@ private[spark] object Utils extends Logging { } /

[GitHub] spark pull request: [SPARK-12215][ML][DOC] User guide section for ...

2015-12-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10244#issuecomment-163489601 **[Test build #47485 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47485/consoleFull)** for PR 10244 at commit [`e8e9c14`](https://gi

[GitHub] spark pull request: [SPARK-12256] [SQL] Code refactoring: naming b...

2015-12-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10243#issuecomment-163488595 **[Test build #47481 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47481/consoleFull)** for PR 10243 at commit [`a71d5b1`](https://g

[GitHub] spark pull request: [SPARK-12256] [SQL] Code refactoring: naming b...

2015-12-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10243#issuecomment-163488624 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12256] [SQL] Code refactoring: naming b...

2015-12-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10243#issuecomment-163488623 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [RFC] Add type-safe config keys to SparkConf.

2015-12-09 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/10205#issuecomment-163488391 Haven't seen any feedback so I guess people are ok with turning this into a real PR? --- If your project is set up for it, you can reply to this email and have your rep

[GitHub] spark pull request: [SPARK-12215][ML][DOC] User guide section for ...

2015-12-09 Thread yu-iskw
Github user yu-iskw commented on the pull request: https://github.com/apache/spark/pull/10244#issuecomment-163488306 Jenkins, test this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-12252][SQL] refactor MapObjects to make...

2015-12-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10239#issuecomment-163488143 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12215][ML][DOC] User guide section for ...

2015-12-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10244#issuecomment-163488145 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12252][SQL] refactor MapObjects to make...

2015-12-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10239#issuecomment-163488086 **[Test build #47479 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47479/consoleFull)** for PR 10239 at commit [`d1992a9`](https://g

[GitHub] spark pull request: [SPARK-12215][ML][DOC] User guide section for ...

2015-12-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10244#issuecomment-163488147 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12252][SQL] refactor MapObjects to make...

2015-12-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10239#issuecomment-163488144 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12242][SQL] Add DataFrame.transform met...

2015-12-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10226#issuecomment-163487805 **[Test build #2193 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2193/consoleFull)** for PR 10226 at commit [`a1fac56`](https://g

[GitHub] spark pull request: [SPARK-6518][MLlib][Example][DOC] Add example ...

2015-12-09 Thread yu-iskw
Github user yu-iskw commented on the pull request: https://github.com/apache/spark/pull/9952#issuecomment-163487878 ping @jkbradley --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this featu

[GitHub] spark pull request: [SPARK-12251] Document and improve off-heap me...

2015-12-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10237#issuecomment-163487503 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12215][ML][DOC] User guide section for ...

2015-12-09 Thread yu-iskw
Github user yu-iskw commented on the pull request: https://github.com/apache/spark/pull/10244#issuecomment-163487655 Jenkins, test this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-12251] Document and improve off-heap me...

2015-12-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10237#issuecomment-163487457 **[Test build #47469 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47469/consoleFull)** for PR 10237 at commit [`2dd2d9e`](https://g

[GitHub] spark pull request: [SPARK-12251] Document and improve off-heap me...

2015-12-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10237#issuecomment-163487504 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12242][SQL] Add DataFrame.transform met...

2015-12-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10226#issuecomment-163487172 **[Test build #2192 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2192/consoleFull)** for PR 10226 at commit [`a1fac56`](https://g

[GitHub] spark pull request: [SPARK-2750][WEB UI] Add https support to the ...

2015-12-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10238#issuecomment-163487000 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-2750][WEB UI] Add https support to the ...

2015-12-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10238#issuecomment-163487001 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12244][SPARK-12245][STREAMING] Rename t...

2015-12-09 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/10224 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request: [SPARK-2750][WEB UI] Add https support to the ...

2015-12-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10238#issuecomment-163486937 **[Test build #47471 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47471/consoleFull)** for PR 10238 at commit [`a555e43`](https://g

[GitHub] spark pull request: [SPARK-12244][SPARK-12245][STREAMING] Rename t...

2015-12-09 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/10224#issuecomment-163486767 merging to master and 1.6 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-12215][ML][DOC] User guide section for ...

2015-12-09 Thread yu-iskw
GitHub user yu-iskw opened a pull request: https://github.com/apache/spark/pull/10244 [SPARK-12215][ML][DOC] User guide section for KMeans in spark.ml cc @jkbradley You can merge this pull request into a Git repository by running: $ git pull https://github.com/yu-iskw/spark SP

[GitHub] spark pull request: [SPARK-12252][SQL] refactor MapObjects to make...

2015-12-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10239#issuecomment-163486564 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

  1   2   3   4   5   6   7   >