[GitHub] spark pull request: [SPARK-14938][ML] replace some RDD.map with Da...

2016-04-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12718#issuecomment-215385742 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-14938][ML] replace some RDD.map with Da...

2016-04-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12718#issuecomment-215385539 **[Test build #57245 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57245/consoleFull)** for PR 12718 at commit

[GitHub] spark pull request: [SPARK-7424] [ML] ML ClassificationModel shoul...

2016-04-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12066#issuecomment-215379968 **[Test build #57244 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57244/consoleFull)** for PR 12066 at commit

[GitHub] spark pull request: [SPARK-7424] [ML] ML ClassificationModel shoul...

2016-04-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12066#issuecomment-215379043 **[Test build #57243 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57243/consoleFull)** for PR 12066 at commit

[GitHub] spark pull request: [SPARK-14850][ML] convert primitive array from...

2016-04-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12640#issuecomment-215374433 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-14850][ML] convert primitive array from...

2016-04-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12640#issuecomment-215374404 **[Test build #57241 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57241/consoleFull)** for PR 12640 at commit

[GitHub] spark pull request: [SPARK-14850][ML] convert primitive array from...

2016-04-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12640#issuecomment-215374427 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-14487][SQL] User Defined Type registrat...

2016-04-28 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/12259#discussion_r61401723 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/types/UDTRegistration.scala --- @@ -0,0 +1,133 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-14850][ML] convert primitive array from...

2016-04-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12640#issuecomment-215372214 **[Test build #57241 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57241/consoleFull)** for PR 12640 at commit

[GitHub] spark pull request: [SPARK-14521][SQL]StackOverflowError in Kryo w...

2016-04-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12598#issuecomment-215372240 **[Test build #57242 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57242/consoleFull)** for PR 12598 at commit

[GitHub] spark pull request: [SPARK-14521][SQL]StackOverflowError in Kryo w...

2016-04-28 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/12598#issuecomment-215371295 Jenkins retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-14850][ML] convert primitive array from...

2016-04-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12640#issuecomment-215370955 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-14850][ML] convert primitive array from...

2016-04-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12640#issuecomment-215370951 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-14850][ML] convert primitive array from...

2016-04-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12640#issuecomment-215370706 **[Test build #57237 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57237/consoleFull)** for PR 12640 at commit

[GitHub] spark pull request: [SPARK-14914] Normalize Paths/URIs for windows...

2016-04-28 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/12695#issuecomment-215369309 Isn't the URI just `file:///D:/test`? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-14850][ML] convert primitive array from...

2016-04-28 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/12640#discussion_r61399541 --- Diff: mllib/src/test/scala/org/apache/spark/mllib/linalg/UDTSerializationBenchmark.scala --- @@ -0,0 +1,70 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-14938][ML] replace some RDD.map with Da...

2016-04-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12718#issuecomment-215367423 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-14938][ML] replace some RDD.map with Da...

2016-04-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12718#issuecomment-215367301 **[Test build #57238 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57238/consoleFull)** for PR 12718 at commit

[GitHub] spark pull request: [SPARK-14938][ML] replace some RDD.map with Da...

2016-04-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12718#issuecomment-215367425 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-14576] [Web UI] Spark console should di...

2016-04-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12341#issuecomment-215366802 **[Test build #57240 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57240/consoleFull)** for PR 12341 at commit

[GitHub] spark pull request: [SPARK-14945][PYTHON] SparkSession Python API

2016-04-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12746#issuecomment-215366426 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-14945][PYTHON] SparkSession Python API

2016-04-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12746#issuecomment-215366419 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-14945][PYTHON] SparkSession Python API

2016-04-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12746#issuecomment-215366183 **[Test build #57233 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57233/consoleFull)** for PR 12746 at commit

[GitHub] spark pull request: [SPARK-14098][SQL] Generate Java code that get...

2016-04-28 Thread kiszk
Github user kiszk commented on the pull request: https://github.com/apache/spark/pull/11956#issuecomment-215365815 ping @davies --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-13973][PYSPARK] Make pyspark fail noisi...

2016-04-28 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/12528#issuecomment-215365706 Thanks @shearerp but can you also very briefly mention how to invoke `jupyter` in the programming guide? just a sentence would suffice, so that people are clear this is

[GitHub] spark pull request: [SPARK-14576] [Web UI] Spark console should di...

2016-04-28 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/12341#issuecomment-215365299 Jenkins retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [Spark-14976][Streaming] make StreamingContext...

2016-04-28 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/12752#discussion_r61397728 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/dstream/FileInputDStream.scala --- @@ -195,10 +195,13 @@ class FileInputDStream[K, V, F <:

[GitHub] spark pull request: [SPARK-14850][ML] convert primitive array from...

2016-04-28 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/12640#discussion_r61397517 --- Diff: mllib/src/test/scala/org/apache/spark/mllib/linalg/UDTSerializationBenchmark.scala --- @@ -0,0 +1,70 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-14969][MLLib] Remove duplicate implemen...

2016-04-28 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/12747#issuecomment-215363871 You can also remove the one in `ANNGradient` right? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: [SPARK-14850][ML] convert primitive array from...

2016-04-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12640#issuecomment-215363656 **[Test build #57239 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57239/consoleFull)** for PR 12640 at commit

[GitHub] spark pull request: [SPARK-14661] [MLlib] trim PCAModel by require...

2016-04-28 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/12419#discussion_r61395945 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/linalg/distributed/RowMatrix.scala --- @@ -379,15 +379,21 @@ class RowMatrix @Since("1.0.0") (

[GitHub] spark pull request: [SPARK-11171][SPARK-11237][SPARK-11241][ML] Tr...

2016-04-28 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/9207#issuecomment-215359267 If the base change is just bringing the `PMMLExportable` trait to ML in a reasonable form, that seems fine. I might not know enough to know if I'm missing something, but

[GitHub] spark pull request: [SPARK-14511][Build] Upgrade genjavadoc to lat...

2016-04-28 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/12707#issuecomment-215357914 Yeah, the problem is that Java 8 has a much stricter javadoc tool. `@group` isn't a valid javadoc tag, so when `ALSModel.scala` gets translated to Java to javadoc it,

[GitHub] spark pull request: [SPARK-14938][ML] replace some RDD.map with Da...

2016-04-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12718#issuecomment-215357553 **[Test build #57238 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57238/consoleFull)** for PR 12718 at commit

[GitHub] spark pull request: [Spark-14976][Streaming] make StreamingContext...

2016-04-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12752#issuecomment-215357222 **[Test build #57236 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57236/consoleFull)** for PR 12752 at commit

[GitHub] spark pull request: [Spark-14976][Streaming] make StreamingContext...

2016-04-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12752#issuecomment-215357266 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [Spark-14976][Streaming] make StreamingContext...

2016-04-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12752#issuecomment-215357267 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-14412][ML][PYSPARK] Add StorageLevel pa...

2016-04-28 Thread MLnick
Github user MLnick commented on a diff in the pull request: https://github.com/apache/spark/pull/12660#discussion_r61393700 --- Diff: python/pyspark/ml/tests.py --- @@ -929,6 +932,50 @@ def test_apply_binary_term_freqs(self): ": expected " +

[GitHub] spark pull request: [SPARK-14938][ML] replace some RDD.map with Da...

2016-04-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12718#issuecomment-215355549 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-14938][ML] replace some RDD.map with Da...

2016-04-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12718#issuecomment-215355548 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-14938][ML] replace some RDD.map with Da...

2016-04-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12718#issuecomment-215355402 **[Test build #57235 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57235/consoleFull)** for PR 12718 at commit

[GitHub] spark pull request: [SPARK-14850][ML] convert primitive array from...

2016-04-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12640#issuecomment-215355291 **[Test build #57237 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57237/consoleFull)** for PR 12640 at commit

[GitHub] spark pull request: [SPARK-14412][ML][PYSPARK] Add StorageLevel pa...

2016-04-28 Thread MLnick
Github user MLnick commented on a diff in the pull request: https://github.com/apache/spark/pull/12660#discussion_r61392731 --- Diff: mllib/src/test/scala/org/apache/spark/ml/recommendation/ALSSuite.scala --- @@ -512,6 +514,55 @@ class ALSSuite

[GitHub] spark pull request: [SPARK-14412][ML][PYSPARK] Add StorageLevel pa...

2016-04-28 Thread MLnick
Github user MLnick commented on a diff in the pull request: https://github.com/apache/spark/pull/12660#discussion_r61392206 --- Diff: mllib/src/test/scala/org/apache/spark/ml/recommendation/ALSSuite.scala --- @@ -512,6 +514,55 @@ class ALSSuite

[GitHub] spark pull request: [SPARK-14412][ML][PYSPARK] Add StorageLevel pa...

2016-04-28 Thread MLnick
Github user MLnick commented on a diff in the pull request: https://github.com/apache/spark/pull/12660#discussion_r61391861 --- Diff: mllib/src/test/scala/org/apache/spark/ml/recommendation/ALSSuite.scala --- @@ -512,6 +514,55 @@ class ALSSuite

[GitHub] spark pull request: SPARK-11402: Use ChildRunnerProvider to create...

2016-04-28 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/9354#issuecomment-215353152 Yes, this PR should be closed. Per discussion in the JIRA, this just is too much SPI to open up for not obvious gain. There may be much more modest refactorings that

[GitHub] spark pull request: [SPARK-14850][ML] convert primitive array from...

2016-04-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12640#issuecomment-215352568 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-14850][ML] convert primitive array from...

2016-04-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12640#issuecomment-215352565 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-14850][ML] convert primitive array from...

2016-04-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12640#issuecomment-215352327 **[Test build #57230 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57230/consoleFull)** for PR 12640 at commit

[GitHub] spark pull request: [SPARK-14412][ML][PYSPARK] Add StorageLevel pa...

2016-04-28 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/12660#discussion_r61391277 --- Diff: python/pyspark/ml/tests.py --- @@ -929,6 +932,50 @@ def test_apply_binary_term_freqs(self): ": expected " +

[GitHub] spark pull request: [SPARK-14412][ML][PYSPARK] Add StorageLevel pa...

2016-04-28 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/12660#discussion_r61391177 --- Diff: mllib/src/test/scala/org/apache/spark/ml/recommendation/ALSSuite.scala --- @@ -512,6 +514,55 @@ class ALSSuite

[GitHub] spark pull request: [SPARK-14412][ML][PYSPARK] Add StorageLevel pa...

2016-04-28 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/12660#discussion_r61391003 --- Diff: mllib/src/test/scala/org/apache/spark/ml/recommendation/ALSSuite.scala --- @@ -512,6 +514,55 @@ class ALSSuite

[GitHub] spark pull request: [SPARK-14412][ML][PYSPARK] Add StorageLevel pa...

2016-04-28 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/12660#discussion_r61391033 --- Diff: mllib/src/test/scala/org/apache/spark/ml/recommendation/ALSSuite.scala --- @@ -512,6 +514,55 @@ class ALSSuite

[GitHub] spark pull request: [SPARK-14412][ML][PYSPARK] Add StorageLevel pa...

2016-04-28 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/12660#discussion_r61390984 --- Diff: mllib/src/test/scala/org/apache/spark/ml/recommendation/ALSSuite.scala --- @@ -512,6 +514,55 @@ class ALSSuite

[GitHub] spark pull request: [Spark-14976][Streaming] make StreamingContext...

2016-04-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12752#issuecomment-215350745 **[Test build #57236 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57236/consoleFull)** for PR 12752 at commit

[GitHub] spark pull request: [Spark-14976][Streaming] make StreamingContext...

2016-04-28 Thread mwws
Github user mwws commented on the pull request: https://github.com/apache/spark/pull/12752#issuecomment-215350461 @chenghao-intel --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [Spark-14976][Streaming] make StreamingContext...

2016-04-28 Thread mwws
GitHub user mwws opened a pull request: https://github.com/apache/spark/pull/12752 [Spark-14976][Streaming] make StreamingContext.textFileStream support wildcard ## What changes were proposed in this pull request? make StreamingContext.textFileStream support wildcard like

[GitHub] spark pull request: [SPARK-14412][ML][PYSPARK] Add StorageLevel pa...

2016-04-28 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/12660#issuecomment-215350491 If it's just porting old API params to the new API, seems sensible. The implementation looks sensible to me. --- If your project is set up for it, you can reply to

[GitHub] spark pull request: [SPARK-14850][ML] convert primitive array from...

2016-04-28 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/12640#discussion_r61389927 --- Diff: sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/UnsafeArrayData.java --- @@ -336,4 +336,62 @@ public UnsafeArrayData

[GitHub] spark pull request: [SPARK-14850][ML] convert primitive array from...

2016-04-28 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/12640#discussion_r61389700 --- Diff: sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/UnsafeArrayData.java --- @@ -336,4 +336,62 @@ public UnsafeArrayData

[GitHub] spark pull request: [SPARK-14945][PYTHON] SparkSession Python API

2016-04-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12746#issuecomment-215347510 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-14945][PYTHON] SparkSession Python API

2016-04-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12746#issuecomment-215347507 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-14945][PYTHON] SparkSession Python API

2016-04-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12746#issuecomment-215347337 **[Test build #57234 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57234/consoleFull)** for PR 12746 at commit

[GitHub] spark pull request: [SPARK-14487][SQL] User Defined Type registrat...

2016-04-28 Thread viirya
Github user viirya commented on the pull request: https://github.com/apache/spark/pull/12259#issuecomment-215346566 @mengxr @dbtsai Thanks for reviewing this! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-14487][SQL] User Defined Type registrat...

2016-04-28 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/12259 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-14487][SQL] User Defined Type registrat...

2016-04-28 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/12259#issuecomment-215345283 Merged into master. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-14938][ML] replace some RDD.map with Da...

2016-04-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12718#issuecomment-215344251 **[Test build #57235 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57235/consoleFull)** for PR 12718 at commit

[GitHub] spark pull request: [SPARK-14850][ML] convert primitive array from...

2016-04-28 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/12640#issuecomment-215343973 @cloud-fan Could you also update the benchmark? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-12660] [SPARK-14967] [SQL] Implement Ex...

2016-04-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12736#issuecomment-215342856 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-12660] [SPARK-14967] [SQL] Implement Ex...

2016-04-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12736#issuecomment-215342854 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-12660] [SPARK-14967] [SQL] Implement Ex...

2016-04-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12736#issuecomment-215342650 **[Test build #57227 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57227/consoleFull)** for PR 12736 at commit

[GitHub] spark pull request: [SPARK-14850][ML] convert primitive array from...

2016-04-28 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/12640#discussion_r61387931 --- Diff: sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/UnsafeArrayData.java --- @@ -336,4 +336,62 @@ public UnsafeArrayData copy() {

[GitHub] spark pull request: [SPARK-14850][ML] convert primitive array from...

2016-04-28 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/12640#discussion_r61387937 --- Diff: sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/UnsafeArrayData.java --- @@ -336,4 +336,62 @@ public UnsafeArrayData copy() {

[GitHub] spark pull request: [SPARK-14850][ML] convert primitive array from...

2016-04-28 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/12640#discussion_r61386974 --- Diff: sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/UnsafeArrayData.java --- @@ -336,4 +336,62 @@ public UnsafeArrayData copy() {

[GitHub] spark pull request: [SPARK-14850][ML] convert primitive array from...

2016-04-28 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/12640#discussion_r61386945 --- Diff: sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/UnsafeArrayData.java --- @@ -336,4 +336,62 @@ public UnsafeArrayData copy() {

[GitHub] spark pull request: [SPARK-14945][PYTHON] SparkSession Python API

2016-04-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12746#issuecomment-215340310 **[Test build #57234 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57234/consoleFull)** for PR 12746 at commit

[GitHub] spark pull request: [SPARK-14945][PYTHON] SparkSession Python API

2016-04-28 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/12746#issuecomment-215340073 retest this please?? Why did you run all the unit tests?? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark pull request: [SPARK-14938][ML] replace some RDD.map with Da...

2016-04-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12718#issuecomment-215339652 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-14938][ML] replace some RDD.map with Da...

2016-04-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12718#issuecomment-215339654 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-14938][ML] replace some RDD.map with Da...

2016-04-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12718#issuecomment-215339565 **[Test build #57231 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57231/consoleFull)** for PR 12718 at commit

[GitHub] spark pull request: [SPARK-14850][ML] convert primitive array from...

2016-04-28 Thread kiszk
Github user kiszk commented on the pull request: https://github.com/apache/spark/pull/12640#issuecomment-215338341 @cloud-fan , @mengxr, it would be worth to add ```final``` to a declaration of ```UnsafeArrayData ``` for encouraging method inlining by JIT compiler, as follows:

[GitHub] spark pull request: [SPARK-13961][ML] spark.ml ChiSqSelector and R...

2016-04-28 Thread BenFradet
Github user BenFradet commented on a diff in the pull request: https://github.com/apache/spark/pull/12467#discussion_r61384769 --- Diff: mllib/src/test/scala/org/apache/spark/ml/feature/RFormulaSuite.scala --- @@ -290,4 +291,18 @@ class RFormulaSuite extends SparkFunSuite with

[GitHub] spark pull request: [SPARK-14571][ML]Log instrumentation in ALS

2016-04-28 Thread MLnick
Github user MLnick commented on a diff in the pull request: https://github.com/apache/spark/pull/12560#discussion_r61384326 --- Diff: mllib/src/main/scala/org/apache/spark/ml/util/Instrumentation.scala --- @@ -85,6 +85,13 @@ private[ml] class Instrumentation[E <: Estimator[_]]

[GitHub] spark pull request: [SPARK-13568] [ML] Create feature transformer ...

2016-04-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11601#issuecomment-215335519 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-12660] [SPARK-14967] [SQL] Implement Ex...

2016-04-28 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/12736#discussion_r61383924 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/analysis/HiveTypeCoercionSuite.scala --- @@ -488,14 +488,6 @@ class

[GitHub] spark pull request: [SPARK-13568] [ML] Create feature transformer ...

2016-04-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11601#issuecomment-215335518 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13568] [ML] Create feature transformer ...

2016-04-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11601#issuecomment-215335486 **[Test build #57229 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57229/consoleFull)** for PR 11601 at commit

[GitHub] spark pull request: [SPARK-14783] [SPARK-14786] [BRANCH-1.6] Prese...

2016-04-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12724#issuecomment-215335070 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-14783] [SPARK-14786] [BRANCH-1.6] Prese...

2016-04-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12724#issuecomment-215335073 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-14783] [SPARK-14786] [BRANCH-1.6] Prese...

2016-04-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12724#issuecomment-215334962 **[Test build #57221 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57221/consoleFull)** for PR 12724 at commit

[GitHub] spark pull request: [SPARK-14706][SPARK-14973][ML][PySpark] Python...

2016-04-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12604#issuecomment-215334819 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-14706][SPARK-14973][ML][PySpark] Python...

2016-04-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12604#issuecomment-215334571 **[Test build #57228 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57228/consoleFull)** for PR 12604 at commit

[GitHub] spark pull request: [SPARK-14706][SPARK-14973][ML][PySpark] Python...

2016-04-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12604#issuecomment-215334815 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-14654][CORE] New accumulator API

2016-04-28 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/12612 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-14945][PYTHON] SparkSession Python API

2016-04-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12746#issuecomment-215334370 **[Test build #57233 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57233/consoleFull)** for PR 12746 at commit

[GitHub] spark pull request: [SPARK-14858][SQL] Enable subquery pushdown

2016-04-28 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/12720#issuecomment-215334359 @hvanhovell That make sense, I will take another deep look tomorrow. --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark pull request: [SPARK-14850][ML] convert primitive array from...

2016-04-28 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/12640#discussion_r61383378 --- Diff: sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/UnsafeArrayData.java --- @@ -336,4 +336,62 @@ public UnsafeArrayData

[GitHub] spark pull request: [SPARK-14654][CORE] New accumulator API

2016-04-28 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/12612#issuecomment-215334099 Merging in master! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-14858][SQL] Enable subquery pushdown

2016-04-28 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/12720#discussion_r61383358 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/namedExpressions.scala --- @@ -337,6 +337,16 @@ case class PrettyAttribute(

[GitHub] spark pull request: [SPARK-14654][CORE] New accumulator API

2016-04-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12612#issuecomment-215332700 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

<    3   4   5   6   7   8   9   >