[GitHub] spark pull request: [SPARK-10181] [SQL] UserGroupInformation class...

2015-10-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9208#issuecomment-150060609 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pr

[GitHub] spark pull request: [SPARK-11171][SPARK-11237][SPARK-11241][ML][WI...

2015-10-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9207#issuecomment-150060900 **[Test build #44105 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44105/consoleFull)** for PR 9207 at commit [`1749aec`](https://gith

[GitHub] spark pull request: [SPARK-9298][SQL] Add pearson correlation aggr...

2015-10-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8587#issuecomment-150060626 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-11171][SPARK-11237][SPARK-11241][ML][WI...

2015-10-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9207#issuecomment-150060616 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-9298][SQL] Add pearson correlation aggr...

2015-10-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8587#issuecomment-150060667 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-10181] [SQL] UserGroupInformation class...

2015-10-21 Thread yolandagao
GitHub user yolandagao opened a pull request: https://github.com/apache/spark/pull/9208 [SPARK-10181] [SQL] UserGroupInformation class needs to be shared for login credentials @yhuai You can merge this pull request into a Git repository by running: $ git pull https://github.c

[GitHub] spark pull request: [SPARK-11171][SPARK-11237][SPARK-11241][ML][WI...

2015-10-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9207#issuecomment-150058761 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-11171][SPARK-11237][SPARK-11241][ML][WI...

2015-10-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9207#issuecomment-150058763 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44

[GitHub] spark pull request: [SPARK-11171][SPARK-11237][SPARK-11241][ML][WI...

2015-10-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9207#issuecomment-150058759 **[Test build #44104 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44104/consoleFull)** for PR 9207 at commit [`368879f`](https://git

[GitHub] spark pull request: [SPARK-11171][SPARK-11237][SPARK-11241][ML][WI...

2015-10-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9207#issuecomment-150058485 **[Test build #44104 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44104/consoleFull)** for PR 9207 at commit [`368879f`](https://gith

[GitHub] spark pull request: [SPARK-11235] [network] Add ability to stream ...

2015-10-21 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/9206#issuecomment-150058459 /cc @rxin @aarondav --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this fe

[GitHub] spark pull request: [SPARK-11171][SPARK-11237][SPARK-11241][ML][WI...

2015-10-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9207#issuecomment-150058402 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-11171][SPARK-11237][SPARK-11241][ML][WI...

2015-10-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9207#issuecomment-150058416 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-9298][SQL] Add pearson correlation aggr...

2015-10-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8587#issuecomment-150057960 **[Test build #44103 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44103/consoleFull)** for PR 8587 at commit [`1505cd2`](https://git

[GitHub] spark pull request: [SPARK-9298][SQL] Add pearson correlation aggr...

2015-10-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8587#issuecomment-150057965 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-9298][SQL] Add pearson correlation aggr...

2015-10-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8587#issuecomment-150057969 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44

[GitHub] spark pull request: [SPARK-11171][SPARK-11237][SPARK-11241][ML][WI...

2015-10-21 Thread holdenk
GitHub user holdenk opened a pull request: https://github.com/apache/spark/pull/9207 [SPARK-11171][SPARK-11237][SPARK-11241][ML][WIP] Try adding PMMLExportable to ML with KMeans Add PMMLExportable to ML & use it for KMeans in ML pipeline. This is a bit different than the PMMLExport

[GitHub] spark pull request: [SPARK-9298][SQL] Add pearson correlation aggr...

2015-10-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8587#issuecomment-150057635 **[Test build #44103 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44103/consoleFull)** for PR 8587 at commit [`1505cd2`](https://gith

[GitHub] spark pull request: [SPARK-11235] [network] Add ability to stream ...

2015-10-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9206#issuecomment-150057544 **[Test build #44102 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44102/consoleFull)** for PR 9206 at commit [`73a0bb8`](https://gith

[GitHub] spark pull request: [SPARK-11235] [network] Add ability to stream ...

2015-10-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9206#issuecomment-150056546 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-9298][SQL] Add pearson correlation aggr...

2015-10-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8587#issuecomment-150056545 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-9298][SQL] Add pearson correlation aggr...

2015-10-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8587#issuecomment-150056525 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-11235] [network] Add ability to stream ...

2015-10-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9206#issuecomment-150056518 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-10708] Consolidate sort shuffle impleme...

2015-10-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8829#issuecomment-150056406 **[Test build #44101 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44101/consoleFull)** for PR 8829 at commit [`f7c620c`](https://gith

[GitHub] spark pull request: [SPARK-10641][WIP][SQL] Add Skewness and Kurto...

2015-10-21 Thread holdenk
Github user holdenk commented on a diff in the pull request: https://github.com/apache/spark/pull/9003#discussion_r42697800 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/DataFrameAggregateSuite.scala --- @@ -221,4 +221,40 @@ class DataFrameAggregateSuite extends QueryTest

[GitHub] spark pull request: [SPARK-11235] [network] Add ability to stream ...

2015-10-21 Thread vanzin
GitHub user vanzin opened a pull request: https://github.com/apache/spark/pull/9206 [SPARK-11235] [network] Add ability to stream data using network lib. The current interface used to fetch shuffle data is not very efficient for large buffers; it requires the receiver to buffer t

[GitHub] spark pull request: [SPARK-5929] Pyspark: Register a pip requireme...

2015-10-21 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/4897#issuecomment-150056080 cc @JoshRosen @sknapp who are more familiar with Jenkins --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. I

[GitHub] spark pull request: [SPARK-10708] Consolidate sort shuffle impleme...

2015-10-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8829#issuecomment-150055879 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-10708] Consolidate sort shuffle impleme...

2015-10-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8829#issuecomment-150055853 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-10708] Consolidate sort shuffle impleme...

2015-10-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8829#issuecomment-150055744 **[Test build #1934 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1934/consoleFull)** for PR 8829 at commit [`f7c620c`](https://git

[GitHub] spark pull request: [SPARK-10979] [SparkR] Sparkrmerge: Add merge ...

2015-10-21 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/9012#issuecomment-150055578 Created https://issues.apache.org/jira/browse/SPARK-11250 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request: [SPARK-10708] Consolidate sort shuffle impleme...

2015-10-21 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/8829#issuecomment-150055150 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-11242][SQL] In conf/spark-env.sh.templa...

2015-10-21 Thread xguo27
Github user xguo27 commented on the pull request: https://github.com/apache/spark/pull/9201#issuecomment-150054928 Right, let me change that too. Thx Sean! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project d

[GitHub] spark pull request: [SPARK-11243] [SQL] output UnsafeRow from colu...

2015-10-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9203#issuecomment-150054848 **[Test build #44100 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44100/consoleFull)** for PR 9203 at commit [`cab9286`](https://gith

[GitHub] spark pull request: [SPARK-10979] [SparkR] Sparkrmerge: Add merge ...

2015-10-21 Thread NarineK
Github user NarineK commented on the pull request: https://github.com/apache/spark/pull/9012#issuecomment-150054734 cool! I can help you with scala and python :) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pro

[GitHub] spark pull request: [SPARK-10979] [SparkR] Sparkrmerge: Add merge ...

2015-10-21 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/9012#discussion_r42696960 --- Diff: R/pkg/R/DataFrame.R --- @@ -1457,15 +1457,142 @@ setMethod("join", dataFrame(sdf) }) -#' @rdname merge +#'

[GitHub] spark pull request: [SPARK-10266][Documentation, ML] Fixed @Since ...

2015-10-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8729#issuecomment-150054474 **[Test build #44099 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44099/consoleFull)** for PR 8729 at commit [`353f23a`](https://git

[GitHub] spark pull request: [SPARK-10266][Documentation, ML] Fixed @Since ...

2015-10-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8729#issuecomment-150054477 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-10266][Documentation, ML] Fixed @Since ...

2015-10-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8729#issuecomment-150054478 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44

[GitHub] spark pull request: [SPARK-10979] [SparkR] Sparkrmerge: Add merge ...

2015-10-21 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/9012#discussion_r42696855 --- Diff: R/pkg/R/DataFrame.R --- @@ -1457,15 +1457,142 @@ setMethod("join", dataFrame(sdf) }) -#' @rdname merge +

[GitHub] spark pull request: [SPARK-10266][Documentation, ML] Fixed @Since ...

2015-10-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8729#issuecomment-150054181 **[Test build #44099 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44099/consoleFull)** for PR 8729 at commit [`353f23a`](https://gith

[GitHub] spark pull request: [SPARK-11243] [SQL] output UnsafeRow from colu...

2015-10-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9203#issuecomment-150053787 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-11243] [SQL] output UnsafeRow from colu...

2015-10-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9203#issuecomment-150053767 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-11242][SQL] In conf/spark-env.sh.templa...

2015-10-21 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/9201#discussion_r42696318 --- Diff: conf/spark-env.sh.template --- @@ -39,7 +39,7 @@ # - SPARK_EXECUTOR_INSTANCES, Number of workers to start (Default: 2) # - SPARK_EXECUTOR_CO

[GitHub] spark pull request: [SPARK-11243] [SQL] output UnsafeRow from colu...

2015-10-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9203#issuecomment-150053373 **[Test build #44098 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44098/consoleFull)** for PR 9203 at commit [`1421bce`](https://gith

[GitHub] spark pull request: [SPARK-11243] [SQL] output UnsafeRow from colu...

2015-10-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9203#issuecomment-150053054 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-11243] [SQL] output UnsafeRow from colu...

2015-10-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9203#issuecomment-150053026 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-10266][Documentation, ML] Fixed @Since ...

2015-10-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8729#issuecomment-150053055 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-10266][Documentation, ML] Fixed @Since ...

2015-10-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8729#issuecomment-150053029 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-11243] [SQL] output UnsafeRow from colu...

2015-10-21 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/9203#discussion_r42695679 --- Diff: sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/UnsafeRow.java --- @@ -618,6 +618,25 @@ public void writeTo(ByteBuffer buffer)

[GitHub] spark pull request: [SPARK-11243] [SQL] output UnsafeRow from colu...

2015-10-21 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/9203#discussion_r42695693 --- Diff: sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/codegen/UnsafeRowWriter.java --- @@ -95,41 +99,75 @@ public void alignToWords(i

[GitHub] spark pull request: [SPARK-10708] Consolidate sort shuffle impleme...

2015-10-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8829#issuecomment-150051020 **[Test build #44090 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44090/consoleFull)** for PR 8829 at commit [`f7c620c`](https://git

[GitHub] spark pull request: [SPARK-10708] Consolidate sort shuffle impleme...

2015-10-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8829#issuecomment-150051059 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-10708] Consolidate sort shuffle impleme...

2015-10-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8829#issuecomment-150051060 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44

[GitHub] spark pull request: [SPARK-10304][SQL] Partition discovery should ...

2015-10-21 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/8840#discussion_r42694917 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/PartitioningUtils.scala --- @@ -128,30 +136,32 @@ private[sql] object Partitionin

[GitHub] spark pull request: [SPARK-11163] Remove unnecessary addPendingTas...

2015-10-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9154#issuecomment-150049165 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44

[GitHub] spark pull request: [SPARK-11163] Remove unnecessary addPendingTas...

2015-10-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9154#issuecomment-150049161 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-11163] Remove unnecessary addPendingTas...

2015-10-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9154#issuecomment-150048853 **[Test build #44093 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44093/consoleFull)** for PR 9154 at commit [`4394f00`](https://git

[GitHub] spark pull request: [SPARK-10266][Documentation, ML] Fixed @Since ...

2015-10-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8729#issuecomment-150046812 **[Test build #44097 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44097/consoleFull)** for PR 8729 at commit [`45472f0`](https://git

[GitHub] spark pull request: [SPARK-10266][Documentation, ML] Fixed @Since ...

2015-10-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8729#issuecomment-150046813 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-10266][Documentation, ML] Fixed @Since ...

2015-10-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8729#issuecomment-150046814 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44

[GitHub] spark pull request: [SPARK-10266][Documentation, ML] Fixed @Since ...

2015-10-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8729#issuecomment-150046454 **[Test build #44097 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44097/consoleFull)** for PR 8729 at commit [`45472f0`](https://gith

[GitHub] spark pull request: [SPARK-10266][Documentation, ML] Fixed @Since ...

2015-10-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8729#issuecomment-150046031 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-10266][Documentation, ML] Fixed @Since ...

2015-10-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8729#issuecomment-150045997 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-10857] [SQL] Block SQL injection vulner...

2015-10-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9202#issuecomment-150045688 **[Test build #44096 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44096/consoleFull)** for PR 9202 at commit [`e7e401f`](https://gith

[GitHub] spark pull request: [SPARK-11243] [SQL] output UnsafeRow from colu...

2015-10-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9203#issuecomment-150044864 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44

[GitHub] spark pull request: [SPARK-11243] [SQL] output UnsafeRow from colu...

2015-10-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9203#issuecomment-150044863 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-11116] [SQL] First Draft of Dataset API

2015-10-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9190#issuecomment-150044716 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44

[GitHub] spark pull request: [SPARK-11243] [SQL] output UnsafeRow from colu...

2015-10-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9203#issuecomment-150044743 **[Test build #44092 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44092/consoleFull)** for PR 9203 at commit [`e33170d`](https://git

[GitHub] spark pull request: [SPARK-11116] [SQL] First Draft of Dataset API

2015-10-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9190#issuecomment-150044715 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-11243] [SQL] output UnsafeRow from colu...

2015-10-21 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/9203#issuecomment-150044370 @JoshRosen If we only scan the cached string and access it (without adding a ConvertToUnsafe), this could be a little bit slower, because we copy the bytes into UnsafeRow

[GitHub] spark pull request: [SPARK-11116] [SQL] First Draft of Dataset API

2015-10-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9190#issuecomment-150044350 **[Test build #44087 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44087/consoleFull)** for PR 9190 at commit [`b172d78`](https://git

[GitHub] spark pull request: [SPARK-10857] [SQL] Block SQL injection vulner...

2015-10-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9202#issuecomment-150043998 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-10857] [SQL] Block SQL injection vulner...

2015-10-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9202#issuecomment-150043989 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-10857] [SQL] Block SQL injection vulner...

2015-10-21 Thread rick-ibm
Github user rick-ibm commented on the pull request: https://github.com/apache/spark/pull/9202#issuecomment-150043741 Thanks, Josh. My last commit should address that long line problem. --- If your project is set up for it, you can reply to this email and have your reply appear on GitH

[GitHub] spark pull request: Minor cleanup of ShuffleMapStage.outputLocs co...

2015-10-21 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/9175 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-11243] [SQL] output UnsafeRow from colu...

2015-10-21 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/9203#discussion_r42692096 --- Diff: sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/codegen/UnsafeRowWriter.java --- @@ -95,41 +99,75 @@ public void alignToWords(i

[GitHub] spark pull request: [SPARK-11243] [SQL] output UnsafeRow from colu...

2015-10-21 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/9203#discussion_r42692044 --- Diff: sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/codegen/UnsafeRowWriter.java --- @@ -58,6 +58,10 @@ private void zeroOutPadding

[GitHub] spark pull request: Minor cleanup of ShuffleMapStage.outputLocs co...

2015-10-21 Thread kayousterhout
Github user kayousterhout commented on the pull request: https://github.com/apache/spark/pull/9175#issuecomment-150043228 LGTM / merged --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this fe

[GitHub] spark pull request: Minor cleanup of ShuffleMapStage.outputLocs co...

2015-10-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9175#issuecomment-150041856 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44

[GitHub] spark pull request: [SPARK-11243] [SQL] output UnsafeRow from colu...

2015-10-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9203#issuecomment-150041884 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44

[GitHub] spark pull request: [SPARK-11243] [SQL] output UnsafeRow from colu...

2015-10-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9203#issuecomment-150041882 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: Minor cleanup of ShuffleMapStage.outputLocs co...

2015-10-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9175#issuecomment-150041854 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-11243] [SQL] output UnsafeRow from colu...

2015-10-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9203#issuecomment-150041762 **[Test build #44089 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44089/consoleFull)** for PR 9203 at commit [`81e3fad`](https://git

[GitHub] spark pull request: Minor cleanup of ShuffleMapStage.outputLocs co...

2015-10-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9175#issuecomment-150041672 **[Test build #44088 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44088/consoleFull)** for PR 9175 at commit [`59319e1`](https://git

[GitHub] spark pull request: [SPARK-10151] [SQL] Support invocation of hive...

2015-10-21 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/8354 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-10151] [SQL] Support invocation of hive...

2015-10-21 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/8354#issuecomment-150038788 I've merged this to master. Thanks @navis! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your proj

[GitHub] spark pull request: [SPARK-11243] [SQL] output UnsafeRow from colu...

2015-10-21 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/9203#issuecomment-150038460 LGTM otherwise. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-11243] [SQL] output UnsafeRow from colu...

2015-10-21 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/9203#discussion_r42688421 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/columnar/GenerateColumnAccessor.scala --- @@ -20,18 +20,42 @@ package org.apache.spark.sql.columnar

[GitHub] spark pull request: [SPARK-10266][Documentation, ML] Fixed @Since ...

2015-10-21 Thread ehsanmok
Github user ehsanmok commented on the pull request: https://github.com/apache/spark/pull/8729#issuecomment-150035571 @mengxr sorry for taking your time, but what's the issue now? everything is updated and all dev/lint-scala tests have passed locally! --- If your project is set up fo

[GitHub] spark pull request: [SPARK-11243] [SQL] output UnsafeRow from colu...

2015-10-21 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/9203#discussion_r42687468 --- Diff: sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/codegen/UnsafeRowWriter.java --- @@ -95,41 +99,75 @@ public void alignToWords(int

[GitHub] spark pull request: [SPARK-11243] [SQL] output UnsafeRow from colu...

2015-10-21 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/9203#discussion_r42687247 --- Diff: sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/codegen/UnsafeRowWriter.java --- @@ -58,6 +58,10 @@ private void zeroOutPaddingBy

[GitHub] spark pull request: [SPARK-11243] [SQL] output UnsafeRow from colu...

2015-10-21 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/9203#issuecomment-150034498 I'm really excited to see how much of a performance difference this makes when scanning string columns, since this could potentially provide a big perf. boost to the s

[GitHub] spark pull request: [SPARK-11243] [SQL] output UnsafeRow from colu...

2015-10-21 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/9203#discussion_r42686848 --- Diff: sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/UnsafeRow.java --- @@ -618,6 +618,25 @@ public void writeTo(ByteBuffer buffer) {

[GitHub] spark pull request: [SPARK-11243] [SQL] output UnsafeRow from colu...

2015-10-21 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/9203#discussion_r42686721 --- Diff: sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/UnsafeRow.java --- @@ -618,6 +618,25 @@ public void writeTo(ByteBuffer buffer) {

[GitHub] spark pull request: [SPARK-11236][CORE] Update Tachyon dependency ...

2015-10-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9204#issuecomment-150033093 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-11236][CORE] Update Tachyon dependency ...

2015-10-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9204#issuecomment-150033096 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44

[GitHub] spark pull request: [SPARK-11236][CORE] Update Tachyon dependency ...

2015-10-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9204#issuecomment-150032938 **[Test build #44084 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44084/consoleFull)** for PR 9204 at commit [`f7edb37`](https://git

[GitHub] spark pull request: [SPARK-10857] [SQL] Block SQL injection vulner...

2015-10-21 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/9202#issuecomment-150032928 ``` Scalastyle checks failed at following occurrences: [error] /home/jenkins/workspace/SparkPullRequestBuilder@3/sql/core/src/test/scala/org/apache/spark/sql/jd

[GitHub] spark pull request: [SPARK-10857] [SQL] Block SQL injection vulner...

2015-10-21 Thread rick-ibm
Github user rick-ibm commented on the pull request: https://github.com/apache/spark/pull/9202#issuecomment-150032606 The following style tests ran cleanly for me: build/sbt scalastyle What other style tests should I run? Thanks, -Rick --- If your proje

<    1   2   3   4   5   6   7   8   >