[GitHub] spark pull request: [SPARK-9334][SQL] Remove UnsafeRowConverter in...

2015-07-24 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/7658#discussion_r35480567 --- Diff: unsafe/src/main/java/org/apache/spark/unsafe/types/ByteArray.java --- @@ -0,0 +1,38 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] spark pull request: [SPARK-9209] Using executor allocation, a exec...

2015-07-24 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/7559#issuecomment-124814662 @KaiXinXiaoLei I think there are still some issues with your code, mostly that you're not explaining the change. --- If your project is set up for it, you can reply to t

[GitHub] spark pull request: [SPARK-9334][SQL] Remove UnsafeRowConverter in...

2015-07-24 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/7658#discussion_r35480542 --- Diff: unsafe/src/main/java/org/apache/spark/unsafe/types/ByteArray.java --- @@ -0,0 +1,38 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request: [SPARK-9334][SQL] Remove UnsafeRowConverter in...

2015-07-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7658#issuecomment-124814035 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-9334][SQL] Remove UnsafeRowConverter in...

2015-07-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7658#issuecomment-124814023 [Test build #38418 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/38418/console) for PR 7658 at commit [`2a56d7e`](https://github.

[GitHub] spark pull request: [SPARK-9336][SQL] Remove extra JoinedRows

2015-07-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7659#issuecomment-124813993 [Test build #38421 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/38421/consoleFull) for PR 7659 at commit [`7510447`](https://gith

[GitHub] spark pull request: [SPARK-9336][SQL] Remove extra JoinedRows

2015-07-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7659#issuecomment-124813956 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-9336][SQL] Remove extra JoinedRows

2015-07-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7659#issuecomment-124813953 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-9336][SQL] Remove extra JoinedRows

2015-07-24 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/7659#issuecomment-124813910 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request: [SPARK-9336][SQL] Remove extra JoinedRows

2015-07-24 Thread rxin
GitHub user rxin opened a pull request: https://github.com/apache/spark/pull/7659 [SPARK-9336][SQL] Remove extra JoinedRows They were added to improve performance (so JIT can inline the JoinedRow calls). However, we can also just improve it by projecting output out to UnsafeRow in

[GitHub] spark pull request: [SPARK-9334][SQL] Remove UnsafeRowConverter in...

2015-07-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7658#issuecomment-124811599 [Test build #38420 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/38420/consoleFull) for PR 7658 at commit [`ed19e6c`](https://gith

[GitHub] spark pull request: [SPARK-5155] [PySpark] [Streaming] Mqtt stream...

2015-07-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4229#issuecomment-124811007 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-5155] [PySpark] [Streaming] Mqtt stream...

2015-07-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4229#issuecomment-124810908 [Test build #97 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SlowSparkPullRequestBuilder/97/console) for PR 4229 at commit [`a6747cb`](https://github.co

[GitHub] spark pull request: [SPARK-9334][SQL] Remove UnsafeRowConverter in...

2015-07-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7658#issuecomment-124809557 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-9334][SQL] Remove UnsafeRowConverter in...

2015-07-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7658#issuecomment-124809588 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-5155] [PySpark] [Streaming] Mqtt stream...

2015-07-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4229#issuecomment-124809221 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-5155] [PySpark] [Streaming] Mqtt stream...

2015-07-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4229#issuecomment-124809153 [Test build #38417 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/38417/console) for PR 4229 at commit [`a6747cb`](https://github.

[GitHub] spark pull request: [SPARK-9254] [BUILD] [HOTFIX] sbt-launch-lib.b...

2015-07-24 Thread yhuai
Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/7597#issuecomment-124806728 I have merged this to branch 1.4. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [Spark-8668][SQL] Adding expr to functions

2015-07-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7606#issuecomment-124806164 [Test build #1200 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1200/consoleFull) for PR 7606 at commit [`ad7f607`](https://git

[GitHub] spark pull request: [Spark-8668][SQL] Adding expr to functions

2015-07-24 Thread JDrit
Github user JDrit commented on the pull request: https://github.com/apache/spark/pull/7606#issuecomment-124804691 @rixn, now with the python added, is there anything else that is needed? --- If your project is set up for it, you can reply to this email and have your reply appear on Gi

[GitHub] spark pull request: [SPARK-9326] Close lock file used for file dow...

2015-07-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7650#issuecomment-124804563 [Test build #38419 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/38419/consoleFull) for PR 7650 at commit [`0401bd1`](https://gith

[GitHub] spark pull request: [SPARK-9326] Close lock file used for file dow...

2015-07-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7650#issuecomment-124803572 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-9326] Close lock file used for file dow...

2015-07-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7650#issuecomment-124803609 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-9326] Close lock file used for file dow...

2015-07-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7650#issuecomment-124803354 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-9326] Close lock file used for file dow...

2015-07-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7650#issuecomment-124803449 [Test build #98 has started](https://amplab.cs.berkeley.edu/jenkins/job/SlowSparkPullRequestBuilder/98/consoleFull) for PR 7650 at commit [`0401bd1`](https://github

[GitHub] spark pull request: [SPARK-9326] Close lock file used for file dow...

2015-07-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7650#issuecomment-124803389 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-8003][SQL] Added virtual column support...

2015-07-24 Thread JDrit
Github user JDrit commented on the pull request: https://github.com/apache/spark/pull/7478#issuecomment-124803186 @rxin, @marmbrus So with the added way to add new functions to the `FunctionRegistry`, does this look good? Having this will also allow functions such as `input__f

[GitHub] spark pull request: [SPARK-9326] Close lock file used for file dow...

2015-07-24 Thread kayousterhout
Github user kayousterhout commented on the pull request: https://github.com/apache/spark/pull/7650#issuecomment-124803033 Jenkins, retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does no

[GitHub] spark pull request: [Spark-8668][SQL] Adding expr to functions

2015-07-24 Thread JDrit
Github user JDrit commented on a diff in the pull request: https://github.com/apache/spark/pull/7606#discussion_r35480045 --- Diff: python/pyspark/sql/functions.py --- @@ -375,6 +375,14 @@ def sparkPartitionId(): sc = SparkContext._active_spark_context return Colum

[GitHub] spark pull request: [SPARK-8186][SPARK-8187][SPARK-8194][SPARK-819...

2015-07-24 Thread adrian-wang
Github user adrian-wang commented on a diff in the pull request: https://github.com/apache/spark/pull/7589#discussion_r35479809 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateTimeUtils.scala --- @@ -573,4 +573,109 @@ object DateTimeUtils {

[GitHub] spark pull request: [SPARK-8186][SPARK-8187][SPARK-8194][SPARK-819...

2015-07-24 Thread adrian-wang
Github user adrian-wang commented on a diff in the pull request: https://github.com/apache/spark/pull/7589#discussion_r35479815 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateTimeUtils.scala --- @@ -573,4 +573,109 @@ object DateTimeUtils {

[GitHub] spark pull request: [Spark-9028] [ML] Add CountVectorizer as an es...

2015-07-24 Thread hhbyyh
Github user hhbyyh commented on the pull request: https://github.com/apache/spark/pull/7388#issuecomment-124800231 @feynmanliang Thanks for helping review. Sent an update --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. I

[GitHub] spark pull request: [SPARK-8186][SPARK-8187][SPARK-8194][SPARK-819...

2015-07-24 Thread yjshen
Github user yjshen commented on a diff in the pull request: https://github.com/apache/spark/pull/7589#discussion_r35479785 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateTimeUtils.scala --- @@ -573,4 +573,109 @@ object DateTimeUtils { dayIn

[GitHub] spark pull request: [SPARK-9334][SQL] Remove UnsafeRowConverter in...

2015-07-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7658#issuecomment-124798287 [Test build #38418 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/38418/consoleFull) for PR 7658 at commit [`2a56d7e`](https://gith

[GitHub] spark pull request: [SPARK-8186][SPARK-8187][SPARK-8194][SPARK-819...

2015-07-24 Thread adrian-wang
Github user adrian-wang commented on a diff in the pull request: https://github.com/apache/spark/pull/7589#discussion_r35479737 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateTimeUtils.scala --- @@ -573,4 +573,109 @@ object DateTimeUtils {

[GitHub] spark pull request: [SPARK-9334][SQL] Remove UnsafeRowConverter in...

2015-07-24 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/7658#discussion_r35479724 --- Diff: unsafe/src/main/java/org/apache/spark/unsafe/types/ByteArray.java --- @@ -0,0 +1,38 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] spark pull request: [SPARK-9334][SQL] Remove UnsafeRowConverter in...

2015-07-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7658#issuecomment-124797668 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-9334][SQL] Remove UnsafeRowConverter in...

2015-07-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7658#issuecomment-124797684 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-9334][SQL] Remove UnsafeRowConverter in...

2015-07-24 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/7658#discussion_r35479711 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/UnsafeRowSerializerSuite.scala --- @@ -22,29 +22,22 @@ import java.io.{ByteArrayInputStream, B

[GitHub] spark pull request: [SPARK-8186][SPARK-8187][SPARK-8194][SPARK-819...

2015-07-24 Thread yjshen
Github user yjshen commented on a diff in the pull request: https://github.com/apache/spark/pull/7589#discussion_r35479705 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateTimeUtils.scala --- @@ -573,4 +573,109 @@ object DateTimeUtils { dayIn

[GitHub] spark pull request: [SPARK-9334][SQL] Remove UnsafeRowConverter in...

2015-07-24 Thread rxin
GitHub user rxin opened a pull request: https://github.com/apache/spark/pull/7658 [SPARK-9334][SQL] Remove UnsafeRowConverter in favor of UnsafeProjection. The two are redundant. Once this patch is merged, I plan to remove the inbound conversions from unsafe aggregates. Y

[GitHub] spark pull request: [SPARK-9334][SQL] Remove UnsafeRowConverter in...

2015-07-24 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/7658#issuecomment-124797268 cc @JoshRosen --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature en

[GitHub] spark pull request: [SPARK-8186][SPARK-8187][SPARK-8194][SPARK-819...

2015-07-24 Thread yjshen
Github user yjshen commented on a diff in the pull request: https://github.com/apache/spark/pull/7589#discussion_r35479695 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateTimeUtils.scala --- @@ -573,4 +573,109 @@ object DateTimeUtils { dayIn

[GitHub] spark pull request: [SPARK-8186][SPARK-8187][SPARK-8194][SPARK-819...

2015-07-24 Thread yjshen
Github user yjshen commented on a diff in the pull request: https://github.com/apache/spark/pull/7589#discussion_r35479613 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateTimeUtils.scala --- @@ -573,4 +573,109 @@ object DateTimeUtils { dayIn

[GitHub] spark pull request: [SPARK-5155] [PySpark] [Streaming] Mqtt stream...

2015-07-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4229#issuecomment-124796143 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-5155] [PySpark] [Streaming] Mqtt stream...

2015-07-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4229#issuecomment-124796141 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-5155] [PySpark] [Streaming] Mqtt stream...

2015-07-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4229#issuecomment-124796147 [Test build #97 has started](https://amplab.cs.berkeley.edu/jenkins/job/SlowSparkPullRequestBuilder/97/consoleFull) for PR 4229 at commit [`a6747cb`](https://github

[GitHub] spark pull request: [SPARK-5155] [PySpark] [Streaming] Mqtt stream...

2015-07-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4229#issuecomment-124795663 [Test build #38417 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/38417/consoleFull) for PR 4229 at commit [`a6747cb`](https://gith

[GitHub] spark pull request: [SPARK-5155] [PySpark] [Streaming] Mqtt stream...

2015-07-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4229#issuecomment-124795348 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-5155] [PySpark] [Streaming] Mqtt stream...

2015-07-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4229#issuecomment-124795334 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-5155] [PySpark] [Streaming] Mqtt stream...

2015-07-24 Thread prabeesh
Github user prabeesh commented on the pull request: https://github.com/apache/spark/pull/4229#issuecomment-124795267 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this fe

[GitHub] spark pull request: [SPARK-9043] Serialize key, value and combiner...

2015-07-24 Thread massie
Github user massie commented on the pull request: https://github.com/apache/spark/pull/7403#issuecomment-124795158 Still failing with... ``` [info] KinesisBackedBlockRDDSuite: [info] Exception encountered when attempting to run a suite with class name: org.apache.spark

[GitHub] spark pull request: [Spark-9028] [ML] Add CountVectorizer as an es...

2015-07-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7388#issuecomment-124794698 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [Spark-9028] [ML] Add CountVectorizer as an es...

2015-07-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7388#issuecomment-124794500 [Test build #38415 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/38415/console) for PR 7388 at commit [`589e93d`](https://github.

[GitHub] spark pull request: [SPARK-8186][SPARK-8187][SPARK-8194][SPARK-819...

2015-07-24 Thread yjshen
Github user yjshen commented on a diff in the pull request: https://github.com/apache/spark/pull/7589#discussion_r35479531 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateTimeUtils.scala --- @@ -573,4 +573,109 @@ object DateTimeUtils { dayIn

[GitHub] spark pull request: [SPARK-8186][SPARK-8187][SPARK-8194][SPARK-819...

2015-07-24 Thread yjshen
Github user yjshen commented on a diff in the pull request: https://github.com/apache/spark/pull/7589#discussion_r35479315 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateTimeUtils.scala --- @@ -573,4 +573,109 @@ object DateTimeUtils { dayIn

[GitHub] spark pull request: [SPARK-9043] Serialize key, value and combiner...

2015-07-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7403#issuecomment-124792889 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-9043] Serialize key, value and combiner...

2015-07-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7403#issuecomment-124792884 [Test build #38414 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/38414/console) for PR 7403 at commit [`59abe01`](https://github.

[GitHub] spark pull request: [SPARK-8564][Streaming]Add the Python API for ...

2015-07-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6955#issuecomment-124792224 [Test build #38416 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/38416/console) for PR 6955 at commit [`b810127`](https://github.

[GitHub] spark pull request: [SPARK-8564][Streaming]Add the Python API for ...

2015-07-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6955#issuecomment-124792225 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-8564][Streaming]Add the Python API for ...

2015-07-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6955#issuecomment-124791928 [Test build #38416 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/38416/consoleFull) for PR 6955 at commit [`b810127`](https://gith

[GitHub] spark pull request: [SPARK-9273] [MLlib] Add Convolutional Neural ...

2015-07-24 Thread hhbyyh
Github user hhbyyh commented on the pull request: https://github.com/apache/spark/pull/7609#issuecomment-124791909 @mengxr Sorry for the surprise. The code was actually written based on a customer requirement and I just shared it hoping it will help. --- If your project is set up fo

[GitHub] spark pull request: [SPARK-8564][Streaming]Add the Python API for ...

2015-07-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6955#issuecomment-124791814 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-8564][Streaming]Add the Python API for ...

2015-07-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6955#issuecomment-124791817 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-9326] Close lock file used for file dow...

2015-07-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7650#issuecomment-124790836 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-9326] Close lock file used for file dow...

2015-07-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7650#issuecomment-124790818 **[Test build #38409 timed out](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/38409/console)** for PR 7650 at commit [`0401bd1`](https://github

[GitHub] spark pull request: [SPARK-8186][SPARK-8187][SPARK-8194][SPARK-819...

2015-07-24 Thread yjshen
Github user yjshen commented on a diff in the pull request: https://github.com/apache/spark/pull/7589#discussion_r35478785 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateTimeUtils.scala --- @@ -573,4 +573,109 @@ object DateTimeUtils { dayIn

[GitHub] spark pull request: [SPARK-9331][SQL] Add a code formatter to auto...

2015-07-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/7656 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [Spark-9028] [ML] Add CountVectorizer as an es...

2015-07-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7388#issuecomment-124790013 [Test build #38415 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/38415/consoleFull) for PR 7388 at commit [`589e93d`](https://gith

[GitHub] spark pull request: [SPARK-9331][SQL] Add a code formatter to auto...

2015-07-24 Thread mateiz
Github user mateiz commented on the pull request: https://github.com/apache/spark/pull/7656#issuecomment-124789906 Looks good. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature ena

[GitHub] spark pull request: [SPARK-9331][SQL] Add a code formatter to auto...

2015-07-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7656#issuecomment-124789712 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [Spark-9028] [ML] Add CountVectorizer as an es...

2015-07-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7388#issuecomment-124789688 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [Spark-9028] [ML] Add CountVectorizer as an es...

2015-07-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7388#issuecomment-124789683 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-9331][SQL] Add a code formatter to auto...

2015-07-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7656#issuecomment-124789694 [Test build #38413 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/38413/console) for PR 7656 at commit [`5ba0e90`](https://github.

[GitHub] spark pull request: [SPARK-9330][SQL] Create specialized getStruct...

2015-07-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/7654 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-9330][SQL] Create specialized getStruct...

2015-07-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7654#issuecomment-124789484 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-9330][SQL] Create specialized getStruct...

2015-07-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7654#issuecomment-124789466 [Test build #38412 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/38412/console) for PR 7654 at commit [`b491a09`](https://github.

[GitHub] spark pull request: [SPARK-8625] [Core] Propagate user exceptions ...

2015-07-24 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/7014#discussion_r35478432 --- Diff: core/src/main/scala/org/apache/spark/TaskEndReason.scala --- @@ -97,13 +103,27 @@ case class ExceptionFailure( description: String,

[GitHub] spark pull request: SPARK-1537 [WiP] Application Timeline Server i...

2015-07-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5423#issuecomment-124787659 [Test build #38408 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/38408/console) for PR 5423 at commit [`44a0d4f`](https://github.

[GitHub] spark pull request: SPARK-1537 [WiP] Application Timeline Server i...

2015-07-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5423#issuecomment-124787740 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-8186][SPARK-8187][SPARK-8194][SPARK-819...

2015-07-24 Thread yjshen
Github user yjshen commented on a diff in the pull request: https://github.com/apache/spark/pull/7589#discussion_r35478407 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/datetimeFunctions.scala --- @@ -258,3 +305,125 @@ case class DateFormatClass(l

[GitHub] spark pull request: [SPARK-9326] Close lock file used for file dow...

2015-07-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7650#issuecomment-124785284 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-9326] Close lock file used for file dow...

2015-07-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7650#issuecomment-124785269 [Test build #96 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SlowSparkPullRequestBuilder/96/console) for PR 7650 at commit [`0401bd1`](https://github.co

[GitHub] spark pull request: [SPARK-9092] Fixed incompatibility when both n...

2015-07-24 Thread squito
Github user squito commented on the pull request: https://github.com/apache/spark/pull/7657#issuecomment-124784178 Jenkins, this is ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-9043] Serialize key, value and combiner...

2015-07-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7403#issuecomment-124782551 [Test build #38414 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/38414/consoleFull) for PR 7403 at commit [`59abe01`](https://gith

[GitHub] spark pull request: [SPARK-9043] Serialize key, value and combiner...

2015-07-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7403#issuecomment-124781626 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-9092] Fixed incompatibility when both n...

2015-07-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7657#issuecomment-124781617 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pr

[GitHub] spark pull request: [SPARK-9043] Serialize key, value and combiner...

2015-07-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7403#issuecomment-124781618 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-9092] Fixed incompatibility when both n...

2015-07-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7657#issuecomment-124781566 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pr

[GitHub] spark pull request: [SPARK-9043] Serialize key, value and combiner...

2015-07-24 Thread massie
Github user massie commented on the pull request: https://github.com/apache/spark/pull/7403#issuecomment-124781545 The error isn't related to this PR... ``` [info] *** 1 SUITE ABORTED *** [error] Error: Total 21, Failed 0, Errors 1, Passed 20 [error] Error during te

[GitHub] spark pull request: [SPARK-9043] Serialize key, value and combiner...

2015-07-24 Thread massie
Github user massie commented on the pull request: https://github.com/apache/spark/pull/7403#issuecomment-124781553 Jenkins, test this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have t

[GitHub] spark pull request: [SPARK-9092] Fixed incompatibility when both n...

2015-07-24 Thread neurons
GitHub user neurons opened a pull request: https://github.com/apache/spark/pull/7657 [SPARK-9092] Fixed incompatibility when both num-executors and dynamic... … allocation are set. Now, dynamic allocation is set to false when num-executors is explicitly specified as an argument. C

[GitHub] spark pull request: [SPARK-9312] [MLLIB] Added predictive probabil...

2015-07-24 Thread jkbradley
Github user jkbradley commented on the pull request: https://github.com/apache/spark/pull/7652#issuecomment-124780680 @badriub I just added some thoughts on the JIRA. Could you please take a look and respond there? Thanks! --- If your project is set up for it, you can reply to this

[GitHub] spark pull request: [SPARK-9209] Using executor allocation, a exec...

2015-07-24 Thread KaiXinXiaoLei
Github user KaiXinXiaoLei commented on the pull request: https://github.com/apache/spark/pull/7559#issuecomment-124780545 I think my change code is not the reason of this failed test , And in my machine, this test passed. --- If your project is set up for it, you can reply to this e

[GitHub] spark pull request: [SPARK-9326] Close lock file used for file dow...

2015-07-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7650#issuecomment-124780496 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-9326] Close lock file used for file dow...

2015-07-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7650#issuecomment-124780487 [Test build #38407 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/38407/console) for PR 7650 at commit [`0401bd1`](https://github.

[GitHub] spark pull request: [SPARK-9331][SQL] Add a code formatter to auto...

2015-07-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7656#issuecomment-124780442 [Test build #38413 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/38413/consoleFull) for PR 7656 at commit [`5ba0e90`](https://gith

[GitHub] spark pull request: [SPARK-9043] Serialize key, value and combiner...

2015-07-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7403#issuecomment-124780285 [Test build #38406 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/38406/console) for PR 7403 at commit [`59abe01`](https://github.

[GitHub] spark pull request: [SPARK-9043] Serialize key, value and combiner...

2015-07-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7403#issuecomment-124780294 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-9331][SQL] Add a code formatter to auto...

2015-07-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7656#issuecomment-124780227 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

  1   2   3   4   5   6   7   8   >