[GitHub] spark pull request: [SPARK-13168][SQL] Collapse adjacent repartiti...

2016-02-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11064#issuecomment-179734325 **[Test build #2515 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2515/consoleFull)** for PR 11064 at commit

[GitHub] spark pull request: [SPARK-13185][SQL] Improve the performance of ...

2016-02-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11071#issuecomment-179741773 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-13185][SQL] Improve the performance of ...

2016-02-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11071#issuecomment-179741404 **[Test build #50746 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50746/consoleFull)** for PR 11071 at commit

[GitHub] spark pull request: [SPARK-13185][SQL] Improve the performance of ...

2016-02-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11071#issuecomment-179741770 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13095] [SQL] improve performance for br...

2016-02-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11065#issuecomment-179748524 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-13095] [SQL] improve performance for br...

2016-02-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11065#issuecomment-179748519 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13002][Mesos] Send initial request of e...

2016-02-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11047#issuecomment-179748356 **[Test build #50747 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50747/consoleFull)** for PR 11047 at commit

[GitHub] spark pull request: [SPARK-13095] [SQL] improve performance for br...

2016-02-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11065#issuecomment-179747960 **[Test build #50742 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50742/consoleFull)** for PR 11065 at commit

[GitHub] spark pull request: [SPARK-13180] Protect against SessionState bei...

2016-02-04 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/11066#discussion_r51849272 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveClientImpl.scala --- @@ -134,7 +134,18 @@ private[hive] class HiveClientImpl(

[GitHub] spark pull request: [SPARK-13185][SQL] Improve the performance of ...

2016-02-04 Thread adrian-wang
Github user adrian-wang commented on a diff in the pull request: https://github.com/apache/spark/pull/11071#discussion_r51851087 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateTimeUtils.scala --- @@ -55,10 +56,19 @@ object DateTimeUtils { //

[GitHub] spark pull request: [SPARK-13185][SQL] Improve the performance of ...

2016-02-04 Thread adrian-wang
Github user adrian-wang commented on a diff in the pull request: https://github.com/apache/spark/pull/11071#discussion_r51851099 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateTimeUtils.scala --- @@ -55,10 +56,19 @@ object DateTimeUtils { //

[GitHub] spark pull request: [SPARK-12739] [Streaming] Details of batch in ...

2016-02-04 Thread mariobriggs
Github user mariobriggs commented on the pull request: https://github.com/apache/spark/pull/11022#issuecomment-179769040 welcome @zsxwing Could I get my name assigned to the JIRA (as a mark of contribution)? --- If your project is set up for it, you can reply to this email and

[GitHub] spark pull request: [SPARK-13002][Mesos] Send initial request of e...

2016-02-04 Thread skyluc
Github user skyluc commented on the pull request: https://github.com/apache/spark/pull/11047#issuecomment-179741301 @andrewor14 yes, dynamic allocation works fine, but `spark.dynamicAllocation.initialExecutors` is not used at start-up. --- If your project is set up for it, you can

[GitHub] spark pull request: [SPARK-13002][Mesos] Send initial request of e...

2016-02-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11047#issuecomment-179791480 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13185][SQL] Improve the performance of ...

2016-02-04 Thread adrian-wang
Github user adrian-wang commented on a diff in the pull request: https://github.com/apache/spark/pull/11071#discussion_r51852765 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateTimeUtils.scala --- @@ -55,10 +56,19 @@ object DateTimeUtils { //

[GitHub] spark pull request: [SPARK-13185][SQL] Improve the performance of ...

2016-02-04 Thread adrian-wang
Github user adrian-wang commented on a diff in the pull request: https://github.com/apache/spark/pull/11071#discussion_r51853631 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateTimeUtils.scala --- @@ -55,10 +56,19 @@ object DateTimeUtils { //

[GitHub] spark pull request: [SPARK-13002][Mesos] Send initial request of e...

2016-02-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11047#issuecomment-179790970 **[Test build #50747 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50747/consoleFull)** for PR 11047 at commit

[GitHub] spark pull request: [SPARK-13002][Mesos] Send initial request of e...

2016-02-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11047#issuecomment-179791483 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11316] setupGroups in coalescedRDD caus...

2016-02-04 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/11060#discussion_r51861250 --- Diff: core/src/main/scala/org/apache/spark/rdd/CoalescedRDD.scala --- @@ -273,7 +273,8 @@ private class PartitionCoalescer(maxPartitions: Int, prev:

[GitHub] spark pull request: [SPARK-13180] Protect against SessionState bei...

2016-02-04 Thread tedyu
Github user tedyu commented on the pull request: https://github.com/apache/spark/pull/11066#issuecomment-179743176 Do you have suggestion on which class to put the common code in ? Thanks --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request: SPARK-13052 waitingApps metric doesn't show th...

2016-02-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10959#issuecomment-180047050 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13146][SQL] Management API for continuo...

2016-02-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11030#issuecomment-180055713 **[Test build #50771 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50771/consoleFull)** for PR 11030 at commit

[GitHub] spark pull request: [SPARK-13146][SQL] Management API for continuo...

2016-02-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11030#issuecomment-180055727 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-13146][SQL] Management API for continuo...

2016-02-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11030#issuecomment-180055720 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13203] Add scalastyle rule banning use ...

2016-02-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11082#issuecomment-180066626 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13205] [SQL] SQL Generation Support for...

2016-02-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11084#issuecomment-180102080 **[Test build #50782 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50782/consoleFull)** for PR 11084 at commit

[GitHub] spark pull request: [SPARK-12992][SQL] Support vectorized decoding...

2016-02-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11055#issuecomment-180047876 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-13146][SQL] Management API for continuo...

2016-02-04 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/11030#issuecomment-180047840 retest this please. The master has been fixed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-5095] [Mesos] Support launching multipl...

2016-02-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10993#issuecomment-180051489 **[Test build #50770 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50770/consoleFull)** for PR 10993 at commit

[GitHub] spark pull request: [SPARK-13164][CORE] Replace deprecated synchro...

2016-02-04 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/11059#issuecomment-180052303 sounds like a good rule --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8964] [SQL] Use Exchange to perform shu...

2016-02-04 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/7334#issuecomment-180062121 cc @davies for a more detailed review --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: [SPARK-13203] Add scalastyle rule banning use ...

2016-02-04 Thread ted-yu
Github user ted-yu commented on the pull request: https://github.com/apache/spark/pull/11082#issuecomment-180064615 ``` external/kafka/src/test/scala/org/apache/spark/streaming/kafka/DirectKafkaStreamSuite.scala: new ArrayBuffer[(String, String)] with

[GitHub] spark pull request: [SPARK-13187][SQL] Add boolean/long/double opt...

2016-02-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11072#issuecomment-180066029 **[Test build #50774 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50774/consoleFull)** for PR 11072 at commit

[GitHub] spark pull request: [SPARK-13203] Add scalastyle rule banning use ...

2016-02-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11082#issuecomment-180074860 **[Test build #50776 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50776/consoleFull)** for PR 11082 at commit

[GitHub] spark pull request: [SPARK-5095] [Mesos] Support launching multipl...

2016-02-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10993#issuecomment-180076930 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13203] Add scalastyle rule banning use ...

2016-02-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11082#issuecomment-180087833 **[Test build #50778 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50778/consoleFull)** for PR 11082 at commit

[GitHub] spark pull request: [SPARK-13203] Add scalastyle rule banning use ...

2016-02-04 Thread ted-yu
Github user ted-yu commented on the pull request: https://github.com/apache/spark/pull/11082#issuecomment-180095881 Jenkins, test this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-13149][SQL]Add FileStreamSource

2016-02-04 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/11034#discussion_r51953075 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/FileStreamSource.scala --- @@ -0,0 +1,141 @@ +/* + * Licensed to the

[GitHub] spark pull request: [SPARK-13149][SQL]Add FileStreamSource

2016-02-04 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/11034#discussion_r51953151 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/streaming/FileStreamSourceSuite.scala --- @@ -0,0 +1,131 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-13149][SQL]Add FileStreamSource

2016-02-04 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/11034#discussion_r51953115 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/streaming/FileStreamSourceSuite.scala --- @@ -0,0 +1,131 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-13149][SQL]Add FileStreamSource

2016-02-04 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/11034#discussion_r51953109 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/streaming/FileStreamSourceSuite.scala --- @@ -0,0 +1,131 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-13149][SQL]Add FileStreamSource

2016-02-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11034#issuecomment-180099140 **[Test build #50780 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50780/consoleFull)** for PR 11034 at commit

[GitHub] spark pull request: SPARK-13052 waitingApps metric doesn't show th...

2016-02-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10959#issuecomment-180099089 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: SPARK-13052 waitingApps metric doesn't show th...

2016-02-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10959#issuecomment-180099091 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-12807] [YARN] Spark External Shuffle no...

2016-02-04 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/10780#issuecomment-180057465 @steveloughran given the discussion on the bug, can you remove shading for anything but Jackson? In particular, shading the javax annotations is wrong because

[GitHub] spark pull request: [SPARK-13203] Add scalastyle rule banning use ...

2016-02-04 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/11082#issuecomment-180063316 can you add one for `SynchronizedMap` as well --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: [SPARK-13136][SQL] Create a dedicated Broadcas...

2016-02-04 Thread hvanhovell
GitHub user hvanhovell opened a pull request: https://github.com/apache/spark/pull/11083 [SPARK-13136][SQL] Create a dedicated Broadcast exchange operator [WIP] Quite a few Spark SQL join operators broadcast one side of the join to all nodes. The are a few problems with this:

[GitHub] spark pull request: [SPARK-13095] [SQL] improve performance for br...

2016-02-04 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/11065#issuecomment-180065661 For join with single Long key: ``` val dim = broadcast(sqlContext.range(1 << 16).selectExpr("id as k", "cast(id as string) as v"))

[GitHub] spark pull request: [SPARK-13149][SQL]Add FileStreamSource

2016-02-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11034#issuecomment-180095564 **[Test build #50779 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50779/consoleFull)** for PR 11034 at commit

[GitHub] spark pull request: [SPARK-13205] [SQL] SQL Generation Support for...

2016-02-04 Thread gatorsmile
GitHub user gatorsmile opened a pull request: https://github.com/apache/spark/pull/11084 [SPARK-13205] [SQL] SQL Generation Support for Self Join This PR addresses two issues: - Self join does not work in SQL Generation - When creating new instances for

[GitHub] spark pull request: [SPARK-13187][SQL] Add boolean/long/double opt...

2016-02-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11072#issuecomment-180097997 **[Test build #50774 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50774/consoleFull)** for PR 11072 at commit

[GitHub] spark pull request: SPARK-13052 waitingApps metric doesn't show th...

2016-02-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10959#issuecomment-180098858 **[Test build #50772 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50772/consoleFull)** for PR 10959 at commit

[GitHub] spark pull request: [SPARK-13203] Add scalastyle rule banning use ...

2016-02-04 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/11082#issuecomment-180101869 I think there's some overlap between this patch and #11067 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark pull request: [SPARK-13203] Add scalastyle rule banning use ...

2016-02-04 Thread ted-yu
Github user ted-yu commented on the pull request: https://github.com/apache/spark/pull/11082#issuecomment-180104115 Jenkins, test this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-12992][SQL] Support vectorized decoding...

2016-02-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11055#issuecomment-180047872 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13095] [SQL] improve performance for br...

2016-02-04 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/11065#issuecomment-180075423 For join with two ints ``` val dim2 = broadcast(sqlContext.range(1 << 16) .selectExpr("cast(id as int) as k1", "cast(id as int) as k2", "cast(id

[GitHub] spark pull request: [SPARK-13203] Add scalastyle rule banning use ...

2016-02-04 Thread ted-yu
Github user ted-yu commented on the pull request: https://github.com/apache/spark/pull/11082#issuecomment-180084459 Jenkins, test this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-12992][SQL] Support vectorized decoding...

2016-02-04 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/11055#discussion_r51952950 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/SQLConf.scala --- @@ -345,6 +345,14 @@ private[spark] object SQLConf { defaultValue =

[GitHub] spark pull request: [SPARK-13203] Add scalastyle rule banning use ...

2016-02-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11082#issuecomment-180100978 **[Test build #50781 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50781/consoleFull)** for PR 11082 at commit

[GitHub] spark pull request: [SPARK-13164][CORE] Replace deprecated synchro...

2016-02-04 Thread tedyu
Github user tedyu commented on the pull request: https://github.com/apache/spark/pull/11059#issuecomment-180046937 Should scalastyle rule be added to ban use of mutable.SynchronizedBuffer ? --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] spark pull request: SPARK-13052 waitingApps metric doesn't show th...

2016-02-04 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/10959#issuecomment-180053049 Actually the tests passed but not for the latest commit. Let's re-run this. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request: SPARK-13052 waitingApps metric doesn't show th...

2016-02-04 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/10959#issuecomment-180052654 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-13203] Add scalastyle rule banning use ...

2016-02-04 Thread ted-yu
Github user ted-yu commented on the pull request: https://github.com/apache/spark/pull/11082#issuecomment-180063800 ``` external/kafka/src/test/scala/org/apache/spark/streaming/kafka/KafkaStreamSuite.scala: val result = new mutable.HashMap[String, Long]() with

[GitHub] spark pull request: [SPARK-5095] [Mesos] Support launching multipl...

2016-02-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10993#issuecomment-180076934 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-13095] [SQL] improve performance for br...

2016-02-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11065#issuecomment-180083649 **[Test build #50777 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50777/consoleFull)** for PR 11065 at commit

[GitHub] spark pull request: [SPARK-13095] [SQL] improve performance for br...

2016-02-04 Thread nongli
Github user nongli commented on a diff in the pull request: https://github.com/apache/spark/pull/11065#discussion_r51954890 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/joins/HashedRelation.scala --- @@ -408,6 +453,210 @@ private[joins] object

[GitHub] spark pull request: [SPARK-13146][SQL] Management API for continuo...

2016-02-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11030#issuecomment-180047515 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-13146][SQL] Management API for continuo...

2016-02-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11030#issuecomment-180047504 **[Test build #50767 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50767/consoleFull)** for PR 11030 at commit

[GitHub] spark pull request: [SPARK-13146][SQL] Management API for continuo...

2016-02-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11030#issuecomment-180047513 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-12992][SQL] Support vectorized decoding...

2016-02-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11055#issuecomment-180047567 **[Test build #50761 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50761/consoleFull)** for PR 11055 at commit

[GitHub] spark pull request: [SPARK-13149][SQL]Add FileStreamSource

2016-02-04 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/11034#discussion_r51938390 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/streaming/FileStreamSourceSuite.scala --- @@ -0,0 +1,131 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-13146][SQL] Management API for continuo...

2016-02-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11030#issuecomment-180054865 **[Test build #50771 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50771/consoleFull)** for PR 11030 at commit

[GitHub] spark pull request: SPARK-13052 waitingApps metric doesn't show th...

2016-02-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10959#issuecomment-180060049 **[Test build #50772 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50772/consoleFull)** for PR 10959 at commit

[GitHub] spark pull request: Add scalastyle rule banning use of mutable.Syn...

2016-02-04 Thread ted-yu
GitHub user ted-yu opened a pull request: https://github.com/apache/spark/pull/11082 Add scalastyle rule banning use of mutable.SynchronizedBuffer See discussion at the tail of #11059 @andrewor14 Please review You can merge this pull request into a Git repository by

[GitHub] spark pull request: [SPARK-13203] Add scalastyle rule banning use ...

2016-02-04 Thread ted-yu
Github user ted-yu commented on the pull request: https://github.com/apache/spark/pull/11082#issuecomment-180074493 Logged SPARK-13204 for replacing mutable.SynchronizedMap --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request: [SPARK-12992][SQL] Support vectorized decoding...

2016-02-04 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/11055#discussion_r51950606 --- Diff: sql/core/src/main/java/org/apache/spark/sql/execution/vectorized/ColumnVectorUtils.java --- @@ -100,6 +101,9 @@ private static void

[GitHub] spark pull request: [SPARK-5095] [Mesos] Support launching multipl...

2016-02-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10993#issuecomment-180088967 **[Test build #50770 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50770/consoleFull)** for PR 10993 at commit

[GitHub] spark pull request: [SPARK-5095] [Mesos] Support launching multipl...

2016-02-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10993#issuecomment-180089190 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13167][SQL] Include rows with null valu...

2016-02-04 Thread sureshthalamati
Github user sureshthalamati commented on a diff in the pull request: https://github.com/apache/spark/pull/11063#discussion_r51951404 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/DataFrameReader.scala --- @@ -213,14 +212,21 @@ class DataFrameReader

[GitHub] spark pull request: [SPARK-5095] [Mesos] Support launching multipl...

2016-02-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10993#issuecomment-180089197 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-13187][SQL] Add boolean/long/double opt...

2016-02-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11072#issuecomment-180098284 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-13187][SQL] Add boolean/long/double opt...

2016-02-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11072#issuecomment-180098283 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13190][BUILD] Update pom.xml to referen...

2016-02-04 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/11075#issuecomment-180101430 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8964] [SQL] Use Exchange to perform shu...

2016-02-04 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/7334#discussion_r51939570 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/QueryExecution.scala --- @@ -44,7 +44,7 @@ class QueryExecution(val sqlContext: SQLContext,

[GitHub] spark pull request: [SPARK-13203] Add scalastyle rule banning use ...

2016-02-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11082#issuecomment-180075187 **[Test build #50776 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50776/consoleFull)** for PR 11082 at commit

[GitHub] spark pull request: [SPARK-13203] Add scalastyle rule banning use ...

2016-02-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11082#issuecomment-180075200 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-13203] Add scalastyle rule banning use ...

2016-02-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11082#issuecomment-180075198 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13095] [SQL] improve performance for br...

2016-02-04 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/11065#issuecomment-180076144 @nongli Posted the generated code, also add a benchmark for join with 2 int keys --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request: [SPARK-5095] [Mesos] Support launching multipl...

2016-02-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10993#issuecomment-180076446 **[Test build #50764 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50764/consoleFull)** for PR 10993 at commit

[GitHub] spark pull request: [SPARK-13136][SQL] Create a dedicated Broadcas...

2016-02-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11083#issuecomment-180094595 **[Test build #50775 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50775/consoleFull)** for PR 11083 at commit

[GitHub] spark pull request: [SPARK-13095] [SQL] improve performance for br...

2016-02-04 Thread nongli
Github user nongli commented on a diff in the pull request: https://github.com/apache/spark/pull/11065#discussion_r51954518 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/joins/HashedRelation.scala --- @@ -408,6 +453,210 @@ private[joins] object

[GitHub] spark pull request: [SPARK-5095] [Mesos] Support launching multipl...

2016-02-04 Thread mgummelt
Github user mgummelt commented on the pull request: https://github.com/apache/spark/pull/10993#issuecomment-180103124 Looks like it failed a network test. Flaky test? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: [SPARK-13149][SQL]Add FileStreamSource

2016-02-04 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/11034#discussion_r51956317 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/FileStreamSource.scala --- @@ -0,0 +1,151 @@ +/* + * Licensed to the

[GitHub] spark pull request: [SPARK-13203] Add scalastyle rule banning use ...

2016-02-04 Thread ted-yu
Github user ted-yu commented on the pull request: https://github.com/apache/spark/pull/11082#issuecomment-180062533 Jenkins, test this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-13203] Add scalastyle rule banning use ...

2016-02-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11082#issuecomment-180066287 **[Test build #50773 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50773/consoleFull)** for PR 11082 at commit

[GitHub] spark pull request: [SPARK-13203] Add scalastyle rule banning use ...

2016-02-04 Thread ted-yu
Github user ted-yu commented on the pull request: https://github.com/apache/spark/pull/11082#issuecomment-180072504 Jenkins, test this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-13136][SQL] Create a dedicated Broadcas...

2016-02-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11083#issuecomment-180072462 **[Test build #50775 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50775/consoleFull)** for PR 11083 at commit

[GitHub] spark pull request: [SPARK-13167][SQL] Include rows with null valu...

2016-02-04 Thread sureshthalamati
Github user sureshthalamati commented on a diff in the pull request: https://github.com/apache/spark/pull/11063#discussion_r51951455 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/DataFrameReader.scala --- @@ -213,14 +212,21 @@ class DataFrameReader

[GitHub] spark pull request: [SPARK-13136][SQL] Create a dedicated Broadcas...

2016-02-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11083#issuecomment-180094758 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-13136][SQL] Create a dedicated Broadcas...

2016-02-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11083#issuecomment-180094756 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

  1   2   3   4   5   6   >