[GitHub] spark pull request: [SPARK-8964] [SQL] Use Exchange to perform shu...

2016-02-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7334#issuecomment-180568890 **[Test build #50844 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50844/consoleFull)** for PR 7334 at commit

[GitHub] spark pull request: [SPARK-13166][SQL]Rename DataStreamReaderWrite...

2016-02-05 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/11096#issuecomment-180571977 Merging to master --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-13166][SQL]Rename DataStreamReaderWrite...

2016-02-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11096#issuecomment-180571853 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-13210] [SQL] catch OOM when allocate me...

2016-02-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11095#issuecomment-180580403 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-13210] [SQL] catch OOM when allocate me...

2016-02-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11095#issuecomment-180580393 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10521][SQL] Utilize Docker for test DB2...

2016-02-05 Thread lresende
Github user lresende commented on the pull request: https://github.com/apache/spark/pull/9893#issuecomment-180593895 Thanks @shaneknapp , I'll refrain the final say on the downtime to others on the PMC ( @JoshRosen and others) --- If your project is set up for it, you can reply to

[GitHub] spark pull request: [SPARK-13145] [SQL] checkAnswer in SQL query s...

2016-02-05 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/11086#discussion_r52081122 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/QueryTest.scala --- @@ -350,6 +350,9 @@ object QueryTest { Row.fromSeq(row.toSeq.map {

[GitHub] spark pull request: [SPARK-12992][SQL] Support vectorized decoding...

2016-02-05 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/11055#discussion_r52081720 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/SQLConf.scala --- @@ -345,6 +345,14 @@ private[spark] object SQLConf { defaultValue =

[GitHub] spark pull request: [SPARK-12939][SQL] migrate encoder resolution ...

2016-02-05 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/10852#issuecomment-180601920 Thanks, merging to master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-13171] [Core] Replace future calls with...

2016-02-05 Thread jodersky
Github user jodersky commented on the pull request: https://github.com/apache/spark/pull/11085#issuecomment-180604528 I rebased on master and ran local tests successfully --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request: [SPARK-13146][SQL] Management API for continuo...

2016-02-05 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/11030#discussion_r52082733 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/StreamExecution.scala --- @@ -55,9 +59,89 @@ class StreamExecution(

[GitHub] spark pull request: [SPARK-13171] [Core] Replace future calls with...

2016-02-05 Thread jodersky
Github user jodersky commented on the pull request: https://github.com/apache/spark/pull/11085#issuecomment-180604643 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-13002][Mesos] Send initial request of e...

2016-02-05 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/11047 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-13146][SQL] Management API for continuo...

2016-02-05 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/11030#discussion_r52082979 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/StreamExecution.scala --- @@ -55,9 +59,89 @@ class StreamExecution(

[GitHub] spark pull request: [SPARK-13146][SQL] Management API for continuo...

2016-02-05 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/11030#discussion_r52083030 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/StreamExecution.scala --- @@ -150,36 +205,40 @@ class StreamExecution(

[GitHub] spark pull request: [SPARK-13145] [SQL] checkAnswer in SQL query s...

2016-02-05 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/11086#discussion_r52083022 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/QueryTest.scala --- @@ -350,6 +350,9 @@ object QueryTest { Row.fromSeq(row.toSeq.map {

[GitHub] spark pull request: [SPARK-13145] [SQL] checkAnswer in SQL query s...

2016-02-05 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/11086#discussion_r52082988 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/QueryTest.scala --- @@ -350,6 +350,9 @@ object QueryTest { Row.fromSeq(row.toSeq.map {

[GitHub] spark pull request: [SPARK-13146][SQL] Management API for continuo...

2016-02-05 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/11030#discussion_r52083110 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/StreamExecution.scala --- @@ -198,14 +257,46 @@ class StreamExecution(

[GitHub] spark pull request: [SPARK-13171] [Core] Replace future calls with...

2016-02-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11085#issuecomment-180608176 **[Test build #50846 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50846/consoleFull)** for PR 11085 at commit

[GitHub] spark pull request: [SPARK-13146][SQL] Management API for continuo...

2016-02-05 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/11030#discussion_r52083507 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/DataFrameWriter.scala --- @@ -185,6 +185,17 @@ final class DataFrameWriter private[sql](df:

[GitHub] spark pull request: [SPARK-8964] [SQL] Use Exchange to perform shu...

2016-02-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7334#issuecomment-180608495 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8964] [SQL] Use Exchange to perform shu...

2016-02-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7334#issuecomment-180608496 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-13149][SQL]Add FileStreamSource

2016-02-05 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/11034#discussion_r52083903 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/FileStreamSource.scala --- @@ -0,0 +1,229 @@ +/* + * Licensed to the

[GitHub] spark pull request: [SPARK-13215] [SQL] remove fallback in codegen

2016-02-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11097#issuecomment-180610270 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13146][SQL] Management API for continuo...

2016-02-05 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/11030#discussion_r52084635 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/StreamExecution.scala --- @@ -150,36 +205,40 @@ class StreamExecution(

[GitHub] spark pull request: [SPARK-13145] [SQL] checkAnswer in SQL query s...

2016-02-05 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/11086#discussion_r52084984 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/QueryTest.scala --- @@ -350,6 +350,9 @@ object QueryTest { Row.fromSeq(row.toSeq.map {

[GitHub] spark pull request: [SPARK-13203] Add scalastyle rule banning use ...

2016-02-05 Thread ted-yu
Github user ted-yu commented on the pull request: https://github.com/apache/spark/pull/11082#issuecomment-180616613 There is no error in DirectKafkaStreamSuite.scala Once [~holdenk]'s PR goes in, I will rebase. --- If your project is set up for it, you can reply to this

[GitHub] spark pull request: [SPARK-13101][SQL] nullability of array type e...

2016-02-05 Thread cloud-fan
Github user cloud-fan commented on the pull request: https://github.com/apache/spark/pull/11035#issuecomment-180702413 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-13145] [SQL] checkAnswer in SQL query s...

2016-02-05 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/11086#discussion_r52098701 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/QueryTest.scala --- @@ -350,6 +350,9 @@ object QueryTest { Row.fromSeq(row.toSeq.map {

[GitHub] spark pull request: [SPARK-12888][SQL][follow-up] benchmark the ne...

2016-02-05 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/10917#discussion_r52098713 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/HashBenchmark.scala --- @@ -87,18 +92,39 @@ object HashBenchmark { .add("binary",

[GitHub] spark pull request: [SPARK-13222][Streaming][WIP]make sure latest ...

2016-02-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11101#issuecomment-180703558 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13101][SQL] nullability of array type e...

2016-02-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11035#issuecomment-180703524 **[Test build #50864 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50864/consoleFull)** for PR 11035 at commit

[GitHub] spark pull request: [SPARK-13222][Streaming][WIP]make sure latest ...

2016-02-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11101#issuecomment-180703559 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-13222][Streaming][WIP]make sure latest ...

2016-02-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11101#issuecomment-180703548 **[Test build #50863 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50863/consoleFull)** for PR 11101 at commit

[GitHub] spark pull request: [SPARK-13131] [SQL] Use best and average time ...

2016-02-05 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/11018#discussion_r52098786 --- Diff: core/src/main/scala/org/apache/spark/util/Benchmark.scala --- @@ -59,17 +60,21 @@ private[spark] class Benchmark( } println

[GitHub] spark pull request: [SPARK-13145] [SQL] checkAnswer in SQL query s...

2016-02-05 Thread bomeng
Github user bomeng commented on a diff in the pull request: https://github.com/apache/spark/pull/11086#discussion_r52098824 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/QueryTest.scala --- @@ -350,6 +350,9 @@ object QueryTest { Row.fromSeq(row.toSeq.map {

[GitHub] spark pull request: [SPARK-13068][PYSPARK][ML]

2016-02-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11099#issuecomment-180708243 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13068][PYSPARK][ML]

2016-02-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11099#issuecomment-180708244 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-13101][SQL] nullability of array type e...

2016-02-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11035#issuecomment-180714059 **[Test build #50864 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50864/consoleFull)** for PR 11035 at commit

[GitHub] spark pull request: [SPARK-13101][SQL] nullability of array type e...

2016-02-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11035#issuecomment-180714098 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-12807] [YARN] Spark External Shuffle no...

2016-02-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10780#issuecomment-180394348 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-13002][Mesos] Send initial request of e...

2016-02-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11047#issuecomment-180439396 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-12476][SQL] Implement JdbcRelation#unha...

2016-02-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10427#issuecomment-180388822 **[Test build #50818 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50818/consoleFull)** for PR 10427 at commit

[GitHub] spark pull request: [SPARK-12807] [YARN] Spark External Shuffle no...

2016-02-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10780#issuecomment-180394345 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13012] [Documentation] Replace example ...

2016-02-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11053#issuecomment-180424657 **[Test build #50824 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50824/consoleFull)** for PR 11053 at commit

[GitHub] spark pull request: [SPARK-11373] [CORE] Add metrics to the Histor...

2016-02-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9571#issuecomment-180390375 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11373] [CORE] Add metrics to the Histor...

2016-02-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9571#issuecomment-180390376 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11373] [CORE] Add metrics to the Histor...

2016-02-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9571#issuecomment-180390371 **[Test build #50822 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50822/consoleFull)** for PR 9571 at commit

[GitHub] spark pull request: [SPARK-13002][Mesos] Send initial request of e...

2016-02-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11047#issuecomment-180428691 **[Test build #50820 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50820/consoleFull)** for PR 11047 at commit

[GitHub] spark pull request: [SPARK-11373] [CORE] Add metrics to the Histor...

2016-02-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9571#issuecomment-180390047 **[Test build #50822 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50822/consoleFull)** for PR 9571 at commit

[GitHub] spark pull request: [SPARK-13002][Mesos] Send initial request of e...

2016-02-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11047#issuecomment-180390254 **[Test build #50821 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50821/consoleFull)** for PR 11047 at commit

[GitHub] spark pull request: [SPARK-12807] [YARN] Spark External Shuffle no...

2016-02-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10780#issuecomment-180394001 **[Test build #50815 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50815/consoleFull)** for PR 10780 at commit

[GitHub] spark pull request: [SPARK-13012] [Documentation] Replace example ...

2016-02-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11053#issuecomment-180426806 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13012] [Documentation] Replace example ...

2016-02-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11053#issuecomment-180426788 **[Test build #50824 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50824/consoleFull)** for PR 11053 at commit

[GitHub] spark pull request: [SPARK-13002][Mesos] Send initial request of e...

2016-02-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11047#issuecomment-180428972 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13002][Mesos] Send initial request of e...

2016-02-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11047#issuecomment-180439401 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-5865] [API DOC] Add doc warnings for me...

2016-02-05 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/10874#issuecomment-180392174 Jenkins, retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-5865] [API DOC] Add doc warnings for me...

2016-02-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10874#issuecomment-180397780 **[Test build #50823 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50823/consoleFull)** for PR 10874 at commit

[GitHub] spark pull request: [SPARK-13012] [Documentation] Replace example ...

2016-02-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11053#issuecomment-180426811 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-13037][ML][PySpark] PySpark ml.recommen...

2016-02-05 Thread yanboliang
Github user yanboliang commented on the pull request: https://github.com/apache/spark/pull/11044#issuecomment-180395685 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-13101][SQL] nullability of array type e...

2016-02-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11035#issuecomment-180714099 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-12807] [YARN] Spark External Shuffle no...

2016-02-05 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/10780#discussion_r52047530 --- Diff: network/yarn/pom.xml --- @@ -96,6 +113,61 @@ + + + +

[GitHub] spark pull request: [SPARK-8964] [SQL] Use Exchange to perform shu...

2016-02-05 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/7334#discussion_r52056901 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/limit.scala --- @@ -0,0 +1,116 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: update documentation

2016-02-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11093#issuecomment-180506266 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-5095] [Mesos] Support launching multipl...

2016-02-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10993#issuecomment-180510322 **[Test build #50833 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50833/consoleFull)** for PR 10993 at commit

[GitHub] spark pull request: [SPARK-13149][SQL]Add FileStreamSource

2016-02-05 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/11034#discussion_r52060863 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/FileStreamSource.scala --- @@ -0,0 +1,223 @@ +/* + * Licensed to the

[GitHub] spark pull request: [SPARK-13171] [Core] Replace future calls with...

2016-02-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11085#issuecomment-180511262 **[Test build #50829 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50829/consoleFull)** for PR 11085 at commit

[GitHub] spark pull request: [SPARK-13214][DOCS] update dynamicAllocation d...

2016-02-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11093#issuecomment-180510996 **[Test build #50832 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50832/consoleFull)** for PR 11093 at commit

[GitHub] spark pull request: [SPARK-13149][SQL]Add FileStreamSource

2016-02-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11034#issuecomment-180511006 **[Test build #50830 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50830/consoleFull)** for PR 11034 at commit

[GitHub] spark pull request: [SPARK-12739] [Streaming] Details of batch in ...

2016-02-05 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/11022#issuecomment-180472783 > Not an issue so much as the person must be in the Contributor role. (Are you an admin? You can edit this). Done The Contributor role was full when I tried

[GitHub] spark pull request: [SPARK-13047][PYSPARK][ML] Pyspark Params.hasP...

2016-02-05 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/10962#issuecomment-180480810 LGTM, just one minor comment. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-13189] Cleanup build references to Scal...

2016-02-05 Thread lresende
GitHub user lresende opened a pull request: https://github.com/apache/spark/pull/11092 [SPARK-13189] Cleanup build references to Scala 2.10 You can merge this pull request into a Git repository by running: $ git pull https://github.com/lresende/spark SPARK-13189

[GitHub] spark pull request: [SPARK-13194][BUILD] Update release audit tool...

2016-02-05 Thread lresende
Github user lresende closed the pull request at: https://github.com/apache/spark/pull/11077 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-8964] [SQL] Use Exchange to perform shu...

2016-02-05 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/7334#discussion_r52056035 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/limit.scala --- @@ -0,0 +1,116 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request: [SPARK-5095] [Mesos] Support launching multipl...

2016-02-05 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/10993#issuecomment-180505172 Yeah @mgummelt we have lots of those. Welcome to Spark :) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark pull request: update documentation

2016-02-05 Thread anabranch
GitHub user anabranch opened a pull request: https://github.com/apache/spark/pull/11093 update documentation You can merge this pull request into a Git repository by running: $ git pull https://github.com/anabranch/spark master Alternatively you can review and apply these

[GitHub] spark pull request: [SPARK-13165][STREAMING] Replace deprecated sy...

2016-02-05 Thread holdenk
Github user holdenk commented on a diff in the pull request: https://github.com/apache/spark/pull/11067#discussion_r52059943 --- Diff: streaming/src/test/scala/org/apache/spark/streaming/MasterFailureTest.scala --- @@ -215,8 +216,8 @@ object MasterFailureTest extends Logging {

[GitHub] spark pull request: [SPARK-13149][SQL]Add FileStreamSource

2016-02-05 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/11034#issuecomment-180506306 Changes to this PR: 1. Add a HashMap batchToMetadata to store the metadata in memory so that we don't need to read metadata files in `getNextBatch` 2. Load

[GitHub] spark pull request: [SPARK-13149][SQL]Add FileStreamSource

2016-02-05 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/11034#discussion_r52060451 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/sources/interfaces.scala --- @@ -195,6 +196,35 @@ trait HadoopFsRelationProvider { }

[GitHub] spark pull request: [SPARK-13146][SQL] Management API for continuo...

2016-02-05 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/11030#discussion_r52060520 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/StreamExecution.scala --- @@ -55,9 +59,88 @@ class StreamExecution(

[GitHub] spark pull request: [SPARK-12807] [YARN] Spark External Shuffle no...

2016-02-05 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/10780#discussion_r52047310 --- Diff: network/yarn/pom.xml --- @@ -86,6 +94,15 @@ + + +

[GitHub] spark pull request: [SPARK-13012] [Documentation] Replace example ...

2016-02-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11053#issuecomment-180478941 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13012] [Documentation] Replace example ...

2016-02-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11053#issuecomment-180478946 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-13047][PYSPARK][ML] Pyspark Params.hasP...

2016-02-05 Thread sethah
Github user sethah commented on the pull request: https://github.com/apache/spark/pull/10962#issuecomment-180478448 ping! @yanboliang @jkbradley This is a small change that will allow the Python API to match the Scala API, where the current behavior could be reasonably

[GitHub] spark pull request: [SPARK-13012] [Documentation] Replace example ...

2016-02-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11053#issuecomment-180478503 **[Test build #50825 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50825/consoleFull)** for PR 11053 at commit

[GitHub] spark pull request: [SPARK-13047][PYSPARK][ML] Pyspark Params.hasP...

2016-02-05 Thread sethah
Github user sethah commented on the pull request: https://github.com/apache/spark/pull/10962#issuecomment-180485241 @davies Thanks for taking a look! I have addressed your comment. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] spark pull request: [SPARK-13047][PYSPARK][ML] Pyspark Params.hasP...

2016-02-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10962#issuecomment-180494282 **[Test build #50826 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50826/consoleFull)** for PR 10962 at commit

[GitHub] spark pull request: [SPARK-13047][PYSPARK][ML] Pyspark Params.hasP...

2016-02-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10962#issuecomment-180494296 **[Test build #2521 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2521/consoleFull)** for PR 10962 at commit

[GitHub] spark pull request: [SPARK-13180] Protect against SessionState bei...

2016-02-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11066#issuecomment-180500926 **[Test build #50827 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50827/consoleFull)** for PR 11066 at commit

[GitHub] spark pull request: [SPARK-13149][SQL]Add FileStreamSource

2016-02-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11034#issuecomment-180500710 **[Test build #50828 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50828/consoleFull)** for PR 11034 at commit

[GitHub] spark pull request: [SPARK-5095] [Mesos] Support launching multipl...

2016-02-05 Thread mgummelt
Github user mgummelt commented on a diff in the pull request: https://github.com/apache/spark/pull/10993#discussion_r52059914 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/CoarseMesosSchedulerBackend.scala --- @@ -373,40 +451,25 @@ private[spark] class

[GitHub] spark pull request: [SPARK-5095] [Mesos] Support launching multipl...

2016-02-05 Thread mgummelt
Github user mgummelt commented on the pull request: https://github.com/apache/spark/pull/10993#issuecomment-180508893 @andrewor14 Glad to be here! Flaky tests or no I think all concerns have been addressed except for dynamic allocation testing, which seems to be broken

[GitHub] spark pull request: [SPARK-13047][PYSPARK][ML] Pyspark Params.hasP...

2016-02-05 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/10962#discussion_r52052341 --- Diff: python/pyspark/ml/param/__init__.py --- @@ -156,9 +156,16 @@ def hasParam(self, paramName): """ Tests whether this

[GitHub] spark pull request: [SPARK-13190][BUILD] Update pom.xml to referen...

2016-02-05 Thread lresende
Github user lresende commented on the pull request: https://github.com/apache/spark/pull/11075#issuecomment-180486122 @rxin this is now merged into #11092 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-13193][BUILD] Update docker test image ...

2016-02-05 Thread lresende
Github user lresende commented on the pull request: https://github.com/apache/spark/pull/11076#issuecomment-180486204 @rxin this is now merged into #11092 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-13191][BUILD] Update Scala 2.11 related...

2016-02-05 Thread lresende
Github user lresende closed the pull request at: https://github.com/apache/spark/pull/11074 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-13193][BUILD] Update docker test image ...

2016-02-05 Thread lresende
Github user lresende closed the pull request at: https://github.com/apache/spark/pull/11076 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-13190][BUILD] Update pom.xml to referen...

2016-02-05 Thread lresende
Github user lresende closed the pull request at: https://github.com/apache/spark/pull/11075 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-13194][BUILD] Update release audit tool...

2016-02-05 Thread lresende
Github user lresende commented on the pull request: https://github.com/apache/spark/pull/11077#issuecomment-180486261 @rxin this is now merged into #11092 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-13047][PYSPARK][ML] Pyspark Params.hasP...

2016-02-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10962#issuecomment-180499905 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

  1   2   3   4   5   >