[GitHub] spark pull request: [Spark-5717] [MLlib] add stop and reorganize i...

2015-02-10 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/4503#issuecomment-73721723 Yes it's a small thing but the examples should call `stop()`. I can merge if you'll move the imports accordingly. --- If your project is set up for it, you can reply to

[GitHub] spark pull request: [Spark-5717] [MLlib] add stop and reorganize i...

2015-02-10 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/4503#discussion_r24421234 --- Diff: examples/src/main/scala/org/apache/spark/examples/mllib/LDAExample.scala --- @@ -21,15 +21,12 @@ import java.text.BreakIterator import

[GitHub] spark pull request: [SPARK-5716] [SQL] Support TOK_CHARSETLITERAL ...

2015-02-10 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4502#issuecomment-73706898 [Test build #27204 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/27204/consoleFull) for PR 4502 at commit

[GitHub] spark pull request: [SPARK-5716] [SQL] Support TOK_CHARSETLITERAL ...

2015-02-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4502#issuecomment-73706909 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [Spark-5717] [MLlib] add stop and reorganize i...

2015-02-10 Thread hhbyyh
Github user hhbyyh commented on the pull request: https://github.com/apache/spark/pull/4503#issuecomment-73717571 The ut failure seems irrelevant. Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] spark pull request: [WIP] [SPARK-5704] [SQL] [PySpark] createDataF...

2015-02-10 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/4498#discussion_r24419929 --- Diff: python/pyspark/sql/context.py --- @@ -186,7 +189,7 @@ def inferSchema(self, rdd, samplingRatio=None): warnings.warn(Some of

[GitHub] spark pull request: [Spark-5717] [MLlib] add stop and reorganize i...

2015-02-10 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4503#issuecomment-73724629 [Test build #27208 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/27208/consoleFull) for PR 4503 at commit

[GitHub] spark pull request: [SPARK-5719]allow daemons to bind to specified...

2015-02-10 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4505#issuecomment-73710867 [Test build #27206 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/27206/consoleFull) for PR 4505 at commit

[GitHub] spark pull request: [SPARK-5719]allow daemons to bind to specified...

2015-02-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4505#issuecomment-73710872 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-1805] [EC2] Validate instance types

2015-02-10 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/4455 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SQL] [Minor] Deferred table resolving for DF ...

2015-02-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4506#issuecomment-73711308 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SQL] [Minor] Deferred table resolving for DF ...

2015-02-10 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4506#issuecomment-73711302 [Test build #27207 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/27207/consoleFull) for PR 4506 at commit

[GitHub] spark pull request: [Spark-5717] [MLlib] add stop and reorganize i...

2015-02-10 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/4503#issuecomment-73725939 jenkins, retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [Spark-5717] [MLlib] add stop and reorganize i...

2015-02-10 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4503#issuecomment-73726711 [Test build #27209 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/27209/consoleFull) for PR 4503 at commit

[GitHub] spark pull request: [SPARK-5709] [SQL] Add EXPLAIN support in Data...

2015-02-10 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4496#issuecomment-73708785 [Test build #27205 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/27205/consoleFull) for PR 4496 at commit

[GitHub] spark pull request: [SPARK-5709] [SQL] Add EXPLAIN support in Data...

2015-02-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4496#issuecomment-73708791 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-1805] [EC2] Validate instance types

2015-02-10 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/4455#issuecomment-73721997 Passes tests, positive review from Josh and nchammas, looks OK to me, I'll merge. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request: #SPARK-2808 update kafka to version 0.8.2

2015-02-10 Thread koeninger
Github user koeninger commented on the pull request: https://github.com/apache/spark/pull/3631#issuecomment-73728226 This will need some changes to KafkaCluster and possibly other things related to the new api... let me know if you want a hand. --- If your project is set up for it,

[GitHub] spark pull request: [SPARK-5681][Streaming] Add tracker status and...

2015-02-10 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/4467#discussion_r24468323 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/scheduler/ReceiverTracker.scala --- @@ -202,16 +232,21 @@ class ReceiverTracker(ssc:

[GitHub] spark pull request: SPARK-4682 [CORE] Consolidate various 'Clock' ...

2015-02-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4514#issuecomment-73820275 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4879] Use driver to coordinate Hadoop o...

2015-02-10 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/4066#discussion_r24468427 --- Diff: core/src/main/scala/org/apache/spark/scheduler/OutputCommitCoordinator.scala --- @@ -0,0 +1,161 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-5658][SQL] Finalize DDL and write suppo...

2015-02-10 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4446#issuecomment-73820280 [Test build #27244 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/27244/consoleFull) for PR 4446 at commit

[GitHub] spark pull request: SPARK-4682 [CORE] Consolidate various 'Clock' ...

2015-02-10 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4514#issuecomment-73820269 [Test build #27248 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/27248/consoleFull) for PR 4514 at commit

[GitHub] spark pull request: [SPARK-5658][SQL] Finalize DDL and write suppo...

2015-02-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4446#issuecomment-73820283 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SQL] Add an exception for analysis errors.

2015-02-10 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/4439 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-5681][Streaming] Add tracker status and...

2015-02-10 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/4467#discussion_r24468104 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/scheduler/ReceiverTracker.scala --- @@ -67,13 +67,39 @@ class ReceiverTracker(ssc:

[GitHub] spark pull request: [SPARK-5681][Streaming] Add tracker status and...

2015-02-10 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/4467#discussion_r24468119 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/scheduler/ReceiverTracker.scala --- @@ -67,13 +67,39 @@ class ReceiverTracker(ssc:

[GitHub] spark pull request: [SPARK-5503][MLLIB] Example code for Power Ite...

2015-02-10 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4495#issuecomment-73819189 [Test build #27245 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/27245/consoleFull) for PR 4495 at commit

[GitHub] spark pull request: [SPARK-5687][Core]TaskResultGetter needs to ca...

2015-02-10 Thread lianhuiwang
Github user lianhuiwang closed the pull request at: https://github.com/apache/spark/pull/4474 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark pull request: [SPARK-5503][MLLIB] Example code for Power Ite...

2015-02-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4495#issuecomment-73819197 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4964] [Streaming] refactor createRDD to...

2015-02-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4511#issuecomment-73819460 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4879] Use driver to coordinate Hadoop o...

2015-02-10 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/4066#issuecomment-73822283 LGTM, I will merge this once tests pass --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: SPARK-4682 [CORE] Consolidate various 'Clock' ...

2015-02-10 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4514#issuecomment-73823479 [Test build #27257 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/27257/consoleFull) for PR 4514 at commit

[GitHub] spark pull request: SPARK-4682 [CORE] Consolidate various 'Clock' ...

2015-02-10 Thread tdas
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/4514#issuecomment-73824804 This is a very bold change. :) * 10K feet comment - Isnt ManualClock more descriptive name than FakeClock? * For other clocks, like the Clock in streaming, since

[GitHub] spark pull request: [SPARK-5503][MLLIB] Example code for Power Ite...

2015-02-10 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/4495#discussion_r24471472 --- Diff: examples/src/main/scala/org/apache/spark/examples/mllib/PowerIterationClusteringExample.scala --- @@ -0,0 +1,149 @@ +/* + * Licensed to the

[GitHub] spark pull request: [SPARK-5503][MLLIB] Example code for Power Ite...

2015-02-10 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/4495#discussion_r24471469 --- Diff: examples/src/main/scala/org/apache/spark/examples/mllib/PowerIterationClusteringExample.scala --- @@ -0,0 +1,149 @@ +/* + * Licensed to the

[GitHub] spark pull request: [SPARK-5503][MLLIB] Example code for Power Ite...

2015-02-10 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/4495#discussion_r24471456 --- Diff: examples/src/main/scala/org/apache/spark/examples/mllib/PowerIterationClusteringExample.scala --- @@ -0,0 +1,149 @@ +/* + * Licensed to the

[GitHub] spark pull request: [SPARK-5503][MLLIB] Example code for Power Ite...

2015-02-10 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/4495#discussion_r24471466 --- Diff: examples/src/main/scala/org/apache/spark/examples/mllib/PowerIterationClusteringExample.scala --- @@ -0,0 +1,149 @@ +/* + * Licensed to the

[GitHub] spark pull request: [SPARK-5503][MLLIB] Example code for Power Ite...

2015-02-10 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/4495#discussion_r24471458 --- Diff: examples/src/main/scala/org/apache/spark/examples/mllib/PowerIterationClusteringExample.scala --- @@ -0,0 +1,149 @@ +/* + * Licensed to the

[GitHub] spark pull request: SPARK-5728 [STREAMING] MQTTStreamSuite leaves ...

2015-02-10 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4517#issuecomment-73826439 [Test build #27253 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/27253/consoleFull) for PR 4517 at commit

[GitHub] spark pull request: [SPARK-5649][SQL] added a rule to check dataty...

2015-02-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4425#issuecomment-73827534 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-5649][SQL] added a rule to check dataty...

2015-02-10 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4425#issuecomment-73827532 [Test build #27260 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/27260/consoleFull) for PR 4425 at commit

[GitHub] spark pull request: [SPARK-5649][SQL] added a rule to check dataty...

2015-02-10 Thread scwf
Github user scwf commented on the pull request: https://github.com/apache/spark/pull/4425#issuecomment-73827898 Retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-5498][SQL]fix query exception when part...

2015-02-10 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4289#issuecomment-73828057 [Test build #27267 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/27267/consoleFull) for PR 4289 at commit

[GitHub] spark pull request: [SPARK-5706] [SQL] Add json schema inferring A...

2015-02-10 Thread chenghao-intel
Github user chenghao-intel commented on a diff in the pull request: https://github.com/apache/spark/pull/4492#discussion_r24472213 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/json/JsonRDD.scala --- @@ -127,7 +135,7 @@ private[sql] object JsonRDD extends Logging {

[GitHub] spark pull request: [SPARK-5641] Allow spark_ec2.py to copy a wide...

2015-02-10 Thread florianverhein
Github user florianverhein commented on the pull request: https://github.com/apache/spark/pull/4487#issuecomment-73829153 Good point. I don't use any yet... However, here is a concrete case where I will soon: https://github.com/florianverhein/spark-ec2/tree/packer/extra

[GitHub] spark pull request: [SPARK-5706] [SQL] Add json schema inferring A...

2015-02-10 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/4492#discussion_r24472531 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/SQLContext.scala --- @@ -380,6 +380,11 @@ class SQLContext(@transient val sparkContext: SparkContext)

[GitHub] spark pull request: [SPARK-5712] [SQL] fix comment with semicolon ...

2015-02-10 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4500#issuecomment-73829962 [Test build #27265 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/27265/consoleFull) for PR 4500 at commit

[GitHub] spark pull request: [SPARK-5712] [SQL] fix comment with semicolon ...

2015-02-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4500#issuecomment-73829965 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-5454] More robust handling of self join...

2015-02-10 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4520#issuecomment-73830800 [Test build #27271 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/27271/consoleFull) for PR 4520 at commit

[GitHub] spark pull request: [SPARK-5454] More robust handling of self join...

2015-02-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4520#issuecomment-73830805 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-5681][Streaming] Add tracker status and...

2015-02-10 Thread viirya
Github user viirya commented on the pull request: https://github.com/apache/spark/pull/4467#issuecomment-73831487 The state behavior should be: * If state = Initialized, then disallow all actions. (actor is not initialized yet) * If state = Started, then allow all

[GitHub] spark pull request: [SPARK-5729] Potential NPE in standalone REST ...

2015-02-10 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/4518 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-5681][Streaming] Add tracker status and...

2015-02-10 Thread viirya
Github user viirya commented on the pull request: https://github.com/apache/spark/pull/4467#issuecomment-73832125 It should accept addblock even it is stopping because there might be receivers processing data. Modified state behavior should be: * If state =

[GitHub] spark pull request: [SPARK-5702][SQL] Allow short names for built-...

2015-02-10 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/4489 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SQL] Add an exception for analysis errors.

2015-02-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4439#issuecomment-73819702 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: SPARK-5728 [STREAMING] MQTTStreamSuite leaves ...

2015-02-10 Thread srowen
GitHub user srowen opened a pull request: https://github.com/apache/spark/pull/4517 SPARK-5728 [STREAMING] MQTTStreamSuite leaves behind ActiveMQ database files Use temp dir for ActiveMQ database You can merge this pull request into a Git repository by running: $ git pull

[GitHub] spark pull request: [SPARK-5658][SQL] Finalize DDL and write suppo...

2015-02-10 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/4446 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-5709] [SQL] Add EXPLAIN support in Data...

2015-02-10 Thread chenghao-intel
Github user chenghao-intel commented on a diff in the pull request: https://github.com/apache/spark/pull/4496#discussion_r24468615 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/DataFrameImpl.scala --- @@ -112,6 +112,12 @@ private[sql] class DataFrameImpl protected[sql](

[GitHub] spark pull request: [SPARK-5704] [SQL] [PySpark] createDataFrame f...

2015-02-10 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/4498#issuecomment-73821969 @pwendell I think this PR is ready to go, just wait for jenkins or not. (The last commit just remove a API and the test for it) --- If your project is set up for it, you

[GitHub] spark pull request: SPARK-5727 [BUILD] Deprecate Debian packaging

2015-02-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4516#issuecomment-73823199 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: SPARK-5727 [BUILD] Deprecate Debian packaging

2015-02-10 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4516#issuecomment-73823195 [Test build #27249 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/27249/consoleFull) for PR 4516 at commit

[GitHub] spark pull request: [SPARK-5681][Streaming] Add tracker status and...

2015-02-10 Thread tdas
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/4467#issuecomment-73824469 I realized that this is a tricky thing to fix while maintaining the stopGracefully semantics. Stop gracefully must ensure that if there are receivers that have already

[GitHub] spark pull request: [SPARK-5649][SQL] added a rule to check dataty...

2015-02-10 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4425#issuecomment-73824551 [Test build #27260 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/27260/consoleFull) for PR 4425 at commit

[GitHub] spark pull request: [SQL][DataFrame] Fix column computability bug.

2015-02-10 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4519#issuecomment-73824873 [Test build #27261 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/27261/consoleFull) for PR 4519 at commit

[GitHub] spark pull request: SPARK-4682 [CORE] Consolidate various 'Clock' ...

2015-02-10 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/4514#discussion_r24470877 --- Diff: core/src/main/scala/org/apache/spark/util/Clock.scala --- @@ -22,8 +22,35 @@ package org.apache.spark.util */ private[spark] trait Clock {

[GitHub] spark pull request: [SPARK-5709] [SQL] Add EXPLAIN support in Data...

2015-02-10 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4496#issuecomment-73824898 [Test build #27262 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/27262/consoleFull) for PR 4496 at commit

[GitHub] spark pull request: [SQL][DataFrame] Fix column computability bug.

2015-02-10 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4519#issuecomment-73825662 [Test build #27263 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/27263/consoleFull) for PR 4519 at commit

[GitHub] spark pull request: [SPARK-4964] [Streaming] refactor createRDD to...

2015-02-10 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4511#issuecomment-73829002 [Test build #27269 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/27269/consoleFull) for PR 4511 at commit

[GitHub] spark pull request: [SPARK-5454] More robust handling of self join...

2015-02-10 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4520#issuecomment-73829637 [Test build #27270 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/27270/consoleFull) for PR 4520 at commit

[GitHub] spark pull request: [SPARK-5454] More robust handling of self join...

2015-02-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4520#issuecomment-73829638 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-5454] More robust handling of self join...

2015-02-10 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4520#issuecomment-73829581 [Test build #27270 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/27270/consoleFull) for PR 4520 at commit

[GitHub] spark pull request: [SPARK-5454] More robust handling of self join...

2015-02-10 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4520#issuecomment-73830143 [Test build #27271 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/27271/consoleFull) for PR 4520 at commit

[GitHub] spark pull request: [SPARK-5649][SQL] added a rule to check dataty...

2015-02-10 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4425#issuecomment-7383 [Test build #27272 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/27272/consoleFull) for PR 4425 at commit

[GitHub] spark pull request: [SPARK-4964] [Streaming] refactor createRDD to...

2015-02-10 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4511#issuecomment-73831038 [Test build #597 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/597/consoleFull) for PR 4511 at commit

[GitHub] spark pull request: [SPARK-5706] [SQL] Add json schema inferring A...

2015-02-10 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/4492#discussion_r24473563 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/SQLContext.scala --- @@ -380,6 +380,11 @@ class SQLContext(@transient val sparkContext: SparkContext)

[GitHub] spark pull request: [SPARK-4879] Use driver to coordinate Hadoop o...

2015-02-10 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/4066#issuecomment-73831899 I only merged this into master and 1.3 for now because there are significant merge conflicts. Thanks @JoshRosen and @mccheah. --- If your project is set up for it,

[GitHub] spark pull request: [SQL][DataFrame] Fix column computability bug.

2015-02-10 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4519#issuecomment-73832523 [Test build #27263 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/27263/consoleFull) for PR 4519 at commit

[GitHub] spark pull request: [SQL][DataFrame] Fix column computability bug.

2015-02-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4519#issuecomment-73832527 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-5681][Streaming] Add tracker status and...

2015-02-10 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4467#issuecomment-73833008 [Test build #27273 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/27273/consoleFull) for PR 4467 at commit

[GitHub] spark pull request: [SPARK-5724] fix the misconfiguration in AkkaU...

2015-02-10 Thread CodingCat
Github user CodingCat commented on the pull request: https://github.com/apache/spark/pull/4512#issuecomment-73833709 I see. you mean provide an empty class in our code base? But, since they are discussing about removing Akka from Spark, is it still worth doing this (instead

[GitHub] spark pull request: [SPARK-5641] Allow spark_ec2.py to copy a wide...

2015-02-10 Thread florianverhein
Github user florianverhein commented on the pull request: https://github.com/apache/spark/pull/4487#issuecomment-73833605 ... Actually that `extra` example should technically be able to be made to work without substitution as I source the `/root/extra/*.sh` scripts in

[GitHub] spark pull request: SPARK-5728 [STREAMING] MQTTStreamSuite leaves ...

2015-02-10 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4517#issuecomment-73820559 [Test build #27253 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/27253/consoleFull) for PR 4517 at commit

[GitHub] spark pull request: [SPARK-4924] Add a library for launching Spark...

2015-02-10 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3916#issuecomment-73821334 [Test build #27246 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/27246/consoleFull) for PR 3916 at commit

[GitHub] spark pull request: [SPARK-4879] Use driver to coordinate Hadoop o...

2015-02-10 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4066#issuecomment-73821367 [Test build #27254 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/27254/consoleFull) for PR 4066 at commit

[GitHub] spark pull request: [SPARK-5709] [SQL] Add EXPLAIN support in Data...

2015-02-10 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/4496#discussion_r24470163 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/Column.scala --- @@ -600,6 +600,15 @@ trait Column extends DataFrame { def desc: Column =

[GitHub] spark pull request: [SPARK-5709] [SQL] Add EXPLAIN support in Data...

2015-02-10 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/4496#issuecomment-73823591 mind rebasing quickly? we are going to cut a snapshot release soon. --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark pull request: [SPARK-5709] [SQL] Add EXPLAIN support in Data...

2015-02-10 Thread chenghao-intel
Github user chenghao-intel commented on the pull request: https://github.com/apache/spark/pull/4496#issuecomment-73823643 yes, I am working on it now. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: [SPARK-5709] [SQL] Add EXPLAIN support in Data...

2015-02-10 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/4496#discussion_r24470202 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/Column.scala --- @@ -600,6 +600,15 @@ trait Column extends DataFrame { def desc: Column =

[GitHub] spark pull request: [SPARK-5709] [SQL] Add EXPLAIN support in Data...

2015-02-10 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/4496#discussion_r24470189 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/Column.scala --- @@ -600,6 +600,15 @@ trait Column extends DataFrame { def desc: Column =

[GitHub] spark pull request: [SPARK-5683] [SQL] Avoid multiple json generat...

2015-02-10 Thread chenghao-intel
Github user chenghao-intel commented on the pull request: https://github.com/apache/spark/pull/4468#issuecomment-73823993 @marmbrus any more comment on this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SQL][Minor] correct some comments

2015-02-10 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4508#issuecomment-73824064 [Test build #27250 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/27250/consoleFull) for PR 4508 at commit

[GitHub] spark pull request: [SQL][DataFrame] Fix column computability bug.

2015-02-10 Thread rxin
GitHub user rxin opened a pull request: https://github.com/apache/spark/pull/4519 [SQL][DataFrame] Fix column computability bug. Do not recursively strip out projects. Only strip the first level project. ```scala df(colA) + df(colB).as(colC) ``` Previously,

[GitHub] spark pull request: [SPARK-5724] fix the misconfiguration in AkkaU...

2015-02-10 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4512#issuecomment-73825418 [Test build #27252 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/27252/consoleFull) for PR 4512 at commit

[GitHub] spark pull request: [SPARK-4879] Use driver to coordinate Hadoop o...

2015-02-10 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4066#issuecomment-73826010 [Test build #27264 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/27264/consoleFull) for PR 4066 at commit

[GitHub] spark pull request: [SPARK-4964] [Streaming] refactor createRDD to...

2015-02-10 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4511#issuecomment-73826099 [Test build #597 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/597/consoleFull) for PR 4511 at commit

[GitHub] spark pull request: [SPARK-5724] fix the misconfiguration in AkkaU...

2015-02-10 Thread ScrapCodes
Github user ScrapCodes commented on the pull request: https://github.com/apache/spark/pull/4512#issuecomment-73833260 Ahh looks like the threshold property is gone, I think the most appropriate solution is to provide empty implementation under this property `implementation-class =

[GitHub] spark pull request: [SPARK-5704] [SQL] [PySpark] createDataFrame f...

2015-02-10 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/4498#issuecomment-73821777 After talk to @yhuai offline, he suggested that we could hold on for Scala API for createDataFrame(rdd, columns), it's not so useful right now. We can revisit it later.

[GitHub] spark pull request: [SPARK-5704] [SQL] [PySpark] createDataFrame f...

2015-02-10 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4498#issuecomment-73821807 [Test build #27255 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/27255/consoleFull) for PR 4498 at commit

[GitHub] spark pull request: [SPARK-5683] [SQL] Avoid multiple json generat...

2015-02-10 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/4468#issuecomment-73824443 Thanks, merged to master and 1.3 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

  1   2   3   4   5   6   7   >