[GitHub] spark pull request: [SPARK-4879] [WIP] Use driver to coordinate Ha...

2015-02-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4066#issuecomment-72785067 [Test build #26712 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26712/consoleFull) for PR 4066 at commit

[GitHub] spark pull request: [SPARK-5582] [history] Ignore empty log direct...

2015-02-03 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/4352#issuecomment-72784977 Note: `getModificationTime` returning `Option[Long]` is not super pretty, but it avoids a second call to `fs.listStatus` to get rid of empty directories, thus avoiding

[GitHub] spark pull request: [SPARK-5582] [history] Ignore empty log direct...

2015-02-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4352#issuecomment-72785062 [Test build #26711 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26711/consoleFull) for PR 4352 at commit

[GitHub] spark pull request: [WIP] [SPARK-5577] Python udf for DataFrame

2015-02-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4351#issuecomment-72786425 [Test build #26705 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26705/consoleFull) for PR 4351 at commit

[GitHub] spark pull request: [WIP] [SPARK-5577] Python udf for DataFrame

2015-02-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4351#issuecomment-72786434 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-2788] [STREAMING] Add location filterin...

2015-02-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/1717#issuecomment-72789158 [Test build #26709 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26709/consoleFull) for PR 1717 at commit

[GitHub] spark pull request: [SPARK-2788] [STREAMING] Add location filterin...

2015-02-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/1717#issuecomment-72789165 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-5324][SQL] Results of describe can't be...

2015-02-03 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/4249#discussion_r24062294 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveQuerySuite.scala --- @@ -63,6 +63,37 @@ class HiveQuerySuite extends

[GitHub] spark pull request: [SPARK-5388] Provide a stable application subm...

2015-02-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4216#issuecomment-72791649 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-5135][SQL] Add support for describe tab...

2015-02-03 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/4227#issuecomment-72792300 @marmbrus this looks good to me. Any more comments? @OopsOutOfMemory would be great to bring this up to date with master. Thanks. --- If your project is set up

[GitHub] spark pull request: [SPARK-5583][SQL][WIP] Support unique join in ...

2015-02-03 Thread scwf
Github user scwf commented on the pull request: https://github.com/apache/spark/pull/4354#issuecomment-72792353 @rxin not sure for that, but here i just adapt it as filter + join in HiveQL.scala, no changes in catalyst and sql/core, maybe we can support it since it is at a small

[GitHub] spark pull request: [SPARK-4969][STREAMING][PYTHON] Add binaryReco...

2015-02-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3803#issuecomment-72793369 [Test build #26725 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26725/consoleFull) for PR 3803 at commit

[GitHub] spark pull request: [SPARK-5583][SQL][WIP] Support unique join in ...

2015-02-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4354#issuecomment-72794276 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-5583][SQL][WIP] Support unique join in ...

2015-02-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4354#issuecomment-72794269 [Test build #26721 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26721/consoleFull) for PR 4354 at commit

[GitHub] spark pull request: [SPARK-5579][SQL][DataFrame] Support for proje...

2015-02-03 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/4348#discussion_r24063848 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/DataFrameImpl.scala --- @@ -179,10 +179,20 @@ private[sql] class DataFrameImpl protected[sql](

[GitHub] spark pull request: [SPARK-4969][STREAMING][PYTHON] Add binaryReco...

2015-02-03 Thread freeman-lab
Github user freeman-lab commented on a diff in the pull request: https://github.com/apache/spark/pull/3803#discussion_r24064747 --- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala --- @@ -671,7 +674,11 @@ class SparkContext(config: SparkConf) extends Logging with

[GitHub] spark pull request: [Spark-3490] Disable SparkUI for tests (backpo...

2015-02-03 Thread tdas
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/3959#issuecomment-72797801 Whats the state of this PR? Is it still relevant? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-5498][SQL]fix bug when query the data w...

2015-02-03 Thread chenghao-intel
Github user chenghao-intel commented on a diff in the pull request: https://github.com/apache/spark/pull/4289#discussion_r24058262 --- Diff: sql/hive/v0.12.0/src/main/scala/org/apache/spark/sql/hive/Shim12.scala --- @@ -242,6 +242,11 @@ private[hive] object HiveShim { }

[GitHub] spark pull request: [SPARK-4943][SPARK-5251][SQL] Allow table name...

2015-02-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4062#issuecomment-72783174 [Test build #26708 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26708/consoleFull) for PR 4062 at commit

[GitHub] spark pull request: [SPARK-2827][GraphX]Add degree distribution op...

2015-02-03 Thread ankurdave
Github user ankurdave commented on the pull request: https://github.com/apache/spark/pull/1767#issuecomment-72783192 @maropu I'd like to merge this. It would be great if you could fix it up, maybe in a new PR. --- If your project is set up for it, you can reply to this email and

[GitHub] spark pull request: [SPARK-4943][SPARK-5251][SQL] Allow table name...

2015-02-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4062#issuecomment-72783177 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [WIP] [SPARK-4587] [mllib] ML model import/exp...

2015-02-03 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/4233#discussion_r24060903 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/classification/LogisticRegression.scala --- @@ -17,14 +17,17 @@ package

[GitHub] spark pull request: [SPARK-5578][SQL][DataFrame] Provide a conveni...

2015-02-03 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/4345#discussion_r24061664 --- Diff: mllib/src/main/scala/org/apache/spark/ml/classification/LogisticRegression.scala --- @@ -132,14 +132,14 @@ class LogisticRegressionModel private[ml]

[GitHub] spark pull request: [WIP] [SPARK-4587] [mllib] ML model import/exp...

2015-02-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4233#issuecomment-72787496 [Test build #26719 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26719/consoleFull) for PR 4233 at commit

[GitHub] spark pull request: [SPARK-5578][SQL][DataFrame] Provide a conveni...

2015-02-03 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/4345#discussion_r24061660 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/SQLQuerySuite.scala --- @@ -26,9 +27,8 @@ import org.apache.spark.sql.catalyst.errors.TreeNodeException

[GitHub] spark pull request: [WIP] [SPARK-4587] [mllib] ML model import/exp...

2015-02-03 Thread jkbradley
Github user jkbradley commented on the pull request: https://github.com/apache/spark/pull/4233#issuecomment-72787523 That last commit did significant re-organization and cleanups to address @mengxr 's comments. Hopefully good to go now! I won't put any more models in this PR. ---

[GitHub] spark pull request: [WIP] [SPARK-5577] Python udf for DataFrame

2015-02-03 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/4351#discussion_r24062243 --- Diff: python/pyspark/sql.py --- @@ -2263,18 +2263,6 @@ def subtract(self, other): return DataFrame(getattr(self._jdf,

[GitHub] spark pull request: [FIX][MLLIB] fix seed handling in Python GMM

2015-02-03 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/4349#issuecomment-72789630 Merged into master and branch-1.3. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: [SPARK-5582] [history] Ignore empty log direct...

2015-02-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4352#issuecomment-72790117 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-5367][SQL] Support star expression in u...

2015-02-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4353#issuecomment-72790907 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-5367][SQL] Support star expression in u...

2015-02-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4353#issuecomment-72790902 [Test build #26714 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26714/consoleFull) for PR 4353 at commit

[GitHub] spark pull request: [SPARK-5583][SQL][WIP] Support unique join in ...

2015-02-03 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/4354#issuecomment-72790981 Is this actually used by anybody? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SQL] Use HiveContext's sessionState in HiveMe...

2015-02-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4355#issuecomment-72795703 [Test build #26724 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26724/consoleFull) for PR 4355 at commit

[GitHub] spark pull request: [SQL] Use HiveContext's sessionState in HiveMe...

2015-02-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4355#issuecomment-72795711 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-5579][SQL][DataFrame] Support for proje...

2015-02-03 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/4348#discussion_r24064580 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/DataFrameImpl.scala --- @@ -179,10 +179,20 @@ private[sql] class DataFrameImpl protected[sql](

[GitHub] spark pull request: [SPARK-5579][SQL][DataFrame] Support for proje...

2015-02-03 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/4348#issuecomment-72796555 We can discuss more offline. For now let's keep this separate, otherwise it can be fairly annoying to use column names that contain space or column names that contain any

[GitHub] spark pull request: [SPARK-5526][SQL] fix issue about cast to date

2015-02-03 Thread viper-kun
Github user viper-kun commented on the pull request: https://github.com/apache/spark/pull/4307#issuecomment-72777528 Thanks, the issue is fixed by #4325. I will close this pr. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark pull request: [WIP] [SPARK-5577] Python udf for DataFrame

2015-02-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4351#issuecomment-72777617 [Test build #26705 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26705/consoleFull) for PR 4351 at commit

[GitHub] spark pull request: [SPARK-5578][SQL][DataFrame] Provide a conveni...

2015-02-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4345#issuecomment-72781877 [Test build #26698 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26698/consoleFull) for PR 4345 at commit

[GitHub] spark pull request: [SPARK-4879] [WIP] Use driver to coordinate Ha...

2015-02-03 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/4066#issuecomment-72783048 One approach would be to have non-authorized committers block in the `canCommit` call until the master knows whether the authorized commit has succeeded. In these

[GitHub] spark pull request: [SPARK-4943][SPARK-5251][SQL] Allow table name...

2015-02-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4062#issuecomment-72783101 [Test build #26708 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26708/consoleFull) for PR 4062 at commit

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-02-03 Thread koeninger
Github user koeninger commented on the pull request: https://github.com/apache/spark/pull/3798#issuecomment-72783141 Yeah, more importantly it's so defaults for things like connection timeouts match what kafka provides. It's possible to assign fake zookeeper.connect and

[GitHub] spark pull request: [SPARK-4939] revive offers periodically in Loc...

2015-02-03 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/4147#issuecomment-72783843 @kayousterhout sure - that seems fine to me! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-2788] [STREAMING] Add location filterin...

2015-02-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/1717#issuecomment-72783897 [Test build #26709 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26709/consoleFull) for PR 1717 at commit

[GitHub] spark pull request: [SPARK-5388] Provide a stable application subm...

2015-02-03 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/4216#issuecomment-72788602 Thanks everyone for your comments. It seems that the main common concern is that this protocol does not follow conventions expected in other REST protocols. As of the

[GitHub] spark pull request: [SPARK-4939] revive offers periodically in Loc...

2015-02-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4147#issuecomment-72775964 [Test build #576 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/576/consoleFull) for PR 4147 at commit

[GitHub] spark pull request: [SPARK-4939] revive offers periodically in Loc...

2015-02-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4147#issuecomment-72776322 [Test build #26702 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26702/consoleFull) for PR 4147 at commit

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-02-03 Thread tdas
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/3798#issuecomment-72779120 Hey Cody, I was trying it and I found a odd behavior. It was printing this repeatedly. ``` 15/02/03 18:22:08 WARN VerifiableProperties: Property

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-02-03 Thread tdas
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/3798#issuecomment-72782434 I see. ConsumerConfig is really necessary only for high-level consumer, but you are using it configure stuff in the low level consumer as well. That is so that you dont

[GitHub] spark pull request: [SPARK-4795][Core] Redesign the primitive typ...

2015-02-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3642#issuecomment-72783414 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-5527] Improvements to standalone doc -e...

2015-02-03 Thread lazyman500
Github user lazyman500 commented on a diff in the pull request: https://github.com/apache/spark/pull/4310#discussion_r24060365 --- Diff: docs/spark-standalone.md --- @@ -93,6 +93,10 @@ You can optionally configure the cluster further by setting environment variable table

[GitHub] spark pull request: [SPARK-4707][STREAMING] Reliable Kafka Receive...

2015-02-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3655#issuecomment-72784691 [Test build #26710 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26710/consoleFull) for PR 3655 at commit

[GitHub] spark pull request: [SPARK-5367][SQL] Support star expression in u...

2015-02-03 Thread scwf
GitHub user scwf opened a pull request: https://github.com/apache/spark/pull/4353 [SPARK-5367][SQL] Support star expression in udfs A follow up for #4163: support select array(key, *) from src Since array(key, *) will not go into this case ``` case Alias(f @

[GitHub] spark pull request: [SPARK-4969][STREAMING][PYTHON] Add binaryReco...

2015-02-03 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/3803#discussion_r24061094 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/api/java/JavaStreamingContext.scala --- @@ -210,6 +211,20 @@ class JavaStreamingContext(val ssc:

[GitHub] spark pull request: [SPARK-5367][SQL] Support star expression in u...

2015-02-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4353#issuecomment-72785853 [Test build #26714 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26714/consoleFull) for PR 4353 at commit

[GitHub] spark pull request: [SPARK-4969][STREAMING][PYTHON] Add binaryReco...

2015-02-03 Thread tdas
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/3803#issuecomment-72785812 LGTM. Just two minor nits. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-5583][SQL][WIP] Support unique join in ...

2015-02-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4354#issuecomment-72787877 [Test build #26720 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26720/consoleFull) for PR 4354 at commit

[GitHub] spark pull request: [SPARK-5583][SQL][WIP] Support unique join in ...

2015-02-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4354#issuecomment-72787879 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-5583][SQL][WIP] Support unique join in ...

2015-02-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4354#issuecomment-72787822 [Test build #26720 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26720/consoleFull) for PR 4354 at commit

[GitHub] spark pull request: [SPARK-5579][SQL][DataFrame] Support for proje...

2015-02-03 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/4348#discussion_r24062195 --- Diff: python/pyspark/sql.py --- @@ -2126,10 +2126,9 @@ def sort(self, *cols): if not cols: raise

[GitHub] spark pull request: [SPARK-5583][SQL][WIP] Support unique join in ...

2015-02-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4354#issuecomment-72788828 [Test build #26722 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26722/consoleFull) for PR 4354 at commit

[GitHub] spark pull request: [SPARK-4587] [mllib] ML model import/export

2015-02-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4233#issuecomment-72792829 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4587] [mllib] ML model import/export

2015-02-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4233#issuecomment-72792822 [Test build #26719 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26719/consoleFull) for PR 4233 at commit

[GitHub] spark pull request: [SPARK-5583][SQL][WIP] Support unique join in ...

2015-02-03 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/4354#issuecomment-72794392 Yea in that case maybe let's not support it. It's hard for me to imagine somebody using this :) Thanks a lot for investigating this though. We can merge this patch

[GitHub] spark pull request: [SPARK-5583][SQL][WIP] Support unique join in ...

2015-02-03 Thread scwf
Github user scwf commented on the pull request: https://github.com/apache/spark/pull/4354#issuecomment-72796072 ok, i am closing this. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-5583][SQL][WIP] Support unique join in ...

2015-02-03 Thread scwf
Github user scwf closed the pull request at: https://github.com/apache/spark/pull/4354 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-4939] move to next locality when no pen...

2015-02-03 Thread markhamstra
Github user markhamstra commented on a diff in the pull request: https://github.com/apache/spark/pull/3779#discussion_r24066157 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskSetManager.scala --- @@ -506,13 +506,59 @@ private[spark] class TaskSetManager( *

[GitHub] spark pull request: [STREAMING] SPARK-3505: Augmenting SparkStream...

2015-02-03 Thread xiliu82
Github user xiliu82 closed the pull request at: https://github.com/apache/spark/pull/2267 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-5379][Streaming] Add awaitTerminationOr...

2015-02-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4171#issuecomment-72803094 [Test build #26726 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26726/consoleFull) for PR 4171 at commit

[GitHub] spark pull request: [SPARK-5379][Streaming] Add awaitTerminationOr...

2015-02-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4171#issuecomment-72803099 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-5574] use given name prefix in dir

2015-02-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4344#issuecomment-72805078 [Test build #26728 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26728/consoleFull) for PR 4344 at commit

[GitHub] spark pull request: [SPARK-4939] move to next locality when no pen...

2015-02-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3779#issuecomment-72805131 [Test build #26733 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26733/consoleFull) for PR 3779 at commit

[GitHub] spark pull request: [SPARK-5574] use given name prefix in dir

2015-02-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4344#issuecomment-72805081 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4939] move to next locality when no pen...

2015-02-03 Thread kayousterhout
Github user kayousterhout commented on a diff in the pull request: https://github.com/apache/spark/pull/3779#discussion_r24065322 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskSetManager.scala --- @@ -506,13 +506,59 @@ private[spark] class TaskSetManager( *

[GitHub] spark pull request: [SPARK-5577] Python udf for DataFrame

2015-02-03 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/4351#discussion_r24065334 --- Diff: python/pyspark/sql.py --- @@ -2263,18 +2263,6 @@ def subtract(self, other): return DataFrame(getattr(self._jdf,

[GitHub] spark pull request: [SPARK-5341] Use maven coordinates as dependen...

2015-02-03 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/4215#issuecomment-72798586 I merged this - thanks Burak! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-4939] move to next locality when no pen...

2015-02-03 Thread kayousterhout
Github user kayousterhout commented on a diff in the pull request: https://github.com/apache/spark/pull/3779#discussion_r24065269 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskSetManager.scala --- @@ -506,13 +506,59 @@ private[spark] class TaskSetManager( *

[GitHub] spark pull request: [SPARK-4969][STREAMING][PYTHON] Add binaryReco...

2015-02-03 Thread tdas
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/3803#issuecomment-72800036 Thanks Jeremy! Good clean patch! On Feb 3, 2015 10:45 PM, UCB AMPLab notificati...@github.com wrote: Test PASSed. Refer to this link for build results

[GitHub] spark pull request: [SPARK-4939] move to next locality when no pen...

2015-02-03 Thread kayousterhout
Github user kayousterhout commented on a diff in the pull request: https://github.com/apache/spark/pull/3779#discussion_r24065817 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskSetManager.scala --- @@ -506,13 +506,59 @@ private[spark] class TaskSetManager( *

[GitHub] spark pull request: [SPARK-4939] move to next locality when no pen...

2015-02-03 Thread markhamstra
Github user markhamstra commented on a diff in the pull request: https://github.com/apache/spark/pull/3779#discussion_r24066349 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskSetManager.scala --- @@ -506,13 +506,59 @@ private[spark] class TaskSetManager( *

[GitHub] spark pull request: [SPARK-5585] Flaky test in MLlib python

2015-02-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4358#issuecomment-72801980 [Test build #26731 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26731/consoleFull) for PR 4358 at commit

[GitHub] spark pull request: [SPARK-5585] Flaky test in MLlib python

2015-02-03 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/4358#issuecomment-72803705 LGTM pending Jenkins. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-5068] [SQL] Fix bug query data when pat...

2015-02-03 Thread chenghao-intel
GitHub user chenghao-intel opened a pull request: https://github.com/apache/spark/pull/4356 [SPARK-5068] [SQL] Fix bug query data when path doesn't exist for HiveContext This is a follow up for #3907 #3891 . Hive actually support the not existed path(either table or

[GitHub] spark pull request: SPARK-5548: Fixed a race condition in AkkaUtil...

2015-02-03 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/4343#issuecomment-72798850 @jacek-lewandowski how about just catching either exception? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark pull request: [SPARK-5574] use given name prefix in dir

2015-02-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4344#issuecomment-72798856 [Test build #26728 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26728/consoleFull) for PR 4344 at commit

[GitHub] spark pull request: [SPARK-5577] Python udf for DataFrame

2015-02-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4351#issuecomment-72798853 [Test build #26727 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26727/consoleFull) for PR 4351 at commit

[GitHub] spark pull request: [SQL][SPARK-5587] Support change database owne...

2015-02-03 Thread scwf
GitHub user scwf opened a pull request: https://github.com/apache/spark/pull/4357 [SQL][SPARK-5587] Support change database owner Support change database owner, here i do not add the golden files since the golden answer is related to the tmp dir path

[GitHub] spark pull request: [SPARK-4939] move to next locality when no pen...

2015-02-03 Thread kayousterhout
Github user kayousterhout commented on a diff in the pull request: https://github.com/apache/spark/pull/3779#discussion_r24065900 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskSetManager.scala --- @@ -506,13 +506,59 @@ private[spark] class TaskSetManager( *

[GitHub] spark pull request: [SPARK-5585] Flaky test in MLlib python

2015-02-03 Thread davies
GitHub user davies opened a pull request: https://github.com/apache/spark/pull/4358 [SPARK-5585] Flaky test in MLlib python Add a seed for tests. You can merge this pull request into a Git repository by running: $ git pull https://github.com/davies/spark flaky_test

[GitHub] spark pull request: [SPARK-2827][GraphX]Add degree distribution op...

2015-02-03 Thread maropu
Github user maropu commented on the pull request: https://github.com/apache/spark/pull/1767#issuecomment-72804365 Ok, I'll take it. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-4939] move to next locality when no pen...

2015-02-03 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/3779#discussion_r24065627 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskSetManager.scala --- @@ -506,13 +506,59 @@ private[spark] class TaskSetManager( * Get the

[GitHub] spark pull request: [SPARK-4939] move to next locality when no pen...

2015-02-03 Thread markhamstra
Github user markhamstra commented on a diff in the pull request: https://github.com/apache/spark/pull/3779#discussion_r24066137 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskSetManager.scala --- @@ -506,13 +506,59 @@ private[spark] class TaskSetManager( *

[GitHub] spark pull request: [SPARK-4939] move to next locality when no pen...

2015-02-03 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/3779#discussion_r24067496 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskSetManager.scala --- @@ -506,13 +506,63 @@ private[spark] class TaskSetManager( * Get the

[GitHub] spark pull request: [SPARK-4969][STREAMING][PYTHON] Add binaryReco...

2015-02-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3803#issuecomment-72799040 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4939] move to next locality when no pen...

2015-02-03 Thread kayousterhout
Github user kayousterhout commented on a diff in the pull request: https://github.com/apache/spark/pull/3779#discussion_r24065873 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskSetManager.scala --- @@ -506,13 +506,59 @@ private[spark] class TaskSetManager( *

[GitHub] spark pull request: [SPARK-4939] move to next locality when no pen...

2015-02-03 Thread markhamstra
Github user markhamstra commented on a diff in the pull request: https://github.com/apache/spark/pull/3779#discussion_r24066698 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskSetManager.scala --- @@ -506,13 +506,59 @@ private[spark] class TaskSetManager( *

[GitHub] spark pull request: [SPARK-4969][STREAMING][PYTHON] Add binaryReco...

2015-02-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/3803 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [FIX][MLLIB] fix seed handling in Python GMM

2015-02-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/4349 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-5579][SQL][DataFrame] Support for proje...

2015-02-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/4348 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-5341] Use maven coordinates as dependen...

2015-02-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/4215 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

<    1   2   3   4   5   6   7   >