[GitHub] spark pull request: [SPARK-7163] [SQL] minor refactory for HiveQl

2015-04-27 Thread scwf
Github user scwf commented on a diff in the pull request: https://github.com/apache/spark/pull/5715#discussion_r29126734 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveContext.scala --- @@ -81,11 +81,38 @@ class HiveContext(sc: SparkContext) extends

[GitHub] spark pull request: [SPARK-6435] spark-shell --jars option does no...

2015-04-27 Thread tsudukim
Github user tsudukim commented on a diff in the pull request: https://github.com/apache/spark/pull/5227#discussion_r29132469 --- Diff: launcher/src/main/java/org/apache/spark/launcher/CommandBuilderUtils.java --- @@ -260,15 +260,14 @@ static String quoteForBatchScript(String arg)

[GitHub] spark pull request: [SPARK-1406] Mllib pmml model export

2015-04-27 Thread selvinsource
Github user selvinsource commented on the pull request: https://github.com/apache/spark/pull/3062#issuecomment-96516889 @mengxr for SVM, I manually tried what you suggested and it looks good. I loaded the example below in JPMML and evaluated it as Classification map, indeed

[GitHub] spark pull request: [SQL][Minor] fix java doc for DataFrame.agg

2015-04-27 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/5712#issuecomment-96516809 Jenkins, test this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: SPARK-1556: bump jets3t version to 0.9.0

2015-04-27 Thread mag-
Github user mag- commented on the pull request: https://github.com/apache/spark/pull/468#issuecomment-96587264 Are you aware that all this regexp hacks will break when hadoop changes version to 3.0.0? --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark pull request: [SPARK-7165] [SQL] use sort merge join for out...

2015-04-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5717#issuecomment-96597976 [Test build #30964 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30964/consoleFull) for PR 5717 at commit

[GitHub] spark pull request: [SPARK-5946][Streaming] Add Python API for dir...

2015-04-27 Thread jerryshao
Github user jerryshao commented on the pull request: https://github.com/apache/spark/pull/4723#issuecomment-96580759 Hi @davies and @tdas , I met a problem of converting Python `int` into Java `Long`, the Java API in KafkaUtils requires offset as `Long` type, this is simple for

[GitHub] spark pull request: Add filter by location boundingbox in TwitterI...

2015-04-27 Thread yang0228
GitHub user yang0228 opened a pull request: https://github.com/apache/spark/pull/5718 Add filter by location boundingbox in TwitterInputDStream.scala Current TwitterInputDStream only filters by keywords. Need a filtering by location feature. You can merge this pull request into

[GitHub] spark pull request: [SPARK-6435] spark-shell --jars option does no...

2015-04-27 Thread tsudukim
Github user tsudukim commented on the pull request: https://github.com/apache/spark/pull/5227#issuecomment-96598393 The problem I mentioned was that the spark-shell.cmd which is called by `SparkLauncherSuite` somehow failed to launch test application. It turned out to be caused by

[GitHub] spark pull request: SPARK-1556: bump jets3t version to 0.9.0

2015-04-27 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/468#issuecomment-96611185 @mag- if you're talking about what I think you are, it was a temporary thing that's long since gone already https://github.com/apache/spark/pull/629/files --- If your

[GitHub] spark pull request: [SPARK-7165] [SQL] use sort merge join for out...

2015-04-27 Thread adrian-wang
GitHub user adrian-wang opened a pull request: https://github.com/apache/spark/pull/5717 [SPARK-7165] [SQL] use sort merge join for outer join This is an extended version of #5208 In this patch, we are introducing sort merge join for not only inner joins, but left outer/ right

[GitHub] spark pull request: [SPARK-7163] [SQL] minor refactory for HiveQl

2015-04-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5715#issuecomment-96597552 [Test build #30962 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30962/consoleFull) for PR 5715 at commit

[GitHub] spark pull request: [SPARK-7162][YARN]Launcher error in yarn-clien...

2015-04-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5716#issuecomment-96597549 [Test build #30961 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30961/consoleFull) for PR 5716 at commit

[GitHub] spark pull request: [SPARK-7162][YARN]Launcher error in yarn-clien...

2015-04-27 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/5716#issuecomment-96613653 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request: SPARK-7107 Add parameter for zookeeper.znode.p...

2015-04-27 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/5673#issuecomment-96792683 Jenkins, test this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-7174][Core] Move calling `TaskScheduler...

2015-04-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5723#issuecomment-96798651 [Test build #31067 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31067/consoleFull) for PR 5723 at commit

[GitHub] spark pull request: [SPARK-6229] Add SASL encryption to network li...

2015-04-27 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/5377#discussion_r29190170 --- Diff: network/common/src/main/java/org/apache/spark/network/sasl/SaslEncryption.java --- @@ -0,0 +1,260 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-6856] [R] Make RDD information more use...

2015-04-27 Thread His-name-is-Joof
Github user His-name-is-Joof commented on the pull request: https://github.com/apache/spark/pull/5667#issuecomment-96819726 Joof On Apr 27, 2015 2:41 PM, Shivaram Venkataraman notificati...@github.com wrote: @His-name-is-Joof https://github.com/His-name-is-Joof --

[GitHub] spark pull request: [SPARK-5342][YARN] Allow long running Spark ap...

2015-04-27 Thread tgravescs
Github user tgravescs commented on the pull request: https://github.com/apache/spark/pull/4688#issuecomment-96819919 @harishreedharan , fyi - we are doing a feature code freeze for spark 1.4 this friday. I think this is really close so hopefully we can get it in. Let me know if

[GitHub] spark pull request: [SPARK-7175] Upgrade to Hive 1.1.0

2015-04-27 Thread punya
Github user punya commented on the pull request: https://github.com/apache/spark/pull/5726#issuecomment-96794273 @srowen I'm sure it will :) I was using the PR to get Jenkins to figure out what tests actually break. At that point, I'll add [WIP] to the title and see if I can fix the

[GitHub] spark pull request: [SPARK-5891][ML] Add Binarizer ML Transformer

2015-04-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5699#issuecomment-96797201 [Test build #30972 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30972/consoleFull) for PR 5699 at commit

[GitHub] spark pull request: [SPARK-7175] Upgrade to Hive 1.1.0

2015-04-27 Thread punya
Github user punya closed the pull request at: https://github.com/apache/spark/pull/5726 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-6030][CORE] Using simulated field layou...

2015-04-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4783#issuecomment-96800849 [Test build #31061 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31061/consoleFull) for PR 4783 at commit

[GitHub] spark pull request: [SPARK-6422][STREAMING] support customized act...

2015-04-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5098#issuecomment-96804955 [Test build #31049 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31049/consoleFull) for PR 5098 at commit

[GitHub] spark pull request: [Build] Enable MiMa checks for launcher and sq...

2015-04-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5727#issuecomment-96813165 [Test build #722 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/722/consoleFull) for PR 5727 at commit

[GitHub] spark pull request: [SPARK-6856] [R] Make RDD information more use...

2015-04-27 Thread shivaram
Github user shivaram commented on the pull request: https://github.com/apache/spark/pull/5667#issuecomment-96813694 @His-name-is-Joof -- Could you let me know what your JIRA username is ? I would like to assign this issue to your --- If your project is set up for it, you can reply

[GitHub] spark pull request: [SPARK-7100][MLLib] Fix persisted RDD leak in ...

2015-04-27 Thread jkbradley
Github user jkbradley commented on the pull request: https://github.com/apache/spark/pull/5669#issuecomment-96816164 After discussing with @mengxr I think we should not bother with the try-finally wrapper. As mentioned above, the method should generally not fail, so the data will be

[GitHub] spark pull request: [Build] Enable MiMa checks for launcher and sq...

2015-04-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5727#issuecomment-96816185 [Test build #31068 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31068/consoleFull) for PR 5727 at commit

[GitHub] spark pull request: [SPARK-6991] [SparkR] Adds support for zipPart...

2015-04-27 Thread shivaram
Github user shivaram commented on the pull request: https://github.com/apache/spark/pull/5568#issuecomment-96816065 Thanks @concretevitamin for the review. Will merge this after Jenkins passes --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request: SPARK-4550. In sort-based shuffle, store map o...

2015-04-27 Thread sryza
Github user sryza commented on a diff in the pull request: https://github.com/apache/spark/pull/4450#discussion_r29190908 --- Diff: core/src/main/scala/org/apache/spark/util/collection/ChainedBuffer.scala --- @@ -0,0 +1,134 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: SPARK-7107 Add parameter for zookeeper.znode.p...

2015-04-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5673#issuecomment-96828599 [Test build #31066 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31066/consoleFull) for PR 5673 at commit

[GitHub] spark pull request: SPARK-7107 Add parameter for zookeeper.znode.p...

2015-04-27 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/5673 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-7175] Upgrade to Hive 1.1.0

2015-04-27 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/5726#issuecomment-96791158 ... I doubt this passes tests. The problem is that you break compatibility with old versions of Hive; it's not this simple. --- If your project is set up for it, you can

[GitHub] spark pull request: [SPARK-7175] Upgrade to Hive 1.1.0

2015-04-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5726#issuecomment-96794694 [Test build #31064 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31064/consoleFull) for PR 5726 at commit

[GitHub] spark pull request: [SPARK-6746B] Refactor large functions in DAGS...

2015-04-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5396#issuecomment-96797161 [Test build #31024 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31024/consoleFull) for PR 5396 at commit

[GitHub] spark pull request: [SPARK-6856] [R] Make RDD information more use...

2015-04-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5667#issuecomment-96800371 [Test build #31060 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31060/consoleFull) for PR 5667 at commit

[GitHub] spark pull request: [SPARK-6806] [SparkR] [Docs] Fill in SparkR ex...

2015-04-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5442#issuecomment-96811042 **[Test build #31015 timed out](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31015/consoleFull)** for PR 5442 at commit

[GitHub] spark pull request: [Build] Enable MiMa checks for launcher and sq...

2015-04-27 Thread JoshRosen
GitHub user JoshRosen opened a pull request: https://github.com/apache/spark/pull/5727 [Build] Enable MiMa checks for launcher and sql projects Now that 1.3 has been released, we should enable MiMa checks for the `sql` and `launcher` subprojects. You can merge this pull request

[GitHub] spark pull request: Spark-5854 personalized page rank

2015-04-27 Thread dwmclary
Github user dwmclary commented on the pull request: https://github.com/apache/spark/pull/4774#issuecomment-96816965 @jegonzal does this algorithm look correct to you? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: [SPARK-7007][core] Add a metric source for Exe...

2015-04-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5589#issuecomment-96819141 [Test build #30999 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30999/consoleFull) for PR 5589 at commit

[GitHub] spark pull request: [SPARK-2691][Mesos] Support for Mesos DockerIn...

2015-04-27 Thread doctapp
Github user doctapp commented on the pull request: https://github.com/apache/spark/pull/3074#issuecomment-96791733 @hellertime thanks for the info, didn't catch this wasn't pre-installed with mesos. --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark pull request: [SPARK-6229] Add SASL encryption to network li...

2015-04-27 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/5377#discussion_r29188459 --- Diff: network/common/src/main/java/org/apache/spark/network/sasl/SaslEncryption.java --- @@ -0,0 +1,260 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-6856] [R] Make RDD information more use...

2015-04-27 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/5667 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [Build] Enable MiMa checks for launcher and sq...

2015-04-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5727#issuecomment-96813311 [Test build #31068 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31068/consoleFull) for PR 5727 at commit

[GitHub] spark pull request: [SPARK-6991] [SparkR] Adds support for zipPart...

2015-04-27 Thread concretevitamin
Github user concretevitamin commented on the pull request: https://github.com/apache/spark/pull/5568#issuecomment-96814334 LGTM. /cc @shivaram --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-7076][SPARK-7077][SPARK-7080][SQL] Use ...

2015-04-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5725#issuecomment-96814367 [Test build #31069 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31069/consoleFull) for PR 5725 at commit

[GitHub] spark pull request: [SPARK-6229] Add SASL encryption to network li...

2015-04-27 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/5377#discussion_r29190765 --- Diff: network/common/src/main/java/org/apache/spark/network/sasl/SparkSaslServer.java --- @@ -60,13 +60,19 @@ static final String DIGEST =

[GitHub] spark pull request: [SPARK-5342][YARN] Allow long running Spark ap...

2015-04-27 Thread harishreedharan
Github user harishreedharan commented on the pull request: https://github.com/apache/spark/pull/4688#issuecomment-96824485 I am testing the changes right now. I will update this PR soon. Thanks @tgravescs! --- If your project is set up for it, you can reply to this email and have

[GitHub] spark pull request: SPARK-4550. In sort-based shuffle, store map o...

2015-04-27 Thread sryza
Github user sryza commented on a diff in the pull request: https://github.com/apache/spark/pull/4450#discussion_r29192947 --- Diff: core/src/main/scala/org/apache/spark/util/collection/WritablePartitionedPairCollection.scala --- @@ -0,0 +1,117 @@ +/* + * Licensed to the

[GitHub] spark pull request: [SPARK-7017][Build][Project Infra]: Refactor d...

2015-04-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5694#issuecomment-96828951 [Test build #31071 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31071/consoleFull) for PR 5694 at commit

[GitHub] spark pull request: [SPARK-6229] Add SASL encryption to network li...

2015-04-27 Thread aarondav
Github user aarondav commented on a diff in the pull request: https://github.com/apache/spark/pull/5377#discussion_r29195262 --- Diff: network/common/src/main/java/org/apache/spark/network/sasl/SaslEncryption.java --- @@ -0,0 +1,260 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-6612] [MLLib] [PySpark] Python KMeans p...

2015-04-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5647#issuecomment-96792936 [Test build #30986 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30986/consoleFull) for PR 5647 at commit

[GitHub] spark pull request: SPARK-7107 Add parameter for zookeeper.znode.p...

2015-04-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5673#issuecomment-96792973 [Test build #31066 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31066/consoleFull) for PR 5673 at commit

[GitHub] spark pull request: [SPARK-6775] [SPARK-6776] [SQL] [WIP] Refactor...

2015-04-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5422#issuecomment-96801888 [Test build #31021 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31021/consoleFull) for PR 5422 at commit

[GitHub] spark pull request: [SPARK-7138][Streaming] Add method to BlockGen...

2015-04-27 Thread tdas
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/5695#issuecomment-96808771 @huitseeker Yes, I want to use the existing rate limiter interface. So that any sort of rate controlling in the future can be applied through that interface. --- If your

[GitHub] spark pull request: [SPARK-6229] Add SASL encryption to network li...

2015-04-27 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/5377#discussion_r29189853 --- Diff: network/common/src/main/java/org/apache/spark/network/sasl/SaslEncryption.java --- @@ -0,0 +1,260 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [Build] Enable MiMa checks for launcher and sq...

2015-04-27 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/5727#issuecomment-96816752 It looks like SQL failed 11 MiMa checks, although it looks like all of them are in test code or internal APIs (so we can just double-check, then add the proper

[GitHub] spark pull request: [SPARK-7100][MLLib] Fix persisted RDD leak in ...

2015-04-27 Thread jimfcarroll
Github user jimfcarroll commented on the pull request: https://github.com/apache/spark/pull/5669#issuecomment-96816661 Your project. I'll downgrade it if you want. :-) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: [SPARK-7056][Streaming] Make the Write Ahead L...

2015-04-27 Thread helena
Github user helena commented on a diff in the pull request: https://github.com/apache/spark/pull/5645#discussion_r29194115 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/rdd/WriteAheadLogBackedBlockRDD.scala --- @@ -96,9 +99,27 @@ class

[GitHub] spark pull request: [SPARK-6991] [SparkR] Adds support for zipPart...

2015-04-27 Thread shivaram
Github user shivaram commented on the pull request: https://github.com/apache/spark/pull/5568#issuecomment-96830292 Hmm this is weird - somehow the test results for this PR were never posted to github.

[GitHub] spark pull request: [SPARK-6829] Added math functions for DataFram...

2015-04-27 Thread brkyvz
Github user brkyvz commented on a diff in the pull request: https://github.com/apache/spark/pull/5616#discussion_r29195806 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/mathfunctions.scala --- @@ -0,0 +1,215 @@ +/* + * Licensed to the

[GitHub] spark pull request: [SPARK-2691][Mesos] Support for Mesos DockerIn...

2015-04-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3074#issuecomment-96795918 [Test build #721 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/721/consoleFull) for PR 3074 at commit

[GitHub] spark pull request: [SPARK-5945] Spark should not retry a stage in...

2015-04-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5636#issuecomment-96795847 [Test build #30990 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30990/consoleFull) for PR 5636 at commit

[GitHub] spark pull request: [SPARK-3454] [WIP] separate json endpoints for...

2015-04-27 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/4435#discussion_r29190417 --- Diff: core/src/main/scala/org/apache/spark/status/api/v1/api.scala --- @@ -0,0 +1,253 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] spark pull request: [SPARK-7175] Upgrade to Hive 1.1.0

2015-04-27 Thread punya
Github user punya commented on the pull request: https://github.com/apache/spark/pull/5726#issuecomment-96796911 Closing in favor of work on https://issues.apache.org/jira/browse/SPARK-6906. --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] spark pull request: [ML] SPARK-2426: Integrate Breeze NNLS with ML...

2015-04-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5005#issuecomment-96807849 **[Test build #31054 timed out](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31054/consoleFull)** for PR 5005 at commit

[GitHub] spark pull request: [SPARK-6030][CORE] Using simulated field layou...

2015-04-27 Thread shivaram
Github user shivaram commented on the pull request: https://github.com/apache/spark/pull/4783#issuecomment-96815195 Thanks @advancedxy for fixing the tests. This change LGTM. @rxin @srowen Could you also take a final look at this ? --- If your project is set up for it, you can reply

[GitHub] spark pull request: [Build] Enable MiMa checks for launcher and sq...

2015-04-27 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/5727#issuecomment-96817556 Ah, `launcher` was only added in 1.4, so I'll put the MiMa exclude back. --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] spark pull request: SPARK-4550. In sort-based shuffle, store map o...

2015-04-27 Thread sryza
Github user sryza commented on a diff in the pull request: https://github.com/apache/spark/pull/4450#discussion_r29191148 --- Diff: core/src/main/scala/org/apache/spark/util/collection/ExternalSorter.scala --- @@ -740,15 +723,29 @@ private[spark] class ExternalSorter[K, V, C](

[GitHub] spark pull request: [SPARK-7168] [BUILD] Update plugin versions in...

2015-04-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5720#issuecomment-96826279 [Test build #31063 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31063/consoleFull) for PR 5720 at commit

[GitHub] spark pull request: SPARK-7107 Add parameter for zookeeper.znode.p...

2015-04-27 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/5673#issuecomment-96829768 Thanks. Merging in master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-3454] [WIP] separate json endpoints for...

2015-04-27 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/4435#discussion_r29183894 --- Diff: core/src/main/java/org/apache/spark/status/api/v1/TaskSorting.java --- @@ -0,0 +1,45 @@ +package org.apache.spark.status.api.v1;/* + *

[GitHub] spark pull request: [SPARK-7120][SPARK-7121] Closure cleaner nesti...

2015-04-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5685#issuecomment-96796263 [Test build #30977 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30977/consoleFull) for PR 5685 at commit

[GitHub] spark pull request: SPARK-4550. In sort-based shuffle, store map o...

2015-04-27 Thread sryza
Github user sryza commented on a diff in the pull request: https://github.com/apache/spark/pull/4450#discussion_r29191682 --- Diff: core/src/main/scala/org/apache/spark/util/collection/PartitionedSerializedPairBuffer.scala --- @@ -0,0 +1,254 @@ +/* + * Licensed to the

[GitHub] spark pull request: [SPARK-6862][Streaming][WebUI] Add BatchPage t...

2015-04-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5473#issuecomment-96827274 [Test build #31070 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31070/consoleFull) for PR 5473 at commit

[GitHub] spark pull request: [SPARK-7056][Streaming] Make the Write Ahead L...

2015-04-27 Thread helena
Github user helena commented on a diff in the pull request: https://github.com/apache/spark/pull/5645#discussion_r29194436 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/rdd/WriteAheadLogBackedBlockRDD.scala --- @@ -96,9 +99,27 @@ class

[GitHub] spark pull request: add support for zipping a sequence of RDDs

2015-04-27 Thread mohitjaggi
Github user mohitjaggi commented on the pull request: https://github.com/apache/spark/pull/2429#issuecomment-96791360 closing on sean's request. i have a workaround. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: add support for zipping a sequence of RDDs

2015-04-27 Thread mohitjaggi
Github user mohitjaggi closed the pull request at: https://github.com/apache/spark/pull/2429 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-7009] repackaging spark assembly jar wi...

2015-04-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5637#issuecomment-96796679 [Test build #30989 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30989/consoleFull) for PR 5637 at commit

[GitHub] spark pull request: [SPARK-6856] [R] Make RDD information more use...

2015-04-27 Thread shivaram
Github user shivaram commented on the pull request: https://github.com/apache/spark/pull/5667#issuecomment-96820582 @srowen Could you add Joof as a contributor on our JIRA ? The assignee auto-complete doesn't seem to pick this up right now --- If your project is set up for it, you

[GitHub] spark pull request: SPARK-4550. In sort-based shuffle, store map o...

2015-04-27 Thread sryza
Github user sryza commented on a diff in the pull request: https://github.com/apache/spark/pull/4450#discussion_r29193245 --- Diff: core/src/main/scala/org/apache/spark/util/collection/WritablePartitionedPairCollection.scala --- @@ -0,0 +1,117 @@ +/* + * Licensed to the

[GitHub] spark pull request: [SPARK-7017][Build][Project Infra]: Refactor d...

2015-04-27 Thread brennonyork
Github user brennonyork commented on the pull request: https://github.com/apache/spark/pull/5694#issuecomment-96827964 jenkins, retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-7174][Core] Move calling `TaskScheduler...

2015-04-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5723#issuecomment-96829203 [Test build #31067 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31067/consoleFull) for PR 5723 at commit

[GitHub] spark pull request: [SPARK-6734] [SQL] Add UDTF.close support in G...

2015-04-27 Thread chenghao-intel
Github user chenghao-intel commented on the pull request: https://github.com/apache/spark/pull/5383#issuecomment-96516549 @liancheng @marmbrus Any more comments? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-7160][SQL] Support converting DataFrame...

2015-04-27 Thread rayortigas
GitHub user rayortigas opened a pull request: https://github.com/apache/spark/pull/5713 [SPARK-7160][SQL] Support converting DataFrames to typed RDDs. https://issues.apache.org/jira/browse/SPARK-7160 https://github.com/databricks/spark-csv/pull/52 cc: @rxin (who

[GitHub] spark pull request: [SPARK-7158] [SQL] Fix bug of cached data cann...

2015-04-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5714#issuecomment-96552127 [Test build #30963 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30963/consoleFull) for PR 5714 at commit

[GitHub] spark pull request: [SPARK-6505][SQL]Remove the reflection call in...

2015-04-27 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/5660#issuecomment-96515766 Thanks for working on this! I'm merging this to master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request: [SPARK-5213] [SQL] Pluggable SQL Parser Suppor...

2015-04-27 Thread chenghao-intel
Github user chenghao-intel commented on the pull request: https://github.com/apache/spark/pull/4015#issuecomment-96516483 @liancheng @rxin @marmbrus can you trigger the unit test for me? Thanks. --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark pull request: [SPARK-7163] [SQL] minor refactory for HiveQl

2015-04-27 Thread scwf
Github user scwf commented on a diff in the pull request: https://github.com/apache/spark/pull/5715#discussion_r29126807 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveContext.scala --- @@ -81,11 +81,38 @@ class HiveContext(sc: SparkContext) extends

[GitHub] spark pull request: [SPARK-6888][SQL] Make the jdbc driver handlin...

2015-04-27 Thread rtreffer
Github user rtreffer commented on the pull request: https://github.com/apache/spark/pull/#issuecomment-96573899 @marmbrus what should we do now? New PR? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: SPARK-4705:[core] Write event logs of differen...

2015-04-27 Thread twinkle-sachdeva
Github user twinkle-sachdeva closed the pull request at: https://github.com/apache/spark/pull/4845 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark pull request: [SPARK-7155] [CORE] Allow newAPIHadoopFile to ...

2015-04-27 Thread yongtang
Github user yongtang commented on the pull request: https://github.com/apache/spark/pull/5708#issuecomment-96524002 @srowen Thanks for the comment. I updated the pull request so that setInputPaths instead of addInputPaths are used. In addition to newAPIHadoopFile(), the instances of

[GitHub] spark pull request: [SPARK-1406] Mllib pmml model export

2015-04-27 Thread selvinsource
Github user selvinsource commented on the pull request: https://github.com/apache/spark/pull/3062#issuecomment-96544425 For binary logistic regression, using the same principle (intercept as threshold), doing some maths, we could set: `intercept = -ln(1/threshold - 1)` --- If

[GitHub] spark pull request: [SPARK-7163] [SQL] minor refactory for HiveQl

2015-04-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5715#issuecomment-96552130 [Test build #30962 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30962/consoleFull) for PR 5715 at commit

[GitHub] spark pull request: [SPARK-7162][YARN]Launcher error in yarn-clien...

2015-04-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5716#issuecomment-96552117 [Test build #30961 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30961/consoleFull) for PR 5716 at commit

[GitHub] spark pull request: SPARK-6735:[YARN] Adding properties to disable...

2015-04-27 Thread twinkle-sachdeva
Github user twinkle-sachdeva commented on the pull request: https://github.com/apache/spark/pull/5449#issuecomment-96515946 Hi @srowen , Please review the changes. Thanks, --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] spark pull request: [SPARK-5213] [SQL] Pluggable SQL Parser Suppor...

2015-04-27 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/4015#issuecomment-96516744 I think Jenkins is having some trouble right now. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-5213] [SQL] Pluggable SQL Parser Suppor...

2015-04-27 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/4015#issuecomment-96516751 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-6505][SQL]Remove the reflection call in...

2015-04-27 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/5660 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: SPARK-1556: bump jets3t version to 0.9.0

2015-04-27 Thread LuqmanSahaf
Github user LuqmanSahaf commented on the pull request: https://github.com/apache/spark/pull/468#issuecomment-96522017 @darose I am facing the VerifyError you mentioned in one of the comments. Can you tell me how you solved that error? --- If your project is set up for it, you can

  1   2   3   4   5   6   7   8   >