[GitHub] spark pull request: [SPARK-8848] [SQL] Refactors Parquet write pat...

2015-10-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8988#issuecomment-146403789 [Test build #43372 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43372/console) for PR 8988 at commit [`af50f9c`](https://github.

[GitHub] spark pull request: [SPARK-8848] [SQL] Refactors Parquet write pat...

2015-10-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8988#issuecomment-146403814 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-8848] [SQL] Refactors Parquet write pat...

2015-10-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8988#issuecomment-146403816 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43

[GitHub] spark pull request: [SPARK-10987] [yarn] Work around for netty rpc...

2015-10-07 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/9021#issuecomment-146403614 /cc @zsxwing --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request: [SPARK-10987] [yarn] Work around for netty rpc...

2015-10-07 Thread vanzin
GitHub user vanzin opened a pull request: https://github.com/apache/spark/pull/9021 [SPARK-10987] [yarn] Work around for netty rpc disconnection event. In YARN client mode, when the AM connects to the driver, it may be the case that the driver never needs to send a message back t

[GitHub] spark pull request: [SPARK-10988] [SQL] Reduce duplication in Aggr...

2015-10-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9015#issuecomment-146400254 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43

[GitHub] spark pull request: [SPARK-10988] [SQL] Reduce duplication in Aggr...

2015-10-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9015#issuecomment-146400251 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-10988] [SQL] Reduce duplication in Aggr...

2015-10-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9015#issuecomment-146400181 [Test build #43364 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43364/console) for PR 9015 at commit [`fb0daa1`](https://github.

[GitHub] spark pull request: [SPARK-10337][SQL] fix hive views on non-hive-...

2015-10-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8990#issuecomment-146399845 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43

[GitHub] spark pull request: [SPARK-10337][SQL] fix hive views on non-hive-...

2015-10-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8990#issuecomment-146399756 [Test build #43370 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43370/console) for PR 8990 at commit [`44fcbf9`](https://github.

[GitHub] spark pull request: [SPARK-10810] [SPARK-10902] [SQL] Improve sess...

2015-10-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8909#issuecomment-146399329 [Test build #1856 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1856/console) for PR 8909 at commit [`3aeae47`](https://github

[GitHub] spark pull request: [SPARK-10887] [SQL] Build HashedRelation outsi...

2015-10-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8953#issuecomment-146399281 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-10887] [SQL] Build HashedRelation outsi...

2015-10-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8953#issuecomment-146399283 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43

[GitHub] spark pull request: [SPARK-10887] [SQL] Build HashedRelation outsi...

2015-10-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8953#issuecomment-146399185 [Test build #43366 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43366/console) for PR 8953 at commit [`081e331`](https://github.

[GitHub] spark pull request: [SPARK-10988] [SQL] Reduce duplication in Aggr...

2015-10-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9015#issuecomment-146399120 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-10988] [SQL] Reduce duplication in Aggr...

2015-10-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9015#issuecomment-146399121 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43

[GitHub] spark pull request: [SPARK-10905][SparkR]: Export freqItems() for ...

2015-10-07 Thread sun-rui
Github user sun-rui commented on the pull request: https://github.com/apache/spark/pull/8962#issuecomment-146399058 @rerngvit, could you rebase it to the latest master? As I moved stats functions to a new R file stats.R in https://github.com/apache/spark/pull/8869 --- If your project

[GitHub] spark pull request: [SPARK-10739][Yarn] Add application attempt wi...

2015-10-07 Thread jerryshao
Github user jerryshao commented on the pull request: https://github.com/apache/spark/pull/8857#issuecomment-146399070 Hi @vanzin , @sryza any opinion on this PR? Thanks a lot. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as wel

[GitHub] spark pull request: [SPARK-10988] [SQL] Reduce duplication in Aggr...

2015-10-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9015#issuecomment-146399027 [Test build #43363 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43363/console) for PR 9015 at commit [`fb0daa1`](https://github.

[GitHub] spark pull request: [SPARK-10905][SparkR]: Export freqItems() for ...

2015-10-07 Thread sun-rui
Github user sun-rui commented on a diff in the pull request: https://github.com/apache/spark/pull/8962#discussion_r41470551 --- Diff: R/pkg/R/DataFrame.R --- @@ -1873,3 +1872,30 @@ setMethod("as.data.frame", collect(x) } ) + +#' freqItems

[GitHub] spark pull request: [SPARK-10993] [SQL] Inital code generated enco...

2015-10-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9019#issuecomment-146397989 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43

[GitHub] spark pull request: [SPARK-10993] [SQL] Inital code generated enco...

2015-10-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9019#issuecomment-146397969 [Test build #43376 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43376/console) for PR 9019 at commit [`768055d`](https://github.

[GitHub] spark pull request: [SPARK-10993] [SQL] Inital code generated enco...

2015-10-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9019#issuecomment-146397983 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-10993] [SQL] Inital code generated enco...

2015-10-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9019#issuecomment-146397119 [Test build #43376 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43376/consoleFull) for PR 9019 at commit [`768055d`](https://gith

[GitHub] spark pull request: [SPARK-10989] [MLLIB] Added the dot and hadama...

2015-10-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9020#issuecomment-146395870 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pr

[GitHub] spark pull request: [SPARK-10989] [MLLIB] Added the dot and hadama...

2015-10-07 Thread da-steve101
GitHub user da-steve101 opened a pull request: https://github.com/apache/spark/pull/9020 [SPARK-10989] [MLLIB] Added the dot and hadamard operators to mllib Added a basic implementation of dot and hadamard products between vectors for mllib You can merge this pull request into a Gi

[GitHub] spark pull request: [SPARK-10993] [SQL] Inital code generated enco...

2015-10-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9019#issuecomment-146393923 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-10993] [SQL] Inital code generated enco...

2015-10-07 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/9019#discussion_r41469930 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/ScalaReflection.scala --- @@ -91,7 +328,6 @@ trait ScalaReflection { case t i

[GitHub] spark pull request: [SPARK-10993] [SQL] Inital code generated enco...

2015-10-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9019#issuecomment-146393911 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-10993] [SQL] Inital code generated enco...

2015-10-07 Thread marmbrus
GitHub user marmbrus opened a pull request: https://github.com/apache/spark/pull/9019 [SPARK-10993] [SQL] Inital code generated encoder for product types This PR is a first cut at code generating an encoder that takes a Scala `Product` type and converts it directly into the tungsten

[GitHub] spark pull request: [SPARK-8848] [SQL] Refactors Parquet write pat...

2015-10-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8988#issuecomment-146393688 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-8848] [SQL] Refactors Parquet write pat...

2015-10-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8988#issuecomment-146393689 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43

[GitHub] spark pull request: [SPARK-8848] [SQL] Refactors Parquet write pat...

2015-10-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8988#issuecomment-146393660 [Test build #43365 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43365/console) for PR 8988 at commit [`c542ae9`](https://github.

[GitHub] spark pull request: SPARK-10771: Implement the shuffle encryption ...

2015-10-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8880#issuecomment-146393548 [Test build #43375 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43375/consoleFull) for PR 8880 at commit [`acb5c89`](https://gith

[GitHub] spark pull request: SPARK-10771: Implement the shuffle encryption ...

2015-10-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8880#issuecomment-146393420 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: SPARK-10771: Implement the shuffle encryption ...

2015-10-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8880#issuecomment-146393441 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: SPARK-10771: Implement the shuffle encryption ...

2015-10-07 Thread winningsix
Github user winningsix commented on the pull request: https://github.com/apache/spark/pull/8880#issuecomment-14639 Hi @vanzin, I have just updated the code based the latest upstream. Could you please take a look at the updated patch? Thank you! --- If your project is set up for i

[GitHub] spark pull request: [SPARK-8848] [SQL] Refactors Parquet write pat...

2015-10-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8988#issuecomment-146393295 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43

[GitHub] spark pull request: [SPARK-8848] [SQL] Refactors Parquet write pat...

2015-10-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8988#issuecomment-146393293 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-8848] [SQL] Refactors Parquet write pat...

2015-10-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8988#issuecomment-146393217 [Test build #43360 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43360/console) for PR 8988 at commit [`f03ef93`](https://github.

[GitHub] spark pull request: [SPARK-10766][SPARK-SUBMIT]Add some configurat...

2015-10-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8918#issuecomment-146391749 [Test build #43374 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43374/consoleFull) for PR 8918 at commit [`94a707a`](https://gith

[GitHub] spark pull request: [SPARK-8848] [SQL] Refactors Parquet write pat...

2015-10-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8988#issuecomment-146391277 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-8848] [SQL] Refactors Parquet write pat...

2015-10-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8988#issuecomment-146391278 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43

[GitHub] spark pull request: [SPARK-8848] [SQL] Refactors Parquet write pat...

2015-10-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8988#issuecomment-146391252 [Test build #43361 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43361/console) for PR 8988 at commit [`2bc5ebc`](https://github.

[GitHub] spark pull request: [SPARK-10766][SPARK-SUBMIT]Add some configurat...

2015-10-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8918#issuecomment-146390725 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-10766][SPARK-SUBMIT]Add some configurat...

2015-10-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8918#issuecomment-146390741 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-10766][SPARK-SUBMIT]Add some configurat...

2015-10-07 Thread SaintBacchus
Github user SaintBacchus commented on the pull request: https://github.com/apache/spark/pull/8918#issuecomment-146390642 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have thi

[GitHub] spark pull request: [SPARK-10412][SQL] report memory usage for tun...

2015-10-07 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/8931#discussion_r41468810 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/aggregate/TungstenAggregationIterator.scala --- @@ -690,6 +697,9 @@ class TungstenAggrega

[GitHub] spark pull request: [SPARK-10786][SQL]Take the whole statement to ...

2015-10-07 Thread SaintBacchus
Github user SaintBacchus commented on the pull request: https://github.com/apache/spark/pull/8895#issuecomment-146390491 @liancheng Can you take a look at this small change? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request: [SPARK-10755][YARN]Set driver also update the ...

2015-10-07 Thread SaintBacchus
Github user SaintBacchus closed the pull request at: https://github.com/apache/spark/pull/8867 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature i

[GitHub] spark pull request: [SPARK-10412][SQL] report memory usage for tun...

2015-10-07 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/8931#discussion_r41468737 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/metric/SQLMetrics.scala --- @@ -35,6 +36,12 @@ private[sql] abstract class SQLMetric[R <:

[GitHub] spark pull request: [SPARK-10473][YARN]Login again in the driver t...

2015-10-07 Thread SaintBacchus
Github user SaintBacchus commented on the pull request: https://github.com/apache/spark/pull/8942#issuecomment-146390416 Yeah @tgravescs I'm running in yarn client mode. I'm sure that `HDFS_DELEGATION_TOKEN token 2339 for spark` is the original token gained by the driver. But I don't

[GitHub] spark pull request: [SPARK-10515] When killing executor, the pendi...

2015-10-07 Thread KaiXinXiaoLei
Github user KaiXinXiaoLei closed the pull request at: https://github.com/apache/spark/pull/8668 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark pull request: [SPARK-10515] When killing executor, the pendi...

2015-10-07 Thread KaiXinXiaoLei
Github user KaiXinXiaoLei commented on the pull request: https://github.com/apache/spark/pull/8668#issuecomment-146389770 see https://github.com/apache/spark/pull/8945 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If yo

[GitHub] spark pull request: [SPARK-9718][ML] linear regression training su...

2015-10-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8564#issuecomment-146389640 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-9718][ML] linear regression training su...

2015-10-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8564#issuecomment-146389641 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43

[GitHub] spark pull request: [SPARK-9718][ML] linear regression training su...

2015-10-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8564#issuecomment-146389576 [Test build #43369 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43369/console) for PR 8564 at commit [`7fb3b1c`](https://github.

[GitHub] spark pull request: [SPARK-10412][SQL] report memory usage for tun...

2015-10-07 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/8931#discussion_r41468414 --- Diff: core/src/main/java/org/apache/spark/unsafe/map/BytesToBytesMap.java --- @@ -560,7 +560,7 @@ public boolean putNewKey( // Here, we'll c

[GitHub] spark pull request: [SPARK-10767][PYSPARK] Make pyspark shared par...

2015-10-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9017#issuecomment-146388687 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43

[GitHub] spark pull request: [SPARK-10412][SQL] report memory usage for tun...

2015-10-07 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/8931#issuecomment-146389520 I slightly prefer to separate the total and the quantiles, e.g. ``` memory total: 10G memory per task (min / med / max): 10MB / 100MB / 1GB ``` Thes

[GitHub] spark pull request: [SPARK-10532][EC2]Added --profile option to sp...

2015-10-07 Thread neil-rubens
Github user neil-rubens commented on the pull request: https://github.com/apache/spark/pull/8696#issuecomment-146389503 +1 using AWS profile is considered to be best practice: https://blogs.aws.amazon.com/security/post/Tx3D6U6WSFGOK2H/A-New-and-Standardized-Way-to-Manage-Crede

[GitHub] spark pull request: added option for specifying AWS credential pro...

2015-10-07 Thread neil-rubens
Github user neil-rubens closed the pull request at: https://github.com/apache/spark/pull/9018 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: added option for specifying AWS credential pro...

2015-10-07 Thread neil-rubens
Github user neil-rubens commented on the pull request: https://github.com/apache/spark/pull/9018#issuecomment-146389385 Sorry; I haven't noticed the other request; having a very similar proposal; hence am closing this one. --- If your project is set up for it, you can reply to this e

[GitHub] spark pull request: [SPARK-10767][PYSPARK] Make pyspark shared par...

2015-10-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9017#issuecomment-146388663 [Test build #43371 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43371/console) for PR 9017 at commit [`053f3e6`](https://github.

[GitHub] spark pull request: [SPARK-9718][ML] linear regression training su...

2015-10-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8564#issuecomment-146388505 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-10767][PYSPARK] Make pyspark shared par...

2015-10-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9017#issuecomment-146388686 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-9718][ML] linear regression training su...

2015-10-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8564#issuecomment-146388506 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43

[GitHub] spark pull request: [SPARK-9718][ML] linear regression training su...

2015-10-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8564#issuecomment-146388370 [Test build #43367 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43367/console) for PR 8564 at commit [`d3021f0`](https://github.

[GitHub] spark pull request: [SPARK-10992][SQL][WIP]Partial Aggregation Sup...

2015-10-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7788#issuecomment-146388181 [Test build #43373 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43373/consoleFull) for PR 7788 at commit [`d1f30a5`](https://gith

[GitHub] spark pull request: [SPARK-10992][SQL][WIP]Partial Aggregation Sup...

2015-10-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7788#issuecomment-146387965 Build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this f

[GitHub] spark pull request: [SPARK-10992][SQL][WIP]Partial Aggregation Sup...

2015-10-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7788#issuecomment-146387947 Build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have thi

[GitHub] spark pull request: [SPARK-10992][SQL][WIP]Partial Aggregation Sup...

2015-10-07 Thread chenghao-intel
Github user chenghao-intel commented on the pull request: https://github.com/apache/spark/pull/7788#issuecomment-146387753 Update the title and reopen it. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project do

[GitHub] spark pull request: [SPARK-10992][SQL][WIP]Partial Aggregation Sup...

2015-10-07 Thread chenghao-intel
GitHub user chenghao-intel reopened a pull request: https://github.com/apache/spark/pull/7788 [SPARK-10992][SQL][WIP]Partial Aggregation Support for Hive UDAF Add Hive UDAF support for aggregate2. A known issue is we still don't support the `distinct` keyword for Hive UDAF. You can

[GitHub] spark pull request: [SPARK-9239][SQL][WIP]Add Hive UDAF support fo...

2015-10-07 Thread chenghao-intel
Github user chenghao-intel commented on the pull request: https://github.com/apache/spark/pull/7788#issuecomment-146387642 Yes @JoshRosen I've just created the issue https://issues.apache.org/jira/browse/SPARK-10992, it will be great if you assign this issue to me. :) --- If your pr

[GitHub] spark pull request: added option for specifying AWS credential pro...

2015-10-07 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/9018#issuecomment-146387648 I think that this is a duplicate of #8696. Therefore, I'd recommend closing this and bumping that other PR. --- If your project is set up for it, you can reply to thi

[GitHub] spark pull request: added option for specifying AWS credential pro...

2015-10-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9018#issuecomment-146387420 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pr

[GitHub] spark pull request: added option for specifying AWS credential pro...

2015-10-07 Thread neil-rubens
GitHub user neil-rubens opened a pull request: https://github.com/apache/spark/pull/9018 added option for specifying AWS credential profile # Need Utilizing AWS profiles is considered best practice: https://blogs.aws.amazon.com/security/post/Tx3D6U6WSFGOK2H/A-New-and-Standa

[GitHub] spark pull request: [SPARK-9066][SQL] Improve cartesian performanc...

2015-10-07 Thread chenghao-intel
Github user chenghao-intel commented on a diff in the pull request: https://github.com/apache/spark/pull/7417#discussion_r41467358 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkStrategies.scala --- @@ -274,12 +275,30 @@ private[sql] abstract class SparkStrat

[GitHub] spark pull request: [SPARK-8848] [SQL] Refactors Parquet write pat...

2015-10-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8988#issuecomment-146386880 [Test build #43372 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43372/consoleFull) for PR 8988 at commit [`af50f9c`](https://gith

[GitHub] spark pull request: [SPARK-10767][PYSPARK] Make pyspark shared par...

2015-10-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9017#issuecomment-146386797 [Test build #43371 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43371/consoleFull) for PR 9017 at commit [`053f3e6`](https://gith

[GitHub] spark pull request: [SPARK-10810] [SPARK-10902] [SQL] Improve sess...

2015-10-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8909#issuecomment-146386233 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-10810] [SPARK-10902] [SQL] Improve sess...

2015-10-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8909#issuecomment-146386234 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43

[GitHub] spark pull request: [SPARK-10810] [SPARK-10902] [SQL] Improve sess...

2015-10-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8909#issuecomment-146386181 [Test build #43350 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43350/console) for PR 8909 at commit [`b70720f`](https://github.

[GitHub] spark pull request: [SPARK-8848] [SQL] Refactors Parquet write pat...

2015-10-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8988#issuecomment-146385909 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-8848] [SQL] Refactors Parquet write pat...

2015-10-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8988#issuecomment-146385921 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-10767][PYSPARK] Make pyspark shared par...

2015-10-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9017#issuecomment-146385907 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-10767][PYSPARK] Make pyspark shared par...

2015-10-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9017#issuecomment-146385922 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-10767][PYSPARK] Make pyspark shared par...

2015-10-07 Thread holdenk
GitHub user holdenk opened a pull request: https://github.com/apache/spark/pull/9017 [SPARK-10767][PYSPARK] Make pyspark shared params codegen more consistent Namely "." shows up in some places in the template when using the param docstring and not in others You can merge this pull

[GitHub] spark pull request: [SPARK-10337][SQL] fix hive views on non-hive-...

2015-10-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8990#issuecomment-146385709 [Test build #43370 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43370/consoleFull) for PR 8990 at commit [`44fcbf9`](https://gith

[GitHub] spark pull request: [SPARK-10337][SQL] fix hive views on non-hive-...

2015-10-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8990#issuecomment-146385387 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-10337][SQL] fix hive views on non-hive-...

2015-10-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8990#issuecomment-146385401 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-9239][SQL][WIP]Add Hive UDAF support fo...

2015-10-07 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/7788#issuecomment-146385308 @chenghao-intel, do you want to file a new JIRA to track only the partial aggregation enhancements for Hive UDAF? --- If your project is set up for it, you can reply

[GitHub] spark pull request: [SPARK-9718][ML] linear regression training su...

2015-10-07 Thread holdenk
Github user holdenk commented on the pull request: https://github.com/apache/spark/pull/8564#issuecomment-146385212 Sure, looking at the logisticregression impl it seems that it currently uses transform, but it doesn't do handle the case where the preidction col is set to "", so I jus

[GitHub] spark pull request: [SPARK-9718][ML] linear regression training su...

2015-10-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8564#issuecomment-146385074 [Test build #43369 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43369/consoleFull) for PR 8564 at commit [`7fb3b1c`](https://gith

[GitHub] spark pull request: SPARK-7021 Add JUnit output for Python tests

2015-10-07 Thread gliptak
Github user gliptak commented on the pull request: https://github.com/apache/spark/pull/8323#issuecomment-146384917 @JoshRosen How are the doctest-s triggered on the commandline and in Jenkins? ``` $ python/run-tests --help No handlers could be found for logger "root"

[GitHub] spark pull request: [SPARK-9718][ML] linear regression training su...

2015-10-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8564#issuecomment-146384813 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-9718][ML] linear regression training su...

2015-10-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8564#issuecomment-146384823 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-9774][ML][PYSPARK] Add python api for m...

2015-10-07 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/8214 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-9774][ML][PYSPARK] Add python api for m...

2015-10-07 Thread jkbradley
Github user jkbradley commented on the pull request: https://github.com/apache/spark/pull/8214#issuecomment-146384581 LGTM, merging with master. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project doe

[GitHub] spark pull request: [SPARK-10337][SQL] fix hive views on non-hive-...

2015-10-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8990#issuecomment-146384271 [Test build #43368 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43368/console) for PR 8990 at commit [`c7afcd4`](https://github.

<    1   2   3   4   5   6   7   8   >