[GitHub] spark pull request: [SPARK-11201] [YARN] Make sure SPARK_YARN_MODE...

2015-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9174#issuecomment-149448332 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10447][PYSPARK] upgrade pyspark to py4j...

2015-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8615#issuecomment-149453667 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10463] [SQL] remove PromotePrecision du...

2015-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8621#issuecomment-149457452 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10463] [SQL] remove PromotePrecision du...

2015-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8621#issuecomment-149457470 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10463] [SQL] remove PromotePrecision du...

2015-10-20 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8621#issuecomment-149458541 **[Test build #43968 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43968/consoleFull)** for PR 8621 at commit

[GitHub] spark pull request: SPARK-11179: Push filters through aggregate if...

2015-10-20 Thread nitin2goyal
Github user nitin2goyal commented on the pull request: https://github.com/apache/spark/pull/9167#issuecomment-149460810 Added tests --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: SPARK-10876 - Display total uptime for complet...

2015-10-20 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9059#issuecomment-149463366 **[Test build #43964 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43964/consoleFull)** for PR 9059 at commit

[GitHub] spark pull request: SPARK-10876 - Display total uptime for complet...

2015-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9059#issuecomment-149463526 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: SPARK-11179: Push filters through aggregate if...

2015-10-20 Thread hvanhovell
Github user hvanhovell commented on the pull request: https://github.com/apache/spark/pull/9167#issuecomment-149464143 We could do a similar thing for window functions. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: [SPARK-10655][SQL] Adding additional data type...

2015-10-20 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9162#issuecomment-149464891 **[Test build #1930 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1930/consoleFull)** for PR 9162 at commit

[GitHub] spark pull request: [SPARK-10655][SQL] Adding additional data type...

2015-10-20 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/9162#discussion_r42464772 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/jdbc/JdbcDialects.scala --- @@ -253,17 +253,33 @@ case object MySQLDialect extends JdbcDialect {

[GitHub] spark pull request: [SPARK-10447][PYSPARK] upgrade pyspark to py4j...

2015-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8615#issuecomment-149453599 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10447][PYSPARK] upgrade pyspark to py4j...

2015-10-20 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8615#issuecomment-149455373 **[Test build #43967 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43967/consoleFull)** for PR 8615 at commit

[GitHub] spark pull request: SPARK-6541 - Sort executors by ID (numeric)

2015-10-20 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/9165#issuecomment-149464281 I'm OK with this. Sorting executor IDs numerically seems like the intent anyway. I don't see a downside to sorting the display otherwise, other than the cost of sorting,

[GitHub] spark pull request: SPARK-10876 - Display total uptime for complet...

2015-10-20 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/9059 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: Minor cleanup of ShuffleMapStage.outputLocs co...

2015-10-20 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9175#issuecomment-149477267 **[Test build #43970 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43970/consoleFull)** for PR 9175 at commit

[GitHub] spark pull request: [SPARK-10471] [CORE] [MESOS] prevent getting o...

2015-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8639#issuecomment-149477174 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: Minor cleanup of ShuffleMapStage.outputLocs co...

2015-10-20 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/9175#issuecomment-149477122 cc @andrewor14 and @mateiz --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-10471] [CORE] [MESOS] prevent getting o...

2015-10-20 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8639#issuecomment-149477387 **[Test build #43971 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43971/consoleFull)** for PR 8639 at commit

[GitHub] spark pull request: Minor cleanup of ShuffleMapStage.outputLocs co...

2015-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9175#issuecomment-149478051 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: Minor cleanup of ShuffleMapStage.outputLocs co...

2015-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9175#issuecomment-149478053 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11153] [SQL] Disables Parquet filter pu...

2015-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9152#issuecomment-149478693 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11153] [SQL] Disables Parquet filter pu...

2015-10-20 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9152#issuecomment-149478557 **[Test build #43963 timed out](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43963/console)** for PR 9152 at commit

[GitHub] spark pull request: [SPARK-10447][PYSPARK] upgrade pyspark to py4j...

2015-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8615#issuecomment-149484039 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10447][PYSPARK] upgrade pyspark to py4j...

2015-10-20 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8615#issuecomment-149483692 **[Test build #43967 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43967/consoleFull)** for PR 8615 at commit

[GitHub] spark pull request: SPARK-11179: Push filters through aggregate if...

2015-10-20 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/9167#discussion_r42467947 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala --- @@ -675,6 +676,20 @@ object PushPredicateThroughGenerate

[GitHub] spark pull request: [SPARK-10471] [CORE] [MESOS] prevent getting o...

2015-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8639#issuecomment-149477186 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11201] [YARN] Make sure SPARK_YARN_MODE...

2015-10-20 Thread harishreedharan
Github user harishreedharan commented on the pull request: https://github.com/apache/spark/pull/9174#issuecomment-149442366 /cc @tdas @tgravescs @vanzin --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-11201] [YARN] Make sure SPARK_YARN_MODE...

2015-10-20 Thread harishreedharan
GitHub user harishreedharan opened a pull request: https://github.com/apache/spark/pull/9174 [SPARK-11201] [YARN] Make sure SPARK_YARN_MODE is set before SparkHad… …oopUtil.get is called. If `StreamingContext.getOrCreate` is used in `yarn-client` mode, a

[GitHub] spark pull request: [SPARK-10473][YARN]Login again in the driver t...

2015-10-20 Thread SaintBacchus
Github user SaintBacchus commented on the pull request: https://github.com/apache/spark/pull/8942#issuecomment-149442226 We had considered to the way to reopen the file. In that way it may have to consider the synchronization problem between event log producer and consumer with more

[GitHub] spark pull request: [SPARK-10473][YARN]Login again in the driver t...

2015-10-20 Thread harishreedharan
Github user harishreedharan commented on the pull request: https://github.com/apache/spark/pull/8942#issuecomment-149442481 Agreed - synchronization is painful and we could end up missing events. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request: [SPARK-11201] [YARN] Make sure SPARK_YARN_MODE...

2015-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9174#issuecomment-149443497 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10447][PYSPARK] upgrade pyspark to py4j...

2015-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8615#issuecomment-149446398 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10447][PYSPARK] upgrade pyspark to py4j...

2015-10-20 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8615#issuecomment-149446259 **[Test build #43962 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43962/consoleFull)** for PR 8615 at commit

[GitHub] spark pull request: [SPARK-10447][PYSPARK] upgrade pyspark to py4j...

2015-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8615#issuecomment-149446394 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11201] [YARN] Make sure SPARK_YARN_MODE...

2015-10-20 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9174#issuecomment-149443919 **[Test build #43965 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43965/consoleFull)** for PR 9174 at commit

[GitHub] spark pull request: [SPARK-11205] [PYSPARK] Delegate to scala Data...

2015-10-20 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9177#issuecomment-149494956 **[Test build #43972 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43972/consoleFull)** for PR 9177 at commit

[GitHub] spark pull request: [SPARK-11205] [PYSPARK] Delegate to scala Data...

2015-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9177#issuecomment-149495063 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: SPARK-11179: Push filters through aggregate if...

2015-10-20 Thread nitin2goyal
Github user nitin2goyal commented on a diff in the pull request: https://github.com/apache/spark/pull/9167#discussion_r42478681 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala --- @@ -675,6 +676,20 @@ object

[GitHub] spark pull request: [SPARK-11153] [SQL] Disables Parquet filter pu...

2015-10-20 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/9152#issuecomment-149517931 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-11182] HDFS Delegation Token will be ex...

2015-10-20 Thread steveloughran
Github user steveloughran commented on a diff in the pull request: https://github.com/apache/spark/pull/9168#discussion_r42482462 --- Diff: core/src/main/scala/org/apache/spark/deploy/SparkHadoopUtil.scala --- @@ -130,6 +132,20 @@ class SparkHadoopUtil extends Logging {

[GitHub] spark pull request: [SPARK-10471] [CORE] [MESOS] prevent getting o...

2015-10-20 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8639#issuecomment-149530425 **[Test build #43971 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43971/consoleFull)** for PR 8639 at commit

[GitHub] spark pull request: [SPARK-10971][SPARKR] RRunner should allow set...

2015-10-20 Thread sun-rui
GitHub user sun-rui opened a pull request: https://github.com/apache/spark/pull/9179 [SPARK-10971][SPARKR] RRunner should allow setting path to Rscript. Add a new spark conf option "spark.sparkr.r.driver.command" to specify the executable for an R script in client modes.

[GitHub] spark pull request: [SPARK-3586][streaming]Support nested director...

2015-10-20 Thread gprivitera
Github user gprivitera commented on the pull request: https://github.com/apache/spark/pull/6588#issuecomment-149517366 @tdas : any update on this PR? Is there anything that should be done yet? --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request: Minor cleanup of ShuffleMapStage.outputLocs co...

2015-10-20 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9175#issuecomment-14952 **[Test build #43970 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43970/consoleFull)** for PR 9175 at commit

[GitHub] spark pull request: Minor cleanup of ShuffleMapStage.outputLocs co...

2015-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9175#issuecomment-149523858 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11208] [SQL] Filter out 'hive.metastore...

2015-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9178#issuecomment-149530194 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10471] [CORE] [MESOS] prevent getting o...

2015-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8639#issuecomment-149531417 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10471] [CORE] [MESOS] prevent getting o...

2015-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8639#issuecomment-149531419 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10971][SPARKR] RRunner should allow set...

2015-10-20 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9179#issuecomment-149533923 **[Test build #43974 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43974/consoleFull)** for PR 9179 at commit

[GitHub] spark pull request: [SPARK-11153] [SQL] Disables Parquet filter pu...

2015-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9152#issuecomment-149518597 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: Minor cleanup of ShuffleMapStage.outputLocs co...

2015-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9175#issuecomment-149523855 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11208] [SQL] Filter out 'hive.metastore...

2015-10-20 Thread artem-aliev
GitHub user artem-aliev opened a pull request: https://github.com/apache/spark/pull/9178 [SPARK-11208] [SQL] Filter out 'hive.metastore.rawstore.impl' from ex… …ecutionHive temporary config The executionHive assumed to be a standard meta store located in temporary

[GitHub] spark pull request: [SPARK-10971][SPARKR] RRunner should allow set...

2015-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9179#issuecomment-149531788 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10971][SPARKR] RRunner should allow set...

2015-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9179#issuecomment-149531751 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11205] [PYSPARK] Delegate to scala Data...

2015-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9177#issuecomment-149495062 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11153] [SQL] Disables Parquet filter pu...

2015-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9152#issuecomment-149518590 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11153] [SQL] Disables Parquet filter pu...

2015-10-20 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9152#issuecomment-149521176 [Test build #43973 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43973/consoleFull) for PR 9152 at commit

[GitHub] spark pull request: [SPARK-11182] HDFS Delegation Token will be ex...

2015-10-20 Thread steveloughran
Github user steveloughran commented on the pull request: https://github.com/apache/spark/pull/9168#issuecomment-149531922 solution 4: fix HDFS. Don't be afraid of filing reports & submitting patches there; it's a better long-term strategy than trying to work around things downstream.

[GitHub] spark pull request: [SPARK-11207][ML] Add test cases for solver se...

2015-10-20 Thread Lewuathe
GitHub user Lewuathe opened a pull request: https://github.com/apache/spark/pull/9180 [SPARK-11207][ML] Add test cases for solver selection of LinearRegres… …sion as followup. This is the follow up work of SPARK-10668. * Fix miner style issues. * Add test case for

[GitHub] spark pull request: [SPARK-11207][ML] Add test cases for solver se...

2015-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9180#issuecomment-149574420 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11207][ML] Add test cases for solver se...

2015-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9180#issuecomment-149574456 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11207][ML] Add test cases for solver se...

2015-10-20 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9180#issuecomment-149574964 **[Test build #43981 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43981/consoleFull)** for PR 9180 at commit

[GitHub] spark pull request: [SPARK-11207][ML] Add test cases for solver se...

2015-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9180#issuecomment-149575641 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10971][SPARKR] RRunner should allow set...

2015-10-20 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9179#issuecomment-149575992 **[Test build #43974 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43974/consoleFull)** for PR 9179 at commit

[GitHub] spark pull request: [SPARK-11207][ML] Add test cases for solver se...

2015-10-20 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9180#issuecomment-149575632 **[Test build #43981 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43981/consoleFull)** for PR 9180 at commit

[GitHub] spark pull request: [SPARK-11207][ML] Add test cases for solver se...

2015-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9180#issuecomment-149575643 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10971][SPARKR] RRunner should allow set...

2015-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9179#issuecomment-149576372 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10971][SPARKR] RRunner should allow set...

2015-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9179#issuecomment-149576374 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-6325] [core,yarn] Do not change target ...

2015-10-20 Thread prakhar-jauhari
Github user prakhar-jauhari commented on the pull request: https://github.com/apache/spark/pull/5018#issuecomment-149576884 @vanzin thanks for the response. And not posting to a closed PR (noted!!) In my case spark driver is reducing the total number of executors on host

[GitHub] spark pull request: [SPARK-11212][Core][Streaming]Make preferred l...

2015-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9181#issuecomment-149577116 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11212][Core][Streaming]Make preferred l...

2015-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9181#issuecomment-149577147 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11212][Core][Streaming]Make preferred l...

2015-10-20 Thread zsxwing
GitHub user zsxwing opened a pull request: https://github.com/apache/spark/pull/9181 [SPARK-11212][Core][Streaming]Make preferred locations support ExecutorCacheTaskLocation and update… … ReceiverTracker and ReceiverSchedulingPolicy to use it This PR includes the

[GitHub] spark pull request: [SPARK-11212][Core][Streaming]Make preferred l...

2015-10-20 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/9181#discussion_r42498602 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/scheduler/ReceiverSchedulingPolicy.scala --- @@ -69,9 +69,12 @@ private[streaming] class

[GitHub] spark pull request: [SPARK-10447][PYSPARK] upgrade pyspark to py4j...

2015-10-20 Thread kevincox
Github user kevincox commented on the pull request: https://github.com/apache/spark/pull/8615#issuecomment-149545940 Awesome work @holdenk! I would live to see this merged. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark pull request: SPARK-10614 SystemClock uses non-monotonic tim...

2015-10-20 Thread steveloughran
Github user steveloughran commented on the pull request: https://github.com/apache/spark/pull/8766#issuecomment-149554897 If people are happy with that, I'll do that --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: [SPARK-11201] [YARN] Make sure SPARK_YARN_MODE...

2015-10-20 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9174#issuecomment-149448598 **[Test build #43966 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43966/consoleFull)** for PR 9174 at commit

[GitHub] spark pull request: [SPARK-10447][PYSPARK] upgrade pyspark to py4j...

2015-10-20 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/8615#issuecomment-149448649 Aw, 2 hours to run the JVM tests and 2 seconds to fail the Python ones :( If you'd like to iterate faster on this in Jenkins, feel free to comment out the

[GitHub] spark pull request: [SPARK-10447][PYSPARK] upgrade pyspark to py4j...

2015-10-20 Thread holdenk
Github user holdenk commented on the pull request: https://github.com/apache/spark/pull/8615#issuecomment-149459756 @JoshRosen cool, I'll do that tomorrow if it still has difficulty (I just had the py4j extracted locally so I didn't notice the change in path), hopefully #43967 is the

[GitHub] spark pull request: SPARK-10876 - Display total uptime for complet...

2015-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9059#issuecomment-149463523 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10655][SQL] Adding additional data type...

2015-10-20 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/9162#discussion_r42464756 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/jdbc/JdbcDialects.scala --- @@ -253,17 +253,33 @@ case object MySQLDialect extends JdbcDialect {

[GitHub] spark pull request: [SPARK-11201] [YARN] Make sure SPARK_YARN_MODE...

2015-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9174#issuecomment-149469318 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: Minor cleanup of ShuffleMapStage.outputLocs co...

2015-10-20 Thread rxin
GitHub user rxin opened a pull request: https://github.com/apache/spark/pull/9175 Minor cleanup of ShuffleMapStage.outputLocs code. I was looking at this code and found the documentation to be insufficient. I added more documentation, and refactored some relevant code path slightly

[GitHub] spark pull request: [SPARK-11201] [YARN] Make sure SPARK_YARN_MODE...

2015-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9174#issuecomment-149443519 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: Minor cleanup of ShuffleMapStage.outputLocs co...

2015-10-20 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/9175#discussion_r42467248 --- Diff: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala --- @@ -1202,7 +1195,7 @@ class DAGScheduler(

[GitHub] spark pull request: Minor cleanup of ShuffleMapStage.outputLocs co...

2015-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9175#issuecomment-149474616 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: Minor cleanup of ShuffleMapStage.outputLocs co...

2015-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9175#issuecomment-149474657 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: Minor cleanup of ShuffleMapStage.outputLocs co...

2015-10-20 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/9175#discussion_r42467209 --- Diff: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala --- @@ -931,24 +936,12 @@ class DAGScheduler(

[GitHub] spark pull request: Minor cleanup of ShuffleMapStage.outputLocs co...

2015-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9175#issuecomment-149475784 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11201] [YARN] Make sure SPARK_YARN_MODE...

2015-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9174#issuecomment-149475956 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11201] [YARN] Make sure SPARK_YARN_MODE...

2015-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9174#issuecomment-149448353 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10463] [SQL] remove PromotePrecision du...

2015-10-20 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/8621#issuecomment-149451946 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request: SPARK-10876 - Display total uptime for complet...

2015-10-20 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/9059#issuecomment-149465372 Merged to master --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-11184] [MLLIB] Declare most of .mllib c...

2015-10-20 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/9169#issuecomment-149473946 To give you an idea of how prevalent the `@Experimental` tag is ... - Streaming: 6 - Core: 29 - SQL: 42 - ML: 93 - MLlib: 95 Worth

[GitHub] spark pull request: Minor cleanup of ShuffleMapStage.outputLocs co...

2015-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9175#issuecomment-149475850 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11201] [YARN] Make sure SPARK_YARN_MODE...

2015-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9174#issuecomment-149475959 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11207][ML] Add test cases for solver se...

2015-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9180#issuecomment-149578865 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11105][yarn] Distribute log4j.propertie...

2015-10-20 Thread tgravescs
Github user tgravescs commented on the pull request: https://github.com/apache/spark/pull/9118#issuecomment-149587427 @vundela Does SPARK_LOG4J_CONF still work? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11105][yarn] Distribute log4j.propertie...

2015-10-20 Thread vundela
Github user vundela commented on a diff in the pull request: https://github.com/apache/spark/pull/9118#discussion_r42503914 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala --- @@ -497,6 +497,19 @@ private[spark] class Client( */ private def

[GitHub] spark pull request: [SPARK-11105][yarn] Distribute log4j.propertie...

2015-10-20 Thread vundela
Github user vundela commented on the pull request: https://github.com/apache/spark/pull/9118#issuecomment-149588730 @tgravescs Yes, it still works and user see a deprecated message. --- If your project is set up for it, you can reply to this email and have your reply appear on

  1   2   3   4   5   6   7   8   9   >