[GitHub] spark issue #18966: [SPARK-21751][SQL] CodeGeneraor.splitExpressions counts ...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18966 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82598/ Test PASSed. ---

[GitHub] spark issue #18966: [SPARK-21751][SQL] CodeGeneraor.splitExpressions counts ...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18966 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #18966: [SPARK-21751][SQL] CodeGeneraor.splitExpressions counts ...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18966 **[Test build #82598 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82598/testReport)** for PR 18966 at commit

[GitHub] spark pull request #19439: [SPARK-21866][ML][PySpark] Adding spark image rea...

Github user MrBago commented on a diff in the pull request: https://github.com/apache/spark/pull/19439#discussion_r143853274 --- Diff: python/pyspark/ml/image.py --- @@ -0,0 +1,133 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one or more +#

[GitHub] spark issue #6751: [SPARK-8300] DataFrame hint for broadcast join.

Github user sridharsubramanian62 commented on the issue: https://github.com/apache/spark/pull/6751 Its available from spark 2.2.0. On Tuesday, October 10, 2017, 1:46:27 PM PDT, Reynold Xin wrote: Isn't the hint available in SQL?

[GitHub] spark pull request #18029: [SPARK-20168] [DStream] Add changes to use kinesi...

Github user brkyvz commented on a diff in the pull request: https://github.com/apache/spark/pull/18029#discussion_r143850792 --- Diff: external/kinesis-asl/src/main/scala/org/apache/spark/streaming/kinesis/KinesisReceiver.scala --- @@ -148,18 +149,30 @@ private[kinesis] class

[GitHub] spark pull request #18029: [SPARK-20168] [DStream] Add changes to use kinesi...

Github user brkyvz commented on a diff in the pull request: https://github.com/apache/spark/pull/18029#discussion_r143850553 --- Diff: external/kinesis-asl/src/main/scala/org/apache/spark/streaming/kinesis/KinesisInputDStream.scala --- @@ -182,14 +181,14 @@ object

[GitHub] spark pull request #18029: [SPARK-20168] [DStream] Add changes to use kinesi...

Github user brkyvz commented on a diff in the pull request: https://github.com/apache/spark/pull/18029#discussion_r143849596 --- Diff: external/kinesis-asl/src/main/java/org/apache/spark/streaming/kinesis/KinesisInitialPosition.java --- @@ -0,0 +1,53 @@ +/* + * Licensed

[GitHub] spark pull request #18029: [SPARK-20168] [DStream] Add changes to use kinesi...

Github user brkyvz commented on a diff in the pull request: https://github.com/apache/spark/pull/18029#discussion_r143850857 --- Diff: external/kinesis-asl/src/test/java/org/apache/spark/streaming/kinesis/JavaKinesisInputDStreamBuilderSuite.java --- @@ -45,15 +43,15 @@ public

[GitHub] spark pull request #18029: [SPARK-20168] [DStream] Add changes to use kinesi...

Github user brkyvz commented on a diff in the pull request: https://github.com/apache/spark/pull/18029#discussion_r143849691 --- Diff: external/kinesis-asl/src/main/java/org/apache/spark/streaming/kinesis/KinesisInitialPosition.java --- @@ -0,0 +1,53 @@ +/* + * Licensed

[GitHub] spark pull request #18029: [SPARK-20168] [DStream] Add changes to use kinesi...

Github user brkyvz commented on a diff in the pull request: https://github.com/apache/spark/pull/18029#discussion_r143849634 --- Diff: external/kinesis-asl/src/main/java/org/apache/spark/streaming/kinesis/KinesisInitialPosition.java --- @@ -0,0 +1,53 @@ +/* + * Licensed

[GitHub] spark pull request #18029: [SPARK-20168] [DStream] Add changes to use kinesi...

Github user brkyvz commented on a diff in the pull request: https://github.com/apache/spark/pull/18029#discussion_r143849442 --- Diff: external/kinesis-asl/src/main/scala/org/apache/spark/streaming/kinesis/InitialPosition.scala --- @@ -0,0 +1,101 @@ +/* + * Licensed to

[GitHub] spark pull request #18029: [SPARK-20168] [DStream] Add changes to use kinesi...

Github user brkyvz commented on a diff in the pull request: https://github.com/apache/spark/pull/18029#discussion_r143850590 --- Diff: external/kinesis-asl/src/main/scala/org/apache/spark/streaming/kinesis/KinesisInputDStream.scala --- @@ -182,14 +181,14 @@ object

[GitHub] spark issue #19250: [SPARK-12297] Table timezone correction for Timestamps

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19250 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19250: [SPARK-12297] Table timezone correction for Timestamps

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19250 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82595/ Test PASSed. ---

[GitHub] spark pull request #19181: [SPARK-21907][CORE] oom during spill

Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/19181 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #19250: [SPARK-12297] Table timezone correction for Timestamps

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19250 **[Test build #82595 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82595/testReport)** for PR 19250 at commit

[GitHub] spark issue #19181: [SPARK-21907][CORE] oom during spill

Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/19181 Merging to master. Thanks! Can you create a backport for Spark-2.2? --- - To unsubscribe, e-mail:

[GitHub] spark issue #18966: [SPARK-21751][SQL] CodeGeneraor.splitExpressions counts ...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18966 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #18966: [SPARK-21751][SQL] CodeGeneraor.splitExpressions counts ...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18966 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82596/ Test PASSed. ---

[GitHub] spark issue #18966: [SPARK-21751][SQL] CodeGeneraor.splitExpressions counts ...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18966 **[Test build #82596 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82596/testReport)** for PR 18966 at commit

[GitHub] spark issue #19181: [SPARK-21907][CORE] oom during spill

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19181 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82594/ Test PASSed. ---

[GitHub] spark issue #19181: [SPARK-21907][CORE] oom during spill

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19181 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19181: [SPARK-21907][CORE] oom during spill

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19181 **[Test build #82594 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82594/testReport)** for PR 19181 at commit

[GitHub] spark issue #6751: [SPARK-8300] DataFrame hint for broadcast join.

Github user rxin commented on the issue: https://github.com/apache/spark/pull/6751 Isn't the hint available in SQL? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands,

[GitHub] spark issue #18664: [SPARK-21375][PYSPARK][SQL][WIP] Add Date and Timestamp ...

Github user BryanCutler commented on the issue: https://github.com/apache/spark/pull/18664 I'll work on doing (1) to have conversions in Python for Arrow to match Non-Arrow and we can see how that turns out. --- -

[GitHub] spark issue #18664: [SPARK-21375][PYSPARK][SQL][WIP] Add Date and Timestamp ...

Github user BryanCutler commented on the issue: https://github.com/apache/spark/pull/18664 > I'm just wondering what if we use timestamp in nested types. Currently we don't support nested types but in the future? I'll try to take this into account, or at least add a note for

[GitHub] spark issue #18664: [SPARK-21375][PYSPARK][SQL][WIP] Add Date and Timestamp ...

Github user BryanCutler commented on the issue: https://github.com/apache/spark/pull/18664 > BTW, do you think it is possible to easily de-duplicate timezone handling for both with-Arrow and without-Arrow within Python side if we go for 1. in the separate PR? @HyukjinKwon ,

[GitHub] spark issue #17100: [SPARK-13947][SQL] PySpark DataFrames: The error message...

Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/17100 Will review it this weekend. Thanks! --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19466: [SPARK-22237] [CORE] Fix spark submit file download for ...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19466 **[Test build #82604 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82604/testReport)** for PR 19466 at commit

[GitHub] spark issue #19466: [CORE] Fix spark submit file download for standalone cli...

Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/19466 cc @yhuai @jiangxb1987 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #19466: [CORE] Fix spark submit file download for standalone cli...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19466 **[Test build #82603 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82603/testReport)** for PR 19466 at commit

[GitHub] spark issue #15670: [SPARK-18161] [Python] Allow pickle to serialize >4 GB o...

Github user holdenk commented on the issue: https://github.com/apache/spark/pull/15670 Do we plan to move this forward? Do you have the time to update this @singularperturbation ? --- - To unsubscribe, e-mail:

[GitHub] spark pull request #15670: [SPARK-18161] [Python] Allow pickle to serialize ...

Github user holdenk commented on a diff in the pull request: https://github.com/apache/spark/pull/15670#discussion_r143838765 --- Diff: python/pyspark/serializers.py --- @@ -64,7 +64,7 @@ from itertools import izip as zip else: import pickle -protocol

[GitHub] spark pull request #19466: [CORE] Fix spark submit file download for standal...

GitHub user loneknightpy opened a pull request: https://github.com/apache/spark/pull/19466 [CORE] Fix spark submit file download for standalone client mode ## What changes were proposed in this pull request? This PR makes spark-submit script to use downloaded files in

[GitHub] spark pull request #15666: [SPARK-11421] [Core][Python][R] Added ability for...

Github user holdenk commented on a diff in the pull request: https://github.com/apache/spark/pull/15666#discussion_r143838425 --- Diff: python/pyspark/tests.py --- @@ -435,6 +436,19 @@ def test_add_file_locally(self): with open(download_path) as test_file:

[GitHub] spark issue #18457: [SPARK-21241][MLlib]- Add setIntercept to StreamingLinea...

Github user holdenk commented on the issue: https://github.com/apache/spark/pull/18457 In the meantime Jenkins OK to test. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands,

[GitHub] spark issue #17100: [SPARK-13947][SQL] PySpark DataFrames: The error message...

Github user holdenk commented on the issue: https://github.com/apache/spark/pull/17100 re-ping @gatorsmile? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #18457: [SPARK-21241][MLlib]- Add setIntercept to StreamingLinea...

Github user holdenk commented on the issue: https://github.com/apache/spark/pull/18457 So we're only really doing bug fixes on the old MLlib stuff, but I guess we haven't finalized the new ML streaming stuff so I'm not sure what we want to do here. cc @MLnick . ---

[GitHub] spark pull request #19439: [SPARK-21866][ML][PySpark] Adding spark image rea...

Github user holdenk commented on a diff in the pull request: https://github.com/apache/spark/pull/19439#discussion_r143836094 --- Diff: python/pyspark/ml/image.py --- @@ -0,0 +1,133 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one or more +#

[GitHub] spark pull request #19439: [SPARK-21866][ML][PySpark] Adding spark image rea...

Github user holdenk commented on a diff in the pull request: https://github.com/apache/spark/pull/19439#discussion_r143836725 --- Diff: python/pyspark/ml/image.py --- @@ -0,0 +1,133 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one or more +#

[GitHub] spark pull request #19439: [SPARK-21866][ML][PySpark] Adding spark image rea...

Github user holdenk commented on a diff in the pull request: https://github.com/apache/spark/pull/19439#discussion_r143836993 --- Diff: python/pyspark/ml/image.py --- @@ -0,0 +1,133 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one or more +#

[GitHub] spark pull request #19082: [SPARK-21870][SQL] Split aggregation code into sm...

Github user a10y commented on a diff in the pull request: https://github.com/apache/spark/pull/19082#discussion_r143836700 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/aggregate/HashAggregateExec.scala --- @@ -244,6 +246,89 @@ case class HashAggregateExec(

[GitHub] spark pull request #19082: [SPARK-21870][SQL] Split aggregation code into sm...

Github user a10y commented on a diff in the pull request: https://github.com/apache/spark/pull/19082#discussion_r143836110 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/aggregate/HashAggregateExec.scala --- @@ -244,6 +246,89 @@ case class HashAggregateExec(

[GitHub] spark issue #19082: [SPARK-21870][SQL] Split aggregation code into small fun...

Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/19082 @kiszk This is one of the solutions if we can remove the limit of num of parameters. However, this does not resolve all the issues. For example, the method becomes too big to inline. ---

[GitHub] spark issue #19438: [SPARK-22208] [SQL] Improve percentile_approx by not rou...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19438 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19438: [SPARK-22208] [SQL] Improve percentile_approx by not rou...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19438 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82593/ Test PASSed. ---

[GitHub] spark issue #19272: [Spark-21842][Mesos] Support Kerberos ticket renewal and...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19272 **[Test build #82602 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82602/testReport)** for PR 19272 at commit

[GitHub] spark issue #19438: [SPARK-22208] [SQL] Improve percentile_approx by not rou...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19438 **[Test build #82593 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82593/testReport)** for PR 19438 at commit

[GitHub] spark issue #19272: [Spark-21842][Mesos] Support Kerberos ticket renewal and...

Github user vanzin commented on the issue: https://github.com/apache/spark/pull/19272 add to whitelist --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #19272: [Spark-21842][Mesos] Support Kerberos ticket renewal and...

Github user vanzin commented on the issue: https://github.com/apache/spark/pull/19272 ok to test --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #19250: [SPARK-12297] Table timezone correction for Timestamps

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19250 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82592/ Test PASSed. ---

[GitHub] spark issue #19250: [SPARK-12297] Table timezone correction for Timestamps

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19250 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19250: [SPARK-12297] Table timezone correction for Timestamps

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19250 **[Test build #82592 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82592/testReport)** for PR 19250 at commit

[GitHub] spark issue #18460: [SPARK-21247][SQL] Type comparison should respect case-s...

Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/18460 Hi, @gatorsmile . Could you review this? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For

[GitHub] spark pull request #19337: [SPARK-22114][ML][MLLIB]add epsilon for LDA

Github user hhbyyh commented on a diff in the pull request: https://github.com/apache/spark/pull/19337#discussion_r143818776 --- Diff: mllib/src/main/scala/org/apache/spark/ml/clustering/LDA.scala --- @@ -224,6 +224,24 @@ private[clustering] trait LDAParams extends Params with

[GitHub] spark issue #19082: [SPARK-21870][SQL] Split aggregation code into small fun...

Github user kiszk commented on the issue: https://github.com/apache/spark/pull/19082 @gatorsmile let me clarify. In other words, do you want to find how to cut the boundary to ensure enabling method inlining for callee methods? It could maximize advantage of both whole-stage codegen

[GitHub] spark issue #19465: [SPARK-21988][SS]Implement StreamingRelation.computeStat...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19465 **[Test build #82600 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82600/testReport)** for PR 19465 at commit

[GitHub] spark issue #19459: [SPARK-20791][PYSPARK] Use Arrow to create Spark DataFra...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19459 **[Test build #82601 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82601/testReport)** for PR 19459 at commit

[GitHub] spark issue #19309: [SPARK-19558][sql] Add config key to register QueryExecu...

Github user vanzin commented on the issue: https://github.com/apache/spark/pull/19309 That's basically what the PR summary says. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #19459: [SPARK-20791][PYSPARK] Use Arrow to create Spark ...

Github user BryanCutler commented on a diff in the pull request: https://github.com/apache/spark/pull/19459#discussion_r143821657 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/arrow/ArrowConverters.scala --- @@ -203,4 +205,16 @@ private[sql] object

[GitHub] spark pull request #19465: [SPARK-21988]Implement StreamingRelation.computeS...

GitHub user zsxwing opened a pull request: https://github.com/apache/spark/pull/19465 [SPARK-21988]Implement StreamingRelation.computeStats to fix explain ## What changes were proposed in this pull request? Implement StreamingRelation.computeStats to fix explain ##

[GitHub] spark issue #19465: [SPARK-21988]Implement StreamingRelation.computeStats to...

Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/19465 cc @joseph-torres --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark pull request #19041: [SPARK-21097][CORE] Add option to recover cached ...

Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/19041#discussion_r143801968 --- Diff: core/src/main/scala/org/apache/spark/CacheRecoveryManager.scala --- @@ -0,0 +1,250 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request #19041: [SPARK-21097][CORE] Add option to recover cached ...

Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/19041#discussion_r143802667 --- Diff: core/src/main/scala/org/apache/spark/CacheRecoveryManager.scala --- @@ -0,0 +1,250 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request #19041: [SPARK-21097][CORE] Add option to recover cached ...

Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/19041#discussion_r143817781 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/CoarseGrainedSchedulerBackend.scala --- @@ -646,18 +648,14 @@ class

[GitHub] spark pull request #19041: [SPARK-21097][CORE] Add option to recover cached ...

Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/19041#discussion_r143800800 --- Diff: core/src/main/scala/org/apache/spark/CacheRecoveryManager.scala --- @@ -0,0 +1,250 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request #19041: [SPARK-21097][CORE] Add option to recover cached ...

Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/19041#discussion_r143813032 --- Diff: core/src/main/scala/org/apache/spark/CacheRecoveryManager.scala --- @@ -0,0 +1,250 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark issue #19082: [SPARK-21870][SQL] Split aggregation code into small fun...

Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/19082 https://github.com/apache/spark/pull/18931 is not what we want, although it can partially resolves some issues. Simply disabling the whole-stage codegen might trigger the regression like Q66.

[GitHub] spark pull request #19041: [SPARK-21097][CORE] Add option to recover cached ...

Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/19041#discussion_r143814841 --- Diff: core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala --- @@ -88,6 +88,8 @@ private[spark] class ExecutorAllocationManager(

[GitHub] spark pull request #19041: [SPARK-21097][CORE] Add option to recover cached ...

Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/19041#discussion_r143802485 --- Diff: core/src/main/scala/org/apache/spark/CacheRecoveryManager.scala --- @@ -0,0 +1,250 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request #19041: [SPARK-21097][CORE] Add option to recover cached ...

Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/19041#discussion_r143820628 --- Diff: core/src/main/scala/org/apache/spark/storage/BlockManagerMasterEndpoint.scala --- @@ -237,6 +246,43 @@ class BlockManagerMasterEndpoint(

[GitHub] spark pull request #19041: [SPARK-21097][CORE] Add option to recover cached ...

Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/19041#discussion_r143812180 --- Diff: core/src/main/scala/org/apache/spark/CacheRecoveryManager.scala --- @@ -0,0 +1,250 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request #19041: [SPARK-21097][CORE] Add option to recover cached ...

Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/19041#discussion_r143810812 --- Diff: core/src/main/scala/org/apache/spark/CacheRecoveryManager.scala --- @@ -0,0 +1,250 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request #19041: [SPARK-21097][CORE] Add option to recover cached ...

Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/19041#discussion_r143810600 --- Diff: core/src/main/scala/org/apache/spark/CacheRecoveryManager.scala --- @@ -0,0 +1,250 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request #19041: [SPARK-21097][CORE] Add option to recover cached ...

Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/19041#discussion_r143800993 --- Diff: core/src/main/scala/org/apache/spark/CacheRecoveryManager.scala --- @@ -0,0 +1,250 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request #19041: [SPARK-21097][CORE] Add option to recover cached ...

Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/19041#discussion_r143819718 --- Diff: core/src/main/scala/org/apache/spark/storage/BlockManagerMasterEndpoint.scala --- @@ -237,6 +246,43 @@ class BlockManagerMasterEndpoint(

[GitHub] spark pull request #19041: [SPARK-21097][CORE] Add option to recover cached ...

Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/19041#discussion_r143813769 --- Diff: core/src/main/scala/org/apache/spark/CacheRecoveryManager.scala --- @@ -0,0 +1,250 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request #19041: [SPARK-21097][CORE] Add option to recover cached ...

Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/19041#discussion_r143815041 --- Diff: core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala --- @@ -234,12 +239,14 @@ private[spark] class ExecutorAllocationManager(

[GitHub] spark pull request #19041: [SPARK-21097][CORE] Add option to recover cached ...

Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/19041#discussion_r143816789 --- Diff: core/src/main/scala/org/apache/spark/internal/config/package.scala --- @@ -76,6 +76,14 @@ package object config {

[GitHub] spark pull request #19041: [SPARK-21097][CORE] Add option to recover cached ...

Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/19041#discussion_r143818189 --- Diff: core/src/main/scala/org/apache/spark/storage/BlockManagerMasterEndpoint.scala --- @@ -97,6 +97,10 @@ class BlockManagerMasterEndpoint(

[GitHub] spark pull request #19041: [SPARK-21097][CORE] Add option to recover cached ...

Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/19041#discussion_r143802914 --- Diff: core/src/main/scala/org/apache/spark/CacheRecoveryManager.scala --- @@ -0,0 +1,250 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request #19041: [SPARK-21097][CORE] Add option to recover cached ...

Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/19041#discussion_r143811908 --- Diff: core/src/main/scala/org/apache/spark/CacheRecoveryManager.scala --- @@ -0,0 +1,250 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request #19041: [SPARK-21097][CORE] Add option to recover cached ...

Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/19041#discussion_r143807978 --- Diff: core/src/main/scala/org/apache/spark/CacheRecoveryManager.scala --- @@ -0,0 +1,250 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request #19041: [SPARK-21097][CORE] Add option to recover cached ...

Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/19041#discussion_r143811393 --- Diff: core/src/main/scala/org/apache/spark/CacheRecoveryManager.scala --- @@ -0,0 +1,250 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request #19041: [SPARK-21097][CORE] Add option to recover cached ...

Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/19041#discussion_r143816598 --- Diff: core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala --- @@ -416,63 +423,52 @@ private[spark] class ExecutorAllocationManager(

[GitHub] spark pull request #19041: [SPARK-21097][CORE] Add option to recover cached ...

Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/19041#discussion_r143810176 --- Diff: core/src/main/scala/org/apache/spark/CacheRecoveryManager.scala --- @@ -0,0 +1,250 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request #19041: [SPARK-21097][CORE] Add option to recover cached ...

Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/19041#discussion_r143813871 --- Diff: core/src/main/scala/org/apache/spark/CacheRecoveryManager.scala --- @@ -0,0 +1,250 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request #19041: [SPARK-21097][CORE] Add option to recover cached ...

Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/19041#discussion_r143814023 --- Diff: core/src/main/scala/org/apache/spark/CacheRecoveryManager.scala --- @@ -0,0 +1,250 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request #19041: [SPARK-21097][CORE] Add option to recover cached ...

Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/19041#discussion_r143818025 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/CoarseGrainedSchedulerBackend.scala --- @@ -698,6 +696,11 @@ class

[GitHub] spark pull request #19041: [SPARK-21097][CORE] Add option to recover cached ...

Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/19041#discussion_r143817365 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/CoarseGrainedSchedulerBackend.scala --- @@ -646,18 +648,14 @@ class

[GitHub] spark pull request #19041: [SPARK-21097][CORE] Add option to recover cached ...

Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/19041#discussion_r143817162 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/CoarseGrainedSchedulerBackend.scala --- @@ -601,40 +602,41 @@ class

[GitHub] spark pull request #19041: [SPARK-21097][CORE] Add option to recover cached ...

Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/19041#discussion_r143816092 --- Diff: core/src/main/scala/org/apache/spark/CacheRecoveryManager.scala --- @@ -0,0 +1,250 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request #19041: [SPARK-21097][CORE] Add option to recover cached ...

Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/19041#discussion_r143819863 --- Diff: core/src/main/scala/org/apache/spark/storage/BlockManagerMasterEndpoint.scala --- @@ -237,6 +246,43 @@ class BlockManagerMasterEndpoint(

[GitHub] spark pull request #19041: [SPARK-21097][CORE] Add option to recover cached ...

Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/19041#discussion_r143802830 --- Diff: core/src/main/scala/org/apache/spark/CacheRecoveryManager.scala --- @@ -0,0 +1,250 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request #19041: [SPARK-21097][CORE] Add option to recover cached ...

Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/19041#discussion_r143803799 --- Diff: core/src/main/scala/org/apache/spark/CacheRecoveryManager.scala --- @@ -0,0 +1,250 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request #19041: [SPARK-21097][CORE] Add option to recover cached ...

Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/19041#discussion_r143801381 --- Diff: core/src/main/scala/org/apache/spark/CacheRecoveryManager.scala --- @@ -0,0 +1,250 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request #19041: [SPARK-21097][CORE] Add option to recover cached ...

Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/19041#discussion_r143799387 --- Diff: core/src/main/scala/org/apache/spark/CacheRecoveryManager.scala --- @@ -0,0 +1,250 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request #19041: [SPARK-21097][CORE] Add option to recover cached ...

Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/19041#discussion_r143816714 --- Diff: core/src/main/scala/org/apache/spark/internal/config/package.scala --- @@ -76,6 +76,14 @@ package object config {

[GitHub] spark pull request #19041: [SPARK-21097][CORE] Add option to recover cached ...

Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/19041#discussion_r143815711 --- Diff: core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala --- @@ -416,63 +423,52 @@ private[spark] class ExecutorAllocationManager(

<    1   2   3   4   5   6   >