Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/17897
oh, seems it's included by https://github.com/apache/spark/pull/17540 ?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your proj
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/17540
Hi @rdblue , I have sent you a PR to fix the missing metrics issue of
`ExecutedCommandExec`, and we also need to fix the streaming batch metrics
issue, then we are ready to go.
---
If your proje
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/17880#discussion_r115244928
--- Diff:
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/analysis/TypeCoercionSuite.scala
---
@@ -484,24 +484,50 @@ class TypeCoercionSuite
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/17896
**[Test build #76576 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76576/testReport)**
for PR 17896 at commit
[`5637212`](https://github.com/apache/spark/commit/56
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/17869
@heary-cao, could you try to add `Utils.clearLocalRootDirs()` in the first
of `beforeEach` and in the last of `afterEach` and check out the results?
It looks initial local directory is c
Github user uncleGen commented on the issue:
https://github.com/apache/spark/pull/17896
retest this please.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so,
Github user n-marion commented on the issue:
https://github.com/apache/spark/pull/17686
Missed the import organization. Just ran it locally. Didn't hit same
problem.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If you
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/17886
**[Test build #76572 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76572/testReport)**
for PR 17886 at commit
[`6696502`](https://github.com/apache/spark/commit/66
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/17845
**[Test build #76571 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76571/testReport)**
for PR 17845 at commit
[`cf35eea`](https://github.com/apache/spark/commit/cf
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/17876
**[Test build #76570 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76570/testReport)**
for PR 17876 at commit
[`fcbeeb9`](https://github.com/apache/spark/commit/fc
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16989
**[Test build #76574 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76574/testReport)**
for PR 16989 at commit
[`4ad6bda`](https://github.com/apache/spark/commit/4a
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15435
**[Test build #76573 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76573/testReport)**
for PR 15435 at commit
[`b7dcd16`](https://github.com/apache/spark/commit/b7
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/17897
**[Test build #76575 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76575/testReport)**
for PR 17897 at commit
[`1adaf6e`](https://github.com/apache/spark/commit/1a
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/17844
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/17844
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76569/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/17844
**[Test build #76569 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76569/testReport)**
for PR 17844 at commit
[`fd5b43b`](https://github.com/apache/spark/commit/f
Github user wzhfy commented on the issue:
https://github.com/apache/spark/pull/17897
retest this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or
Github user WeichenXu123 commented on the issue:
https://github.com/apache/spark/pull/15435
jenkins test please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes
Github user jinxing64 commented on the issue:
https://github.com/apache/spark/pull/16989
Jenkins, test this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wis
Github user wzhfy commented on a diff in the pull request:
https://github.com/apache/spark/pull/17897#discussion_r115238974
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/command/tables.scala ---
@@ -1025,3 +1025,5 @@ case class ShowCreateTableCommand(table:
Tabl
Github user heary-cao commented on the issue:
https://github.com/apache/spark/pull/17869
@HyukjinKwon
ok
thanks.
I wish you the best
A happy holiday.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If yo
Github user ScrapCodes commented on the issue:
https://github.com/apache/spark/pull/17308
Hi @marmbrus and @brkyvz, Thanks a lot of taking a look.
@marmbrus You are right, we should have another way to canonicalize kafka
params. I can only think of appending a unique id to kaf
Github user maropu commented on the issue:
https://github.com/apache/spark/pull/17666
@hvanhovell ping
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or i
Github user WeichenXu123 commented on the issue:
https://github.com/apache/spark/pull/15435
Jenkins, test this please.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and
Github user ConeyLiu commented on a diff in the pull request:
https://github.com/apache/spark/pull/17898#discussion_r115232250
--- Diff: core/src/main/scala/org/apache/spark/rdd/CartesianRDD.scala ---
@@ -72,8 +72,10 @@ class CartesianRDD[T: ClassTag, U: ClassTag](
over
Github user jinxing64 commented on the issue:
https://github.com/apache/spark/pull/16989
@cloud-fan
Thank you very much for reviewing this thus far :)
>How about we always fetch to disk if the block size is over
maxBytesInFlight?
I super agree with this. It's to use `maxBy
Github user jinxing64 commented on a diff in the pull request:
https://github.com/apache/spark/pull/16989#discussion_r115230064
--- Diff:
core/src/main/scala/org/apache/spark/storage/ShuffleBlockFetcherIterator.scala
---
@@ -163,6 +173,8 @@ final class ShuffleBlockFetcherIterator(
Github user jinxing64 commented on a diff in the pull request:
https://github.com/apache/spark/pull/16989#discussion_r115229995
--- Diff:
core/src/main/scala/org/apache/spark/storage/ShuffleBlockFetcherIterator.scala
---
@@ -175,33 +187,45 @@ final class ShuffleBlockFetcherIterato
Github user jinxing64 commented on a diff in the pull request:
https://github.com/apache/spark/pull/16989#discussion_r115229968
--- Diff:
core/src/test/scala/org/apache/spark/scheduler/MapStatusSuite.scala ---
@@ -128,4 +130,22 @@ class MapStatusSuite extends SparkFunSuite {
Github user ConeyLiu commented on the issue:
https://github.com/apache/spark/pull/17300
Thanks @cloud-fan @mridulm @gatorsmile
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
en
Github user ConeyLiu commented on a diff in the pull request:
https://github.com/apache/spark/pull/17890#discussion_r115229257
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/streaming/DataStreamWriter.scala
---
@@ -379,7 +379,7 @@ final class DataStreamWriter[T] private[sq
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/17540#discussion_r115229230
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/StreamExecution.scala
---
@@ -283,44 +283,57 @@ class StreamExecution(
Github user WeichenXu123 commented on the issue:
https://github.com/apache/spark/pull/15435
Jenkins test this please.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and
Github user srowen commented on a diff in the pull request:
https://github.com/apache/spark/pull/17890#discussion_r115222829
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/streaming/DataStreamWriter.scala
---
@@ -379,7 +379,7 @@ final class DataStreamWriter[T] private[sql]
Github user MLnick commented on the issue:
https://github.com/apache/spark/pull/17742
LGTM - I think #17845 and this should go in 2.2. Let me know any objections
@srowen @jkbradley
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub
Github user MLnick commented on the issue:
https://github.com/apache/spark/pull/17845
jenkins retest this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishe
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/16989
looks pretty good, one last comment: since the shuffle fetcher doesn't
support spilling to disk, we should be very careful to avoid allocating a lot
of memory. Normally this should be fine as the
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/17860
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is ena
Github user jinxing64 commented on a diff in the pull request:
https://github.com/apache/spark/pull/16989#discussion_r115220025
--- Diff:
core/src/main/scala/org/apache/spark/storage/ShuffleBlockFetcherIterator.scala
---
@@ -163,6 +173,8 @@ final class ShuffleBlockFetcherIterator(
Github user MLnick commented on the issue:
https://github.com/apache/spark/pull/17860
Merged to master/branch-2.2
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wish
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/16989#discussion_r115219343
--- Diff:
core/src/test/scala/org/apache/spark/scheduler/MapStatusSuite.scala ---
@@ -128,4 +130,22 @@ class MapStatusSuite extends SparkFunSuite {
Github user jinxing64 commented on a diff in the pull request:
https://github.com/apache/spark/pull/16989#discussion_r115219258
--- Diff: core/src/main/scala/org/apache/spark/scheduler/MapStatus.scala ---
@@ -128,41 +130,52 @@ private[spark] class CompressedMapStatus(
* @param
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/16989#discussion_r115219013
--- Diff:
core/src/main/scala/org/apache/spark/storage/ShuffleBlockFetcherIterator.scala
---
@@ -175,33 +187,45 @@ final class ShuffleBlockFetcherIterato
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/17899
Can one of the admins verify this patch?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feat
GitHub user ptkool opened a pull request:
https://github.com/apache/spark/pull/17899
[SPARK-20636] Add new optimization rule to flip adjacent Window expressions.
## What changes were proposed in this pull request?
Add new optimization rule to eliminate unnecessary shuffling
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/16989#discussion_r115218468
--- Diff:
core/src/main/scala/org/apache/spark/storage/ShuffleBlockFetcherIterator.scala
---
@@ -163,6 +173,8 @@ final class ShuffleBlockFetcherIterator(
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/16989#discussion_r115218041
--- Diff:
core/src/main/scala/org/apache/spark/storage/ShuffleBlockFetcherIterator.scala
---
@@ -163,6 +173,8 @@ final class ShuffleBlockFetcherIterator(
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/16989#discussion_r115217559
--- Diff: core/src/main/scala/org/apache/spark/scheduler/MapStatus.scala ---
@@ -128,41 +130,52 @@ private[spark] class CompressedMapStatus(
* @param
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15435
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76565/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15435
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15435
**[Test build #76565 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76565/testReport)**
for PR 15435 at commit
[`b7dcd16`](https://github.com/apache/spark/commit/b
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/17866
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/17866
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76564/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/17866
**[Test build #76564 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76564/testReport)**
for PR 17866 at commit
[`ac710c7`](https://github.com/apache/spark/commit/a
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/17896
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76568/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/17896
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/17896
**[Test build #76568 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76568/testReport)**
for PR 17896 at commit
[`5637212`](https://github.com/apache/spark/commit/5
Github user mridulm commented on the issue:
https://github.com/apache/spark/pull/17300
Thanks for merging @cloud-fan, this PR kept dropping form my list ...
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/17898#discussion_r115211527
--- Diff: core/src/main/scala/org/apache/spark/rdd/CartesianRDD.scala ---
@@ -72,8 +72,10 @@ class CartesianRDD[T: ClassTag, U: ClassTag](
overr
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/17898#discussion_r115211058
--- Diff: core/src/main/scala/org/apache/spark/rdd/CartesianRDD.scala ---
@@ -72,8 +72,10 @@ class CartesianRDD[T: ClassTag, U: ClassTag](
overr
Github user srowen commented on a diff in the pull request:
https://github.com/apache/spark/pull/17898#discussion_r115210488
--- Diff: core/src/main/scala/org/apache/spark/rdd/CartesianRDD.scala ---
@@ -72,8 +72,10 @@ class CartesianRDD[T: ClassTag, U: ClassTag](
overri
Github user jinxing64 commented on the issue:
https://github.com/apache/spark/pull/16989
@cloud-fan
More comments on this ? :)
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this featur
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/17300
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is ena
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/17300
thanks, merging to master!
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wi
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/17887
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/17887
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76563/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/17887
**[Test build #76563 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76563/testReport)**
for PR 17887 at commit
[`ab77de7`](https://github.com/apache/spark/commit/a
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/17644#discussion_r115207897
--- Diff:
sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveExternalCatalog.scala ---
@@ -632,9 +632,51 @@ private[spark] class HiveExternalCatalog(co
Github user jtengyp commented on the issue:
https://github.com/apache/spark/pull/17898
Here is my test:
Environment : 3 workers, each has 10 cores, 30G memory, 1 executor
Test data : users : 480,189, each is a 10-dim vector, and items : 17770,
each is a 10-dim vector.
With
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/17887#discussion_r115207039
--- Diff:
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/parser/ExpressionParserSuite.scala
---
@@ -447,6 +462,44 @@ class ExpressionParserSui
Github user morenn520 commented on the issue:
https://github.com/apache/spark/pull/17872
@jerryshao done.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, o
Github user szalai1 commented on the issue:
https://github.com/apache/spark/pull/17435
@HyukjinKwon sure, I will do it this week. I totally forgot this. Sorry.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your proje
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/17887#discussion_r115205264
--- Diff:
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/parser/ExpressionParserSuite.scala
---
@@ -160,6 +166,15 @@ class ExpressionParserSui
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/17874#discussion_r115204690
--- Diff: mllib/src/test/scala/org/apache/spark/ml/fpm/FPGrowthSuite.scala
---
@@ -83,7 +83,7 @@ class FPGrowthSuite extends SparkFunSuite with
MLlibTest
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/17897
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/17796
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is ena
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/17897
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76567/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/17897
**[Test build #76567 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76567/testReport)**
for PR 17897 at commit
[`1adaf6e`](https://github.com/apache/spark/commit/1
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/17686
@n-marion looks like still some style issues from the checker
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/17796
Merged to master
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or i
Github user viirya commented on a diff in the pull request:
https://github.com/apache/spark/pull/17897#discussion_r115202713
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/command/tables.scala ---
@@ -1025,3 +1025,5 @@ case class ShowCreateTableCommand(table:
Tab
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/17844
**[Test build #76569 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76569/testReport)**
for PR 17844 at commit
[`fd5b43b`](https://github.com/apache/spark/commit/fd
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/17844#discussion_r115200884
--- Diff:
repl/scala-2.11/src/test/scala/org/apache/spark/repl/ReplSuite.scala ---
@@ -373,52 +190,6 @@ class ReplSuite extends SparkFunSuite {
}
Github user zuotingbing commented on the issue:
https://github.com/apache/spark/pull/17858
@gatorsmile it seems my mistake, i will try to fix this.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/17872
This change may be conflicted with #17723 , but I think it is easy to
resolve, CC @mgummelt .
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHu
Github user jerryshao commented on a diff in the pull request:
https://github.com/apache/spark/pull/17872#discussion_r115200282
--- Diff:
resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/security/HadoopFSCredentialProvider.scala
---
@@ -22,6 +22,8 @@ import scala
Github user viirya commented on the issue:
https://github.com/apache/spark/pull/17898
Maybe create a JIRA and update title as Spark PR convention. Since this
should be a performance improvement, the difference is expected to show.
---
If your project is set up for it, you can reply t
Github user jtengyp commented on a diff in the pull request:
https://github.com/apache/spark/pull/17898#discussion_r115199537
--- Diff: core/src/main/scala/org/apache/spark/rdd/CartesianRDD.scala ---
@@ -72,8 +72,10 @@ class CartesianRDD[T: ClassTag, U: ClassTag](
overr
Github user viirya commented on a diff in the pull request:
https://github.com/apache/spark/pull/17898#discussion_r115199237
--- Diff: core/src/main/scala/org/apache/spark/rdd/CartesianRDD.scala ---
@@ -72,8 +72,10 @@ class CartesianRDD[T: ClassTag, U: ClassTag](
overri
Github user chutium commented on a diff in the pull request:
https://github.com/apache/spark/pull/17886#discussion_r115196548
--- Diff:
sql/hive-thriftserver/src/main/java/org/apache/hive/service/cli/session/HiveSessionImpl.java
---
@@ -71,6 +71,10 @@
import org.apache.hive.s
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/17869
I think this does not look too urgent to merge it without investigating the
reason and it is inappropriate to submit a PR without knowing/explaining how it
fixes.
I suspect this is rela
Github user zuotingbing commented on the issue:
https://github.com/apache/spark/pull/17858
@gatorsmile My production environment is spark 2.0.2 and test successful.
Is there something be changed since 2.0.2 for this case? Thanks!
---
If your project is set up for it, you can reply to
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/17898
Please read http://spark.apache.org/contributing.html
For example, "Update X" is never sufficient as a title.
How does this avoid fetching? how much difference does it make?
---
If your proje
Github user morenn520 commented on a diff in the pull request:
https://github.com/apache/spark/pull/17872#discussion_r115191861
--- Diff:
resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/security/HadoopFSCredentialProvider.scala
---
@@ -48,9 +50,16 @@ private[sec
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/17898
Can one of the admins verify this patch?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feat
GitHub user jtengyp opened a pull request:
https://github.com/apache/spark/pull/17898
Update CartesianRDD.scala
In compute, group each iterator to multiple groups, reducing repeatedly
data fetching.
## What changes were proposed in this pull request?
In compute, gr
Github user gatorsmile commented on a diff in the pull request:
https://github.com/apache/spark/pull/17897#discussion_r115190940
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/QueryExecution.scala ---
@@ -114,7 +114,7 @@ class QueryExecution(val sparkSession: Spar
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/17896
**[Test build #76568 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76568/testReport)**
for PR 17896 at commit
[`5637212`](https://github.com/apache/spark/commit/56
Github user uncleGen commented on the issue:
https://github.com/apache/spark/pull/17896
retest this please.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so,
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/17897
**[Test build #76567 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76567/testReport)**
for PR 17897 at commit
[`1adaf6e`](https://github.com/apache/spark/commit/1a
501 - 600 of 634 matches
Mail list logo
