Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/19611#discussion_r147824694
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/HDFSBackedStateStoreProvider.scala
---
@@ -297,17 +297,41 @@ private
Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/19611#discussion_r147784280
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/HDFSBackedStateStoreProvider.scala
---
@@ -297,17 +297,41 @@ private
Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/19611#discussion_r147824364
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/HDFSBackedStateStoreProvider.scala
---
@@ -297,17 +297,41 @@ private
Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/19611#discussion_r147826631
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/HDFSBackedStateStoreProvider.scala
---
@@ -297,17 +297,41 @@ private
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/19611
I think we can remove the unit test. It's obviously that `loadMap` is not
recursive and will not cause StackOverflowError
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/19469
Sorry for the delay. I think it's not worth to design a new feature that's
only for DStream. Instead, I would encourage people to use Structured Streaming
in the new Spark versions.
I'm
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/19581
Thanks! Merging to master.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/19581
LGTM pending tests
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/19435
Thanks! Merging to master.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/19469
LGTM. cc @jerryshao to take a look.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/19469
ok to test
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h
GitHub user zsxwing opened a pull request:
https://github.com/apache/spark/pull/19465
[SPARK-21988]Implement StreamingRelation.computeStats to fix explain
## What changes were proposed in this pull request?
Implement StreamingRelation.computeStats to fix explain
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/19465
cc @joseph-torres
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/19461
Discussed offline. We don't need to backport to branch-2.2.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/19461
Oh, there are some conflicts with 2.2. @joseph-torres could you submit a
backport PR, please?
---
-
To unsubscribe, e-mail
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/19461
Thanks! Merging to master and 2.2.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/19336
LGTM. Merging to master.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/19432
Thanks! Merging to master.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/19432
cc @gatorsmile
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h
GitHub user zsxwing opened a pull request:
https://github.com/apache/spark/pull/19432
[SPARK-22203][SQL]Add job description for file listing Spark jobs
## What changes were proposed in this pull request?
The user may be confused about some 1-tasks jobs. We can add a job
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/19416
LGTM pending tests
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h
Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/19416#discussion_r142583033
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/FlatMapGroupsWithState_StateManager.scala
---
@@ -0,0 +1,143
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/16568
@srowen sounds good to me. 2.2.0 was out several months ago and I didn't
see any issue caused by the new netty version
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/19314
Thanks! Merging to master and branch-2.2
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/19314
cc @marmbrus
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h
GitHub user zsxwing opened a pull request:
https://github.com/apache/spark/pull/19314
[SPARK-22094][SS]processAllAvailable should check the query state
## What changes were proposed in this pull request?
`processAllAvailable` should also check the query state
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/19271
LGTM pending tests
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h
Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/19271#discussion_r140050970
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/SymmetricHashJoinStateManager.scala
---
@@ -0,0 +1,405
Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/19271#discussion_r140055717
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/SymmetricHashJoinStateManager.scala
---
@@ -0,0 +1,403
Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/19271#discussion_r140042806
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/UnsupportedOperationChecker.scala
---
@@ -222,16 +222,17 @@ object
Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/19271#discussion_r140044239
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/StateStore.scala
---
@@ -27,9 +27,10 @@ import
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/19170
cc @vanzin
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/19170
ok to test
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/19212
Thanks! Merging to master.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/19212
LGTM pending tests
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/18317
I opened https://github.com/sitalkedia/spark/pull/1 in your repo. Could you
take a look at it?
---
-
To unsubscribe, e-mail
Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/18317#discussion_r138502374
--- Diff: core/src/main/java/org/apache/spark/io/ReadAheadInputStream.java
---
@@ -0,0 +1,313 @@
+/*
+ * Licensed under the Apache License, Version
Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/18317#discussion_r138430322
--- Diff: core/src/main/java/org/apache/spark/io/ReadAheadInputStream.java
---
@@ -0,0 +1,315 @@
+/*
+ * Licensed under the Apache License, Version
Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/18317#discussion_r138225592
--- Diff: core/src/main/java/org/apache/spark/io/ReadAheadInputStream.java
---
@@ -0,0 +1,315 @@
+/*
+ * Licensed under the Apache License, Version
Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/18317#discussion_r138201871
--- Diff: core/src/main/java/org/apache/spark/io/ReadAheadInputStream.java
---
@@ -0,0 +1,315 @@
+/*
+ * Licensed under the Apache License, Version
Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/18317#discussion_r138207519
--- Diff: core/src/main/java/org/apache/spark/io/ReadAheadInputStream.java
---
@@ -0,0 +1,315 @@
+/*
+ * Licensed under the Apache License, Version
Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/18317#discussion_r138193555
--- Diff: core/src/main/java/org/apache/spark/io/ReadAheadInputStream.java
---
@@ -0,0 +1,315 @@
+/*
+ * Licensed under the Apache License, Version
Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/18317#discussion_r138225438
--- Diff: core/src/main/java/org/apache/spark/io/ReadAheadInputStream.java
---
@@ -0,0 +1,315 @@
+/*
+ * Licensed under the Apache License, Version
Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/18317#discussion_r138198506
--- Diff: core/src/main/java/org/apache/spark/io/ReadAheadInputStream.java
---
@@ -0,0 +1,315 @@
+/*
+ * Licensed under the Apache License, Version
Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/18317#discussion_r138207456
--- Diff: core/src/main/java/org/apache/spark/io/ReadAheadInputStream.java
---
@@ -0,0 +1,315 @@
+/*
+ * Licensed under the Apache License, Version
Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/18317#discussion_r138195259
--- Diff: core/src/main/java/org/apache/spark/io/ReadAheadInputStream.java
---
@@ -0,0 +1,315 @@
+/*
+ * Licensed under the Apache License, Version
Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/18317#discussion_r138194732
--- Diff: core/src/main/java/org/apache/spark/io/ReadAheadInputStream.java
---
@@ -0,0 +1,315 @@
+/*
+ * Licensed under the Apache License, Version
Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/18317#discussion_r138204793
--- Diff: core/src/main/java/org/apache/spark/io/ReadAheadInputStream.java
---
@@ -0,0 +1,292 @@
+/*
+ * Licensed under the Apache License, Version
Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/18317#discussion_r138200321
--- Diff: core/src/main/java/org/apache/spark/io/ReadAheadInputStream.java
---
@@ -0,0 +1,317 @@
+/*
+ * Licensed under the Apache License, Version
Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/18317#discussion_r138194101
--- Diff: core/src/main/java/org/apache/spark/io/ReadAheadInputStream.java
---
@@ -0,0 +1,315 @@
+/*
+ * Licensed under the Apache License, Version
Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/18317#discussion_r138189593
--- Diff:
core/src/main/java/org/apache/spark/util/collection/unsafe/sort/UnsafeSorterSpillReader.java
---
@@ -72,10 +72,15 @@ public
Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/18317#discussion_r138189733
--- Diff:
core/src/test/java/org/apache/spark/io/GenericFileInputStreamSuite.java ---
@@ -50,17 +52,16 @@ public void tearDown
Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/18317#discussion_r138201264
--- Diff: core/src/main/java/org/apache/spark/io/ReadAheadInputStream.java
---
@@ -0,0 +1,315 @@
+/*
+ * Licensed under the Apache License, Version
Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/18317#discussion_r138188910
--- Diff:
core/src/main/java/org/apache/spark/util/collection/unsafe/sort/UnsafeSorterSpillReader.java
---
@@ -72,10 +72,15 @@ public
Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/18317#discussion_r138195292
--- Diff: core/src/main/java/org/apache/spark/io/ReadAheadInputStream.java
---
@@ -0,0 +1,315 @@
+/*
+ * Licensed under the Apache License, Version
Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/18317#discussion_r138200201
--- Diff: core/src/main/java/org/apache/spark/io/ReadAheadInputStream.java
---
@@ -0,0 +1,315 @@
+/*
+ * Licensed under the Apache License, Version
Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/18317#discussion_r138194341
--- Diff: core/src/main/java/org/apache/spark/io/ReadAheadInputStream.java
---
@@ -0,0 +1,315 @@
+/*
+ * Licensed under the Apache License, Version
Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/18317#discussion_r138208239
--- Diff: core/src/main/java/org/apache/spark/io/ReadAheadInputStream.java
---
@@ -0,0 +1,315 @@
+/*
+ * Licensed under the Apache License, Version
Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/18317#discussion_r138198579
--- Diff: core/src/main/java/org/apache/spark/io/ReadAheadInputStream.java
---
@@ -0,0 +1,315 @@
+/*
+ * Licensed under the Apache License, Version
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/19112
LGTM. Thanks! Merging to master and 2.2.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/19096#discussion_r137409030
--- Diff:
external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaWriteTask.scala
---
@@ -43,8 +43,10 @@ private[kafka010] class
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/18935
Merging to master.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/18935
Just realized the last build is 18 days ago. Triggered a new now. Will
merge after passing tests.
---
-
To unsubscribe, e-mail
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/18935
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/18935
LGTM since enableVerboseMetrics is off by default. Merging to master.
Thanks!
---
-
To unsubscribe, e-mail: reviews-unsubscr
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/19093
Thanks! Merging to master.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled
Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/18883#discussion_r136451595
--- Diff: project/MimaExcludes.scala ---
@@ -41,7 +41,10 @@ object MimaExcludes {
// [SPARK-19937] Add remote bytes read to disk
Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/18883#discussion_r136450775
--- Diff: project/MimaExcludes.scala ---
@@ -41,7 +41,10 @@ object MimaExcludes {
// [SPARK-19937] Add remote bytes read to disk
Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/18883#discussion_r136443138
--- Diff: project/MimaExcludes.scala ---
@@ -41,7 +41,10 @@ object MimaExcludes {
// [SPARK-19937] Add remote bytes read to disk
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/19093
LGTM pending tests
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/19093
ok to test
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/18928
@YuvalItzchakov there are many cases: power outage, the process is killed
by oom killer, or the user calls `System.exit`...
---
If your project is set up for it, you can reply to this email
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/18964
Thanks. Merging to master.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/18964
@neoremind that's an interesting project. However, Spark RPC is not
designed for high-performance and general RPC. In general, Spark just needs a
good enough RPC system. That's why it's using Java
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/18964
LGTM
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/18964
ok to test
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/18964
> I also notice that Spark RPC by default uses java native serialization,
even a verifying endpoint exist or not request would cost 1K of payload size,
not to mention some other real logic endpo
GitHub user zsxwing opened a pull request:
https://github.com/apache/spark/pull/18997
[SPARK-21788][SS]Handle more exceptions when stopping a streaming query
## What changes were proposed in this pull request?
Add more cases we should view as a normal query stop rather than
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/18935
Could you bump the netty version to use its new APIs rather than reflection?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/18923#discussion_r15831
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/console.scala
---
@@ -49,7 +49,7 @@ class ConsoleSink(options: Map[String
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/18944
retest this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so
Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/18944#discussion_r133096415
--- Diff:
sql/hive-thriftserver/src/test/scala/org/apache/spark/sql/hive/HiveMetastoreLazyInitializationSuite.scala
---
@@ -0,0 +1,57
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/18944
cc @yhuai
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so
GitHub user zsxwing opened a pull request:
https://github.com/apache/spark/pull/18944
[SPARK-21732][SQL]Lazily init hive metastore client
## What changes were proposed in this pull request?
This PR changes the codes to lazily init hive metastore client so that we
can
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/18928
@tdas
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so
GitHub user zsxwing opened a pull request:
https://github.com/apache/spark/pull/18928
[SPARK-21696][SS]Fix a potential issue that may generate partial snapshot
files
## What changes were proposed in this pull request?
Directly writing a snapshot file may generate a partial
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/18846
@thide I think DRIVER_HOST_ADDRESS will be used to generate the driver
url. Could you check if this line still works after your change?
https://github.com/apache/spark/blob
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/18890
Merged. Could you close the PR?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/18890
Thanks! Merging to branch-2.2.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/18890
LGTM
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/18799
@tdas addressed your comments
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled
Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/18799#discussion_r132067907
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/streaming/FileStreamSourceSuite.scala
---
@@ -1314,6 +1314,7 @@ class FileStreamSourceSuite extends
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/18881
retest this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/18881
LGTM pending tests
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/18179
@markgrover I'm going to close this one. This is just an improvement and
not need to go into 2.2.1.
---
If your project is set up for it, you can reply to this email and have your
reply appear
Github user zsxwing closed the pull request at:
https://github.com/apache/spark/pull/18179
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature
Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/18799#discussion_r131793251
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/HDFSMetadataLog.scala
---
@@ -123,7 +123,7 @@ class HDFSMetadataLog[T <: Any
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/18840
Thanks! Merging to master and branch-2.2.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/18848
Also merged to branch-2.2.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/18846
Does this affect how we detect driver/executor connection lost?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does
601 - 700 of 6049 matches
Mail list logo
