Github user omuravskiy closed the pull request at:
https://github.com/apache/spark/pull/16006
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h
Github user omuravskiy commented on the issue:
https://github.com/apache/spark/pull/19431
No objections
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h
Github user omuravskiy commented on a diff in the pull request:
https://github.com/apache/spark/pull/16006#discussion_r105780496
--- Diff:
external/kafka-0-10/src/main/scala/org/apache/spark/streaming/kafka010/DirectKafkaInputDStream.scala
---
@@ -143,9 +147,16 @@ private[spark
Github user omuravskiy commented on the issue:
https://github.com/apache/spark/pull/16006
Yes
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so
Github user omuravskiy commented on the issue:
https://github.com/apache/spark/pull/16006
Tests added
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so
Github user omuravskiy commented on the issue:
https://github.com/apache/spark/pull/16006
I added new commit, the default value of `backpressureInitialRate` if
`spark.streaming.backpressure.initialRate` is now taken from
`spark.streaming.backpressure.pid.minRate`, or 100
Github user omuravskiy commented on a diff in the pull request:
https://github.com/apache/spark/pull/16006#discussion_r91038777
--- Diff:
external/kafka-0-10/src/main/scala/org/apache/spark/streaming/kafka010/DirectKafkaInputDStream.scala
---
@@ -143,9 +147,14 @@ private[spark
Github user omuravskiy commented on a diff in the pull request:
https://github.com/apache/spark/pull/16006#discussion_r91035292
--- Diff:
external/kafka-0-10/src/main/scala/org/apache/spark/streaming/kafka010/DirectKafkaInputDStream.scala
---
@@ -67,6 +67,10 @@ private[spark
GitHub user omuravskiy opened a pull request:
https://github.com/apache/spark/pull/16006
Use spark.streaming.backpressure.initialRate in DirectKafkaInputDStream
## What changes were proposed in this pull request?
Use spark.streaming.backpressure.initialRate
