Iulian Dragos created SPARK-8978:
------------------------------------
Summary: Implement the DirectKafkaController
Key: SPARK-8978
URL: https://issues.apache.org/jira/browse/SPARK-8978
Project: Spark
Issue Type: Sub-task
Components: Streaming
Reporter: Iulian Dragos
Fix For: 1.5.0
Based on this [design
doc|https://docs.google.com/document/d/1ls_g5fFmfbbSTIfQQpUxH56d0f3OksF567zwA00zK9E/edit?usp=sharing].
The DirectKafkaInputDStream should use the rate estimate to control how many
records/partition to put in the next batch.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
