Luis Alves created SPARK-13106:
----------------------------------
Summary: KafkaUtils.createDirectStream method with messageHandler
and topics
Key: SPARK-13106
URL: https://issues.apache.org/jira/browse/SPARK-13106
Project: Spark
Issue Type: Bug
Components: Streaming
Reporter: Luis Alves
Regarding the KafkaUtils.createDirectStream method here:
https://github.com/apache/spark/blob/master/external/kafka/src/main/scala/org/apache/spark/streaming/kafka/KafkaUtils.scala#L473
I purpose to also allow to pass the a messageHandler as argument instead of
using the one that is setted inside the method:
{code}
val messageHandler = (mmd: MessageAndMetadata[K, V]) => (mmd.key, mmd.message)
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]