[jira] [Commented] (SPARK-4063) Add the ability to send messages to Kafka in the stream
[ https://issues.apache.org/jira/browse/SPARK-4063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14236899#comment-14236899 ] Helena Edelson commented on SPARK-4063: --- Obviously. But since I created the ticket someone else submitted a PR https://github.com/apache/spark/pull/2994. The idea is of course that it is much cleaner to have a clean integration to read as well as write in a stream. Add the ability to send messages to Kafka in the stream --- Key: SPARK-4063 URL: https://issues.apache.org/jira/browse/SPARK-4063 Project: Spark Issue Type: New Feature Components: Input/Output Reporter: Helena Edelson Currently you can only receive from Kafka in the stream. This would be adding the ability to publish from the stream as well. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-4063) Add the ability to send messages to Kafka in the stream
[ https://issues.apache.org/jira/browse/SPARK-4063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14181520#comment-14181520 ] Helena Edelson commented on SPARK-4063: --- I have this started in a WIP branch Add the ability to send messages to Kafka in the stream --- Key: SPARK-4063 URL: https://issues.apache.org/jira/browse/SPARK-4063 Project: Spark Issue Type: New Feature Components: Input/Output Reporter: Helena Edelson Currently you can only receive from Kafka in the stream. This would be adding the ability to publish from the stream as well. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-4063) Add the ability to send messages to Kafka in the stream
[ https://issues.apache.org/jira/browse/SPARK-4063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14181526#comment-14181526 ] Sean Owen commented on SPARK-4063: -- Is this like a streaming operation that saves an RDD to a Kafka queue? The general ability to write to Kafka is of course accomplishable by just using the Kafka APIs. Add the ability to send messages to Kafka in the stream --- Key: SPARK-4063 URL: https://issues.apache.org/jira/browse/SPARK-4063 Project: Spark Issue Type: New Feature Components: Input/Output Reporter: Helena Edelson Currently you can only receive from Kafka in the stream. This would be adding the ability to publish from the stream as well. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
