[jira] [Commented] (SPARK-17935) Add KafkaForeachWriter in external kafka-0.8.0 for structured streaming module

2016-11-02 Thread zhangxinyu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15628295#comment-15628295 ] zhangxinyu commented on SPARK-17935: Thank you for your suggestions. Kafka sink will support some

[jira] [Comment Edited] (SPARK-17935) Add KafkaForeachWriter in external kafka-0.8.0 for structured streaming module

2016-11-02 Thread zhangxinyu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15628295#comment-15628295 ] zhangxinyu edited comment on SPARK-17935 at 11/2/16 9:10 AM: - Thank you for

[jira] [Commented] (SPARK-17935) Add KafkaForeachWriter in external kafka-0.8.0 for structured streaming module

2016-10-31 Thread zhangxinyu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15621603#comment-15621603 ] zhangxinyu commented on SPARK-17935: Could you please take a look at current kafka sink design? >

[jira] [Comment Edited] (SPARK-17935) Add KafkaForeachWriter in external kafka-0.8.0 for structured streaming module

2016-10-31 Thread zhangxinyu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15601778#comment-15601778 ] zhangxinyu edited comment on SPARK-17935 at 10/31/16 8:25 AM: -- h2. KafkaSink

[jira] [Comment Edited] (SPARK-17935) Add KafkaForeachWriter in external kafka-0.8.0 for structured streaming module

2016-10-31 Thread zhangxinyu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15601778#comment-15601778 ] zhangxinyu edited comment on SPARK-17935 at 10/31/16 8:04 AM: -- h2. KafkaSink

[jira] [Comment Edited] (SPARK-17935) Add KafkaForeachWriter in external kafka-0.8.0 for structured streaming module

2016-10-31 Thread zhangxinyu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15601778#comment-15601778 ] zhangxinyu edited comment on SPARK-17935 at 10/31/16 8:03 AM: -- h2. KafkaSink

[jira] [Comment Edited] (SPARK-17935) Add KafkaForeachWriter in external kafka-0.8.0 for structured streaming module

2016-10-31 Thread zhangxinyu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15601778#comment-15601778 ] zhangxinyu edited comment on SPARK-17935 at 10/31/16 7:59 AM: -- h2. KafkaSink

[jira] [Comment Edited] (SPARK-17935) Add KafkaForeachWriter in external kafka-0.8.0 for structured streaming module

2016-10-31 Thread zhangxinyu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15601778#comment-15601778 ] zhangxinyu edited comment on SPARK-17935 at 10/31/16 7:54 AM: -- h2. KafkaSink

[jira] [Comment Edited] (SPARK-17935) Add KafkaForeachWriter in external kafka-0.8.0 for structured streaming module

2016-10-31 Thread zhangxinyu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15601778#comment-15601778 ] zhangxinyu edited comment on SPARK-17935 at 10/31/16 7:53 AM: -- h2. KafkaSink

[jira] [Commented] (SPARK-17935) Add KafkaForeachWriter in external kafka-0.8.0 for structured streaming module

2016-10-31 Thread zhangxinyu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15621541#comment-15621541 ] zhangxinyu commented on SPARK-17935: Thanks Cody Koeninger! Here is my opinion: * Kafka producer

[jira] [Comment Edited] (SPARK-17935) Add KafkaForeachWriter in external kafka-0.8.0 for structured streaming module

2016-10-25 Thread zhangxinyu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15601778#comment-15601778 ] zhangxinyu edited comment on SPARK-17935 at 10/26/16 3:26 AM: -- h2. KafkaSink

[jira] [Commented] (SPARK-17935) Add KafkaForeachWriter in external kafka-0.8.0 for structured streaming module

2016-10-24 Thread zhangxinyu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15601783#comment-15601783 ] zhangxinyu commented on SPARK-17935: I write a short deasign doc of KafkaSink for kafka-0.10 as

[jira] [Commented] (SPARK-17935) Add KafkaForeachWriter in external kafka-0.8.0 for structured streaming module

2016-10-24 Thread zhangxinyu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15601778#comment-15601778 ] zhangxinyu commented on SPARK-17935: h2. KafkaSink Design Doc h4. Goal Output results to kafka

[jira] [Commented] (SPARK-17935) Add KafkaForeachWriter in external kafka-0.8.0 for structured streaming module

2016-10-15 Thread zhangxinyu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15578176#comment-15578176 ] zhangxinyu commented on SPARK-17935: I will try it on 0.10 in the future. But as I know most of users

[jira] [Updated] (SPARK-17935) Add KafkaForeachWriter in external kafka-0.8.0 for structured streaming module

2016-10-14 Thread zhangxinyu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangxinyu updated SPARK-17935: --- Description: Now spark already supports kafkaInputStream. It would be useful that we add

[jira] [Updated] (SPARK-17935) Add KafkaForeachWriter in external kafka-0.8.0 for structured streaming module

2016-10-14 Thread zhangxinyu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangxinyu updated SPARK-17935: --- External issue URL: (was: https://github.com/apache/spark/pull/15483) > Add KafkaForeachWriter in

[jira] [Updated] (SPARK-17935) Add KafkaForeachWriter in external kafka-0.8.0 for structured streaming module

2016-10-14 Thread zhangxinyu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangxinyu updated SPARK-17935: --- External issue URL: https://github.com/apache/spark/pull/15483 > Add KafkaForeachWriter in external

[jira] [Created] (SPARK-17935) Add KafkaForeachWriter in external kafka-0.8.0 for structured streaming module

2016-10-14 Thread zhangxinyu (JIRA)
zhangxinyu created SPARK-17935: -- Summary: Add KafkaForeachWriter in external kafka-0.8.0 for structured streaming module Key: SPARK-17935 URL: https://issues.apache.org/jira/browse/SPARK-17935 Project:

[jira] [Commented] (SPARK-17631) Structured Streaming - Do we need to output results through http API?

2016-09-28 Thread zhangxinyu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15529311#comment-15529311 ] zhangxinyu commented on SPARK-17631: I agree with your points that http could be used as a

[jira] [Updated] (SPARK-17631) Structured Streaming - Do we need to output results through http API?

2016-09-27 Thread zhangxinyu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangxinyu updated SPARK-17631: --- Description: Streaming query results can be sinked to http server through http post request was:

[jira] [Commented] (SPARK-17631) Structured Streaming - Do we need to output results through http API?

2016-09-27 Thread zhangxinyu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15528228#comment-15528228 ] zhangxinyu commented on SPARK-17631: The pr is still open. I want to discuss it with someone who

[jira] [Created] (SPARK-17687) Structured Streaming - Does anyone need kafka sink

2016-09-27 Thread zhangxinyu (JIRA)
zhangxinyu created SPARK-17687: -- Summary: Structured Streaming - Does anyone need kafka sink Key: SPARK-17687 URL: https://issues.apache.org/jira/browse/SPARK-17687 Project: Spark Issue Type:

[jira] [Updated] (SPARK-17631) Structured Streaming - Do we need to output result through http API?

2016-09-27 Thread zhangxinyu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangxinyu updated SPARK-17631: --- Summary: Structured Streaming - Do we need to output result through http API? (was: Structured

[jira] [Updated] (SPARK-17631) Structured Streaming - Do we need to output results through http API?

2016-09-27 Thread zhangxinyu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangxinyu updated SPARK-17631: --- Summary: Structured Streaming - Do we need to output results through http API? (was: Structured

[jira] [Commented] (SPARK-17631) Structured Streaming - Add Http Stream Sink

2016-09-24 Thread zhangxinyu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15519970#comment-15519970 ] zhangxinyu commented on SPARK-17631: h4. A short design for this feature h5. Goal Build an http sink

[jira] [Updated] (SPARK-17631) Structured Streaming - Add Http Stream Sink

2016-09-22 Thread zhangxinyu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangxinyu updated SPARK-17631: --- Target Version/s: (was: 2.1.0, 2.2.0) > Structured Streaming - Add Http Stream Sink >

[jira] [Updated] (SPARK-17631) Structured Streaming - Add Http Stream Sink

2016-09-22 Thread zhangxinyu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangxinyu updated SPARK-17631: --- Shepherd: (was: Reynold Xin) > Structured Streaming - Add Http Stream Sink >

[jira] [Created] (SPARK-17631) Structured Streaming - Add Http Stream Sink

2016-09-22 Thread zhangxinyu (JIRA)
zhangxinyu created SPARK-17631: -- Summary: Structured Streaming - Add Http Stream Sink Key: SPARK-17631 URL: https://issues.apache.org/jira/browse/SPARK-17631 Project: Spark Issue Type: New