[
https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15389797#comment-15389797
]
Cody Koeninger commented on SPARK-12177:
This has already been merged for the upcoming Spark 2.0
[
https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15389668#comment-15389668
]
David Sabater commented on SPARK-12177:
---
I am with you guys, this is an important feature required
[
https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15357480#comment-15357480
]
Apache Spark commented on SPARK-12177:
--
User 'koeninger' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15356930#comment-15356930
]
Apache Spark commented on SPARK-12177:
--
User 'tdas' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15356704#comment-15356704
]
Apache Spark commented on SPARK-12177:
--
User 'tdas' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15341859#comment-15341859
]
Cody Koeninger commented on SPARK-12177:
Thanks for the comments, clarified where I could.
I
[
https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15341381#comment-15341381
]
Lars Francke commented on SPARK-12177:
--
I have looked at the code and have only minor nit-picks
[
https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15336811#comment-15336811
]
Mirza Gaush Beg commented on SPARK-12177:
-
any ETA on this fix. we are using spark 1.6 and kafka
[
https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15335369#comment-15335369
]
Jinxia Liu commented on SPARK-12177:
Thanks Cody, I will check your example.
I can move the extra
[
https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15335363#comment-15335363
]
Jinxia Liu commented on SPARK-12177:
Okay if you think its ok then let it be.
> Update KafkaDStreams
[
https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15335332#comment-15335332
]
Cody Koeninger commented on SPARK-12177:
The 0.8 consumer had mixed usage from different author's
[
https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15335311#comment-15335311
]
Cody Koeninger commented on SPARK-12177:
[~jinx...@ebay.com] Replied by email, but just to put
[
https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15335297#comment-15335297
]
Cody Koeninger commented on SPARK-12177:
Yes, that's related to that Kafka ticket, I noticed
[
https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15335215#comment-15335215
]
Jinxia Liu commented on SPARK-12177:
Hi Cody,
should the log usage be unified in the kafka streaming
[
https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15335200#comment-15335200
]
Jinxia Liu commented on SPARK-12177:
Hi Cody,
I did some tests today using your connector, and
[
https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15333960#comment-15333960
]
Sean Owen commented on SPARK-12177:
---
They should be in Spark, only. I haven't been following closely,
[
https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15333966#comment-15333966
]
Cody Koeninger commented on SPARK-12177:
I also believe they should be in Spark, only.
The only
[
https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15333694#comment-15333694
]
Cody Koeninger commented on SPARK-12177:
We've settled down to one PR, tests for that PR are
[
https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15331168#comment-15331168
]
Jinxia Liu commented on SPARK-12177:
Thanks Cody!
> Update KafkaDStreams to new Kafka 0.10 Consumer
[
https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15331114#comment-15331114
]
Cody Koeninger commented on SPARK-12177:
[~jinx...@ebay.com] looks like that test had some flaky
[
https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15331026#comment-15331026
]
Jinxia Liu commented on SPARK-12177:
[~c...@koeninger.org] thanks for the quick reply.
1. glad to
[
https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15331021#comment-15331021
]
Cody Koeninger commented on SPARK-12177:
[~jinx...@ebay.com]
1. I'm already looking at that test
[
https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15331007#comment-15331007
]
Jinxia Liu commented on SPARK-12177:
[~c...@koeninger.org] thanks for contributing the connector for
[
https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15331005#comment-15331005
]
Jinxia Liu commented on SPARK-12177:
[~c...@koeninger.org] thanks for contributing the connector for
[
https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15331003#comment-15331003
]
Cody Koeninger commented on SPARK-12177:
I had verified basic functionality with a broker set up
[
https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330675#comment-15330675
]
Mark Grover commented on SPARK-12177:
-
bq. I can rename it to spark-streaming-kafka-0-10 to match the
[
https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330552#comment-15330552
]
Cody Koeninger commented on SPARK-12177:
I can rename it to spark-streaming-kafka-0-10 to match
[
https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330500#comment-15330500
]
Mark Grover commented on SPARK-12177:
-
bq. It's worth mentioning that authentication is also
[
https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15329044#comment-15329044
]
Ismael Juma commented on SPARK-12177:
-
{quote}
b) the real benefit is security - I am personally a
[
https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15328894#comment-15328894
]
Sean McKibben commented on SPARK-12177:
---
Unfortunately I can't contribute what I would like to, but
[
https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15328707#comment-15328707
]
Cody Koeninger commented on SPARK-12177:
I don't think waiting for 0.11 makes sense.
> Update
[
https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15328699#comment-15328699
]
Mark Grover commented on SPARK-12177:
-
Hi Ismael and Cody,
My personal opinion was to hold off
[
https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15324702#comment-15324702
]
Cody Koeninger commented on SPARK-12177:
I'll say the same thing I told Luciano when he asked me
[
https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15324652#comment-15324652
]
Luciano Resende commented on SPARK-12177:
-
At Apache Bahir we are working on a release based on
[
https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15324566#comment-15324566
]
Cody Koeninger commented on SPARK-12177:
[~ijuma] I could be wrong, but I think Mark was talking
[
https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15324126#comment-15324126
]
Ismael Juma commented on SPARK-12177:
-
{quote}
I agree with Cody that the new Kafka consumer API
36 matches
Mail list logo
