[
https://issues.apache.org/jira/browse/SPARK-17147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16359786#comment-16359786
]
Apache Spark commented on SPARK-17147:
--
User 'koeninger' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-17147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16338032#comment-16338032
]
Justin Miller commented on SPARK-17147:
---
I'm also seeing this behavior on a topic that has
[
https://issues.apache.org/jira/browse/SPARK-17147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16337027#comment-16337027
]
chao.wu commented on SPARK-17147:
-
While the topic clean config is delete "cleanup.policy=delete", the
[
https://issues.apache.org/jira/browse/SPARK-17147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157002#comment-16157002
]
Cody Koeninger commented on SPARK-17147:
Patch is there, if anyone wants to test it and provide
[
https://issues.apache.org/jira/browse/SPARK-17147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16156937#comment-16156937
]
Michal W commented on SPARK-17147:
--
Hey, just wanted to check if there's any progress on this issue?
>
[
https://issues.apache.org/jira/browse/SPARK-17147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15887342#comment-15887342
]
Dean Wampler commented on SPARK-17147:
--
Cody, thanks for the suggestion. We'll try to test it and
[
https://issues.apache.org/jira/browse/SPARK-17147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15887091#comment-15887091
]
Cody Koeninger commented on SPARK-17147:
Dean if you guys have any bandwith to help test out
[
https://issues.apache.org/jira/browse/SPARK-17147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15882778#comment-15882778
]
Dean Wampler commented on SPARK-17147:
--
We're interested in this enhancement. Anyone know if and one
[
https://issues.apache.org/jira/browse/SPARK-17147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15744380#comment-15744380
]
caolan commented on SPARK-17147:
Sure, I will give a try on your branch, will let you know the result.
>
[
https://issues.apache.org/jira/browse/SPARK-17147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15743024#comment-15743024
]
Sean McKibben commented on SPARK-17147:
---
I apologize for the extended radio silence on this. I've
[
https://issues.apache.org/jira/browse/SPARK-17147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15742285#comment-15742285
]
Cody Koeninger commented on SPARK-17147:
If compacted topics are important to you, then you
[
https://issues.apache.org/jira/browse/SPARK-17147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15740906#comment-15740906
]
caolan commented on SPARK-17147:
I am using spark 2.0.0 + kafka 0.10 + compact mode topics even in some
[
https://issues.apache.org/jira/browse/SPARK-17147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15729055#comment-15729055
]
Cody Koeninger commented on SPARK-17147:
This ticket is about createDirectStream. The question
[
https://issues.apache.org/jira/browse/SPARK-17147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15728326#comment-15728326
]
caolan commented on SPARK-17147:
Will createDirectStream also be fixed.
I hit the same issue, but I use
[
https://issues.apache.org/jira/browse/SPARK-17147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15586422#comment-15586422
]
Justin Miller commented on SPARK-17147:
---
K I'll try to assemble everything I've seen so far around
[
https://issues.apache.org/jira/browse/SPARK-17147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15586417#comment-15586417
]
Cody Koeninger commented on SPARK-17147:
If that's something you're seeing regularly, probably
[
https://issues.apache.org/jira/browse/SPARK-17147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15586403#comment-15586403
]
Justin Miller commented on SPARK-17147:
---
OK thank you. Might be related to the thousands of
[
https://issues.apache.org/jira/browse/SPARK-17147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15586397#comment-15586397
]
Cody Koeninger commented on SPARK-17147:
Then no, this issue is unlikely to affect you unless
[
https://issues.apache.org/jira/browse/SPARK-17147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15586387#comment-15586387
]
Justin Miller commented on SPARK-17147:
---
Log compaction? Only for our offset topics.
> Spark
[
https://issues.apache.org/jira/browse/SPARK-17147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15584172#comment-15584172
]
Cody Koeninger commented on SPARK-17147:
Well, are you using compacted topics?
> Spark Streaming
[
https://issues.apache.org/jira/browse/SPARK-17147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15584169#comment-15584169
]
Justin Miller commented on SPARK-17147:
---
Could this possibly be related to why I'm seeing the
[
https://issues.apache.org/jira/browse/SPARK-17147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15560439#comment-15560439
]
Sean McKibben commented on SPARK-17147:
---
I just had time to read through the changeset today, but
[
https://issues.apache.org/jira/browse/SPARK-17147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15560241#comment-15560241
]
Cody Koeninger commented on SPARK-17147:
[~graphex] My WIP is at
[
https://issues.apache.org/jira/browse/SPARK-17147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15558572#comment-15558572
]
Cody Koeninger commented on SPARK-17147:
I talked with Sean in person about this, and think
[
https://issues.apache.org/jira/browse/SPARK-17147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15453884#comment-15453884
]
Sean McKibben commented on SPARK-17147:
---
I think Kafka's log compaction's design is still intended
[
https://issues.apache.org/jira/browse/SPARK-17147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15453229#comment-15453229
]
Robert Conrad commented on SPARK-17147:
---
[~graphex] you're absolutely right about the seek, but
[
https://issues.apache.org/jira/browse/SPARK-17147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15437672#comment-15437672
]
Sean McKibben commented on SPARK-17147:
---
I tried Robert's changes, but the performance for any
[
https://issues.apache.org/jira/browse/SPARK-17147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15437469#comment-15437469
]
Sean McKibben commented on SPARK-17147:
---
Compacted topics in Kafka prior to 0.9 had some issues and
[
https://issues.apache.org/jira/browse/SPARK-17147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15430872#comment-15430872
]
Cody Koeninger commented on SPARK-17147:
My point is more that this probably isn't just two lines
[
https://issues.apache.org/jira/browse/SPARK-17147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15429846#comment-15429846
]
Robert Conrad commented on SPARK-17147:
---
Nope, I started the project with kafka 0.10 and spark
[
https://issues.apache.org/jira/browse/SPARK-17147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15429742#comment-15429742
]
Cody Koeninger commented on SPARK-17147:
Have you successfully used the 0.8 consumer with
31 matches
Mail list logo