[
https://issues.apache.org/jira/browse/SPARK-18475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15679472#comment-15679472
]
Cody Koeninger edited comment on SPARK-18475 at 11/19/16 4:02 PM:
--
Yes,
[
https://issues.apache.org/jira/browse/SPARK-18475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15679472#comment-15679472
]
Cody Koeninger commented on SPARK-18475:
Yes, an RDD does have an ordering guarantee, it's an
[
https://issues.apache.org/jira/browse/SPARK-18475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15674459#comment-15674459
]
Cody Koeninger commented on SPARK-18475:
This has come up several times, and my answer is
[
https://issues.apache.org/jira/browse/SPARK-18386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15654308#comment-15654308
]
Cody Koeninger commented on SPARK-18386:
That should work. There may be dependency conflicts
[
https://issues.apache.org/jira/browse/SPARK-18057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15654295#comment-15654295
]
Cody Koeninger commented on SPARK-18057:
I definitely do not want another copy-paste situation,
Cody Koeninger created SPARK-18386:
--
Summary: Batch mode SQL source for Kafka
Key: SPARK-18386
URL: https://issues.apache.org/jira/browse/SPARK-18386
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-18371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15649638#comment-15649638
]
Cody Koeninger commented on SPARK-18371:
Thanks for digging into this. The other thing I noticed
[
https://issues.apache.org/jira/browse/SPARK-18258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15638555#comment-15638555
]
Cody Koeninger commented on SPARK-18258:
Sure, added, let me know if I'm missing something or can
[
https://issues.apache.org/jira/browse/SPARK-18258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cody Koeninger updated SPARK-18258:
---
Description:
Transactional "exactly-once" semantics for output require storing an offset
[
https://issues.apache.org/jira/browse/SPARK-18258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15637621#comment-15637621
]
Cody Koeninger commented on SPARK-18258:
So one obvious one is that if wherever checkpoint data
[
https://issues.apache.org/jira/browse/SPARK-18258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15637576#comment-15637576
]
Cody Koeninger commented on SPARK-18258:
The sink doesn't have to reason about equality of the
Cody Koeninger created SPARK-18272:
--
Summary: Test topic addition for subscribePattern on Kafka DStream
and Structured Stream
Key: SPARK-18272
URL: https://issues.apache.org/jira/browse/SPARK-18272
[
https://issues.apache.org/jira/browse/SPARK-18258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cody Koeninger updated SPARK-18258:
---
Description:
Transactional "exactly-once" semantics for output require storing an offset
Cody Koeninger created SPARK-18258:
--
Summary: Sinks need access to offset representation
Key: SPARK-18258
URL: https://issues.apache.org/jira/browse/SPARK-18258
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-17938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15629332#comment-15629332
]
Cody Koeninger commented on SPARK-17938:
Direct stream isn't a receiver, receiver settings don't
[
https://issues.apache.org/jira/browse/SPARK-18212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15627838#comment-15627838
]
Cody Koeninger commented on SPARK-18212:
So here's a heavily excerpted version of what I see
[
https://issues.apache.org/jira/browse/SPARK-17935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15626774#comment-15626774
]
Cody Koeninger commented on SPARK-17935:
Some other things to think about:
- are there any
[
https://issues.apache.org/jira/browse/SPARK-17935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15612663#comment-15612663
]
Cody Koeninger commented on SPARK-17935:
So the main thing to point out is that Kafka producers
[
https://issues.apache.org/jira/browse/SPARK-17829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15610399#comment-15610399
]
Cody Koeninger commented on SPARK-17829:
I'm not telling you to do it that way, just asking if
[
https://issues.apache.org/jira/browse/SPARK-17829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15609653#comment-15609653
]
Cody Koeninger commented on SPARK-17829:
Have you considered using a typeclass?
> Stable format
Cody Koeninger created SPARK-18057:
--
Summary: Update structured streaming kafka from 10.0.1 to 10.1.0
Key: SPARK-18057
URL: https://issues.apache.org/jira/browse/SPARK-18057
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-18056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cody Koeninger updated SPARK-18056:
---
Description: There are a couple of relevant KIPs here,
Cody Koeninger created SPARK-18056:
--
Summary: Update KafkaDStreams from 10.0.1 to 10.1.0
Key: SPARK-18056
URL: https://issues.apache.org/jira/browse/SPARK-18056
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-17829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15593000#comment-15593000
]
Cody Koeninger commented on SPARK-17829:
At least with regard to kafka offsets, it might be good
Cody Koeninger created SPARK-18033:
--
Summary: Deprecate TaskContext.partitionId
Key: SPARK-18033
URL: https://issues.apache.org/jira/browse/SPARK-18033
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-17147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15586417#comment-15586417
]
Cody Koeninger commented on SPARK-17147:
If that's something you're seeing regularly, probably
[
https://issues.apache.org/jira/browse/SPARK-17147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15586397#comment-15586397
]
Cody Koeninger commented on SPARK-17147:
Then no, this issue is unlikely to affect you unless
[
https://issues.apache.org/jira/browse/SPARK-17147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cody Koeninger updated SPARK-17147:
---
Summary: Spark Streaming Kafka 0.10 Consumer Can't Handle Non-consecutive
Offsets (i.e. Log
[
https://issues.apache.org/jira/browse/SPARK-17147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15584172#comment-15584172
]
Cody Koeninger commented on SPARK-17147:
Well, are you using compacted topics?
> Spark Streaming
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15578894#comment-15578894
]
Cody Koeninger commented on SPARK-17812:
As you just said yourself, assign doesn't mean you
[
https://issues.apache.org/jira/browse/SPARK-17935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15578141#comment-15578141
]
Cody Koeninger commented on SPARK-17935:
Why is this in kafka-0-8, when we haven't resolved (for
[
https://issues.apache.org/jira/browse/SPARK-17938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15578133#comment-15578133
]
Cody Koeninger commented on SPARK-17938:
There was pretty extensive discussion of this on list,
[
https://issues.apache.org/jira/browse/SPARK-17813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15577037#comment-15577037
]
Cody Koeninger commented on SPARK-17813:
To be clear, the current direct stream (and as a result
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cody Koeninger updated SPARK-17812:
---
Description:
Right now you can only run a Streaming Query starting from either the earliest
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15577022#comment-15577022
]
Cody Koeninger commented on SPARK-17812:
Assign is useful, otherwise you have no way of consuming
[
https://issues.apache.org/jira/browse/SPARK-17937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cody Koeninger updated SPARK-17937:
---
Description:
Possible events for which offsets are needed:
# New partition is discovered
#
[
https://issues.apache.org/jira/browse/SPARK-17937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cody Koeninger updated SPARK-17937:
---
Description:
Possible events for which offsets are needed:
# New partition is discovered
#
[
https://issues.apache.org/jira/browse/SPARK-17937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cody Koeninger updated SPARK-17937:
---
Description:
Possible events for which offsets are needed:
# New partition is discovered
#
[
https://issues.apache.org/jira/browse/SPARK-17937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cody Koeninger updated SPARK-17937:
---
Description:
Possible events for which offsets are needed:
# New partition is discovered
#
[
https://issues.apache.org/jira/browse/SPARK-17937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cody Koeninger updated SPARK-17937:
---
Description:
Possible events for which offsets are needed:
# New partition is discovered
#
[
https://issues.apache.org/jira/browse/SPARK-17937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cody Koeninger updated SPARK-17937:
---
Description:
Possible events for which offsets are needed:
# New partition is discovered
#
[
https://issues.apache.org/jira/browse/SPARK-17937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cody Koeninger updated SPARK-17937:
---
Description:
Possible events for which offsets are needed:
# New partition is discovered
#
[
https://issues.apache.org/jira/browse/SPARK-17937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cody Koeninger updated SPARK-17937:
---
Description:
Possible events for which offsets are needed:
# *New partition* is discovered
#
[
https://issues.apache.org/jira/browse/SPARK-17937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cody Koeninger updated SPARK-17937:
---
Description:
Possible events for which offsets are needed:
# *New partition* is discovered
#
[
https://issues.apache.org/jira/browse/SPARK-17937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cody Koeninger updated SPARK-17937:
---
Description:
Possible events for which offsets are needed:
# New partition is discovered
#
[
https://issues.apache.org/jira/browse/SPARK-17937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cody Koeninger updated SPARK-17937:
---
Description:
Possible events for which offsets are needed:
# New partition is discovered
#
Cody Koeninger created SPARK-17937:
--
Summary: Clarify Kafka offset semantics for Structured Streaming
Key: SPARK-17937
URL: https://issues.apache.org/jira/browse/SPARK-17937
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573843#comment-15573843
]
Cody Koeninger commented on SPARK-17812:
So I think this is what we're agreed on:
Mutually
[
https://issues.apache.org/jira/browse/SPARK-17813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573806#comment-15573806
]
Cody Koeninger commented on SPARK-17813:
So issues to be worked out here (assuming we're still
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573766#comment-15573766
]
Cody Koeninger commented on SPARK-17812:
OK, failing on start is clear (it's really annoying in
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573563#comment-15573563
]
Cody Koeninger commented on SPARK-17812:
So a short term question
- with your proposed interface,
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573479#comment-15573479
]
Cody Koeninger commented on SPARK-17812:
While some decision is better than none, can you help me
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573432#comment-15573432
]
Cody Koeninger edited comment on SPARK-17812 at 10/13/16 10:44 PM:
---
If
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573432#comment-15573432
]
Cody Koeninger commented on SPARK-17812:
If you're seriously worried that people are going to get
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573395#comment-15573395
]
Cody Koeninger edited comment on SPARK-17812 at 10/13/16 10:25 PM:
---
1.
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573395#comment-15573395
]
Cody Koeninger commented on SPARK-17812:
1. we dont have lists, we have strings. regexes and
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cody Koeninger updated SPARK-17812:
---
Comment: was deleted
(was: One other slightly ugly thing...
{noformat}
// starting
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573166#comment-15573166
]
Cody Koeninger edited comment on SPARK-17812 at 10/13/16 9:17 PM:
--
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573166#comment-15573166
]
Cody Koeninger commented on SPARK-17812:
Here's my concrete suggestion:
3 mutually exclusive
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15572922#comment-15572922
]
Cody Koeninger edited comment on SPARK-17812 at 10/13/16 8:33 PM:
--
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573089#comment-15573089
]
Cody Koeninger commented on SPARK-17812:
One other slightly ugly thing...
{noformat}
// starting
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15572922#comment-15572922
]
Cody Koeninger commented on SPARK-17812:
Sorry, I didn't see this comment until just now.
X
[
https://issues.apache.org/jira/browse/SPARK-17900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15572119#comment-15572119
]
Cody Koeninger commented on SPARK-17900:
Thanks for doing this, should make things clearer.
[
https://issues.apache.org/jira/browse/SPARK-15408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cody Koeninger closed SPARK-15408.
--
Resolution: Cannot Reproduce
> Spark streaming app crashes with NotLeaderForPartitionException
[
https://issues.apache.org/jira/browse/SPARK-15272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15570221#comment-15570221
]
Cody Koeninger commented on SPARK-15272:
Checking to see if the 0.10 consumer's handling of
[
https://issues.apache.org/jira/browse/SPARK-15272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15570221#comment-15570221
]
Cody Koeninger edited comment on SPARK-15272 at 10/12/16 11:33 PM:
---
[
https://issues.apache.org/jira/browse/SPARK-11698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15570208#comment-15570208
]
Cody Koeninger commented on SPARK-11698:
Would a custom ConsumerStrategy for the new consumer
[
https://issues.apache.org/jira/browse/SPARK-10320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cody Koeninger resolved SPARK-10320.
Resolution: Fixed
Fix Version/s: 2.0.0
SPARK-12177 added the new consumer, which
[
https://issues.apache.org/jira/browse/SPARK-9947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cody Koeninger closed SPARK-9947.
-
Resolution: Won't Fix
The direct DStream api already gives access to offsets, and it seems clear
[
https://issues.apache.org/jira/browse/SPARK-8337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15570186#comment-15570186
]
Cody Koeninger commented on SPARK-8337:
---
Can this be closed, given that the subtasks are resolved
[
https://issues.apache.org/jira/browse/SPARK-5505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cody Koeninger closed SPARK-5505.
-
Resolution: Won't Fix
The old kafka High Level Consumer has been abandoned at this point.
[
https://issues.apache.org/jira/browse/SPARK-5718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cody Koeninger resolved SPARK-5718.
---
Resolution: Fixed
Fix Version/s: 2.0.0
SPARK-12177 added support for the native kafka
[
https://issues.apache.org/jira/browse/SPARK-10815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15570139#comment-15570139
]
Cody Koeninger commented on SPARK-10815:
Another unfortunate thing about the Sink api is that it
[
https://issues.apache.org/jira/browse/SPARK-17344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15567457#comment-15567457
]
Cody Koeninger commented on SPARK-17344:
Given the choice between rewriting underlying kafka
[
https://issues.apache.org/jira/browse/SPARK-17837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cody Koeninger closed SPARK-17837.
--
Resolution: Duplicate
Duplicate of SPARK-17829
> Disaster recovery of offsets from WAL
>
[
https://issues.apache.org/jira/browse/SPARK-17344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15566244#comment-15566244
]
Cody Koeninger commented on SPARK-17344:
How long would it take CDH to distribute 0.10 if there
[
https://issues.apache.org/jira/browse/SPARK-17853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15565559#comment-15565559
]
Cody Koeninger commented on SPARK-17853:
Good, will keep this ticket open at least until
[
https://issues.apache.org/jira/browse/SPARK-17853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15565400#comment-15565400
]
Cody Koeninger commented on SPARK-17853:
Use a different group id.
Let me know if that addresses
[
https://issues.apache.org/jira/browse/SPARK-17853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15565278#comment-15565278
]
Cody Koeninger commented on SPARK-17853:
Which version of DStream are you using, 0-10 or 0-8?
Are
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15563285#comment-15563285
]
Cody Koeninger commented on SPARK-17812:
No, it's not covered by strict assign. If you don't
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15560925#comment-15560925
]
Cody Koeninger commented on SPARK-17812:
I want to start a pattern subscription at known good
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15560839#comment-15560839
]
Cody Koeninger commented on SPARK-17812:
That totally kills the usability of SubscribePattern.
>
[
https://issues.apache.org/jira/browse/SPARK-17815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15560837#comment-15560837
]
Cody Koeninger commented on SPARK-17815:
My personal concerns about complexity are because I'm
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15560719#comment-15560719
]
Cody Koeninger commented on SPARK-17812:
Generally agree with the direction of what you're
[
https://issues.apache.org/jira/browse/SPARK-17815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15560684#comment-15560684
]
Cody Koeninger commented on SPARK-17815:
Regarding kafka consumer behavior, I'm not saying it's
Cody Koeninger created SPARK-17841:
--
Summary: Kafka 0.10 commitQueue needs to be drained
Key: SPARK-17841
URL: https://issues.apache.org/jira/browse/SPARK-17841
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-17147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15560241#comment-15560241
]
Cody Koeninger commented on SPARK-17147:
[~graphex] My WIP is at
[
https://issues.apache.org/jira/browse/SPARK-17815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15559911#comment-15559911
]
Cody Koeninger commented on SPARK-17815:
The WAL cannot be the only source of truth, because it
[
https://issues.apache.org/jira/browse/SPARK-17147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15558572#comment-15558572
]
Cody Koeninger commented on SPARK-17147:
I talked with Sean in person about this, and think
[
https://issues.apache.org/jira/browse/SPARK-4960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15558557#comment-15558557
]
Cody Koeninger commented on SPARK-4960:
---
Is this idea pretty much dead at this point? It seems like
[
https://issues.apache.org/jira/browse/SPARK-3146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cody Koeninger resolved SPARK-3146.
---
Resolution: Fixed
Fix Version/s: 1.3.0
> Improve the flexibility of Spark Streaming
[
https://issues.apache.org/jira/browse/SPARK-3146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15558550#comment-15558550
]
Cody Koeninger commented on SPARK-3146:
---
SPARK-4964 / the direct stream added a messageHandler.
>
[
https://issues.apache.org/jira/browse/SPARK-17837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cody Koeninger updated SPARK-17837:
---
Summary: Disaster recovery of offsets from WAL (was: Disaster recover of
offsets from WAL)
Cody Koeninger created SPARK-17837:
--
Summary: Disaster recover of offsets from WAL
Key: SPARK-17837
URL: https://issues.apache.org/jira/browse/SPARK-17837
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-17815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15558528#comment-15558528
]
Cody Koeninger commented on SPARK-17815:
So if you start committing offsets to kafka, there are
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15558506#comment-15558506
]
Cody Koeninger commented on SPARK-17812:
So I'm willing to do this work, mostly because I've
[
https://issues.apache.org/jira/browse/SPARK-17344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15558474#comment-15558474
]
Cody Koeninger commented on SPARK-17344:
I think this is premature until you have a fully
[
https://issues.apache.org/jira/browse/SPARK-15406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15554160#comment-15554160
]
Cody Koeninger commented on SPARK-15406:
I think if you're already gravitating towards json as
[
https://issues.apache.org/jira/browse/SPARK-15406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15554139#comment-15554139
]
Cody Koeninger commented on SPARK-15406:
When something has gone wrong, as an end user, how do I
[
https://issues.apache.org/jira/browse/SPARK-15406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15553955#comment-15553955
]
Cody Koeninger edited comment on SPARK-15406 at 10/7/16 3:20 AM:
-
As soon
101 - 200 of 409 matches
Mail list logo
