[
https://issues.apache.org/jira/browse/SAMZA-224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14018960#comment-14018960
]
Chris Riccomini commented on SAMZA-224:
---------------------------------------
bq. Is it really safe to assume that? KafkaSystemAdmin leaves "upcoming" at 0
if the topic is empty, but the javadocs for SystemStreamPartitionMetadata say
that "upcoming" should also be null for an empty stream.
You're correct. It's not safe to assume this. All open source implementations
(Kafka consumer, file consumer) always provide a non-null upcoming offset, I
believe, but we do have an internal implementation (Databus consumer) that
doesn't.
It doesn't seem that outlandish to me to require that all systems have an
upcoming offset, even if a stream is empty, right? You need somewhere to start
reading from. The null upcoming offset for Databus is really just a gap in
Databus' API that prevents us from getting at this information. We never use
"upcoming" with this consumer because we can't.
Anyway, I agree that this is messy. I'm afraid I don't have a really good
proposal as to how to handle this. :/
> TestStatefulTask.testShouldStartAndRestore fails intermittently
> ---------------------------------------------------------------
>
> Key: SAMZA-224
> URL: https://issues.apache.org/jira/browse/SAMZA-224
> Project: Samza
> Issue Type: Bug
> Components: test
> Affects Versions: 0.6.0
> Reporter: Martin Kleppmann
> Assignee: Martin Kleppmann
> Fix For: 0.7.0
>
>
> [~closeuris] reported the following issue on SAMZA-185. I'm now
> intermittently seeing this problem too, so I'm opening a new issue for it (as
> I'm not sure the issue has anything to do with the Kafka 0.8.1 upgrade).
> {noformat}
> org.apache.samza.test.integration.TestStatefulTask >
> testShouldStartAndRestore FAILED
> java.lang.AssertionError at TestStatefulTask.scala:356
> 2 tests completed, 1 failed
> :samza-test_2.10:test FAILED
> {noformat}
> Logs provided by Yan (mine look similar):
> Failed tests: http://pastebin.com/3nEDw9jC
> Standard output: http://pastebin.com/20vZbk7c
> Standard error: http://pastebin.com/gU6cTNAr
--
This message was sent by Atlassian JIRA
(v6.2#6252)
