Hai created SAMZA-1870:
--------------------------
Summary: HDFS system admin not handling END_OF_STREAM offset
Key: SAMZA-1870
URL: https://issues.apache.org/jira/browse/SAMZA-1870
Project: Samza
Issue Type: Bug
Reporter: Hai
Assignee: Hai
This happens particularly when using HDFS as a bootstrap stream:
org.apache.samza.SamzaException: Invalid offset for MultiFileHdfsReader:
END_OF_STREAM
at
org.apache.samza.system.hdfs.reader.MultiFileHdfsReader.getCurFileIndex(MultiFileHdfsReader.java:64)
at
org.apache.samza.system.hdfs.HdfsSystemAdmin.offsetComparator(HdfsSystemAdmin.java:224)
at
org.apache.samza.system.chooser.BootstrappingChooser.org$apache$samza$system$chooser$BootstrappingChooser$$checkOffset(BootstrappingChooser.scala:274)
at
org.apache.samza.system.chooser.BootstrappingChooser.choose(BootstrappingChooser.scala:204)
at
org.apache.samza.system.chooser.DefaultChooser.choose(DefaultChooser.scala:294)
at org.apache.samza.system.SystemConsumers.choose(SystemConsumers.scala:210)
at org.apache.samza.task.AsyncRunLoop.chooseEnvelope(AsyncRunLoop.java:208)
at org.apache.samza.task.AsyncRunLoop.run(AsyncRunLoop.java:156)
at org.apache.samza.container.SamzaContainer.run(SamzaContainer.scala:787)
at
org.apache.samza.runtime.LocalContainerRunner.run(LocalContainerRunner.java:101)
at
org.apache.samza.runtime.LocalContainerRunner.main(LocalContainerRunner.java:148)
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
