[
https://issues.apache.org/jira/browse/SAMZA-1870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16610932#comment-16610932
]
ASF GitHub Bot commented on SAMZA-1870:
---------------------------------------
Github user asfgit closed the pull request at:
https://github.com/apache/samza/pull/633
> HDFS system admin not handling END_OF_STREAM offset
> ---------------------------------------------------
>
> Key: SAMZA-1870
> URL: https://issues.apache.org/jira/browse/SAMZA-1870
> Project: Samza
> Issue Type: Bug
> Reporter: Hai
> Assignee: Hai
> Priority: Major
>
> This happens particularly when using HDFS as a bootstrap stream:
> org.apache.samza.SamzaException: Invalid offset for MultiFileHdfsReader:
> END_OF_STREAM
> at
> org.apache.samza.system.hdfs.reader.MultiFileHdfsReader.getCurFileIndex(MultiFileHdfsReader.java:64)
> at
> org.apache.samza.system.hdfs.HdfsSystemAdmin.offsetComparator(HdfsSystemAdmin.java:224)
> at
> org.apache.samza.system.chooser.BootstrappingChooser.org$apache$samza$system$chooser$BootstrappingChooser$$checkOffset(BootstrappingChooser.scala:274)
> at
> org.apache.samza.system.chooser.BootstrappingChooser.choose(BootstrappingChooser.scala:204)
> at
> org.apache.samza.system.chooser.DefaultChooser.choose(DefaultChooser.scala:294)
> at org.apache.samza.system.SystemConsumers.choose(SystemConsumers.scala:210)
> at org.apache.samza.task.AsyncRunLoop.chooseEnvelope(AsyncRunLoop.java:208)
> at org.apache.samza.task.AsyncRunLoop.run(AsyncRunLoop.java:156)
> at org.apache.samza.container.SamzaContainer.run(SamzaContainer.scala:787)
> at
> org.apache.samza.runtime.LocalContainerRunner.run(LocalContainerRunner.java:101)
> at
> org.apache.samza.runtime.LocalContainerRunner.main(LocalContainerRunner.java:148)
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
