[
https://issues.apache.org/jira/browse/BEAM-12729?focusedWorklogId=636077&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-636077
]
ASF GitHub Bot logged work on BEAM-12729:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 09/Aug/21 20:48
Start Date: 09/Aug/21 20:48
Worklog Time Spent: 10m
Work Description: pabloem commented on pull request #15298:
URL: https://github.com/apache/beam/pull/15298#issuecomment-895532669
Run Java PostCommit
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 636077)
Remaining Estimate: 1.5h (was: 1h 40m)
Time Spent: 0.5h (was: 20m)
> Suppress Avro Runtime Exceptions for Streaming
> -----------------------------------------------
>
> Key: BEAM-12729
> URL: https://issues.apache.org/jira/browse/BEAM-12729
> Project: Beam
> Issue Type: Improvement
> Components: io-java-avro
> Reporter: Dylan Hercher
> Priority: P2
> Labels: streaming
> Original Estimate: 2h
> Time Spent: 0.5h
> Remaining Estimate: 1.5h
>
> The current design of ReadFileRangesFn continually throws any un-recoverable
> errors until the pipeline is turned down for streaming pipelines.
>
> These invalid file errors do not have a resolvable solution and should be
> logged as errors for the files in question to allow the pipeline to continue
> progressing.
>
> As a file which cannot be read will never recover via a dead letter queue
> design. Since no recovery is possible we can simply log the errored file and
> continue processing.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
