[
https://issues.apache.org/jira/browse/BEAM-3798?focusedWorklogId=80892&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-80892
]
ASF GitHub Bot logged work on BEAM-3798:
----------------------------------------
Author: ASF GitHub Bot
Created on: 15/Mar/18 17:16
Start Date: 15/Mar/18 17:16
Worklog Time Spent: 10m
Work Description: lgajowy commented on issue #4871: [BEAM-3798] Remove
error check on dataflow when getting batch job state
URL: https://github.com/apache/beam/pull/4871#issuecomment-373454679
@lukecwik could you take a look?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 80892)
Time Spent: 0.5h (was: 20m)
> Performance tests flaky due to Dataflow transient errors
> --------------------------------------------------------
>
> Key: BEAM-3798
> URL: https://issues.apache.org/jira/browse/BEAM-3798
> Project: Beam
> Issue Type: Bug
> Components: runner-dataflow
> Reporter: Łukasz Gajowy
> Assignee: Thomas Groh
> Priority: Major
> Time Spent: 0.5h
> Remaining Estimate: 0h
>
> Performance tests are flaky due to transient errors that happened during data
> processing (eg. SocketTimeoutException while connecting to DB). Currently
> exceptions that happen on Dataflow runner but are retried successfully, fail
> the test regardless of the final job state (giving a false-negative result).
> Possible solution for batch scenarios:
> We could "rethrow" exceptions that happened due to transient errors *only* if
> the job status is other than DONE.
> Possible solution for streaming scenarios:
> (don't know yet)
> [Link to discussion on dev list
> |https://lists.apache.org/thread.html/e480f8181913dc81d2d4cd1430557a646537473ccf29fe6390229098@%3Cdev.beam.apache.org%3E]
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
