[
https://issues.apache.org/jira/browse/BEAM-3949?focusedWorklogId=108577&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-108577
]
ASF GitHub Bot logged work on BEAM-3949:
----------------------------------------
Author: ASF GitHub Bot
Created on: 04/Jun/18 13:36
Start Date: 04/Jun/18 13:36
Worklog Time Spent: 10m
Work Description: kkucharc commented on a change in pull request #5434:
[BEAM-3949] IOIT's setup() and teardown() db connection attempt sometimes fail
resulting in test flakiness
URL: https://github.com/apache/beam/pull/5434#discussion_r192743116
##########
File path:
sdks/java/io/common/src/test/java/org/apache/beam/sdk/io/common/IOITHelper.java
##########
@@ -36,4 +40,54 @@ public static String getHashForRecordCount(int recordCount,
Map<Integer, String>
}
return hash;
}
+
+ /**
+ * Interface for passing method to executeWithRetry method.
+ */
+ public interface RetryFunction {
+ void run() throws Exception;
+ }
+
+ public static void executeWithRetry(RetryFunction function)
+ throws Exception {
+ int maxAttempts = 3;
+ long minDelay = 10_000;
+ executeWithRetry(maxAttempts, minDelay, function);
+ }
+
+ public static void executeWithRetry(int maxAttempts, long minDelay,
RetryFunction function)
+ throws Exception {
+ ArrayList<Exception> errorList = new ArrayList<Exception>();
+ int attempts = 0;
+ long delay = minDelay;
+
+ while (attempts < maxAttempts) {
+ try {
+ function.run();
+ return;
+ } catch (Exception e) {
+ LOG.error(
+ "Attempt #{} of {} threw an exception: {} after {} ms",
+ attempts + 1,
+ maxAttempts,
+ e.getMessage(),
+ delay);
+ errorList.add(e);
+
+ if (attempts == maxAttempts - 1) {
Review comment:
Well, it depends how we're counting. right now we are starting from attempts
= 0 and in while there is ` while (attempts < maxAttempts)`.
I can change the start value of attempts to 1, then as you said change this
if to `if (attempts == maxAttempts)`. I guess it can look better.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 108577)
Time Spent: 6.5h (was: 6h 20m)
> IOIT's setup() and teardown() db connection attempt sometimes fail resulting
> in test flakiness
> ----------------------------------------------------------------------------------------------
>
> Key: BEAM-3949
> URL: https://issues.apache.org/jira/browse/BEAM-3949
> Project: Beam
> Issue Type: Sub-task
> Components: testing
> Reporter: Łukasz Gajowy
> Assignee: Kasia Kucharczyk
> Priority: Major
> Time Spent: 6.5h
> Remaining Estimate: 0h
>
> setup() and teardown() methods sometimes have trouble connecting database in
> Performance tests. It results in test flakiness.
> Example logs:
> [https://builds.apache.org/view/A-D/view/Beam/job/beam_PerformanceTests_HadoopInputFormat/65/console]
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
