[ https://issues.apache.org/jira/browse/BEAM-5925?focusedWorklogId=166890&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-166890 ]
ASF GitHub Bot logged work on BEAM-5925: ---------------------------------------- Author: ASF GitHub Bot Created on: 16/Nov/18 14:19 Start Date: 16/Nov/18 14:19 Worklog Time Spent: 10m Work Description: wscheep opened a new pull request #7065: [BEAM-5925] Add .withMaxRetryTimeoutMillis() to ElasticseachIO.ConnectionConfiguration URL: https://github.com/apache/beam/pull/7065 Added a builder method on ConnectionConfiguration to set the MaxRetryTimeoutMillis on the elastic RestClient. Because of test flakyness, I set the timeout in the tests to 10min (is this too wide)? @echauchot ------------------------ Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Format the pull request title like `[BEAM-XXX] Fixes bug in ApproximateQuantiles`, where you replace `BEAM-XXX` with the appropriate JIRA issue, if applicable. This will automatically link the pull request to the issue. - [ ] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.pdf). It will help us expedite review of your Pull Request if you tag someone (e.g. `@username`) to look at it. Post-Commit Tests Status (on master branch) ------------------------------------------------------------------------------------------------ Lang | SDK | Apex | Dataflow | Flink | Gearpump | Samza | Spark --- | --- | --- | --- | --- | --- | --- | --- Go | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Go_GradleBuild/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Go_GradleBuild/lastCompletedBuild/) | --- | --- | --- | --- | --- | --- Java | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/lastCompletedBuild/) | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex_Gradle/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex_Gradle/lastCompletedBuild/) | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/lastCompletedBuild/) | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Flink_Gradle/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Flink_Gradle/lastCompletedBuild/) [![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Flink/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Flink/lastCompletedBuild/) | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Gearpump_Gradle/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Gearpump_Gradle/lastCompletedBuild/) | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Samza_Gradle/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Samza_Gradle/lastCompletedBuild/) | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Spark_Gradle/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Spark_Gradle/lastCompletedBuild/) Python | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Python_Verify/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Python_Verify/lastCompletedBuild/) | --- | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/lastCompletedBuild/) </br> [![Build Status](https://builds.apache.org/job/beam_PostCommit_Py_ValCont/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Py_ValCont/lastCompletedBuild/) | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/lastCompletedBuild/) | --- | --- | --- ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking ------------------- Worklog Id: (was: 166890) Time Spent: 10m Remaining Estimate: 0h > Test flake in ElasticsearchIOTest.testWriteFullAddressing > --------------------------------------------------------- > > Key: BEAM-5925 > URL: https://issues.apache.org/jira/browse/BEAM-5925 > Project: Beam > Issue Type: Bug > Components: io-java-elasticsearch > Reporter: Kenneth Knowles > Assignee: Wout Scheepers > Priority: Critical > Time Spent: 10m > Remaining Estimate: 0h > > https://builds.apache.org/view/A-D/view/Beam/job/beam_PostCommit_Java_GradleBuild/1789/ > https://scans.gradle.com/s/j42mwdsn5svcs > {code} > org.apache.beam.sdk.Pipeline$PipelineExecutionException: java.io.IOException: > listener timeout after waiting for [30000] ms > {code} > Log looks like this: > {code} > [2018-10-31T04:06:07,571][INFO ][o.a.b.s.i.e.ElasticsearchIOTest] > [testWriteFullAddressing]: before test > [2018-10-31T04:06:07,572][INFO ][o.a.b.s.i.e.ElasticsearchIOTest] > [ElasticsearchIOTest#testWriteFullAddressing]: setting up test > [2018-10-31T04:06:07,589][INFO ][o.e.c.m.MetaDataIndexTemplateService] > [node_s0] adding template [random_index_template] for index patterns [*] > [2018-10-31T04:06:07,645][INFO ][o.a.b.s.i.e.ElasticsearchIOTest] > [ElasticsearchIOTest#testWriteFullAddressing]: all set up test > [2018-10-31T04:06:10,536][INFO ][o.e.c.m.MetaDataCreateIndexService] > [node_s0] [galilei] creating index, cause [auto(bulk api)], templates > [random_index_template], shards [6]/[0], mappings [] > [2018-10-31T04:06:33,963][INFO ][o.e.c.m.MetaDataCreateIndexService] > [node_s0] [curie] creating index, cause [auto(bulk api)], templates > [random_index_template], shards [6]/[0], mappings [] > [2018-10-31T04:06:34,034][INFO ][o.e.c.m.MetaDataCreateIndexService] > [node_s0] [darwin] creating index, cause [auto(bulk api)], templates > [random_index_template], shards [6]/[0], mappings [] > [2018-10-31T04:06:34,050][INFO ][o.e.c.m.MetaDataCreateIndexService] > [node_s0] [copernicus] creating index, cause [auto(bulk api)], templates > [random_index_template], shards [6]/[0], mappings [] > [2018-10-31T04:06:34,075][INFO ][o.e.c.m.MetaDataCreateIndexService] > [node_s0] [faraday] creating index, cause [auto(bulk api)], templates > [random_index_template], shards [6]/[0], mappings [] > [2018-10-31T04:06:34,095][INFO ][o.e.c.m.MetaDataCreateIndexService] > [node_s0] [bohr] creating index, cause [auto(bulk api)], templates > [random_index_template], shards [6]/[0], mappings [] > [2018-10-31T04:06:34,113][INFO ][o.e.c.m.MetaDataCreateIndexService] > [node_s0] [pasteur] creating index, cause [auto(bulk api)], templates > [random_index_template], shards [6]/[0], mappings [] > [2018-10-31T04:06:34,142][INFO ][o.e.c.m.MetaDataCreateIndexService] > [node_s0] [einstein] creating index, cause [auto(bulk api)], templates > [random_index_template], shards [6]/[0], mappings [] > [2018-10-31T04:06:34,205][INFO ][o.e.c.m.MetaDataCreateIndexService] > [node_s0] [maxwell] creating index, cause [auto(bulk api)], templates > [random_index_template], shards [6]/[0], mappings [] > [2018-10-31T04:06:34,226][INFO ][o.e.c.m.MetaDataCreateIndexService] > [node_s0] [newton] creating index, cause [auto(bulk api)], templates > [random_index_template], shards [6]/[0], mappings [] > [2018-10-31T04:06:36,914][INFO ][o.e.c.r.a.AllocationService] [node_s0] > Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards > started [[galilei][4], [galilei][5]] ...]). > [2018-10-31T04:06:36,970][INFO ][o.e.c.m.MetaDataMappingService] [node_s0] > [galilei/Vn1b8XXVSAmrTb5BVe2IJQ] create_mapping [TYPE_1] > [2018-10-31T04:06:37,137][INFO ][o.e.c.m.MetaDataMappingService] [node_s0] > [newton/bjnImLt_QguBGEFH9lBJ6Q] create_mapping [TYPE_-1] > [2018-10-31T04:06:37,385][INFO ][o.e.c.m.MetaDataMappingService] [node_s0] > [maxwell/-RZ32NbRRZWaGaVfaptFIA] create_mapping [TYPE_0] > [2018-10-31T04:06:37,636][INFO ][o.e.c.m.MetaDataMappingService] [node_s0] > [einstein/2lgF5Vj6Ti2KTS-pYSzv3Q] create_mapping [TYPE_1] > [2018-10-31T04:06:37,806][INFO ][o.e.c.m.MetaDataMappingService] [node_s0] > [pasteur/832OwzleRSOHsWx85vOH-w] create_mapping [TYPE_0] > [2018-10-31T04:06:38,103][INFO ][o.e.c.m.MetaDataMappingService] [node_s0] > [bohr/9YTwB1yvTYKf9YjYCmHjwg] create_mapping [TYPE_1] > [2018-10-31T04:06:38,229][INFO ][o.e.c.m.MetaDataMappingService] [node_s0] > [faraday/vIMYG8vpTQKqNkyajcFOxw] create_mapping [TYPE_0] > [2018-10-31T04:06:38,576][INFO ][o.e.c.m.MetaDataMappingService] [node_s0] > [copernicus/NzCZssInSiOdZKTmLCoXRw] create_mapping [TYPE_1] > [2018-10-31T04:06:38,890][INFO ][o.e.c.m.MetaDataMappingService] [node_s0] > [darwin/g_sIfS5aQwi6BAXw_--vgw] create_mapping [TYPE_1] > [2018-10-31T04:06:39,201][INFO ][o.e.c.m.MetaDataMappingService] [node_s0] > [curie/PDuZqTZQROytGLowXGMxhA] create_mapping [TYPE_0] > [2018-10-31T04:06:40,030][INFO ][o.a.b.s.i.e.ElasticsearchIOTest] > [ElasticsearchIOTest#testWriteFullAddressing]: cleaning up after test > [2018-10-31T04:06:40,185][INFO ][o.e.c.m.MetaDataDeleteIndexService] > [node_s0] [bohr/9YTwB1yvTYKf9YjYCmHjwg] deleting index > [2018-10-31T04:06:40,185][INFO ][o.e.c.m.MetaDataDeleteIndexService] > [node_s0] [copernicus/NzCZssInSiOdZKTmLCoXRw] deleting index > [2018-10-31T04:06:40,185][INFO ][o.e.c.m.MetaDataDeleteIndexService] > [node_s0] [maxwell/-RZ32NbRRZWaGaVfaptFIA] deleting index > [2018-10-31T04:06:40,185][INFO ][o.e.c.m.MetaDataDeleteIndexService] > [node_s0] [pasteur/832OwzleRSOHsWx85vOH-w] deleting index > [2018-10-31T04:06:40,185][INFO ][o.e.c.m.MetaDataDeleteIndexService] > [node_s0] [einstein/2lgF5Vj6Ti2KTS-pYSzv3Q] deleting index > [2018-10-31T04:06:40,185][INFO ][o.e.c.m.MetaDataDeleteIndexService] > [node_s0] [newton/bjnImLt_QguBGEFH9lBJ6Q] deleting index > [2018-10-31T04:06:40,185][INFO ][o.e.c.m.MetaDataDeleteIndexService] > [node_s0] [darwin/g_sIfS5aQwi6BAXw_--vgw] deleting index > [2018-10-31T04:06:40,185][INFO ][o.e.c.m.MetaDataDeleteIndexService] > [node_s0] [galilei/Vn1b8XXVSAmrTb5BVe2IJQ] deleting index > [2018-10-31T04:06:40,185][INFO ][o.e.c.m.MetaDataDeleteIndexService] > [node_s0] [curie/PDuZqTZQROytGLowXGMxhA] deleting index > [2018-10-31T04:06:40,185][INFO ][o.e.c.m.MetaDataDeleteIndexService] > [node_s0] [faraday/vIMYG8vpTQKqNkyajcFOxw] deleting index > [2018-10-31T04:06:40,801][INFO ][o.e.c.m.MetaDataIndexTemplateService] > [node_s0] removing template [random_index_template] > [2018-10-31T04:06:40,811][INFO ][o.a.b.s.i.e.ElasticsearchIOTest] > [ElasticsearchIOTest#testWriteFullAddressing]: cleaned up after test > [2018-10-31T04:06:40,811][INFO ][o.a.b.s.i.e.ElasticsearchIOTest] > [testWriteFullAddressing]: after test > {code} > So perhaps it is just too tight a timeout? -- This message was sent by Atlassian JIRA (v7.6.3#76005)