[
https://issues.apache.org/jira/browse/BEAM-5985?focusedWorklogId=173756&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-173756
]
ASF GitHub Bot logged work on BEAM-5985:
----------------------------------------
Author: ASF GitHub Bot
Created on: 10/Dec/18 20:13
Start Date: 10/Dec/18 20:13
Worklog Time Spent: 10m
Work Description: lgajowy commented on issue #7184: [BEAM-5985] Create
jenkins jobs to run the load tests for Java SDK
URL: https://github.com/apache/beam/pull/7184#issuecomment-445956269
I think the "Java GroupByKey Small Load Test Dataflow" job didn't set max
number of workers option and that caused a situation where a Load test took all
available workers and starve other jobs for an hour.
See here (match by Job id):
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-12-10_08_16_32-12840883456333022524?project=apache-beam-testing
Full console logs:
https://builds.apache.org/job/beam_Java_LoadTests_GroupByKey_Dataflow_Small/5/consoleText
Judging from the logs and the code we are missing `maxNumWorkers` option in
the job. @kkucharc could you add that option?
@alanmyrvold : Sorry for this. How many workers at most can we use for such
big job?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 173756)
Time Spent: 5h 20m (was: 5h 10m)
> Create jenkins jobs to run the load tests for Java SDK
> ------------------------------------------------------
>
> Key: BEAM-5985
> URL: https://issues.apache.org/jira/browse/BEAM-5985
> Project: Beam
> Issue Type: Sub-task
> Components: testing
> Reporter: Lukasz Gajowy
> Assignee: Kasia Kucharczyk
> Priority: Major
> Time Spent: 5h 20m
> Remaining Estimate: 0h
>
> How/how often/in what cases we run those tests is yet to be decided (this is
> part of the task)
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
