[
https://issues.apache.org/jira/browse/BEAM-8972?focusedWorklogId=406948&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-406948
]
ASF GitHub Bot logged work on BEAM-8972:
----------------------------------------
Author: ASF GitHub Bot
Created on: 20/Mar/20 09:29
Start Date: 20/Mar/20 09:29
Worklog Time Spent: 10m
Work Description: mxm commented on issue #10386: [BEAM-8972] Add Jenkins
job with Combine test for portable Java
URL: https://github.com/apache/beam/pull/10386#issuecomment-601606381
>@mxm I ran into a problem with TaskManagers timing out in a streaming case,
the latest failed test is an example of this. Do you have any insight into why
this might have happened?
@mwalenia Not from the top of my head. I would need a stack trace or log to
see what happened.
> Also there's an issue of intermittent `OutOfDirectMemoryError` getting
thrown by gRPC on batch as well (eg.
[here](https://builds.apache.org/job/beam_LoadTests_Java_Combine_Portable_Flink_Batch_PR/30/console)
)
Flink 1.10 has changed the memory configuration. It looks like GRPC's direct
memory allocation is competing with Flink's managed memory. Flink allocates a
fix amount of direct memory upfront leaving only a small amount left. See
https://ci.apache.org/projects/flink/flink-docs-stable/ops/config.html#memory-configuration,
especially `taskmanager.memory.framework.off-heap.size` and
`taskmanager.memory.jvm-overhead.fraction`.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
-------------------
Worklog Id: (was: 406948)
Time Spent: 32h (was: 31h 50m)
> Add a Jenkins job running Combine load test on Java with Flink in Portability
> mode
> ----------------------------------------------------------------------------------
>
> Key: BEAM-8972
> URL: https://issues.apache.org/jira/browse/BEAM-8972
> Project: Beam
> Issue Type: Improvement
> Components: testing
> Reporter: Michał Walenia
> Assignee: Michał Walenia
> Priority: Minor
> Time Spent: 32h
> Remaining Estimate: 0h
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
