Steve Loughran created YARN-11916:
-------------------------------------
Summary: FileSystemTimelineReaderImpl vulnerable to race conditions
Key: YARN-11916
URL: https://issues.apache.org/jira/browse/YARN-11916
Project: Hadoop YARN
Issue Type: Improvement
Components: timelineserver
Affects Versions: 3.4.2
Reporter: Steve Loughran
Assignee: Steve Loughran
Yarn timelineserver FileSystemTimelineReaderImpl implementation does atomic
updates via: copy, append, rename. This gives it bad scalability and concurrent
calls will lose data.
has bad concurrency on write and will lose updates. And its scalability
Not plans to fix what was just the PoC of the v2 API, just
* update javadocs
* warn on startup that people should stop it.
* do some other hardening while there, and test cleanup
This code is @Private/@Unstable. Maybe we can move it into the -test jar.
Nobody will complain.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
