yuzhaojing created HUDI-3477:
--------------------------------
Summary: Sync timeline for client from embedded timeline service
instead scan filesystem
Key: HUDI-3477
URL: https://issues.apache.org/jira/browse/HUDI-3477
Project: Apache Hudi
Issue Type: Improvement
Components: flink, spark, timeline-server
Reporter: yuzhaojing
Assignee: yuzhaojing
Currently, the hudi meta client gets timeline using scan filesystem. But when
the task num and job num incre, the file system will be under enormous
pressure, which will affect the system stability. In this issue, I hope to use
embedded timeline service instead scan the filesystem to solve this problem.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
