Hi, team,
Background: More and more hudi accesses use deltastreamer, resulting in a large number of deltastreamer jobs that need to be managed. In our company, we also manage a large number of deltastreamer jobs by ourselves, and there is a lot of operation and maintenance management and monitoring work. If we can provide such a deltastreamer service to create, manage, and monitor all tasks in a unified manner, it can greatly reduce the management pressure of deltastreamer, and at the same time lower the threshold for using deltastreamer, which is conducive to the promotion and use of deltastreamer. At the same time, considering that deltastreamer already supports configuration hot update capability [https://github.com/apache/hudi/pull/8807], we can offer configuration hot update capability based on the feature, and make configuration changes without restarting the job. We hope to provide: Provides a web UI to support creation, management and monitoring of deltastreamer tasks Using configuration hot update capability to provide timely configuration change capability I don't know whether such a service is in line with the evolution of the community, and I hope to receive your reply! Best Regards
