zhangyue19921010 commented on PR #4309: URL: https://github.com/apache/hudi/pull/4309#issuecomment-1101136793
Very valuable idea! Further, maybe we can do more interesting things based on this very valuable hudi metastore server, which is beneficial to realize Hudi lake manager which could decouple hudi ingestion and hudi table service, including cleaner, archival, clustering, compaction and any table services in the feature. And this lake manager could unify and automatically call put services such as cleaner/clustering/compaction/archive(multi-writer and async) based on this metastore server. Users only need to care about their own ingest pipline and leave all the table services to the manager to automatically discover and manage the hudi table thereby greatly reducing the pressure of operation and maintenance and the cost of on board. CC @yihua and @nsivabalan -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
