deepakpanda93 commented on issue #15192: URL: https://github.com/apache/hudi/issues/15192#issuecomment-5324878620
This issue was reviewed as part of the JIRA-migrated backlog triage and is being closed as stale. Two reasons. First, the ask is not implementable as written. The title asks for `run_sync_tool.sh` to be run periodically, while the description asks for the opposite - *"maybe we could make this feature more optional, so in some cases we could ignore the update of table partitions"*. There is no single behaviour to build and no acceptance criterion. The JIRA last moved 2022-05-20. Second, the underlying need is already met. Inline meta sync (`hoodie.datasource.meta.sync.enable` / `hoodie.datasource.hive_sync.enable`) runs the sync at the end of every commit, so newly created partitions become visible to Hive without any external scheduler. `run_sync_tool.sh` remains only as a manual/backfill tool - on current master the sole reference to it is in `docker/demo/setup_demo_container.sh`. No commit or PR carries HUDI-4127. Closing. If inline sync is not producing partitions for a specific setup, that is a concrete bug worth a fresh issue. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
