sivabalan narayanan created HUDI-3872:
-----------------------------------------
Summary: Write tests for async clustering job to run concurrently
w/ deltastreamer w/o overlap
Key: HUDI-3872
URL: https://issues.apache.org/jira/browse/HUDI-3872
Project: Apache Hudi
Issue Type: Test
Components: clustering, deltastreamer
Reporter: sivabalan narayanan
We want to test HoodieClusteringJob along w/ deltastreamer continuous job. But
to test it reliably, we need to ensure regular writers don't overlap w/
clustering file groups. If not, one of them will fail. So, we need to come up
w/ test data generation differently so that regular writers keep writing to new
partition in every batch and so clustering can take care of older partitions
and there won't be any over-stepping among these.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
