Hi Kabeer, No need to apologize :) Mailing list works lot better for reporting issues. We can respond much quicker, since its not buried with all other github events
On what you saw, the cleaner does list all partitions currently. Have you tried reducing cleaner parallelism if limiting connections is your goal? Also some good news is, once https://issues.apache.org/jira/browse/HUDI-1 is landed (currently being reviewed), a follow on is to rework the cleaner incrementally on top which should help a lot here. Thanks Vinoth On Sat, Mar 23, 2019 at 7:39 PM Kabeer Ahmed <[email protected]> wrote: > Hi, > > I have just raised this issue and thought to share with the community if > someone else is experiencing this. Apologies in advance if this is a > redundant email. > Thanks > Kabeer. >
