Hi Gu Haihua, What kinds of Kafka Connect (KC) tasks are running?
Where are the too many open files errors being thrown? Is it on the brokers? Or the standalone KC? Also, on the machine affected, can you please run `ulimit -a` under the relevant user (the user KC is running under, or the user the broker runs under, depending on where you're seeing the error) and post the output here? Cheers, Liam Clarke-Hutchinson On Thu, May 13, 2021 at 4:54 PM Gu Haihua <guhaihua0...@outlook.com> wrote: > Hi everyone > > We have a kafka connect service, which runs in standalone mode. Recently, > there are too many tasks running on it, and sometimes too many open files > error will be thrown. Through the lsof command, it can be seen that there > are many commit.offsets files open. > > $ lsof -p 16862|wc -l > 36960 > > $ lsof -p 16862|grep connect.offsets|wc -l > 36161 > > Does anyone know the reason? > > Regards > Haihua >
