Ares-W opened a new issue #1908:
URL: https://github.com/apache/hudi/issues/1908
There are too many close_wait sockets in 50010 when I use SparkStreaming to
save kafka data to Hudi. I use
dataFrame.write.format("org.apache.hudi").mode().save() method to save data to
hudi. But when one batch data write to hudi,there remains some close_wait
sockets on 50010 port and never close,With the program running,there are more
and more close_wait socket on 50010 and throw “Too mang open files” Exception.
How to close the close_wait socket?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
