[jira] [Commented] (FLINK-8707) Excessive amount of files opened by flink task manager

[ https://issues.apache.org/jira/browse/FLINK-8707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16495219#comment-16495219 ] Alexander Gardner commented on FLINK-8707: -- Hi Piotr Apologies again, all my time on

[jira] [Commented] (FLINK-8707) Excessive amount of files opened by flink task manager

[ https://issues.apache.org/jira/browse/FLINK-8707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16468809#comment-16468809 ] Alon Galant commented on FLINK-8707: Thanks Nico. My problem is solved :) We run Flink over

[jira] [Commented] (FLINK-8707) Excessive amount of files opened by flink task manager

[ https://issues.apache.org/jira/browse/FLINK-8707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16435853#comment-16435853 ] Alexander Gardner commented on FLINK-8707: -- Hi Stephan  Sorry for delay, will endeavour to

[jira] [Commented] (FLINK-8707) Excessive amount of files opened by flink task manager

[ https://issues.apache.org/jira/browse/FLINK-8707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16424125#comment-16424125 ] Nico Kruber commented on FLINK-8707: I still need to look at the detailed logs you two provided, but

[jira] [Commented] (FLINK-8707) Excessive amount of files opened by flink task manager

[ https://issues.apache.org/jira/browse/FLINK-8707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16424006#comment-16424006 ] Alon Galant commented on FLINK-8707: Hey,  I have a similar problem, this is my thread on Flink ML:

[jira] [Commented] (FLINK-8707) Excessive amount of files opened by flink task manager

[ https://issues.apache.org/jira/browse/FLINK-8707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16418909#comment-16418909 ] Till Rohrmann commented on FLINK-8707: -- Unblocked for 1.5.0 release since so far we could not

[jira] [Commented] (FLINK-8707) Excessive amount of files opened by flink task manager

[ https://issues.apache.org/jira/browse/FLINK-8707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16408599#comment-16408599 ] Aljoscha Krettek commented on FLINK-8707: - There is also this ML thread:

[jira] [Commented] (FLINK-8707) Excessive amount of files opened by flink task manager

[ https://issues.apache.org/jira/browse/FLINK-8707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16408067#comment-16408067 ] Piotr Nowojski commented on FLINK-8707: --- [~imogard] could you provide us the steps to reproduce your

[jira] [Commented] (FLINK-8707) Excessive amount of files opened by flink task manager

[ https://issues.apache.org/jira/browse/FLINK-8707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16406934#comment-16406934 ] Stephan Ewen commented on FLINK-8707: - Thanks for all the additional data. My first thoughts are that

[jira] [Commented] (FLINK-8707) Excessive amount of files opened by flink task manager

[ https://issues.apache.org/jira/browse/FLINK-8707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16381955#comment-16381955 ] Alexander Gardner commented on FLINK-8707: -- Hi there Were there any thoughts on the data I

[jira] [Commented] (FLINK-8707) Excessive amount of files opened by flink task manager

[ https://issues.apache.org/jira/browse/FLINK-8707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16373384#comment-16373384 ] Alexander Gardner commented on FLINK-8707: -- Summary of above detail is that: lsof | grep TM_PID

[jira] [Commented] (FLINK-8707) Excessive amount of files opened by flink task manager

[ https://issues.apache.org/jira/browse/FLINK-8707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16373377#comment-16373377 ] Alexander Gardner commented on FLINK-8707: -- Hi Stephan, Piotr & Nico Just some notes from the

[jira] [Commented] (FLINK-8707) Excessive amount of files opened by flink task manager

[ https://issues.apache.org/jira/browse/FLINK-8707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16372919#comment-16372919 ] Piotr Nowojski commented on FLINK-8707: --- If you take a look into the attached results of lsof, 60%

[jira] [Commented] (FLINK-8707) Excessive amount of files opened by flink task manager

[ https://issues.apache.org/jira/browse/FLINK-8707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16372028#comment-16372028 ] Stephan Ewen commented on FLINK-8707: - If I understood the description by [~imogard] correct, then

[jira] [Commented] (FLINK-8707) Excessive amount of files opened by flink task manager

[ https://issues.apache.org/jira/browse/FLINK-8707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16371717#comment-16371717 ] Piotr Nowojski commented on FLINK-8707: --- I don't know. But isn't the most of the descriptors used by

[jira] [Commented] (FLINK-8707) Excessive amount of files opened by flink task manager

[ https://issues.apache.org/jira/browse/FLINK-8707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16371401#comment-16371401 ] Stephan Ewen commented on FLINK-8707: - If I understand this correctly, the FDs should be network

[jira] [Commented] (FLINK-8707) Excessive amount of files opened by flink task manager

[ https://issues.apache.org/jira/browse/FLINK-8707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16370315#comment-16370315 ] Alexander Gardner commented on FLINK-8707: -- Also, if you start to run a Flink job on the cluster

[jira] [Commented] (FLINK-8707) Excessive amount of files opened by flink task manager

[ https://issues.apache.org/jira/browse/FLINK-8707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16370223#comment-16370223 ] Alexander Gardner commented on FLINK-8707: -- Attaching the lsof output, removing any refs to real

[jira] [Commented] (FLINK-8707) Excessive amount of files opened by flink task manager

[ https://issues.apache.org/jira/browse/FLINK-8707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16370219#comment-16370219 ] Alexander Gardner commented on FLINK-8707: -- Hi Aljoscha I'm adding some more info from our DEV