[jira] [Commented] (FLINK-21995) YARNSessionFIFOSecuredITCase>YARNSessionFIFOITCase.checkForProhibitedLogContents: File channel manager has shutdown.
[ https://issues.apache.org/jira/browse/FLINK-21995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17481811#comment-17481811 ] Piotr Nowojski commented on FLINK-21995: https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=30050=logs=fc5181b0-e452-5c8f-68de-1097947f6483=995c650b-6573-581c-9ce6-7ad4cc038461 > YARNSessionFIFOSecuredITCase>YARNSessionFIFOITCase.checkForProhibitedLogContents: > File channel manager has shutdown. > > > Key: FLINK-21995 > URL: https://issues.apache.org/jira/browse/FLINK-21995 > Project: Flink > Issue Type: Bug > Components: Deployment / YARN >Affects Versions: 1.11.3, 1.13.0 >Reporter: Dawid Wysakowicz >Priority: Not a Priority > Labels: auto-deprioritized-major, auto-deprioritized-minor, > test-stability > > https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=15546=logs=fc5181b0-e452-5c8f-68de-1097947f6483=62110053-334f-5295-a0ab-80dd7e2babbf=30260 > {code} > [ERROR] > YARNSessionFIFOSecuredITCase>YARNSessionFIFOITCase.checkForProhibitedLogContents:84->YarnTestBase.ensureNoProhibitedStringInLogFiles:589 > Found a file > /__w/2/s/flink-yarn-tests/target/flink-yarn-tests-fifo-secured/flink-yarn-tests-fifo-secured-logDir-nm-1_0/application_1616768573754_0001/container_1616768573754_0001_01_02/taskmanager.log > with a prohibited string (one of [Exception, Started > SelectChannelConnector@0.0.0.0:8081]). Excerpts: > [ > 2021-03-26 14:23:37,554 INFO > org.apache.flink.configuration.GlobalConfiguration [] - Loading > configuration property: taskmanager.numberOfTaskSlots, 1 > 2021-03-26 14:23:37,555 INFO > org.apache.flink.configuration.GlobalConfiguration [] - Loading > configuration property: jobmanager.memory.process.size, 1600m > 2021-03-26 14:23:37,555 INFO > org.apache.flink.configuration.GlobalConfiguration [] - Loading > configuration property: jobmanager.rpc.port, 6123 > 2021-03-26 14:23:37,660 INFO org.apache.flink.yarn.YarnTaskExecutorRunner > [] - RECEIVED SIGNAL 15: SIGTERM. Shutting down as requested. > 2021-03-26 14:23:37,663 INFO > org.apache.flink.runtime.blob.TransientBlobCache [] - Shutting > down BLOB cache > 2021-03-26 14:23:37,667 INFO > org.apache.flink.runtime.blob.PermanentBlobCache [] - Shutting > down BLOB cache > 2021-03-26 14:23:37,668 INFO > org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager [] - > Shutting down TaskExecutorLocalStateStoresManager. > 2021-03-26 14:23:37,677 INFO org.apache.flink.runtime.filecache.FileCache > [] - removed file cache directory > /__w/2/s/flink-yarn-tests/target/flink-yarn-tests-fifo-secured/flink-yarn-tests-fifo-secured-localDir-nm-1_0/usercache/hadoop/appcache/application_1616768573754_0001/flink-dist-cache-eefe237c-906b-4b9a-b63f-997ef24c58ba > 2021-03-26 14:23:37,678 INFO > org.apache.flink.runtime.io.disk.FileChannelManagerImpl [] - > FileChannelManager removed spill file directory > /__w/2/s/flink-yarn-tests/target/flink-yarn-tests-fifo-secured/flink-yarn-tests-fifo-secured-localDir-nm-1_0/usercache/hadoop/appcache/application_1616768573754_0001/flink-netty-shuffle-d0a7a4ea-92b2-4614-bfed-2e949a36b9bc > 2021-03-26 14:23:37,680 WARN org.apache.flink.runtime.taskmanager.Task > [] - Keyed Aggregation -> Sink: Print to Std. Out (1/1)#0 > (e81d01c2526376e7d0b4b33ccd8d8c7a) switched from RUNNING to FAILED with > failure cause: java.lang.IllegalStateException: File channel manager has > shutdown. > 2021-03-26 14:23:37,680 WARN org.apache.flink.runtime.taskmanager.Task > [] - Keyed Aggregation -> Sink: Print to Std. Out (1/1)#0 > (e81d01c2526376e7d0b4b33ccd8d8c7a) switched from RUNNING to FAILED with > failure cause: java.lang.IllegalStateException: File channel manager has > shutdown. > at > org.apache.flink.util.Preconditions.checkState(Preconditions.java:193) > at > org.apache.flink.runtime.io.disk.FileChannelManagerImpl.getPaths(FileChannelManagerImpl.java:122) > at > org.apache.flink.runtime.io.disk.iomanager.IOManager.getSpillingDirectoriesPaths(IOManager.java:118) > at > org.apache.flink.streaming.runtime.io.StreamTaskNetworkInput.lambda$getRecordDeserializers$0(StreamTaskNetworkInput.java:90) > at java.util.stream.Collectors.lambda$toMap$58(Collectors.java:1321) > at java.util.stream.ReduceOps$3ReducingSink.accept(ReduceOps.java:169) > at > java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1384) > at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482) > at >
[jira] [Commented] (FLINK-21995) YARNSessionFIFOSecuredITCase>YARNSessionFIFOITCase.checkForProhibitedLogContents: File channel manager has shutdown.
[ https://issues.apache.org/jira/browse/FLINK-21995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17325692#comment-17325692 ] Dawid Wysakowicz commented on FLINK-21995: -- https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=16829=logs=fc5181b0-e452-5c8f-68de-1097947f6483=62110053-334f-5295-a0ab-80dd7e2babbf=29588 > YARNSessionFIFOSecuredITCase>YARNSessionFIFOITCase.checkForProhibitedLogContents: > File channel manager has shutdown. > > > Key: FLINK-21995 > URL: https://issues.apache.org/jira/browse/FLINK-21995 > Project: Flink > Issue Type: Bug > Components: Deployment / YARN >Affects Versions: 1.11.3, 1.13.0 >Reporter: Dawid Wysakowicz >Priority: Major > Labels: test-stability > > https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=15546=logs=fc5181b0-e452-5c8f-68de-1097947f6483=62110053-334f-5295-a0ab-80dd7e2babbf=30260 > {code} > [ERROR] > YARNSessionFIFOSecuredITCase>YARNSessionFIFOITCase.checkForProhibitedLogContents:84->YarnTestBase.ensureNoProhibitedStringInLogFiles:589 > Found a file > /__w/2/s/flink-yarn-tests/target/flink-yarn-tests-fifo-secured/flink-yarn-tests-fifo-secured-logDir-nm-1_0/application_1616768573754_0001/container_1616768573754_0001_01_02/taskmanager.log > with a prohibited string (one of [Exception, Started > SelectChannelConnector@0.0.0.0:8081]). Excerpts: > [ > 2021-03-26 14:23:37,554 INFO > org.apache.flink.configuration.GlobalConfiguration [] - Loading > configuration property: taskmanager.numberOfTaskSlots, 1 > 2021-03-26 14:23:37,555 INFO > org.apache.flink.configuration.GlobalConfiguration [] - Loading > configuration property: jobmanager.memory.process.size, 1600m > 2021-03-26 14:23:37,555 INFO > org.apache.flink.configuration.GlobalConfiguration [] - Loading > configuration property: jobmanager.rpc.port, 6123 > 2021-03-26 14:23:37,660 INFO org.apache.flink.yarn.YarnTaskExecutorRunner > [] - RECEIVED SIGNAL 15: SIGTERM. Shutting down as requested. > 2021-03-26 14:23:37,663 INFO > org.apache.flink.runtime.blob.TransientBlobCache [] - Shutting > down BLOB cache > 2021-03-26 14:23:37,667 INFO > org.apache.flink.runtime.blob.PermanentBlobCache [] - Shutting > down BLOB cache > 2021-03-26 14:23:37,668 INFO > org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager [] - > Shutting down TaskExecutorLocalStateStoresManager. > 2021-03-26 14:23:37,677 INFO org.apache.flink.runtime.filecache.FileCache > [] - removed file cache directory > /__w/2/s/flink-yarn-tests/target/flink-yarn-tests-fifo-secured/flink-yarn-tests-fifo-secured-localDir-nm-1_0/usercache/hadoop/appcache/application_1616768573754_0001/flink-dist-cache-eefe237c-906b-4b9a-b63f-997ef24c58ba > 2021-03-26 14:23:37,678 INFO > org.apache.flink.runtime.io.disk.FileChannelManagerImpl [] - > FileChannelManager removed spill file directory > /__w/2/s/flink-yarn-tests/target/flink-yarn-tests-fifo-secured/flink-yarn-tests-fifo-secured-localDir-nm-1_0/usercache/hadoop/appcache/application_1616768573754_0001/flink-netty-shuffle-d0a7a4ea-92b2-4614-bfed-2e949a36b9bc > 2021-03-26 14:23:37,680 WARN org.apache.flink.runtime.taskmanager.Task > [] - Keyed Aggregation -> Sink: Print to Std. Out (1/1)#0 > (e81d01c2526376e7d0b4b33ccd8d8c7a) switched from RUNNING to FAILED with > failure cause: java.lang.IllegalStateException: File channel manager has > shutdown. > 2021-03-26 14:23:37,680 WARN org.apache.flink.runtime.taskmanager.Task > [] - Keyed Aggregation -> Sink: Print to Std. Out (1/1)#0 > (e81d01c2526376e7d0b4b33ccd8d8c7a) switched from RUNNING to FAILED with > failure cause: java.lang.IllegalStateException: File channel manager has > shutdown. > at > org.apache.flink.util.Preconditions.checkState(Preconditions.java:193) > at > org.apache.flink.runtime.io.disk.FileChannelManagerImpl.getPaths(FileChannelManagerImpl.java:122) > at > org.apache.flink.runtime.io.disk.iomanager.IOManager.getSpillingDirectoriesPaths(IOManager.java:118) > at > org.apache.flink.streaming.runtime.io.StreamTaskNetworkInput.lambda$getRecordDeserializers$0(StreamTaskNetworkInput.java:90) > at java.util.stream.Collectors.lambda$toMap$58(Collectors.java:1321) > at java.util.stream.ReduceOps$3ReducingSink.accept(ReduceOps.java:169) > at > java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1384) > at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482) > at > java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472) > at >
[jira] [Commented] (FLINK-21995) YARNSessionFIFOSecuredITCase>YARNSessionFIFOITCase.checkForProhibitedLogContents: File channel manager has shutdown.
[ https://issues.apache.org/jira/browse/FLINK-21995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17321953#comment-17321953 ] Guowei Ma commented on FLINK-21995: --- https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=16566=logs=5cae8624-c7eb-5c51-92d3-4d2dacedd221=420bd9ec-164e-562e-8947-0dacde3cec91=29129 > YARNSessionFIFOSecuredITCase>YARNSessionFIFOITCase.checkForProhibitedLogContents: > File channel manager has shutdown. > > > Key: FLINK-21995 > URL: https://issues.apache.org/jira/browse/FLINK-21995 > Project: Flink > Issue Type: Bug > Components: Deployment / YARN >Affects Versions: 1.11.3, 1.13.0 >Reporter: Dawid Wysakowicz >Priority: Major > Labels: test-stability > > https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=15546=logs=fc5181b0-e452-5c8f-68de-1097947f6483=62110053-334f-5295-a0ab-80dd7e2babbf=30260 > {code} > [ERROR] > YARNSessionFIFOSecuredITCase>YARNSessionFIFOITCase.checkForProhibitedLogContents:84->YarnTestBase.ensureNoProhibitedStringInLogFiles:589 > Found a file > /__w/2/s/flink-yarn-tests/target/flink-yarn-tests-fifo-secured/flink-yarn-tests-fifo-secured-logDir-nm-1_0/application_1616768573754_0001/container_1616768573754_0001_01_02/taskmanager.log > with a prohibited string (one of [Exception, Started > SelectChannelConnector@0.0.0.0:8081]). Excerpts: > [ > 2021-03-26 14:23:37,554 INFO > org.apache.flink.configuration.GlobalConfiguration [] - Loading > configuration property: taskmanager.numberOfTaskSlots, 1 > 2021-03-26 14:23:37,555 INFO > org.apache.flink.configuration.GlobalConfiguration [] - Loading > configuration property: jobmanager.memory.process.size, 1600m > 2021-03-26 14:23:37,555 INFO > org.apache.flink.configuration.GlobalConfiguration [] - Loading > configuration property: jobmanager.rpc.port, 6123 > 2021-03-26 14:23:37,660 INFO org.apache.flink.yarn.YarnTaskExecutorRunner > [] - RECEIVED SIGNAL 15: SIGTERM. Shutting down as requested. > 2021-03-26 14:23:37,663 INFO > org.apache.flink.runtime.blob.TransientBlobCache [] - Shutting > down BLOB cache > 2021-03-26 14:23:37,667 INFO > org.apache.flink.runtime.blob.PermanentBlobCache [] - Shutting > down BLOB cache > 2021-03-26 14:23:37,668 INFO > org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager [] - > Shutting down TaskExecutorLocalStateStoresManager. > 2021-03-26 14:23:37,677 INFO org.apache.flink.runtime.filecache.FileCache > [] - removed file cache directory > /__w/2/s/flink-yarn-tests/target/flink-yarn-tests-fifo-secured/flink-yarn-tests-fifo-secured-localDir-nm-1_0/usercache/hadoop/appcache/application_1616768573754_0001/flink-dist-cache-eefe237c-906b-4b9a-b63f-997ef24c58ba > 2021-03-26 14:23:37,678 INFO > org.apache.flink.runtime.io.disk.FileChannelManagerImpl [] - > FileChannelManager removed spill file directory > /__w/2/s/flink-yarn-tests/target/flink-yarn-tests-fifo-secured/flink-yarn-tests-fifo-secured-localDir-nm-1_0/usercache/hadoop/appcache/application_1616768573754_0001/flink-netty-shuffle-d0a7a4ea-92b2-4614-bfed-2e949a36b9bc > 2021-03-26 14:23:37,680 WARN org.apache.flink.runtime.taskmanager.Task > [] - Keyed Aggregation -> Sink: Print to Std. Out (1/1)#0 > (e81d01c2526376e7d0b4b33ccd8d8c7a) switched from RUNNING to FAILED with > failure cause: java.lang.IllegalStateException: File channel manager has > shutdown. > 2021-03-26 14:23:37,680 WARN org.apache.flink.runtime.taskmanager.Task > [] - Keyed Aggregation -> Sink: Print to Std. Out (1/1)#0 > (e81d01c2526376e7d0b4b33ccd8d8c7a) switched from RUNNING to FAILED with > failure cause: java.lang.IllegalStateException: File channel manager has > shutdown. > at > org.apache.flink.util.Preconditions.checkState(Preconditions.java:193) > at > org.apache.flink.runtime.io.disk.FileChannelManagerImpl.getPaths(FileChannelManagerImpl.java:122) > at > org.apache.flink.runtime.io.disk.iomanager.IOManager.getSpillingDirectoriesPaths(IOManager.java:118) > at > org.apache.flink.streaming.runtime.io.StreamTaskNetworkInput.lambda$getRecordDeserializers$0(StreamTaskNetworkInput.java:90) > at java.util.stream.Collectors.lambda$toMap$58(Collectors.java:1321) > at java.util.stream.ReduceOps$3ReducingSink.accept(ReduceOps.java:169) > at > java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1384) > at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482) > at > java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472) > at >
[jira] [Commented] (FLINK-21995) YARNSessionFIFOSecuredITCase>YARNSessionFIFOITCase.checkForProhibitedLogContents: File channel manager has shutdown.
[ https://issues.apache.org/jira/browse/FLINK-21995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17319877#comment-17319877 ] Guowei Ma commented on FLINK-21995: --- https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=16406=logs=245e1f2e-ba5b-5570-d689-25ae21e5302f=02d88c1a-f1b3-5a8c-4b4a-cf43c70f99e1=27277 > YARNSessionFIFOSecuredITCase>YARNSessionFIFOITCase.checkForProhibitedLogContents: > File channel manager has shutdown. > > > Key: FLINK-21995 > URL: https://issues.apache.org/jira/browse/FLINK-21995 > Project: Flink > Issue Type: Bug > Components: Deployment / YARN >Affects Versions: 1.13.0 >Reporter: Dawid Wysakowicz >Priority: Major > Labels: test-stability > > https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=15546=logs=fc5181b0-e452-5c8f-68de-1097947f6483=62110053-334f-5295-a0ab-80dd7e2babbf=30260 > {code} > [ERROR] > YARNSessionFIFOSecuredITCase>YARNSessionFIFOITCase.checkForProhibitedLogContents:84->YarnTestBase.ensureNoProhibitedStringInLogFiles:589 > Found a file > /__w/2/s/flink-yarn-tests/target/flink-yarn-tests-fifo-secured/flink-yarn-tests-fifo-secured-logDir-nm-1_0/application_1616768573754_0001/container_1616768573754_0001_01_02/taskmanager.log > with a prohibited string (one of [Exception, Started > SelectChannelConnector@0.0.0.0:8081]). Excerpts: > [ > 2021-03-26 14:23:37,554 INFO > org.apache.flink.configuration.GlobalConfiguration [] - Loading > configuration property: taskmanager.numberOfTaskSlots, 1 > 2021-03-26 14:23:37,555 INFO > org.apache.flink.configuration.GlobalConfiguration [] - Loading > configuration property: jobmanager.memory.process.size, 1600m > 2021-03-26 14:23:37,555 INFO > org.apache.flink.configuration.GlobalConfiguration [] - Loading > configuration property: jobmanager.rpc.port, 6123 > 2021-03-26 14:23:37,660 INFO org.apache.flink.yarn.YarnTaskExecutorRunner > [] - RECEIVED SIGNAL 15: SIGTERM. Shutting down as requested. > 2021-03-26 14:23:37,663 INFO > org.apache.flink.runtime.blob.TransientBlobCache [] - Shutting > down BLOB cache > 2021-03-26 14:23:37,667 INFO > org.apache.flink.runtime.blob.PermanentBlobCache [] - Shutting > down BLOB cache > 2021-03-26 14:23:37,668 INFO > org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager [] - > Shutting down TaskExecutorLocalStateStoresManager. > 2021-03-26 14:23:37,677 INFO org.apache.flink.runtime.filecache.FileCache > [] - removed file cache directory > /__w/2/s/flink-yarn-tests/target/flink-yarn-tests-fifo-secured/flink-yarn-tests-fifo-secured-localDir-nm-1_0/usercache/hadoop/appcache/application_1616768573754_0001/flink-dist-cache-eefe237c-906b-4b9a-b63f-997ef24c58ba > 2021-03-26 14:23:37,678 INFO > org.apache.flink.runtime.io.disk.FileChannelManagerImpl [] - > FileChannelManager removed spill file directory > /__w/2/s/flink-yarn-tests/target/flink-yarn-tests-fifo-secured/flink-yarn-tests-fifo-secured-localDir-nm-1_0/usercache/hadoop/appcache/application_1616768573754_0001/flink-netty-shuffle-d0a7a4ea-92b2-4614-bfed-2e949a36b9bc > 2021-03-26 14:23:37,680 WARN org.apache.flink.runtime.taskmanager.Task > [] - Keyed Aggregation -> Sink: Print to Std. Out (1/1)#0 > (e81d01c2526376e7d0b4b33ccd8d8c7a) switched from RUNNING to FAILED with > failure cause: java.lang.IllegalStateException: File channel manager has > shutdown. > 2021-03-26 14:23:37,680 WARN org.apache.flink.runtime.taskmanager.Task > [] - Keyed Aggregation -> Sink: Print to Std. Out (1/1)#0 > (e81d01c2526376e7d0b4b33ccd8d8c7a) switched from RUNNING to FAILED with > failure cause: java.lang.IllegalStateException: File channel manager has > shutdown. > at > org.apache.flink.util.Preconditions.checkState(Preconditions.java:193) > at > org.apache.flink.runtime.io.disk.FileChannelManagerImpl.getPaths(FileChannelManagerImpl.java:122) > at > org.apache.flink.runtime.io.disk.iomanager.IOManager.getSpillingDirectoriesPaths(IOManager.java:118) > at > org.apache.flink.streaming.runtime.io.StreamTaskNetworkInput.lambda$getRecordDeserializers$0(StreamTaskNetworkInput.java:90) > at java.util.stream.Collectors.lambda$toMap$58(Collectors.java:1321) > at java.util.stream.ReduceOps$3ReducingSink.accept(ReduceOps.java:169) > at > java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1384) > at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482) > at > java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472) > at >