[jira] [Updated] (FLINK-21995) YARNSessionFIFOSecuredITCase>YARNSessionFIFOITCase.checkForProhibitedLogContents: File channel manager has shutdown.
[
https://issues.apache.org/jira/browse/FLINK-21995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Flink Jira Bot updated FLINK-21995:
---
Labels: auto-deprioritized-major auto-deprioritized-minor test-stability
(was: auto-deprioritized-major auto-deprioritized-minor stale-minor
test-stability)
Priority: Not a Priority (was: Minor)
This issue was labeled "stale-minor" 7 days ago and has not received any
updates so it is being deprioritized. If this ticket is actually Minor, please
raise the priority and ask a committer to assign you the issue or revive the
public discussion.
> YARNSessionFIFOSecuredITCase>YARNSessionFIFOITCase.checkForProhibitedLogContents:
> File channel manager has shutdown.
>
>
> Key: FLINK-21995
> URL: https://issues.apache.org/jira/browse/FLINK-21995
> Project: Flink
> Issue Type: Bug
> Components: Deployment / YARN
>Affects Versions: 1.11.3, 1.13.0
>Reporter: Dawid Wysakowicz
>Priority: Not a Priority
> Labels: auto-deprioritized-major, auto-deprioritized-minor,
> test-stability
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=15546=logs=fc5181b0-e452-5c8f-68de-1097947f6483=62110053-334f-5295-a0ab-80dd7e2babbf=30260
> {code}
> [ERROR]
> YARNSessionFIFOSecuredITCase>YARNSessionFIFOITCase.checkForProhibitedLogContents:84->YarnTestBase.ensureNoProhibitedStringInLogFiles:589
> Found a file
> /__w/2/s/flink-yarn-tests/target/flink-yarn-tests-fifo-secured/flink-yarn-tests-fifo-secured-logDir-nm-1_0/application_1616768573754_0001/container_1616768573754_0001_01_02/taskmanager.log
> with a prohibited string (one of [Exception, Started
> SelectChannelConnector@0.0.0.0:8081]). Excerpts:
> [
> 2021-03-26 14:23:37,554 INFO
> org.apache.flink.configuration.GlobalConfiguration [] - Loading
> configuration property: taskmanager.numberOfTaskSlots, 1
> 2021-03-26 14:23:37,555 INFO
> org.apache.flink.configuration.GlobalConfiguration [] - Loading
> configuration property: jobmanager.memory.process.size, 1600m
> 2021-03-26 14:23:37,555 INFO
> org.apache.flink.configuration.GlobalConfiguration [] - Loading
> configuration property: jobmanager.rpc.port, 6123
> 2021-03-26 14:23:37,660 INFO org.apache.flink.yarn.YarnTaskExecutorRunner
> [] - RECEIVED SIGNAL 15: SIGTERM. Shutting down as requested.
> 2021-03-26 14:23:37,663 INFO
> org.apache.flink.runtime.blob.TransientBlobCache [] - Shutting
> down BLOB cache
> 2021-03-26 14:23:37,667 INFO
> org.apache.flink.runtime.blob.PermanentBlobCache [] - Shutting
> down BLOB cache
> 2021-03-26 14:23:37,668 INFO
> org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager [] -
> Shutting down TaskExecutorLocalStateStoresManager.
> 2021-03-26 14:23:37,677 INFO org.apache.flink.runtime.filecache.FileCache
> [] - removed file cache directory
> /__w/2/s/flink-yarn-tests/target/flink-yarn-tests-fifo-secured/flink-yarn-tests-fifo-secured-localDir-nm-1_0/usercache/hadoop/appcache/application_1616768573754_0001/flink-dist-cache-eefe237c-906b-4b9a-b63f-997ef24c58ba
> 2021-03-26 14:23:37,678 INFO
> org.apache.flink.runtime.io.disk.FileChannelManagerImpl [] -
> FileChannelManager removed spill file directory
> /__w/2/s/flink-yarn-tests/target/flink-yarn-tests-fifo-secured/flink-yarn-tests-fifo-secured-localDir-nm-1_0/usercache/hadoop/appcache/application_1616768573754_0001/flink-netty-shuffle-d0a7a4ea-92b2-4614-bfed-2e949a36b9bc
> 2021-03-26 14:23:37,680 WARN org.apache.flink.runtime.taskmanager.Task
> [] - Keyed Aggregation -> Sink: Print to Std. Out (1/1)#0
> (e81d01c2526376e7d0b4b33ccd8d8c7a) switched from RUNNING to FAILED with
> failure cause: java.lang.IllegalStateException: File channel manager has
> shutdown.
> 2021-03-26 14:23:37,680 WARN org.apache.flink.runtime.taskmanager.Task
> [] - Keyed Aggregation -> Sink: Print to Std. Out (1/1)#0
> (e81d01c2526376e7d0b4b33ccd8d8c7a) switched from RUNNING to FAILED with
> failure cause: java.lang.IllegalStateException: File channel manager has
> shutdown.
> at
> org.apache.flink.util.Preconditions.checkState(Preconditions.java:193)
> at
> org.apache.flink.runtime.io.disk.FileChannelManagerImpl.getPaths(FileChannelManagerImpl.java:122)
> at
> org.apache.flink.runtime.io.disk.iomanager.IOManager.getSpillingDirectoriesPaths(IOManager.java:118)
> at
> org.apache.flink.streaming.runtime.io.StreamTaskNetworkInput.lambda$getRecordDeserializers$0(StreamTaskNetworkInput.java:90)
> at java.util.stream.Collectors.lambda$toMap$58(Collectors.java:1321)
> at
[jira] [Updated] (FLINK-21995) YARNSessionFIFOSecuredITCase>YARNSessionFIFOITCase.checkForProhibitedLogContents: File channel manager has shutdown.
[
https://issues.apache.org/jira/browse/FLINK-21995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Flink Jira Bot updated FLINK-21995:
---
Labels: auto-deprioritized-major auto-deprioritized-minor stale-minor
test-stability (was: auto-deprioritized-major auto-deprioritized-minor
test-stability)
I am the [Flink Jira Bot|https://github.com/apache/flink-jira-bot/] and I help
the community manage its development. I see this issues has been marked as
Minor but is unassigned and neither itself nor its Sub-Tasks have been updated
for 180 days. I have gone ahead and marked it "stale-minor". If this ticket is
still Minor, please either assign yourself or give an update. Afterwards,
please remove the label or in 7 days the issue will be deprioritized.
> YARNSessionFIFOSecuredITCase>YARNSessionFIFOITCase.checkForProhibitedLogContents:
> File channel manager has shutdown.
>
>
> Key: FLINK-21995
> URL: https://issues.apache.org/jira/browse/FLINK-21995
> Project: Flink
> Issue Type: Bug
> Components: Deployment / YARN
>Affects Versions: 1.11.3, 1.13.0
>Reporter: Dawid Wysakowicz
>Priority: Minor
> Labels: auto-deprioritized-major, auto-deprioritized-minor,
> stale-minor, test-stability
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=15546=logs=fc5181b0-e452-5c8f-68de-1097947f6483=62110053-334f-5295-a0ab-80dd7e2babbf=30260
> {code}
> [ERROR]
> YARNSessionFIFOSecuredITCase>YARNSessionFIFOITCase.checkForProhibitedLogContents:84->YarnTestBase.ensureNoProhibitedStringInLogFiles:589
> Found a file
> /__w/2/s/flink-yarn-tests/target/flink-yarn-tests-fifo-secured/flink-yarn-tests-fifo-secured-logDir-nm-1_0/application_1616768573754_0001/container_1616768573754_0001_01_02/taskmanager.log
> with a prohibited string (one of [Exception, Started
> SelectChannelConnector@0.0.0.0:8081]). Excerpts:
> [
> 2021-03-26 14:23:37,554 INFO
> org.apache.flink.configuration.GlobalConfiguration [] - Loading
> configuration property: taskmanager.numberOfTaskSlots, 1
> 2021-03-26 14:23:37,555 INFO
> org.apache.flink.configuration.GlobalConfiguration [] - Loading
> configuration property: jobmanager.memory.process.size, 1600m
> 2021-03-26 14:23:37,555 INFO
> org.apache.flink.configuration.GlobalConfiguration [] - Loading
> configuration property: jobmanager.rpc.port, 6123
> 2021-03-26 14:23:37,660 INFO org.apache.flink.yarn.YarnTaskExecutorRunner
> [] - RECEIVED SIGNAL 15: SIGTERM. Shutting down as requested.
> 2021-03-26 14:23:37,663 INFO
> org.apache.flink.runtime.blob.TransientBlobCache [] - Shutting
> down BLOB cache
> 2021-03-26 14:23:37,667 INFO
> org.apache.flink.runtime.blob.PermanentBlobCache [] - Shutting
> down BLOB cache
> 2021-03-26 14:23:37,668 INFO
> org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager [] -
> Shutting down TaskExecutorLocalStateStoresManager.
> 2021-03-26 14:23:37,677 INFO org.apache.flink.runtime.filecache.FileCache
> [] - removed file cache directory
> /__w/2/s/flink-yarn-tests/target/flink-yarn-tests-fifo-secured/flink-yarn-tests-fifo-secured-localDir-nm-1_0/usercache/hadoop/appcache/application_1616768573754_0001/flink-dist-cache-eefe237c-906b-4b9a-b63f-997ef24c58ba
> 2021-03-26 14:23:37,678 INFO
> org.apache.flink.runtime.io.disk.FileChannelManagerImpl [] -
> FileChannelManager removed spill file directory
> /__w/2/s/flink-yarn-tests/target/flink-yarn-tests-fifo-secured/flink-yarn-tests-fifo-secured-localDir-nm-1_0/usercache/hadoop/appcache/application_1616768573754_0001/flink-netty-shuffle-d0a7a4ea-92b2-4614-bfed-2e949a36b9bc
> 2021-03-26 14:23:37,680 WARN org.apache.flink.runtime.taskmanager.Task
> [] - Keyed Aggregation -> Sink: Print to Std. Out (1/1)#0
> (e81d01c2526376e7d0b4b33ccd8d8c7a) switched from RUNNING to FAILED with
> failure cause: java.lang.IllegalStateException: File channel manager has
> shutdown.
> 2021-03-26 14:23:37,680 WARN org.apache.flink.runtime.taskmanager.Task
> [] - Keyed Aggregation -> Sink: Print to Std. Out (1/1)#0
> (e81d01c2526376e7d0b4b33ccd8d8c7a) switched from RUNNING to FAILED with
> failure cause: java.lang.IllegalStateException: File channel manager has
> shutdown.
> at
> org.apache.flink.util.Preconditions.checkState(Preconditions.java:193)
> at
> org.apache.flink.runtime.io.disk.FileChannelManagerImpl.getPaths(FileChannelManagerImpl.java:122)
> at
> org.apache.flink.runtime.io.disk.iomanager.IOManager.getSpillingDirectoriesPaths(IOManager.java:118)
> at
>
[jira] [Updated] (FLINK-21995) YARNSessionFIFOSecuredITCase>YARNSessionFIFOITCase.checkForProhibitedLogContents: File channel manager has shutdown.
[
https://issues.apache.org/jira/browse/FLINK-21995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Flink Jira Bot updated FLINK-21995:
---
Labels: auto-deprioritized-major auto-deprioritized-minor test-stability
(was: auto-deprioritized-major auto-deprioritized-minor stale-major
test-stability)
Priority: Minor (was: Major)
This issue was labeled "stale-major" 7 days ago and has not received any
updates so it is being deprioritized. If this ticket is actually Major, please
raise the priority and ask a committer to assign you the issue or revive the
public discussion.
> YARNSessionFIFOSecuredITCase>YARNSessionFIFOITCase.checkForProhibitedLogContents:
> File channel manager has shutdown.
>
>
> Key: FLINK-21995
> URL: https://issues.apache.org/jira/browse/FLINK-21995
> Project: Flink
> Issue Type: Bug
> Components: Deployment / YARN
>Affects Versions: 1.11.3, 1.13.0
>Reporter: Dawid Wysakowicz
>Priority: Minor
> Labels: auto-deprioritized-major, auto-deprioritized-minor,
> test-stability
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=15546=logs=fc5181b0-e452-5c8f-68de-1097947f6483=62110053-334f-5295-a0ab-80dd7e2babbf=30260
> {code}
> [ERROR]
> YARNSessionFIFOSecuredITCase>YARNSessionFIFOITCase.checkForProhibitedLogContents:84->YarnTestBase.ensureNoProhibitedStringInLogFiles:589
> Found a file
> /__w/2/s/flink-yarn-tests/target/flink-yarn-tests-fifo-secured/flink-yarn-tests-fifo-secured-logDir-nm-1_0/application_1616768573754_0001/container_1616768573754_0001_01_02/taskmanager.log
> with a prohibited string (one of [Exception, Started
> SelectChannelConnector@0.0.0.0:8081]). Excerpts:
> [
> 2021-03-26 14:23:37,554 INFO
> org.apache.flink.configuration.GlobalConfiguration [] - Loading
> configuration property: taskmanager.numberOfTaskSlots, 1
> 2021-03-26 14:23:37,555 INFO
> org.apache.flink.configuration.GlobalConfiguration [] - Loading
> configuration property: jobmanager.memory.process.size, 1600m
> 2021-03-26 14:23:37,555 INFO
> org.apache.flink.configuration.GlobalConfiguration [] - Loading
> configuration property: jobmanager.rpc.port, 6123
> 2021-03-26 14:23:37,660 INFO org.apache.flink.yarn.YarnTaskExecutorRunner
> [] - RECEIVED SIGNAL 15: SIGTERM. Shutting down as requested.
> 2021-03-26 14:23:37,663 INFO
> org.apache.flink.runtime.blob.TransientBlobCache [] - Shutting
> down BLOB cache
> 2021-03-26 14:23:37,667 INFO
> org.apache.flink.runtime.blob.PermanentBlobCache [] - Shutting
> down BLOB cache
> 2021-03-26 14:23:37,668 INFO
> org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager [] -
> Shutting down TaskExecutorLocalStateStoresManager.
> 2021-03-26 14:23:37,677 INFO org.apache.flink.runtime.filecache.FileCache
> [] - removed file cache directory
> /__w/2/s/flink-yarn-tests/target/flink-yarn-tests-fifo-secured/flink-yarn-tests-fifo-secured-localDir-nm-1_0/usercache/hadoop/appcache/application_1616768573754_0001/flink-dist-cache-eefe237c-906b-4b9a-b63f-997ef24c58ba
> 2021-03-26 14:23:37,678 INFO
> org.apache.flink.runtime.io.disk.FileChannelManagerImpl [] -
> FileChannelManager removed spill file directory
> /__w/2/s/flink-yarn-tests/target/flink-yarn-tests-fifo-secured/flink-yarn-tests-fifo-secured-localDir-nm-1_0/usercache/hadoop/appcache/application_1616768573754_0001/flink-netty-shuffle-d0a7a4ea-92b2-4614-bfed-2e949a36b9bc
> 2021-03-26 14:23:37,680 WARN org.apache.flink.runtime.taskmanager.Task
> [] - Keyed Aggregation -> Sink: Print to Std. Out (1/1)#0
> (e81d01c2526376e7d0b4b33ccd8d8c7a) switched from RUNNING to FAILED with
> failure cause: java.lang.IllegalStateException: File channel manager has
> shutdown.
> 2021-03-26 14:23:37,680 WARN org.apache.flink.runtime.taskmanager.Task
> [] - Keyed Aggregation -> Sink: Print to Std. Out (1/1)#0
> (e81d01c2526376e7d0b4b33ccd8d8c7a) switched from RUNNING to FAILED with
> failure cause: java.lang.IllegalStateException: File channel manager has
> shutdown.
> at
> org.apache.flink.util.Preconditions.checkState(Preconditions.java:193)
> at
> org.apache.flink.runtime.io.disk.FileChannelManagerImpl.getPaths(FileChannelManagerImpl.java:122)
> at
> org.apache.flink.runtime.io.disk.iomanager.IOManager.getSpillingDirectoriesPaths(IOManager.java:118)
> at
> org.apache.flink.streaming.runtime.io.StreamTaskNetworkInput.lambda$getRecordDeserializers$0(StreamTaskNetworkInput.java:90)
> at java.util.stream.Collectors.lambda$toMap$58(Collectors.java:1321)
> at
[jira] [Updated] (FLINK-21995) YARNSessionFIFOSecuredITCase>YARNSessionFIFOITCase.checkForProhibitedLogContents: File channel manager has shutdown.
[
https://issues.apache.org/jira/browse/FLINK-21995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Flink Jira Bot updated FLINK-21995:
---
Labels: auto-deprioritized-major auto-deprioritized-minor stale-major
test-stability (was: auto-deprioritized-major auto-deprioritized-minor
test-stability)
I am the [Flink Jira Bot|https://github.com/apache/flink-jira-bot/] and I help
the community manage its development. I see this issues has been marked as
Major but is unassigned and neither itself nor its Sub-Tasks have been updated
for 60 days. I have gone ahead and added a "stale-major" to the issue". If this
ticket is a Major, please either assign yourself or give an update. Afterwards,
please remove the label or in 7 days the issue will be deprioritized.
> YARNSessionFIFOSecuredITCase>YARNSessionFIFOITCase.checkForProhibitedLogContents:
> File channel manager has shutdown.
>
>
> Key: FLINK-21995
> URL: https://issues.apache.org/jira/browse/FLINK-21995
> Project: Flink
> Issue Type: Bug
> Components: Deployment / YARN
>Affects Versions: 1.11.3, 1.13.0
>Reporter: Dawid Wysakowicz
>Priority: Major
> Labels: auto-deprioritized-major, auto-deprioritized-minor,
> stale-major, test-stability
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=15546=logs=fc5181b0-e452-5c8f-68de-1097947f6483=62110053-334f-5295-a0ab-80dd7e2babbf=30260
> {code}
> [ERROR]
> YARNSessionFIFOSecuredITCase>YARNSessionFIFOITCase.checkForProhibitedLogContents:84->YarnTestBase.ensureNoProhibitedStringInLogFiles:589
> Found a file
> /__w/2/s/flink-yarn-tests/target/flink-yarn-tests-fifo-secured/flink-yarn-tests-fifo-secured-logDir-nm-1_0/application_1616768573754_0001/container_1616768573754_0001_01_02/taskmanager.log
> with a prohibited string (one of [Exception, Started
> SelectChannelConnector@0.0.0.0:8081]). Excerpts:
> [
> 2021-03-26 14:23:37,554 INFO
> org.apache.flink.configuration.GlobalConfiguration [] - Loading
> configuration property: taskmanager.numberOfTaskSlots, 1
> 2021-03-26 14:23:37,555 INFO
> org.apache.flink.configuration.GlobalConfiguration [] - Loading
> configuration property: jobmanager.memory.process.size, 1600m
> 2021-03-26 14:23:37,555 INFO
> org.apache.flink.configuration.GlobalConfiguration [] - Loading
> configuration property: jobmanager.rpc.port, 6123
> 2021-03-26 14:23:37,660 INFO org.apache.flink.yarn.YarnTaskExecutorRunner
> [] - RECEIVED SIGNAL 15: SIGTERM. Shutting down as requested.
> 2021-03-26 14:23:37,663 INFO
> org.apache.flink.runtime.blob.TransientBlobCache [] - Shutting
> down BLOB cache
> 2021-03-26 14:23:37,667 INFO
> org.apache.flink.runtime.blob.PermanentBlobCache [] - Shutting
> down BLOB cache
> 2021-03-26 14:23:37,668 INFO
> org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager [] -
> Shutting down TaskExecutorLocalStateStoresManager.
> 2021-03-26 14:23:37,677 INFO org.apache.flink.runtime.filecache.FileCache
> [] - removed file cache directory
> /__w/2/s/flink-yarn-tests/target/flink-yarn-tests-fifo-secured/flink-yarn-tests-fifo-secured-localDir-nm-1_0/usercache/hadoop/appcache/application_1616768573754_0001/flink-dist-cache-eefe237c-906b-4b9a-b63f-997ef24c58ba
> 2021-03-26 14:23:37,678 INFO
> org.apache.flink.runtime.io.disk.FileChannelManagerImpl [] -
> FileChannelManager removed spill file directory
> /__w/2/s/flink-yarn-tests/target/flink-yarn-tests-fifo-secured/flink-yarn-tests-fifo-secured-localDir-nm-1_0/usercache/hadoop/appcache/application_1616768573754_0001/flink-netty-shuffle-d0a7a4ea-92b2-4614-bfed-2e949a36b9bc
> 2021-03-26 14:23:37,680 WARN org.apache.flink.runtime.taskmanager.Task
> [] - Keyed Aggregation -> Sink: Print to Std. Out (1/1)#0
> (e81d01c2526376e7d0b4b33ccd8d8c7a) switched from RUNNING to FAILED with
> failure cause: java.lang.IllegalStateException: File channel manager has
> shutdown.
> 2021-03-26 14:23:37,680 WARN org.apache.flink.runtime.taskmanager.Task
> [] - Keyed Aggregation -> Sink: Print to Std. Out (1/1)#0
> (e81d01c2526376e7d0b4b33ccd8d8c7a) switched from RUNNING to FAILED with
> failure cause: java.lang.IllegalStateException: File channel manager has
> shutdown.
> at
> org.apache.flink.util.Preconditions.checkState(Preconditions.java:193)
> at
> org.apache.flink.runtime.io.disk.FileChannelManagerImpl.getPaths(FileChannelManagerImpl.java:122)
> at
> org.apache.flink.runtime.io.disk.iomanager.IOManager.getSpillingDirectoriesPaths(IOManager.java:118)
> at
>
[jira] [Updated] (FLINK-21995) YARNSessionFIFOSecuredITCase>YARNSessionFIFOITCase.checkForProhibitedLogContents: File channel manager has shutdown.
[
https://issues.apache.org/jira/browse/FLINK-21995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Piotr Nowojski updated FLINK-21995:
---
Priority: Major (was: Not a Priority)
> YARNSessionFIFOSecuredITCase>YARNSessionFIFOITCase.checkForProhibitedLogContents:
> File channel manager has shutdown.
>
>
> Key: FLINK-21995
> URL: https://issues.apache.org/jira/browse/FLINK-21995
> Project: Flink
> Issue Type: Bug
> Components: Deployment / YARN
>Affects Versions: 1.11.3, 1.13.0
>Reporter: Dawid Wysakowicz
>Priority: Major
> Labels: auto-deprioritized-major, auto-deprioritized-minor,
> test-stability
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=15546=logs=fc5181b0-e452-5c8f-68de-1097947f6483=62110053-334f-5295-a0ab-80dd7e2babbf=30260
> {code}
> [ERROR]
> YARNSessionFIFOSecuredITCase>YARNSessionFIFOITCase.checkForProhibitedLogContents:84->YarnTestBase.ensureNoProhibitedStringInLogFiles:589
> Found a file
> /__w/2/s/flink-yarn-tests/target/flink-yarn-tests-fifo-secured/flink-yarn-tests-fifo-secured-logDir-nm-1_0/application_1616768573754_0001/container_1616768573754_0001_01_02/taskmanager.log
> with a prohibited string (one of [Exception, Started
> SelectChannelConnector@0.0.0.0:8081]). Excerpts:
> [
> 2021-03-26 14:23:37,554 INFO
> org.apache.flink.configuration.GlobalConfiguration [] - Loading
> configuration property: taskmanager.numberOfTaskSlots, 1
> 2021-03-26 14:23:37,555 INFO
> org.apache.flink.configuration.GlobalConfiguration [] - Loading
> configuration property: jobmanager.memory.process.size, 1600m
> 2021-03-26 14:23:37,555 INFO
> org.apache.flink.configuration.GlobalConfiguration [] - Loading
> configuration property: jobmanager.rpc.port, 6123
> 2021-03-26 14:23:37,660 INFO org.apache.flink.yarn.YarnTaskExecutorRunner
> [] - RECEIVED SIGNAL 15: SIGTERM. Shutting down as requested.
> 2021-03-26 14:23:37,663 INFO
> org.apache.flink.runtime.blob.TransientBlobCache [] - Shutting
> down BLOB cache
> 2021-03-26 14:23:37,667 INFO
> org.apache.flink.runtime.blob.PermanentBlobCache [] - Shutting
> down BLOB cache
> 2021-03-26 14:23:37,668 INFO
> org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager [] -
> Shutting down TaskExecutorLocalStateStoresManager.
> 2021-03-26 14:23:37,677 INFO org.apache.flink.runtime.filecache.FileCache
> [] - removed file cache directory
> /__w/2/s/flink-yarn-tests/target/flink-yarn-tests-fifo-secured/flink-yarn-tests-fifo-secured-localDir-nm-1_0/usercache/hadoop/appcache/application_1616768573754_0001/flink-dist-cache-eefe237c-906b-4b9a-b63f-997ef24c58ba
> 2021-03-26 14:23:37,678 INFO
> org.apache.flink.runtime.io.disk.FileChannelManagerImpl [] -
> FileChannelManager removed spill file directory
> /__w/2/s/flink-yarn-tests/target/flink-yarn-tests-fifo-secured/flink-yarn-tests-fifo-secured-localDir-nm-1_0/usercache/hadoop/appcache/application_1616768573754_0001/flink-netty-shuffle-d0a7a4ea-92b2-4614-bfed-2e949a36b9bc
> 2021-03-26 14:23:37,680 WARN org.apache.flink.runtime.taskmanager.Task
> [] - Keyed Aggregation -> Sink: Print to Std. Out (1/1)#0
> (e81d01c2526376e7d0b4b33ccd8d8c7a) switched from RUNNING to FAILED with
> failure cause: java.lang.IllegalStateException: File channel manager has
> shutdown.
> 2021-03-26 14:23:37,680 WARN org.apache.flink.runtime.taskmanager.Task
> [] - Keyed Aggregation -> Sink: Print to Std. Out (1/1)#0
> (e81d01c2526376e7d0b4b33ccd8d8c7a) switched from RUNNING to FAILED with
> failure cause: java.lang.IllegalStateException: File channel manager has
> shutdown.
> at
> org.apache.flink.util.Preconditions.checkState(Preconditions.java:193)
> at
> org.apache.flink.runtime.io.disk.FileChannelManagerImpl.getPaths(FileChannelManagerImpl.java:122)
> at
> org.apache.flink.runtime.io.disk.iomanager.IOManager.getSpillingDirectoriesPaths(IOManager.java:118)
> at
> org.apache.flink.streaming.runtime.io.StreamTaskNetworkInput.lambda$getRecordDeserializers$0(StreamTaskNetworkInput.java:90)
> at java.util.stream.Collectors.lambda$toMap$58(Collectors.java:1321)
> at java.util.stream.ReduceOps$3ReducingSink.accept(ReduceOps.java:169)
> at
> java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1384)
> at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)
> at
> java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)
> at
> java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)
> at
[jira] [Updated] (FLINK-21995) YARNSessionFIFOSecuredITCase>YARNSessionFIFOITCase.checkForProhibitedLogContents: File channel manager has shutdown.
[
https://issues.apache.org/jira/browse/FLINK-21995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Flink Jira Bot updated FLINK-21995:
---
Labels: auto-deprioritized-major auto-deprioritized-minor test-stability
(was: auto-deprioritized-major stale-minor test-stability)
Priority: Not a Priority (was: Minor)
This issue was labeled "stale-minor" 7 days ago and has not received any
updates so it is being deprioritized. If this ticket is actually Minor, please
raise the priority and ask a committer to assign you the issue or revive the
public discussion.
> YARNSessionFIFOSecuredITCase>YARNSessionFIFOITCase.checkForProhibitedLogContents:
> File channel manager has shutdown.
>
>
> Key: FLINK-21995
> URL: https://issues.apache.org/jira/browse/FLINK-21995
> Project: Flink
> Issue Type: Bug
> Components: Deployment / YARN
>Affects Versions: 1.11.3, 1.13.0
>Reporter: Dawid Wysakowicz
>Priority: Not a Priority
> Labels: auto-deprioritized-major, auto-deprioritized-minor,
> test-stability
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=15546=logs=fc5181b0-e452-5c8f-68de-1097947f6483=62110053-334f-5295-a0ab-80dd7e2babbf=30260
> {code}
> [ERROR]
> YARNSessionFIFOSecuredITCase>YARNSessionFIFOITCase.checkForProhibitedLogContents:84->YarnTestBase.ensureNoProhibitedStringInLogFiles:589
> Found a file
> /__w/2/s/flink-yarn-tests/target/flink-yarn-tests-fifo-secured/flink-yarn-tests-fifo-secured-logDir-nm-1_0/application_1616768573754_0001/container_1616768573754_0001_01_02/taskmanager.log
> with a prohibited string (one of [Exception, Started
> SelectChannelConnector@0.0.0.0:8081]). Excerpts:
> [
> 2021-03-26 14:23:37,554 INFO
> org.apache.flink.configuration.GlobalConfiguration [] - Loading
> configuration property: taskmanager.numberOfTaskSlots, 1
> 2021-03-26 14:23:37,555 INFO
> org.apache.flink.configuration.GlobalConfiguration [] - Loading
> configuration property: jobmanager.memory.process.size, 1600m
> 2021-03-26 14:23:37,555 INFO
> org.apache.flink.configuration.GlobalConfiguration [] - Loading
> configuration property: jobmanager.rpc.port, 6123
> 2021-03-26 14:23:37,660 INFO org.apache.flink.yarn.YarnTaskExecutorRunner
> [] - RECEIVED SIGNAL 15: SIGTERM. Shutting down as requested.
> 2021-03-26 14:23:37,663 INFO
> org.apache.flink.runtime.blob.TransientBlobCache [] - Shutting
> down BLOB cache
> 2021-03-26 14:23:37,667 INFO
> org.apache.flink.runtime.blob.PermanentBlobCache [] - Shutting
> down BLOB cache
> 2021-03-26 14:23:37,668 INFO
> org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager [] -
> Shutting down TaskExecutorLocalStateStoresManager.
> 2021-03-26 14:23:37,677 INFO org.apache.flink.runtime.filecache.FileCache
> [] - removed file cache directory
> /__w/2/s/flink-yarn-tests/target/flink-yarn-tests-fifo-secured/flink-yarn-tests-fifo-secured-localDir-nm-1_0/usercache/hadoop/appcache/application_1616768573754_0001/flink-dist-cache-eefe237c-906b-4b9a-b63f-997ef24c58ba
> 2021-03-26 14:23:37,678 INFO
> org.apache.flink.runtime.io.disk.FileChannelManagerImpl [] -
> FileChannelManager removed spill file directory
> /__w/2/s/flink-yarn-tests/target/flink-yarn-tests-fifo-secured/flink-yarn-tests-fifo-secured-localDir-nm-1_0/usercache/hadoop/appcache/application_1616768573754_0001/flink-netty-shuffle-d0a7a4ea-92b2-4614-bfed-2e949a36b9bc
> 2021-03-26 14:23:37,680 WARN org.apache.flink.runtime.taskmanager.Task
> [] - Keyed Aggregation -> Sink: Print to Std. Out (1/1)#0
> (e81d01c2526376e7d0b4b33ccd8d8c7a) switched from RUNNING to FAILED with
> failure cause: java.lang.IllegalStateException: File channel manager has
> shutdown.
> 2021-03-26 14:23:37,680 WARN org.apache.flink.runtime.taskmanager.Task
> [] - Keyed Aggregation -> Sink: Print to Std. Out (1/1)#0
> (e81d01c2526376e7d0b4b33ccd8d8c7a) switched from RUNNING to FAILED with
> failure cause: java.lang.IllegalStateException: File channel manager has
> shutdown.
> at
> org.apache.flink.util.Preconditions.checkState(Preconditions.java:193)
> at
> org.apache.flink.runtime.io.disk.FileChannelManagerImpl.getPaths(FileChannelManagerImpl.java:122)
> at
> org.apache.flink.runtime.io.disk.iomanager.IOManager.getSpillingDirectoriesPaths(IOManager.java:118)
> at
> org.apache.flink.streaming.runtime.io.StreamTaskNetworkInput.lambda$getRecordDeserializers$0(StreamTaskNetworkInput.java:90)
> at java.util.stream.Collectors.lambda$toMap$58(Collectors.java:1321)
> at
[jira] [Updated] (FLINK-21995) YARNSessionFIFOSecuredITCase>YARNSessionFIFOITCase.checkForProhibitedLogContents: File channel manager has shutdown.
[
https://issues.apache.org/jira/browse/FLINK-21995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Flink Jira Bot updated FLINK-21995:
---
Labels: auto-deprioritized-major stale-minor test-stability (was:
auto-deprioritized-major test-stability)
I am the [Flink Jira Bot|https://github.com/apache/flink-jira-bot/] and I help
the community manage its development. I see this issues has been marked as
Minor but is unassigned and neither itself nor its Sub-Tasks have been updated
for 180 days. I have gone ahead and marked it "stale-minor". If this ticket is
still Minor, please either assign yourself or give an update. Afterwards,
please remove the label or in 7 days the issue will be deprioritized.
> YARNSessionFIFOSecuredITCase>YARNSessionFIFOITCase.checkForProhibitedLogContents:
> File channel manager has shutdown.
>
>
> Key: FLINK-21995
> URL: https://issues.apache.org/jira/browse/FLINK-21995
> Project: Flink
> Issue Type: Bug
> Components: Deployment / YARN
>Affects Versions: 1.11.3, 1.13.0
>Reporter: Dawid Wysakowicz
>Priority: Minor
> Labels: auto-deprioritized-major, stale-minor, test-stability
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=15546=logs=fc5181b0-e452-5c8f-68de-1097947f6483=62110053-334f-5295-a0ab-80dd7e2babbf=30260
> {code}
> [ERROR]
> YARNSessionFIFOSecuredITCase>YARNSessionFIFOITCase.checkForProhibitedLogContents:84->YarnTestBase.ensureNoProhibitedStringInLogFiles:589
> Found a file
> /__w/2/s/flink-yarn-tests/target/flink-yarn-tests-fifo-secured/flink-yarn-tests-fifo-secured-logDir-nm-1_0/application_1616768573754_0001/container_1616768573754_0001_01_02/taskmanager.log
> with a prohibited string (one of [Exception, Started
> SelectChannelConnector@0.0.0.0:8081]). Excerpts:
> [
> 2021-03-26 14:23:37,554 INFO
> org.apache.flink.configuration.GlobalConfiguration [] - Loading
> configuration property: taskmanager.numberOfTaskSlots, 1
> 2021-03-26 14:23:37,555 INFO
> org.apache.flink.configuration.GlobalConfiguration [] - Loading
> configuration property: jobmanager.memory.process.size, 1600m
> 2021-03-26 14:23:37,555 INFO
> org.apache.flink.configuration.GlobalConfiguration [] - Loading
> configuration property: jobmanager.rpc.port, 6123
> 2021-03-26 14:23:37,660 INFO org.apache.flink.yarn.YarnTaskExecutorRunner
> [] - RECEIVED SIGNAL 15: SIGTERM. Shutting down as requested.
> 2021-03-26 14:23:37,663 INFO
> org.apache.flink.runtime.blob.TransientBlobCache [] - Shutting
> down BLOB cache
> 2021-03-26 14:23:37,667 INFO
> org.apache.flink.runtime.blob.PermanentBlobCache [] - Shutting
> down BLOB cache
> 2021-03-26 14:23:37,668 INFO
> org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager [] -
> Shutting down TaskExecutorLocalStateStoresManager.
> 2021-03-26 14:23:37,677 INFO org.apache.flink.runtime.filecache.FileCache
> [] - removed file cache directory
> /__w/2/s/flink-yarn-tests/target/flink-yarn-tests-fifo-secured/flink-yarn-tests-fifo-secured-localDir-nm-1_0/usercache/hadoop/appcache/application_1616768573754_0001/flink-dist-cache-eefe237c-906b-4b9a-b63f-997ef24c58ba
> 2021-03-26 14:23:37,678 INFO
> org.apache.flink.runtime.io.disk.FileChannelManagerImpl [] -
> FileChannelManager removed spill file directory
> /__w/2/s/flink-yarn-tests/target/flink-yarn-tests-fifo-secured/flink-yarn-tests-fifo-secured-localDir-nm-1_0/usercache/hadoop/appcache/application_1616768573754_0001/flink-netty-shuffle-d0a7a4ea-92b2-4614-bfed-2e949a36b9bc
> 2021-03-26 14:23:37,680 WARN org.apache.flink.runtime.taskmanager.Task
> [] - Keyed Aggregation -> Sink: Print to Std. Out (1/1)#0
> (e81d01c2526376e7d0b4b33ccd8d8c7a) switched from RUNNING to FAILED with
> failure cause: java.lang.IllegalStateException: File channel manager has
> shutdown.
> 2021-03-26 14:23:37,680 WARN org.apache.flink.runtime.taskmanager.Task
> [] - Keyed Aggregation -> Sink: Print to Std. Out (1/1)#0
> (e81d01c2526376e7d0b4b33ccd8d8c7a) switched from RUNNING to FAILED with
> failure cause: java.lang.IllegalStateException: File channel manager has
> shutdown.
> at
> org.apache.flink.util.Preconditions.checkState(Preconditions.java:193)
> at
> org.apache.flink.runtime.io.disk.FileChannelManagerImpl.getPaths(FileChannelManagerImpl.java:122)
> at
> org.apache.flink.runtime.io.disk.iomanager.IOManager.getSpillingDirectoriesPaths(IOManager.java:118)
> at
> org.apache.flink.streaming.runtime.io.StreamTaskNetworkInput.lambda$getRecordDeserializers$0(StreamTaskNetworkInput.java:90)
> at
[jira] [Updated] (FLINK-21995) YARNSessionFIFOSecuredITCase>YARNSessionFIFOITCase.checkForProhibitedLogContents: File channel manager has shutdown.
[
https://issues.apache.org/jira/browse/FLINK-21995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Flink Jira Bot updated FLINK-21995:
---
Labels: auto-deprioritized-major test-stability (was: stale-major
test-stability)
Priority: Minor (was: Major)
This issue was labeled "stale-major" 7 ago and has not received any updates so
it is being deprioritized. If this ticket is actually Major, please raise the
priority and ask a committer to assign you the issue or revive the public
discussion.
> YARNSessionFIFOSecuredITCase>YARNSessionFIFOITCase.checkForProhibitedLogContents:
> File channel manager has shutdown.
>
>
> Key: FLINK-21995
> URL: https://issues.apache.org/jira/browse/FLINK-21995
> Project: Flink
> Issue Type: Bug
> Components: Deployment / YARN
>Affects Versions: 1.11.3, 1.13.0
>Reporter: Dawid Wysakowicz
>Priority: Minor
> Labels: auto-deprioritized-major, test-stability
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=15546=logs=fc5181b0-e452-5c8f-68de-1097947f6483=62110053-334f-5295-a0ab-80dd7e2babbf=30260
> {code}
> [ERROR]
> YARNSessionFIFOSecuredITCase>YARNSessionFIFOITCase.checkForProhibitedLogContents:84->YarnTestBase.ensureNoProhibitedStringInLogFiles:589
> Found a file
> /__w/2/s/flink-yarn-tests/target/flink-yarn-tests-fifo-secured/flink-yarn-tests-fifo-secured-logDir-nm-1_0/application_1616768573754_0001/container_1616768573754_0001_01_02/taskmanager.log
> with a prohibited string (one of [Exception, Started
> SelectChannelConnector@0.0.0.0:8081]). Excerpts:
> [
> 2021-03-26 14:23:37,554 INFO
> org.apache.flink.configuration.GlobalConfiguration [] - Loading
> configuration property: taskmanager.numberOfTaskSlots, 1
> 2021-03-26 14:23:37,555 INFO
> org.apache.flink.configuration.GlobalConfiguration [] - Loading
> configuration property: jobmanager.memory.process.size, 1600m
> 2021-03-26 14:23:37,555 INFO
> org.apache.flink.configuration.GlobalConfiguration [] - Loading
> configuration property: jobmanager.rpc.port, 6123
> 2021-03-26 14:23:37,660 INFO org.apache.flink.yarn.YarnTaskExecutorRunner
> [] - RECEIVED SIGNAL 15: SIGTERM. Shutting down as requested.
> 2021-03-26 14:23:37,663 INFO
> org.apache.flink.runtime.blob.TransientBlobCache [] - Shutting
> down BLOB cache
> 2021-03-26 14:23:37,667 INFO
> org.apache.flink.runtime.blob.PermanentBlobCache [] - Shutting
> down BLOB cache
> 2021-03-26 14:23:37,668 INFO
> org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager [] -
> Shutting down TaskExecutorLocalStateStoresManager.
> 2021-03-26 14:23:37,677 INFO org.apache.flink.runtime.filecache.FileCache
> [] - removed file cache directory
> /__w/2/s/flink-yarn-tests/target/flink-yarn-tests-fifo-secured/flink-yarn-tests-fifo-secured-localDir-nm-1_0/usercache/hadoop/appcache/application_1616768573754_0001/flink-dist-cache-eefe237c-906b-4b9a-b63f-997ef24c58ba
> 2021-03-26 14:23:37,678 INFO
> org.apache.flink.runtime.io.disk.FileChannelManagerImpl [] -
> FileChannelManager removed spill file directory
> /__w/2/s/flink-yarn-tests/target/flink-yarn-tests-fifo-secured/flink-yarn-tests-fifo-secured-localDir-nm-1_0/usercache/hadoop/appcache/application_1616768573754_0001/flink-netty-shuffle-d0a7a4ea-92b2-4614-bfed-2e949a36b9bc
> 2021-03-26 14:23:37,680 WARN org.apache.flink.runtime.taskmanager.Task
> [] - Keyed Aggregation -> Sink: Print to Std. Out (1/1)#0
> (e81d01c2526376e7d0b4b33ccd8d8c7a) switched from RUNNING to FAILED with
> failure cause: java.lang.IllegalStateException: File channel manager has
> shutdown.
> 2021-03-26 14:23:37,680 WARN org.apache.flink.runtime.taskmanager.Task
> [] - Keyed Aggregation -> Sink: Print to Std. Out (1/1)#0
> (e81d01c2526376e7d0b4b33ccd8d8c7a) switched from RUNNING to FAILED with
> failure cause: java.lang.IllegalStateException: File channel manager has
> shutdown.
> at
> org.apache.flink.util.Preconditions.checkState(Preconditions.java:193)
> at
> org.apache.flink.runtime.io.disk.FileChannelManagerImpl.getPaths(FileChannelManagerImpl.java:122)
> at
> org.apache.flink.runtime.io.disk.iomanager.IOManager.getSpillingDirectoriesPaths(IOManager.java:118)
> at
> org.apache.flink.streaming.runtime.io.StreamTaskNetworkInput.lambda$getRecordDeserializers$0(StreamTaskNetworkInput.java:90)
> at java.util.stream.Collectors.lambda$toMap$58(Collectors.java:1321)
> at java.util.stream.ReduceOps$3ReducingSink.accept(ReduceOps.java:169)
> at
> java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1384)
>
[jira] [Updated] (FLINK-21995) YARNSessionFIFOSecuredITCase>YARNSessionFIFOITCase.checkForProhibitedLogContents: File channel manager has shutdown.
[
https://issues.apache.org/jira/browse/FLINK-21995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Flink Jira Bot updated FLINK-21995:
---
Labels: stale-major test-stability (was: test-stability)
I am the [Flink Jira Bot|https://github.com/apache/flink-jira-bot/] and I help
the community manage its development. I see this issues has been marked as
Major but is unassigned and neither itself nor its Sub-Tasks have been updated
for 30 days. I have gone ahead and added a "stale-major" to the issue". If this
ticket is a Major, please either assign yourself or give an update. Afterwards,
please remove the label or in 7 days the issue will be deprioritized.
> YARNSessionFIFOSecuredITCase>YARNSessionFIFOITCase.checkForProhibitedLogContents:
> File channel manager has shutdown.
>
>
> Key: FLINK-21995
> URL: https://issues.apache.org/jira/browse/FLINK-21995
> Project: Flink
> Issue Type: Bug
> Components: Deployment / YARN
>Affects Versions: 1.11.3, 1.13.0
>Reporter: Dawid Wysakowicz
>Priority: Major
> Labels: stale-major, test-stability
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=15546=logs=fc5181b0-e452-5c8f-68de-1097947f6483=62110053-334f-5295-a0ab-80dd7e2babbf=30260
> {code}
> [ERROR]
> YARNSessionFIFOSecuredITCase>YARNSessionFIFOITCase.checkForProhibitedLogContents:84->YarnTestBase.ensureNoProhibitedStringInLogFiles:589
> Found a file
> /__w/2/s/flink-yarn-tests/target/flink-yarn-tests-fifo-secured/flink-yarn-tests-fifo-secured-logDir-nm-1_0/application_1616768573754_0001/container_1616768573754_0001_01_02/taskmanager.log
> with a prohibited string (one of [Exception, Started
> SelectChannelConnector@0.0.0.0:8081]). Excerpts:
> [
> 2021-03-26 14:23:37,554 INFO
> org.apache.flink.configuration.GlobalConfiguration [] - Loading
> configuration property: taskmanager.numberOfTaskSlots, 1
> 2021-03-26 14:23:37,555 INFO
> org.apache.flink.configuration.GlobalConfiguration [] - Loading
> configuration property: jobmanager.memory.process.size, 1600m
> 2021-03-26 14:23:37,555 INFO
> org.apache.flink.configuration.GlobalConfiguration [] - Loading
> configuration property: jobmanager.rpc.port, 6123
> 2021-03-26 14:23:37,660 INFO org.apache.flink.yarn.YarnTaskExecutorRunner
> [] - RECEIVED SIGNAL 15: SIGTERM. Shutting down as requested.
> 2021-03-26 14:23:37,663 INFO
> org.apache.flink.runtime.blob.TransientBlobCache [] - Shutting
> down BLOB cache
> 2021-03-26 14:23:37,667 INFO
> org.apache.flink.runtime.blob.PermanentBlobCache [] - Shutting
> down BLOB cache
> 2021-03-26 14:23:37,668 INFO
> org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager [] -
> Shutting down TaskExecutorLocalStateStoresManager.
> 2021-03-26 14:23:37,677 INFO org.apache.flink.runtime.filecache.FileCache
> [] - removed file cache directory
> /__w/2/s/flink-yarn-tests/target/flink-yarn-tests-fifo-secured/flink-yarn-tests-fifo-secured-localDir-nm-1_0/usercache/hadoop/appcache/application_1616768573754_0001/flink-dist-cache-eefe237c-906b-4b9a-b63f-997ef24c58ba
> 2021-03-26 14:23:37,678 INFO
> org.apache.flink.runtime.io.disk.FileChannelManagerImpl [] -
> FileChannelManager removed spill file directory
> /__w/2/s/flink-yarn-tests/target/flink-yarn-tests-fifo-secured/flink-yarn-tests-fifo-secured-localDir-nm-1_0/usercache/hadoop/appcache/application_1616768573754_0001/flink-netty-shuffle-d0a7a4ea-92b2-4614-bfed-2e949a36b9bc
> 2021-03-26 14:23:37,680 WARN org.apache.flink.runtime.taskmanager.Task
> [] - Keyed Aggregation -> Sink: Print to Std. Out (1/1)#0
> (e81d01c2526376e7d0b4b33ccd8d8c7a) switched from RUNNING to FAILED with
> failure cause: java.lang.IllegalStateException: File channel manager has
> shutdown.
> 2021-03-26 14:23:37,680 WARN org.apache.flink.runtime.taskmanager.Task
> [] - Keyed Aggregation -> Sink: Print to Std. Out (1/1)#0
> (e81d01c2526376e7d0b4b33ccd8d8c7a) switched from RUNNING to FAILED with
> failure cause: java.lang.IllegalStateException: File channel manager has
> shutdown.
> at
> org.apache.flink.util.Preconditions.checkState(Preconditions.java:193)
> at
> org.apache.flink.runtime.io.disk.FileChannelManagerImpl.getPaths(FileChannelManagerImpl.java:122)
> at
> org.apache.flink.runtime.io.disk.iomanager.IOManager.getSpillingDirectoriesPaths(IOManager.java:118)
> at
> org.apache.flink.streaming.runtime.io.StreamTaskNetworkInput.lambda$getRecordDeserializers$0(StreamTaskNetworkInput.java:90)
> at java.util.stream.Collectors.lambda$toMap$58(Collectors.java:1321)
> at
[jira] [Updated] (FLINK-21995) YARNSessionFIFOSecuredITCase>YARNSessionFIFOITCase.checkForProhibitedLogContents: File channel manager has shutdown.
[
https://issues.apache.org/jira/browse/FLINK-21995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Guowei Ma updated FLINK-21995:
--
Affects Version/s: 1.11.3
> YARNSessionFIFOSecuredITCase>YARNSessionFIFOITCase.checkForProhibitedLogContents:
> File channel manager has shutdown.
>
>
> Key: FLINK-21995
> URL: https://issues.apache.org/jira/browse/FLINK-21995
> Project: Flink
> Issue Type: Bug
> Components: Deployment / YARN
>Affects Versions: 1.11.3, 1.13.0
>Reporter: Dawid Wysakowicz
>Priority: Major
> Labels: test-stability
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=15546=logs=fc5181b0-e452-5c8f-68de-1097947f6483=62110053-334f-5295-a0ab-80dd7e2babbf=30260
> {code}
> [ERROR]
> YARNSessionFIFOSecuredITCase>YARNSessionFIFOITCase.checkForProhibitedLogContents:84->YarnTestBase.ensureNoProhibitedStringInLogFiles:589
> Found a file
> /__w/2/s/flink-yarn-tests/target/flink-yarn-tests-fifo-secured/flink-yarn-tests-fifo-secured-logDir-nm-1_0/application_1616768573754_0001/container_1616768573754_0001_01_02/taskmanager.log
> with a prohibited string (one of [Exception, Started
> SelectChannelConnector@0.0.0.0:8081]). Excerpts:
> [
> 2021-03-26 14:23:37,554 INFO
> org.apache.flink.configuration.GlobalConfiguration [] - Loading
> configuration property: taskmanager.numberOfTaskSlots, 1
> 2021-03-26 14:23:37,555 INFO
> org.apache.flink.configuration.GlobalConfiguration [] - Loading
> configuration property: jobmanager.memory.process.size, 1600m
> 2021-03-26 14:23:37,555 INFO
> org.apache.flink.configuration.GlobalConfiguration [] - Loading
> configuration property: jobmanager.rpc.port, 6123
> 2021-03-26 14:23:37,660 INFO org.apache.flink.yarn.YarnTaskExecutorRunner
> [] - RECEIVED SIGNAL 15: SIGTERM. Shutting down as requested.
> 2021-03-26 14:23:37,663 INFO
> org.apache.flink.runtime.blob.TransientBlobCache [] - Shutting
> down BLOB cache
> 2021-03-26 14:23:37,667 INFO
> org.apache.flink.runtime.blob.PermanentBlobCache [] - Shutting
> down BLOB cache
> 2021-03-26 14:23:37,668 INFO
> org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager [] -
> Shutting down TaskExecutorLocalStateStoresManager.
> 2021-03-26 14:23:37,677 INFO org.apache.flink.runtime.filecache.FileCache
> [] - removed file cache directory
> /__w/2/s/flink-yarn-tests/target/flink-yarn-tests-fifo-secured/flink-yarn-tests-fifo-secured-localDir-nm-1_0/usercache/hadoop/appcache/application_1616768573754_0001/flink-dist-cache-eefe237c-906b-4b9a-b63f-997ef24c58ba
> 2021-03-26 14:23:37,678 INFO
> org.apache.flink.runtime.io.disk.FileChannelManagerImpl [] -
> FileChannelManager removed spill file directory
> /__w/2/s/flink-yarn-tests/target/flink-yarn-tests-fifo-secured/flink-yarn-tests-fifo-secured-localDir-nm-1_0/usercache/hadoop/appcache/application_1616768573754_0001/flink-netty-shuffle-d0a7a4ea-92b2-4614-bfed-2e949a36b9bc
> 2021-03-26 14:23:37,680 WARN org.apache.flink.runtime.taskmanager.Task
> [] - Keyed Aggregation -> Sink: Print to Std. Out (1/1)#0
> (e81d01c2526376e7d0b4b33ccd8d8c7a) switched from RUNNING to FAILED with
> failure cause: java.lang.IllegalStateException: File channel manager has
> shutdown.
> 2021-03-26 14:23:37,680 WARN org.apache.flink.runtime.taskmanager.Task
> [] - Keyed Aggregation -> Sink: Print to Std. Out (1/1)#0
> (e81d01c2526376e7d0b4b33ccd8d8c7a) switched from RUNNING to FAILED with
> failure cause: java.lang.IllegalStateException: File channel manager has
> shutdown.
> at
> org.apache.flink.util.Preconditions.checkState(Preconditions.java:193)
> at
> org.apache.flink.runtime.io.disk.FileChannelManagerImpl.getPaths(FileChannelManagerImpl.java:122)
> at
> org.apache.flink.runtime.io.disk.iomanager.IOManager.getSpillingDirectoriesPaths(IOManager.java:118)
> at
> org.apache.flink.streaming.runtime.io.StreamTaskNetworkInput.lambda$getRecordDeserializers$0(StreamTaskNetworkInput.java:90)
> at java.util.stream.Collectors.lambda$toMap$58(Collectors.java:1321)
> at java.util.stream.ReduceOps$3ReducingSink.accept(ReduceOps.java:169)
> at
> java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1384)
> at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)
> at
> java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)
> at
> java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)
> at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
> at
>
