[
https://issues.apache.org/jira/browse/FLINK-19657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Robert Metzger closed FLINK-19657.
----------------------------------
Resolution: Fixed
Resolved in
https://github.com/apache/flink/commit/e5192bf0b65dd9586e442dbbe4ee58f5c6779839
> YARNSessionCapacitySchedulerITCase.checkForProhibitedLogContents: netty
> failed with java.io.IOException: Broken pipe
> --------------------------------------------------------------------------------------------------------------------
>
> Key: FLINK-19657
> URL: https://issues.apache.org/jira/browse/FLINK-19657
> Project: Flink
> Issue Type: Bug
> Components: Deployment / YARN
> Affects Versions: 1.12.0
> Reporter: Robert Metzger
> Assignee: Robert Metzger
> Priority: Critical
> Labels: pull-request-available, test-stability
> Fix For: 1.12.0
>
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=7666&view=logs&j=fc5181b0-e452-5c8f-68de-1097947f6483&t=62110053-334f-5295-a0ab-80dd7e2babbf
> {code}
> 2020-10-15T10:41:39.3168991Z [ERROR] Failures:
> 2020-10-15T10:41:39.3172085Z [ERROR]
> YARNSessionCapacitySchedulerITCase.checkForProhibitedLogContents:650->YarnTestBase.ensureNoProhibitedStringInLogFiles:479
> Found a file
> /__w/2/s/flink-yarn-tests/target/flink-yarn-tests-capacityscheduler/flink-yarn-tests-capacityscheduler-logDir-nm-1_0/application_1602757819968_0002/container_1602757819968_0002_01_000002/taskmanager.log
> with a prohibited string (one of [Exception, Started
> SelectChannelConnector@0.0.0.0:8081]). Excerpts:
> 2020-10-15T10:41:39.3173934Z [
> 2020-10-15T10:41:39.3175238Z 2020-10-15 10:31:08,883 INFO
> org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService [] - Remove job
> 5a24db6b51d7c697fe30e49aa1a8412c from job leader monitoring.
> 2020-10-15T10:41:39.3176858Z 2020-10-15 10:31:08,885 INFO
> org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Close
> JobManager connection for job 5a24db6b51d7c697fe30e49aa1a8412c.
> 2020-10-15T10:41:39.3178614Z 2020-10-15 10:31:09,531 INFO
> org.apache.flink.yarn.YarnTaskExecutorRunner [] - RECEIVED
> SIGNAL 15: SIGTERM. Shutting down as requested.
> 2020-10-15T10:41:39.3199037Z 2020-10-15 10:31:09,538 INFO
> org.apache.flink.runtime.blob.PermanentBlobCache [] - Shutting
> down BLOB cache
> 2020-10-15T10:41:39.3202316Z 2020-10-15 10:31:09,573 INFO
> org.apache.flink.runtime.io.disk.FileChannelManagerImpl [] -
> FileChannelManager removed spill file directory
> /__w/2/s/flink-yarn-tests/target/flink-yarn-tests-capacityscheduler/flink-yarn-tests-capacityscheduler-localDir-nm-1_0/usercache/agent07_azpcontainer/appcache/application_1602757819968_0002/flink-io-fa9b2b85-fbe7-429c-85a9-6fcfb4811b01
> 2020-10-15T10:41:39.3204499Z 2020-10-15 10:31:09,577 INFO
> org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager [] -
> Shutting down TaskExecutorLocalStateStoresManager.
> 2020-10-15T10:41:39.3240288Z 2020-10-15 10:31:09,579 INFO
> org.apache.flink.runtime.io.disk.FileChannelManagerImpl [] -
> FileChannelManager removed spill file directory
> /__w/2/s/flink-yarn-tests/target/flink-yarn-tests-capacityscheduler/flink-yarn-tests-capacityscheduler-localDir-nm-1_0/usercache/agent07_azpcontainer/appcache/application_1602757819968_0002/flink-netty-shuffle-7e95809e-e862-45b1-892e-09835297c82d
> 2020-10-15T10:41:39.3244086Z 2020-10-15 10:31:09,594 INFO
> org.apache.flink.runtime.filecache.FileCache [] - removed
> file cache directory
> /__w/2/s/flink-yarn-tests/target/flink-yarn-tests-capacityscheduler/flink-yarn-tests-capacityscheduler-localDir-nm-1_0/usercache/agent07_azpcontainer/appcache/application_1602757819968_0002/flink-dist-cache-ed288b32-5c40-48b9-9bcb-7186f5a7bfc2
> 2020-10-15T10:41:39.3246636Z 2020-10-15 10:31:09,596 INFO
> org.apache.flink.runtime.blob.TransientBlobCache [] - Shutting
> down BLOB cache
> 2020-10-15T10:41:39.3248653Z 2020-10-15 10:31:09,661 WARN
> akka.remote.transport.netty.NettyTransport [] - Remote
> connection to [61b81e62b514/192.168.128.2:39365] failed with
> java.io.IOException: Broken pipe
> 2020-10-15T10:41:39.3250746Z 2020-10-15 10:31:09,661 WARN
> akka.remote.transport.netty.NettyTransport [] - Remote
> connection to [61b81e62b514/192.168.128.2:39365] failed with
> java.io.IOException: Broken pipe
> 2020-10-15T10:41:39.3253551Z 2020-10-15 10:31:09,662 WARN
> akka.remote.transport.netty.NettyTransport [] - Remote
> connection to [61b81e62b514/192.168.128.2:39365] failed with
> java.io.IOException: Broken pipe
> 2020-10-15T10:41:39.3255688Z 2020-10-15 10:31:09,662 WARN
> akka.remote.transport.netty.NettyTransport [] - Remote
> connection to [61b81e62b514/192.168.128.2:39365] failed with
> java.io.IOException: Broken pipe
> 2020-10-15T10:41:39.3267975Z ]
> 2020-10-15T10:41:39.3270637Z [ERROR]
> YARNSessionCapacitySchedulerITCase.checkForProhibitedLogContents:650->YarnTestBase.ensureNoProhibitedStringInLogFiles:479
> Found a file
> /__w/2/s/flink-yarn-tests/target/flink-yarn-tests-capacityscheduler/flink-yarn-tests-capacityscheduler-logDir-nm-1_0/application_1602757819968_0002/container_1602757819968_0002_01_000002/taskmanager.log
> with a prohibited string (one of [Exception, Started
> SelectChannelConnector@0.0.0.0:8081]). Excerpts:
> 2020-10-15T10:41:39.3272364Z [
> 2020-10-15T10:41:39.3273848Z 2020-10-15 10:31:08,883 INFO
> org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService [] - Remove job
> 5a24db6b51d7c697fe30e49aa1a8412c from job leader monitoring.
> 2020-10-15T10:41:39.3275694Z 2020-10-15 10:31:08,885 INFO
> org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Close
> JobManager connection for job 5a24db6b51d7c697fe30e49aa1a8412c.
> 2020-10-15T10:41:39.3277365Z 2020-10-15 10:31:09,531 INFO
> org.apache.flink.yarn.YarnTaskExecutorRunner [] - RECEIVED
> SIGNAL 15: SIGTERM. Shutting down as requested.
> 2020-10-15T10:41:39.3278813Z 2020-10-15 10:31:09,538 INFO
> org.apache.flink.runtime.blob.PermanentBlobCache [] - Shutting
> down BLOB cache
> 2020-10-15T10:41:39.3281136Z 2020-10-15 10:31:09,573 INFO
> org.apache.flink.runtime.io.disk.FileChannelManagerImpl [] -
> FileChannelManager removed spill file directory
> /__w/2/s/flink-yarn-tests/target/flink-yarn-tests-capacityscheduler/flink-yarn-tests-capacityscheduler-localDir-nm-1_0/usercache/agent07_azpcontainer/appcache/application_1602757819968_0002/flink-io-fa9b2b85-fbe7-429c-85a9-6fcfb4811b01
> 2020-10-15T10:41:39.3283728Z 2020-10-15 10:31:09,577 INFO
> org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager [] -
> Shutting down TaskExecutorLocalStateStoresManager.
> 2020-10-15T10:41:39.3285976Z 2020-10-15 10:31:09,579 INFO
> org.apache.flink.runtime.io.disk.FileChannelManagerImpl [] -
> FileChannelManager removed spill file directory
> /__w/2/s/flink-yarn-tests/target/flink-yarn-tests-capacityscheduler/flink-yarn-tests-capacityscheduler-localDir-nm-1_0/usercache/agent07_azpcontainer/appcache/application_1602757819968_0002/flink-netty-shuffle-7e95809e-e862-45b1-892e-09835297c82d
> 2020-10-15T10:41:39.3288937Z 2020-10-15 10:31:09,594 INFO
> org.apache.flink.runtime.filecache.FileCache [] - removed
> file cache directory
> /__w/2/s/flink-yarn-tests/target/flink-yarn-tests-capacityscheduler/flink-yarn-tests-capacityscheduler-localDir-nm-1_0/usercache/agent07_azpcontainer/appcache/application_1602757819968_0002/flink-dist-cache-ed288b32-5c40-48b9-9bcb-7186f5a7bfc2
> 2020-10-15T10:41:39.3291038Z 2020-10-15 10:31:09,596 INFO
> org.apache.flink.runtime.blob.TransientBlobCache [] - Shutting
> down BLOB cache
> 2020-10-15T10:41:39.3293240Z 2020-10-15 10:31:09,661 WARN
> akka.remote.transport.netty.NettyTransport [] - Remote
> connection to [61b81e62b514/192.168.128.2:39365] failed with
> java.io.IOException: Broken pipe
> 2020-10-15T10:41:39.3295639Z 2020-10-15 10:31:09,661 WARN
> akka.remote.transport.netty.NettyTransport [] - Remote
> connection to [61b81e62b514/192.168.128.2:39365] failed with
> java.io.IOException: Broken pipe
> 2020-10-15T10:41:39.3297824Z 2020-10-15 10:31:09,662 WARN
> akka.remote.transport.netty.NettyTransport [] - Remote
> connection to [61b81e62b514/192.168.128.2:39365] failed with
> java.io.IOException: Broken pipe
> 2020-10-15T10:41:39.3299775Z 2020-10-15 10:31:09,662 WARN
> akka.remote.transport.netty.NettyTransport [] - Remote
> connection to [61b81e62b514/192.168.128.2:39365] failed with
> java.io.IOException: Broken pipe
> 2020-10-15T10:41:39.3300726Z ]
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
