Robert Metzger created FLINK-19657:
--------------------------------------
Summary:
YARNSessionCapacitySchedulerITCase.checkForProhibitedLogContents: netty failed
with java.io.IOException: Broken pipe
Key: FLINK-19657
URL: https://issues.apache.org/jira/browse/FLINK-19657
Project: Flink
Issue Type: Bug
Components: Deployment / YARN
Affects Versions: 1.12.0
Reporter: Robert Metzger
https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=7666&view=logs&j=fc5181b0-e452-5c8f-68de-1097947f6483&t=62110053-334f-5295-a0ab-80dd7e2babbf
{code}
2020-10-15T10:41:39.3168991Z [ERROR] Failures:
2020-10-15T10:41:39.3172085Z [ERROR]
YARNSessionCapacitySchedulerITCase.checkForProhibitedLogContents:650->YarnTestBase.ensureNoProhibitedStringInLogFiles:479
Found a file
/__w/2/s/flink-yarn-tests/target/flink-yarn-tests-capacityscheduler/flink-yarn-tests-capacityscheduler-logDir-nm-1_0/application_1602757819968_0002/container_1602757819968_0002_01_000002/taskmanager.log
with a prohibited string (one of [Exception, Started
[email protected]:8081]). Excerpts:
2020-10-15T10:41:39.3173934Z [
2020-10-15T10:41:39.3175238Z 2020-10-15 10:31:08,883 INFO
org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService [] - Remove job
5a24db6b51d7c697fe30e49aa1a8412c from job leader monitoring.
2020-10-15T10:41:39.3176858Z 2020-10-15 10:31:08,885 INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Close
JobManager connection for job 5a24db6b51d7c697fe30e49aa1a8412c.
2020-10-15T10:41:39.3178614Z 2020-10-15 10:31:09,531 INFO
org.apache.flink.yarn.YarnTaskExecutorRunner [] - RECEIVED
SIGNAL 15: SIGTERM. Shutting down as requested.
2020-10-15T10:41:39.3199037Z 2020-10-15 10:31:09,538 INFO
org.apache.flink.runtime.blob.PermanentBlobCache [] - Shutting down
BLOB cache
2020-10-15T10:41:39.3202316Z 2020-10-15 10:31:09,573 INFO
org.apache.flink.runtime.io.disk.FileChannelManagerImpl [] -
FileChannelManager removed spill file directory
/__w/2/s/flink-yarn-tests/target/flink-yarn-tests-capacityscheduler/flink-yarn-tests-capacityscheduler-localDir-nm-1_0/usercache/agent07_azpcontainer/appcache/application_1602757819968_0002/flink-io-fa9b2b85-fbe7-429c-85a9-6fcfb4811b01
2020-10-15T10:41:39.3204499Z 2020-10-15 10:31:09,577 INFO
org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager [] -
Shutting down TaskExecutorLocalStateStoresManager.
2020-10-15T10:41:39.3240288Z 2020-10-15 10:31:09,579 INFO
org.apache.flink.runtime.io.disk.FileChannelManagerImpl [] -
FileChannelManager removed spill file directory
/__w/2/s/flink-yarn-tests/target/flink-yarn-tests-capacityscheduler/flink-yarn-tests-capacityscheduler-localDir-nm-1_0/usercache/agent07_azpcontainer/appcache/application_1602757819968_0002/flink-netty-shuffle-7e95809e-e862-45b1-892e-09835297c82d
2020-10-15T10:41:39.3244086Z 2020-10-15 10:31:09,594 INFO
org.apache.flink.runtime.filecache.FileCache [] - removed file
cache directory
/__w/2/s/flink-yarn-tests/target/flink-yarn-tests-capacityscheduler/flink-yarn-tests-capacityscheduler-localDir-nm-1_0/usercache/agent07_azpcontainer/appcache/application_1602757819968_0002/flink-dist-cache-ed288b32-5c40-48b9-9bcb-7186f5a7bfc2
2020-10-15T10:41:39.3246636Z 2020-10-15 10:31:09,596 INFO
org.apache.flink.runtime.blob.TransientBlobCache [] - Shutting down
BLOB cache
2020-10-15T10:41:39.3248653Z 2020-10-15 10:31:09,661 WARN
akka.remote.transport.netty.NettyTransport [] - Remote
connection to [61b81e62b514/192.168.128.2:39365] failed with
java.io.IOException: Broken pipe
2020-10-15T10:41:39.3250746Z 2020-10-15 10:31:09,661 WARN
akka.remote.transport.netty.NettyTransport [] - Remote
connection to [61b81e62b514/192.168.128.2:39365] failed with
java.io.IOException: Broken pipe
2020-10-15T10:41:39.3253551Z 2020-10-15 10:31:09,662 WARN
akka.remote.transport.netty.NettyTransport [] - Remote
connection to [61b81e62b514/192.168.128.2:39365] failed with
java.io.IOException: Broken pipe
2020-10-15T10:41:39.3255688Z 2020-10-15 10:31:09,662 WARN
akka.remote.transport.netty.NettyTransport [] - Remote
connection to [61b81e62b514/192.168.128.2:39365] failed with
java.io.IOException: Broken pipe
2020-10-15T10:41:39.3267975Z ]
2020-10-15T10:41:39.3270637Z [ERROR]
YARNSessionCapacitySchedulerITCase.checkForProhibitedLogContents:650->YarnTestBase.ensureNoProhibitedStringInLogFiles:479
Found a file
/__w/2/s/flink-yarn-tests/target/flink-yarn-tests-capacityscheduler/flink-yarn-tests-capacityscheduler-logDir-nm-1_0/application_1602757819968_0002/container_1602757819968_0002_01_000002/taskmanager.log
with a prohibited string (one of [Exception, Started
[email protected]:8081]). Excerpts:
2020-10-15T10:41:39.3272364Z [
2020-10-15T10:41:39.3273848Z 2020-10-15 10:31:08,883 INFO
org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService [] - Remove job
5a24db6b51d7c697fe30e49aa1a8412c from job leader monitoring.
2020-10-15T10:41:39.3275694Z 2020-10-15 10:31:08,885 INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Close
JobManager connection for job 5a24db6b51d7c697fe30e49aa1a8412c.
2020-10-15T10:41:39.3277365Z 2020-10-15 10:31:09,531 INFO
org.apache.flink.yarn.YarnTaskExecutorRunner [] - RECEIVED
SIGNAL 15: SIGTERM. Shutting down as requested.
2020-10-15T10:41:39.3278813Z 2020-10-15 10:31:09,538 INFO
org.apache.flink.runtime.blob.PermanentBlobCache [] - Shutting down
BLOB cache
2020-10-15T10:41:39.3281136Z 2020-10-15 10:31:09,573 INFO
org.apache.flink.runtime.io.disk.FileChannelManagerImpl [] -
FileChannelManager removed spill file directory
/__w/2/s/flink-yarn-tests/target/flink-yarn-tests-capacityscheduler/flink-yarn-tests-capacityscheduler-localDir-nm-1_0/usercache/agent07_azpcontainer/appcache/application_1602757819968_0002/flink-io-fa9b2b85-fbe7-429c-85a9-6fcfb4811b01
2020-10-15T10:41:39.3283728Z 2020-10-15 10:31:09,577 INFO
org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager [] -
Shutting down TaskExecutorLocalStateStoresManager.
2020-10-15T10:41:39.3285976Z 2020-10-15 10:31:09,579 INFO
org.apache.flink.runtime.io.disk.FileChannelManagerImpl [] -
FileChannelManager removed spill file directory
/__w/2/s/flink-yarn-tests/target/flink-yarn-tests-capacityscheduler/flink-yarn-tests-capacityscheduler-localDir-nm-1_0/usercache/agent07_azpcontainer/appcache/application_1602757819968_0002/flink-netty-shuffle-7e95809e-e862-45b1-892e-09835297c82d
2020-10-15T10:41:39.3288937Z 2020-10-15 10:31:09,594 INFO
org.apache.flink.runtime.filecache.FileCache [] - removed file
cache directory
/__w/2/s/flink-yarn-tests/target/flink-yarn-tests-capacityscheduler/flink-yarn-tests-capacityscheduler-localDir-nm-1_0/usercache/agent07_azpcontainer/appcache/application_1602757819968_0002/flink-dist-cache-ed288b32-5c40-48b9-9bcb-7186f5a7bfc2
2020-10-15T10:41:39.3291038Z 2020-10-15 10:31:09,596 INFO
org.apache.flink.runtime.blob.TransientBlobCache [] - Shutting down
BLOB cache
2020-10-15T10:41:39.3293240Z 2020-10-15 10:31:09,661 WARN
akka.remote.transport.netty.NettyTransport [] - Remote
connection to [61b81e62b514/192.168.128.2:39365] failed with
java.io.IOException: Broken pipe
2020-10-15T10:41:39.3295639Z 2020-10-15 10:31:09,661 WARN
akka.remote.transport.netty.NettyTransport [] - Remote
connection to [61b81e62b514/192.168.128.2:39365] failed with
java.io.IOException: Broken pipe
2020-10-15T10:41:39.3297824Z 2020-10-15 10:31:09,662 WARN
akka.remote.transport.netty.NettyTransport [] - Remote
connection to [61b81e62b514/192.168.128.2:39365] failed with
java.io.IOException: Broken pipe
2020-10-15T10:41:39.3299775Z 2020-10-15 10:31:09,662 WARN
akka.remote.transport.netty.NettyTransport [] - Remote
connection to [61b81e62b514/192.168.128.2:39365] failed with
java.io.IOException: Broken pipe
2020-10-15T10:41:39.3300726Z ]
{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
