[ 
https://issues.apache.org/jira/browse/TS-1975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14139478#comment-14139478
 ] 

Jared Ocker commented on TS-1975:
---------------------------------

Unfortunately, I don't know how to initiate it, it just happens multiple times 
per day.  Below is a listing of our September log output from {{grep FATAL 
manager.log}} showing the frequency on a test server with light traffic.  I've 
not seen any core dumps.  Do you have any suggestions for debug tags?  Even 
excluding some of the most verbose tags with {{CONFIG 
proxy.config.diags.debug.tags STRING ^(?!.\*dir_clean|stats|log.*|http)}} still 
generates a ton of output.


{code}
[Sep  4 14:41:12.517] Manager {0x7fb24371e7e0} FATAL: 
[LocalManager::pollMgmtProcessServer] Error in read (errno: 104)
[Sep  4 20:13:49.649] Manager {0x7fa5f16ed7e0} FATAL: 
[LocalManager::pollMgmtProcessServer] Error in read (errno: 104)
[Sep  5 00:34:55.776] Manager {0x7fab124677e0} FATAL: 
[LocalManager::pollMgmtProcessServer] Error in read (errno: 104)
[Sep  5 09:25:42.075] Manager {0x7f9edb27b7e0} FATAL: 
[LocalManager::pollMgmtProcessServer] Error in read (errno: 104)
[Sep  6 00:13:55.717] Manager {0x7f7b8313a7e0} FATAL: 
[LocalManager::pollMgmtProcessServer] Error in read (errno: 104)
[Sep  6 00:58:49.020] Manager {0x7f04482517e0} FATAL: 
[LocalManager::pollMgmtProcessServer] Error in read (errno: 104)
[Sep  6 01:00:49.758] Manager {0x7fd4e6c387e0} FATAL: 
[LocalManager::pollMgmtProcessServer] Error in read (errno: 104)
[Sep  6 03:01:39.411] Manager {0x7f4b0285b7e0} FATAL: 
[LocalManager::pollMgmtProcessServer] Error in read (errno: 104)
[Sep  6 05:15:48.996] Manager {0x7fb6867407e0} FATAL: 
[LocalManager::pollMgmtProcessServer] Error in read (errno: 104)
[Sep  6 23:19:50.204] Manager {0x7fb67c3e57e0} FATAL: 
[LocalManager::pollMgmtProcessServer] Error in read (errno: 104)
[Sep  7 01:15:41.632] Manager {0x7fe5527627e0} FATAL: 
[LocalManager::pollMgmtProcessServer] Error in read (errno: 104)
[Sep  7 01:17:50.320] Manager {0x7f60e471c7e0} FATAL: 
[LocalManager::pollMgmtProcessServer] Error in read (errno: 104)
[Sep  7 02:43:49.077] Manager {0x7f3f960c27e0} FATAL: 
[LocalManager::pollMgmtProcessServer] Error in read (errno: 104)
[Sep  7 03:11:15.545] Manager {0x7f21e77107e0} FATAL: 
[LocalManager::pollMgmtProcessServer] Error in read (errno: 104)
[Sep  7 03:12:01.707] Manager {0x7fcc284f37e0} FATAL: 
[LocalManager::pollMgmtProcessServer] Error in read (errno: 104)
[Sep  7 03:34:53.128] Manager {0x7f283d1317e0} FATAL: 
[LocalManager::pollMgmtProcessServer] Error in read (errno: 104)
[Sep  7 20:01:45.939] Manager {0x7f63d15977e0} FATAL: 
[LocalManager::pollMgmtProcessServer] Error in read (errno: 104)
[Sep  7 20:02:54.278] Manager {0x7fec786157e0} FATAL: 
[LocalManager::pollMgmtProcessServer] Error in read (errno: 104)
[Sep  7 20:52:53.018] Manager {0x7f34d10fc7e0} FATAL: 
[LocalManager::pollMgmtProcessServer] Error in read (errno: 104)
[Sep  8 23:03:53.881] Manager {0x7f97d5be57e0} FATAL: 
[LocalManager::pollMgmtProcessServer] Error in read (errno: 104)
[Sep  9 01:17:06.301] Manager {0x7f62dc3837e0} FATAL: 
[LocalManager::pollMgmtProcessServer] Error in read (errno: 104)
[Sep  9 04:02:54.184] Manager {0x7f1e2a0587e0} FATAL: 
[LocalManager::pollMgmtProcessServer] Error in read (errno: 104)
[Sep 10 02:09:23.664] Manager {0x7f7936f427e0} FATAL: 
[LocalManager::pollMgmtProcessServer] Error in read (errno: 104)
[Sep 10 04:05:23.641] Manager {0x7fd0c8fcc7e0} FATAL: 
[LocalManager::pollMgmtProcessServer] Error in read (errno: 104)
[Sep 10 21:49:25.050] Manager {0x7f2bd3ba47e0} FATAL: 
[LocalManager::pollMgmtProcessServer] Error in read (errno: 104)
[Sep 10 22:55:24.225] Manager {0x7fbe262aa7e0} FATAL: 
[LocalManager::pollMgmtProcessServer] Error in read (errno: 104)
[Sep 11 02:15:24.191] Manager {0x7f030a7da7e0} FATAL: 
[LocalManager::pollMgmtProcessServer] Error in read (errno: 104)
[Sep 12 01:48:25.133] Manager {0x7f7a396337e0} FATAL: 
[LocalManager::pollMgmtProcessServer] Error in read (errno: 104)
[Sep 12 03:28:24.094] Manager {0x7f53933977e0} FATAL: 
[LocalManager::pollMgmtProcessServer] Error in read (errno: 104)
[Sep 12 03:29:24.516] Manager {0x7f0d3d1567e0} FATAL: 
[LocalManager::pollMgmtProcessServer] Error in read (errno: 104)
[Sep 12 04:03:25.149] Manager {0x7f55a12b07e0} FATAL: 
[LocalManager::pollMgmtProcessServer] Error in read (errno: 104)
[Sep 12 07:02:24.187] Manager {0x7f72d13ee7e0} FATAL: 
[LocalManager::pollMgmtProcessServer] Error in read (errno: 104)
[Sep 12 10:18:24.169] Manager {0x7f564bae57e0} FATAL: 
[LocalManager::pollMgmtProcessServer] Error in read (errno: 104)
[Sep 12 11:13:15.805] Manager {0x7fb1b9ccc7e0} FATAL: 
[LocalManager::pollMgmtProcessServer] Error in read (errno: 104)
[Sep 12 11:30:17.156] Manager {0x7ff22a03d7e0} FATAL: 
[LocalManager::pollMgmtProcessServer] Error in read (errno: 104)
[Sep 12 12:39:25.266] Manager {0x7fed1d3867e0} FATAL: 
[LocalManager::pollMgmtProcessServer] Error in read (errno: 104)
[Sep 13 22:25:27.007] Manager {0x7ffa02b5f7e0} FATAL: 
[LocalManager::pollMgmtProcessServer] Error in read (errno: 104)
[Sep 14 01:11:25.274] Manager {0x7f268c5ee7e0} FATAL: 
[LocalManager::pollMgmtProcessServer] Error in read (errno: 104)
[Sep 14 02:36:25.141] Manager {0x7f3dcb5ab7e0} FATAL: 
[LocalManager::pollMgmtProcessServer] Error in read (errno: 104)
[Sep 14 03:25:42.525] Manager {0x7fde6f39e7e0} FATAL: 
[LocalManager::pollMgmtProcessServer] Error in read (errno: 104)
[Sep 14 04:17:35.546] Manager {0x7ff83a0887e0} FATAL: 
[LocalManager::pollMgmtProcessServer] Error in read (errno: 104)
[Sep 14 04:51:42.809] Manager {0x7fae26b077e0} FATAL: 
[LocalManager::pollMgmtProcessServer] Error in read (errno: 104)
[Sep 14 10:02:41.937] Manager {0x7f31859497e0} FATAL: 
[LocalManager::pollMgmtProcessServer] Error in read (errno: 104)
[Sep 14 23:15:42.147] Manager {0x7fe977e227e0} FATAL: 
[LocalManager::pollMgmtProcessServer] Error in read (errno: 104)
[Sep 15 01:25:42.191] Manager {0x7f12e61f77e0} FATAL: 
[LocalManager::pollMgmtProcessServer] Error in read (errno: 104)
[Sep 15 10:05:34.388] Manager {0x7fce621767e0} FATAL: 
[LocalManager::pollMgmtProcessServer] Error in read (errno: 104)
[Sep 16 01:29:41.832] Manager {0x7f0f1c8157e0} FATAL: 
[LocalManager::pollMgmtProcessServer] Error in read (errno: 104)
{code}

> LocalManager may cause manager crash
> ------------------------------------
>
>                 Key: TS-1975
>                 URL: https://issues.apache.org/jira/browse/TS-1975
>             Project: Traffic Server
>          Issue Type: Bug
>          Components: Manager
>    Affects Versions: 3.3.4
>            Reporter: Zhao Yongming
>            Assignee: portl4t
>              Labels: Crash
>             Fix For: 5.2.0
>
>
> when something wrong with the LocalManager, with 
> [LocalManager::pollMgmtProcessServer] Error in read (errno: 104), then you 
> will get manager and server restart.
> {code}
> Jun 17 17:40:06 cache163 traffic_manager[25654]: {0x7f528b4297e0} FATAL: 
> [LocalManager::pollMgmtProcessServer] Error in read (errno: 104)
> Jun 17 17:40:06 cache163 traffic_manager[25654]: {0x7f528b4297e0} FATAL:  
> (last system error 104: Connection reset by peer)
> Jun 17 17:40:06 cache163 traffic_manager[25654]: {0x7f528b4297e0} ERROR: 
> [LocalManager::sendMgmtMsgToProcesses] Error writing message
> Jun 17 17:40:06 cache163 traffic_manager[25654]: {0x7f528b4297e0} ERROR:  
> (last system error 32: Broken pipe)
> Jun 17 17:40:07 cache163 traffic_cop[25652]: cop received child status signal 
> [25654 2816]
> Jun 17 17:40:07 cache163 traffic_cop[25652]: traffic_manager not running, 
> making sure traffic_server is dead
> Jun 17 17:40:07 cache163 traffic_cop[25652]: spawning traffic_manager
> Jun 17 17:40:07 cache163 traffic_manager[10118]: NOTE: --- Manager Starting 
> ---
> Jun 17 17:40:07 cache163 traffic_manager[10118]: NOTE: Manager Version: 
> Apache Traffic Server - traffic_manager - 3.2.0 - (build # 51516 on Jun 15 
> 2013 at 16:01:06)
> Jun 17 17:40:07 cache163 traffic_manager[10118]: NOTE: 
> RLIMIT_NOFILE(7):cur(160000),max(160000)
> Jun 17 17:40:07 cache163 traffic_manager[10118]: {0x7f26fc24a7e0} STATUS: 
> opened /var/log/trafficserver/manager.log
> Jun 17 17:40:09 cache163 traffic_server[10131]: NOTE: --- Server Starting ---
> Jun 17 17:40:09 cache163 traffic_server[10131]: NOTE: Server Version: Apache 
> Traffic Server - traffic_server - 3.2.0 - (build # 51516 on Jun 15 2013 at 
> 16:01:31)
> Jun 17 17:40:09 cache163 traffic_server[10131]: {0x2b167ded2280} STATUS: 
> opened /var/log/trafficserver/diags.log
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to