Re: [Ocfs2-users] OCFS2 CRASH Again and Again, this filesystem is COMPLETE GARBAGE

2017-11-29 Thread netbsd
Hello,

As I said it in the previous thread, the 3 nodes are 3 identical KVM 
virtual machines running on the same physical host which have more than 
enough resources (48 CPU 256GB RAM Gbit network).

I have also tried to move them to other physical servers but didn't 
help.

I also run constant ping tests between the nodes, there was no packet 
loss.

And even then if there would be it should not completely kill the OS 
with kernel panic just recommend me ANY value I can adjust which might 
works here.

Thank you



On 2017-11-29 01:24, Changwei Ge wrote:
> Hi,
> It seems that your cluster has something wrong with connection between
> nodes. So no dlm message can be sent out.
> This may cause a node being fenced, thus to crash.
> 
> Please check your network condition including switch, Ethernet HBA 
> card,
> etc.
> 
> Thanks,
> Changwei
> 
> On 2017/11/28 18:07, net...@tango.lu wrote:
>> Hello,
>> 
>> Servers crashed like 20 times since the last time I wrote to the list.
>> Today is the last with:
>> 
>> [ 1901.810483] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420
>> ERROR: Error -107 when sending message 504 (key 0x91e4e5c6) to node 0
>> [ 1901.918314] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420
>> ERROR: Error -107 when sending message 504 (key 0x91e4e5c6) to node 0
>> [ 1902.026297] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420
>> ERROR: Error -107 when sending message 504 (key 0x91e4e5c6) to node 0
>> [ 1902.134304] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420
>> ERROR: Error -107 when sending message 504 (key 0x91e4e5c6) to node 0
>> [ 1902.242303] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420
>> ERROR: Error -107 when sending message 504 (key 0x91e4e5c6) to node 0
>> [ 1902.350317] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420
>> ERROR: Error -107 when sending message 504 (key 0x91e4e5c6) to node 0
>> [ 1902.458320] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420
>> ERROR: Error -107 when sending message 504 (key 0x91e4e5c6) to node 0
>> [ 1902.566318] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420
>> ERROR: Error -107 when sending message 504 (key 0x91e4e5c6) to node 0
>> [ 1902.674300] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420
>> ERROR: Error -107 when sending message 504 (key 0x91e4e5c6) to node 0
>> [ 1902.782286] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420
>> ERROR: Error -107 when sending message 504 (key 0x91e4e5c6) to node 0
>> [ 1902.868732] o2net: Connection to node webserver1 (num 0) at
>> 10.0.0.3: shutdown, state 7
>> [ 1904.882872] o2net: Connected to node webserver1 (num 0) at
>> 10.0.0.3:
>> [ 1904.883058] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420
>> ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
>> [ 1904.990594] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420
>> ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
>> [ 1905.098771] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420
>> ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
>> [ 1905.206754] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420
>> ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
>> [ 1905.314710] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420
>> ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
>> [ 1905.422646] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420
>> ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
>> [ 1905.530853] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420
>> ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
>> [ 1905.638652] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420
>> ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
>> [ 1905.746728] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420
>> ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
>> [ 1905.854609] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420
>> ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
>> [ 1905.962636] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420
>> ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
>> [ 1906.070921] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420
>> ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
>> [ 1906.178744] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420
>> ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
>> [ 1906.286737] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420
>> ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
>> [ 1906.394632] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420
>> ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
>> [ 1906.502613] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420
>> ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
>> [ 

Re: [Ocfs2-users] OCFS2 CRASH Again and Again, this filesystem is COMPLETE GARBAGE

2017-11-28 Thread Changwei Ge
Hi,
It seems that your cluster has something wrong with connection between 
nodes. So no dlm message can be sent out.
This may cause a node being fenced, thus to crash.

Please check your network condition including switch, Ethernet HBA card, 
etc.

Thanks,
Changwei

On 2017/11/28 18:07, net...@tango.lu wrote:
> Hello,
> 
> Servers crashed like 20 times since the last time I wrote to the list.
> Today is the last with:
> 
> [ 1901.810483] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420
> ERROR: Error -107 when sending message 504 (key 0x91e4e5c6) to node 0
> [ 1901.918314] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420
> ERROR: Error -107 when sending message 504 (key 0x91e4e5c6) to node 0
> [ 1902.026297] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420
> ERROR: Error -107 when sending message 504 (key 0x91e4e5c6) to node 0
> [ 1902.134304] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420
> ERROR: Error -107 when sending message 504 (key 0x91e4e5c6) to node 0
> [ 1902.242303] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420
> ERROR: Error -107 when sending message 504 (key 0x91e4e5c6) to node 0
> [ 1902.350317] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420
> ERROR: Error -107 when sending message 504 (key 0x91e4e5c6) to node 0
> [ 1902.458320] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420
> ERROR: Error -107 when sending message 504 (key 0x91e4e5c6) to node 0
> [ 1902.566318] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420
> ERROR: Error -107 when sending message 504 (key 0x91e4e5c6) to node 0
> [ 1902.674300] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420
> ERROR: Error -107 when sending message 504 (key 0x91e4e5c6) to node 0
> [ 1902.782286] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420
> ERROR: Error -107 when sending message 504 (key 0x91e4e5c6) to node 0
> [ 1902.868732] o2net: Connection to node webserver1 (num 0) at
> 10.0.0.3: shutdown, state 7
> [ 1904.882872] o2net: Connected to node webserver1 (num 0) at
> 10.0.0.3:
> [ 1904.883058] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420
> ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
> [ 1904.990594] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420
> ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
> [ 1905.098771] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420
> ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
> [ 1905.206754] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420
> ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
> [ 1905.314710] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420
> ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
> [ 1905.422646] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420
> ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
> [ 1905.530853] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420
> ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
> [ 1905.638652] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420
> ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
> [ 1905.746728] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420
> ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
> [ 1905.854609] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420
> ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
> [ 1905.962636] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420
> ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
> [ 1906.070921] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420
> ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
> [ 1906.178744] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420
> ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
> [ 1906.286737] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420
> ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
> [ 1906.394632] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420
> ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
> [ 1906.502613] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420
> ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
> [ 1906.610862] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420
> ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
> [ 1906.718651] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420
> ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
> [ 1906.826857] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420
> ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
> [ 1906.934580] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420
> ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
> [ 1907.042570] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420
> ERROR: Error -92 

Re: [Ocfs2-users] OCFS2 CRASH Again and Again, this filesystem is COMPLETE GARBAGE

2017-11-28 Thread Gang He
Hello Netbsd,


What was your problem? 
dlm_send_remote_convert_request failed, or hung_task_timeout?

Thanks
Gang



>>> 
> Hello,
> 
> Servers crashed like 20 times since the last time I wrote to the list. 
> Today is the last with:
> 
> [ 1901.810483] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420 
> ERROR: Error -107 when sending message 504 (key 0x91e4e5c6) to node 0
> [ 1901.918314] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420 
> ERROR: Error -107 when sending message 504 (key 0x91e4e5c6) to node 0
> [ 1902.026297] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420 
> ERROR: Error -107 when sending message 504 (key 0x91e4e5c6) to node 0
> [ 1902.134304] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420 
> ERROR: Error -107 when sending message 504 (key 0x91e4e5c6) to node 0
> [ 1902.242303] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420 
> ERROR: Error -107 when sending message 504 (key 0x91e4e5c6) to node 0
> [ 1902.350317] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420 
> ERROR: Error -107 when sending message 504 (key 0x91e4e5c6) to node 0
> [ 1902.458320] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420 
> ERROR: Error -107 when sending message 504 (key 0x91e4e5c6) to node 0
> [ 1902.566318] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420 
> ERROR: Error -107 when sending message 504 (key 0x91e4e5c6) to node 0
> [ 1902.674300] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420 
> ERROR: Error -107 when sending message 504 (key 0x91e4e5c6) to node 0
> [ 1902.782286] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420 
> ERROR: Error -107 when sending message 504 (key 0x91e4e5c6) to node 0
> [ 1902.868732] o2net: Connection to node webserver1 (num 0) at 
> 10.0.0.3: shutdown, state 7
> [ 1904.882872] o2net: Connected to node webserver1 (num 0) at 
> 10.0.0.3:
> [ 1904.883058] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420 
> ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
> [ 1904.990594] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420 
> ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
> [ 1905.098771] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420 
> ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
> [ 1905.206754] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420 
> ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
> [ 1905.314710] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420 
> ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
> [ 1905.422646] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420 
> ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
> [ 1905.530853] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420 
> ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
> [ 1905.638652] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420 
> ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
> [ 1905.746728] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420 
> ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
> [ 1905.854609] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420 
> ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
> [ 1905.962636] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420 
> ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
> [ 1906.070921] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420 
> ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
> [ 1906.178744] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420 
> ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
> [ 1906.286737] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420 
> ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
> [ 1906.394632] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420 
> ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
> [ 1906.502613] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420 
> ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
> [ 1906.610862] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420 
> ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
> [ 1906.718651] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420 
> ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
> [ 1906.826857] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420 
> ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
> [ 1906.934580] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420 
> ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
> [ 1907.042570] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420 
> ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
> [ 1907.150604] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420 
> ERROR: Error -92 when sending 

[Ocfs2-users] OCFS2 CRASH Again and Again, this filesystem is COMPLETE GARBAGE

2017-11-28 Thread netbsd
Hello,

Servers crashed like 20 times since the last time I wrote to the list. 
Today is the last with:

[ 1901.810483] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420 
ERROR: Error -107 when sending message 504 (key 0x91e4e5c6) to node 0
[ 1901.918314] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420 
ERROR: Error -107 when sending message 504 (key 0x91e4e5c6) to node 0
[ 1902.026297] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420 
ERROR: Error -107 when sending message 504 (key 0x91e4e5c6) to node 0
[ 1902.134304] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420 
ERROR: Error -107 when sending message 504 (key 0x91e4e5c6) to node 0
[ 1902.242303] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420 
ERROR: Error -107 when sending message 504 (key 0x91e4e5c6) to node 0
[ 1902.350317] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420 
ERROR: Error -107 when sending message 504 (key 0x91e4e5c6) to node 0
[ 1902.458320] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420 
ERROR: Error -107 when sending message 504 (key 0x91e4e5c6) to node 0
[ 1902.566318] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420 
ERROR: Error -107 when sending message 504 (key 0x91e4e5c6) to node 0
[ 1902.674300] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420 
ERROR: Error -107 when sending message 504 (key 0x91e4e5c6) to node 0
[ 1902.782286] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420 
ERROR: Error -107 when sending message 504 (key 0x91e4e5c6) to node 0
[ 1902.868732] o2net: Connection to node webserver1 (num 0) at 
10.0.0.3: shutdown, state 7
[ 1904.882872] o2net: Connected to node webserver1 (num 0) at 
10.0.0.3:
[ 1904.883058] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420 
ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
[ 1904.990594] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420 
ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
[ 1905.098771] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420 
ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
[ 1905.206754] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420 
ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
[ 1905.314710] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420 
ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
[ 1905.422646] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420 
ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
[ 1905.530853] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420 
ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
[ 1905.638652] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420 
ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
[ 1905.746728] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420 
ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
[ 1905.854609] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420 
ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
[ 1905.962636] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420 
ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
[ 1906.070921] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420 
ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
[ 1906.178744] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420 
ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
[ 1906.286737] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420 
ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
[ 1906.394632] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420 
ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
[ 1906.502613] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420 
ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
[ 1906.610862] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420 
ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
[ 1906.718651] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420 
ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
[ 1906.826857] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420 
ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
[ 1906.934580] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420 
ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
[ 1907.042570] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420 
ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
[ 1907.150604] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420 
ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
[ 1907.258684] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420 
ERROR: Error -92 when sending message 504 (key 0x91e4e5c6) to node 0
[ 1907.366672] (php-fpm7.0,822,3):dlm_send_remote_convert_request:420 
ERROR: Error -92