Hi Dan, It's the following open call that failed:
23724: open("/dev/overlay", O_RDWR|O_EXCL) Err#2 ENOENT For some reason 'add_drv overlay' didn't load the driver successfully. Running rem_drv and then add_drv resolved the issue. After that, I rebooted the host several times, unfortunately the issue was not reproduced again. I should have tried more digging before rebooting it. This is the first time we had this varpd issue. If you happen to have more about the possible cause of this failure, it would be nice to know. If it happens again, definitely I will keep you guys updated. Thanks, -Youzhong # add_drv overlay Driver (overlay) is already installed. # modinfo | grep overlay # ls -l /dev/overlay /dev/overlay: No such file or directory # rem_drv overlay Invalid argument Cannot remove major number binding for 196 # modinfo | grep overlay # add_drv overlay # ls -l /dev/overlay lrwxrwxrwx 1 root root 35 May 18 22:08 /dev/overlay -> ../devices/pseudo/overlay@0:overlay # grep 196 name_to_major overlay 196 # ls -l name_to_major -rw-r--r-- 1 root sys 2952 May 18 20:33 name_to_major # svcs -xv svc:/network/varpd:default (virtual ARP daemon) State: maintenance since May 18, 2018 at 03:53:23 PM EDT Reason: Start method exited with $SMF_EXIT_ERR_FATAL. See: http://illumos.org/msg/SMF-8000-KS See: /var/svc/log/network-varpd:default.log Impact: This service is not running. # svcadm clear network/varpd # svcs -xv # svcs varpd STATE STIME FMRI online 20:34:28 svc:/network/varpd:default # reboot # svcs -xv # modinfo | grep overlay 279 fffffffff8712000 7488 196 1 overlay (Overlay Network Driver) On Fri, May 18, 2018 at 5:16 PM, Dan McDonald <dan...@joyent.com> wrote: > > > > On May 18, 2018, at 5:11 PM, Youzhong Yang <youzh...@gmail.com> wrote: > > > > Thanks Jason. In my environment, I've disabled KPTI through boot var > 'kpti=0', not sure if it contributes to the issue. > > kpti shouldn't affect anything. > > Could you: > > 1. ) ```truss -f -o /tmp/truss-out.txt /usr/lib/varpd/varpd``` > > 2. ) Assuming it's not too big, send the output to the list? > > I'm curious what precisely failed with ESEARCH. > > Thanks, > Dan > ------------------------------------------- smartos-discuss Archives: https://www.listbox.com/member/archive/184463/=now Modify Your Subscription: https://www.listbox.com/member/?member_id=25769125 Powered by Listbox: http://www.listbox.com