Thanks Robert. We are running 'release-20140206', and I can see the deadlock fix is in the latest smartos release and I'll give it a try.
On Mon, Jun 2, 2014 at 5:15 PM, Robert Mustacchi <[email protected]> wrote: > On 6/2/14 14:03 , Youzhong Yang via smartos-discuss wrote: > > Hi All, > > > > On one of our servers running SmartOS, the 'iostat' hung and there're a > > bunch of stuck 'iostat' commands. > > > > It seems everyone of them has the same kernel stack: > > > > stack pointer for thread ffffffbe78d0f3a0: ffffff0173d84380 > > [ ffffff0173d84380 _resume_from_idle+0xf4() ] > > ffffff0173d843b0 swtch+0x141() > > ffffff0173d843f0 cv_wait+0x70(ffffffbe78d0f58e, ffffffbe78d0f590) > > ffffff0173d84450 delay_common+0xb8(1) > > ffffff0173d84490 delay+0x30(1) > > ffffff0173d845a0 ufs_dirlook+0xbd(ffffff3284c2b778, ffffff0173d847a0, > > ffffff0173d845d0, ffffffc18e7bf918, 1, 0) > > ffffff0173d84640 ufs_lookup+0x191(ffffff3284b5da00, ffffff0173d847a0, > > ffffff0173d848e8, ffffff0173d84a70, 0, ffffff3257d44840, > > ffffffc18e7bf918, 0, > > 0, 0) > > ffffff0173d846f0 fop_lookup+0xa2(ffffff3284b5da00, ffffff0173d847a0, > > ffffff0173d848e8, ffffff0173d84a70, 0, ffffff3257d44840, > > ffffffc18e7bf918, 0, > > 0, 0) > > ffffff0173d84950 lookuppnvp+0x1f6(ffffff0173d84a70, 0, 1, 0, > > ffffff0173d84c88 > > , ffffff3257d44840, ffffff3257d44840, ffffffc18e7bf918) > > ffffff0173d849f0 lookuppnatcred+0x15e(ffffff0173d84a70, 0, 1, 0, > > ffffff0173d84c88, 0, ffffffc18e7bf918) > > ffffff0173d84af0 lookupnameatcred+0xad(8046e68, 0, 1, 0, > > ffffff0173d84c88, 0, > > ffffffc18e7bf918) > > ffffff0173d84b40 lookupnameat+0x39(8046e68, 0, 1, 0, ffffff0173d84c88, > 0) > > ffffff0173d84cf0 vn_openat+0x315(8046e68, 0, 1, 1a4, ffffff0173d84e00, > 0, > > ffffff0100000012, 0, 4) > > ffffff0173d84e60 copen+0x20c(ffd19553, 8046e68, 1, 1a4) > > ffffff0173d84e90 openat32+0x27(ffd19553, 8046e68, 0, 1a4) > > ffffff0173d84ec0 open32+0x25(8046e68, 0, 1a4) > > ffffff0173d84f10 _sys_sysenter_post_swapgs+0x149() > > > > Is this a known issue? how can I further debug this issue on the server? > is > > there a way to break out of this stuckness? > > What version of SmartOS are you running? > > There was a known deadlock in UFS in the form of our bug id OS-2797 > ( > https://github.com/joyent/illumos-joyent/commit/1fc9d3e612e4b1fa29e25f9183e45149f2f5a5ec > ). > > You can get more information via mdb -k and looking through the various > stacks that are here. I don't recall that there was a way out of this one. > > Robert > ------------------------------------------- smartos-discuss Archives: https://www.listbox.com/member/archive/184463/=now RSS Feed: https://www.listbox.com/member/archive/rss/184463/25769125-55cfbc00 Modify Your Subscription: https://www.listbox.com/member/?member_id=25769125&id_secret=25769125-7688e9fb Powered by Listbox: http://www.listbox.com
