On 6/2/14 14:03 , Youzhong Yang via smartos-discuss wrote: > Hi All, > > On one of our servers running SmartOS, the 'iostat' hung and there're a > bunch of stuck 'iostat' commands. > > It seems everyone of them has the same kernel stack: > > stack pointer for thread ffffffbe78d0f3a0: ffffff0173d84380 > [ ffffff0173d84380 _resume_from_idle+0xf4() ] > ffffff0173d843b0 swtch+0x141() > ffffff0173d843f0 cv_wait+0x70(ffffffbe78d0f58e, ffffffbe78d0f590) > ffffff0173d84450 delay_common+0xb8(1) > ffffff0173d84490 delay+0x30(1) > ffffff0173d845a0 ufs_dirlook+0xbd(ffffff3284c2b778, ffffff0173d847a0, > ffffff0173d845d0, ffffffc18e7bf918, 1, 0) > ffffff0173d84640 ufs_lookup+0x191(ffffff3284b5da00, ffffff0173d847a0, > ffffff0173d848e8, ffffff0173d84a70, 0, ffffff3257d44840, > ffffffc18e7bf918, 0, > 0, 0) > ffffff0173d846f0 fop_lookup+0xa2(ffffff3284b5da00, ffffff0173d847a0, > ffffff0173d848e8, ffffff0173d84a70, 0, ffffff3257d44840, > ffffffc18e7bf918, 0, > 0, 0) > ffffff0173d84950 lookuppnvp+0x1f6(ffffff0173d84a70, 0, 1, 0, > ffffff0173d84c88 > , ffffff3257d44840, ffffff3257d44840, ffffffc18e7bf918) > ffffff0173d849f0 lookuppnatcred+0x15e(ffffff0173d84a70, 0, 1, 0, > ffffff0173d84c88, 0, ffffffc18e7bf918) > ffffff0173d84af0 lookupnameatcred+0xad(8046e68, 0, 1, 0, > ffffff0173d84c88, 0, > ffffffc18e7bf918) > ffffff0173d84b40 lookupnameat+0x39(8046e68, 0, 1, 0, ffffff0173d84c88, 0) > ffffff0173d84cf0 vn_openat+0x315(8046e68, 0, 1, 1a4, ffffff0173d84e00, 0, > ffffff0100000012, 0, 4) > ffffff0173d84e60 copen+0x20c(ffd19553, 8046e68, 1, 1a4) > ffffff0173d84e90 openat32+0x27(ffd19553, 8046e68, 0, 1a4) > ffffff0173d84ec0 open32+0x25(8046e68, 0, 1a4) > ffffff0173d84f10 _sys_sysenter_post_swapgs+0x149() > > Is this a known issue? how can I further debug this issue on the server? is > there a way to break out of this stuckness?
What version of SmartOS are you running? There was a known deadlock in UFS in the form of our bug id OS-2797 (https://github.com/joyent/illumos-joyent/commit/1fc9d3e612e4b1fa29e25f9183e45149f2f5a5ec). You can get more information via mdb -k and looking through the various stacks that are here. I don't recall that there was a way out of this one. Robert ------------------------------------------- smartos-discuss Archives: https://www.listbox.com/member/archive/184463/=now RSS Feed: https://www.listbox.com/member/archive/rss/184463/25769125-55cfbc00 Modify Your Subscription: https://www.listbox.com/member/?member_id=25769125&id_secret=25769125-7688e9fb Powered by Listbox: http://www.listbox.com
