On 05/25/2012 04:52 PM, Dan Kenigsberg wrote:
On Fri, May 25, 2012 at 02:59:31AM +0800, ShaoHe Feng wrote:
On 05/23/2012 03:52 AM, Dan Kenigsberg wrote:
On Tue, May 22, 2012 at 05:02:01PM +0800, ShaoHe Feng wrote:
both mountTests and parted_utils_tests failed.
Failed where? On your own host? Is it reproducible? We had a similar,
but transient, problem in
http://jenkins.ovirt.org/job/vdsm_unit_tests/143/console
yes it is reproducible.
bu if I shop the sandbox service, and restart, then this problem
does not occur.
if I sandbox service start, then this problem comes up again.
Pardon, but I am not familiar with the sandbox service. Could you
describe a complete reproducer?
# chkconfig sandbox off
then restart fedora.
# ./run_tests.sh mountTests
no matter how times the test rum, then this problem does not comes up.
# chkconfig sandbox on
then restart fedora.
# ./run_tests.sh mountTests
# ls /dev/loop*
there are 7 loop devices.
and I run the test 8 times, then the problem comes up.
losetup: could not find any free loop device
however after I make one loop block file by mknod , I can run test successfully
one time.
We, or some other suite using the server, may be leaking a loop device.
Eyal Edri, do you know what has made this go away in run #144?
the test execute 'mount' and 'umount' command. after the umount
command, the loop device can not be freed
here is the log:
-------------------->> begin captured logging<< --------------------
Storage.Misc.excCmd: DEBUG: 'dd if=/dev/zero of=/tmp/tmpH2KSCr
bs=100M count=1' (cwd None)
Storage.Misc.excCmd: DEBUG: SUCCESS:<err> = '1+0 records in\n1+0
records out\n104857600 bytes (105 MB) copied, 0.266024 s, 39 4
MB/s\n';<rc> = 0
Storage.Misc.excCmd: DEBUG: 'losetup -f --show /tmp/tmpH2KSCr' (cwd None)
Storage.Misc.excCmd: DEBUG: FAILED:<err> = 'losetup: could not
find any free loop device\n';<rc> = 255
--------------------->> end captured logging<< ---------------------
Does your Linux host have a trace of the generated loop device?
What says
losetup -a
?
# losetup -a
/dev/loop0: [fd03]:918121 (/tmp/tmpeihztM)
/dev/loop1: [fd03]:918122 (/tmp/tmp43EVnb)
/dev/loop2: [fd03]:918123 (/tmp/tmpCoknYi)
/dev/loop3: [fd03]:918124 (/tmp/tmp_PFqBx)
/dev/loop4: [fd03]:918125 (/tmp/tmplVEPQs)
/dev/loop5: [fd03]:918126 (/tmp/tmpQrHVKH)
/dev/loop6: [fd03]:918127 (/tmp/tmpZkZJ7V)
/dev/loop7: [fd03]:918128 (/tmp/tmpmUSR26)
# losetup -d /dev/loop0
loop: can't delete device /dev/loop0: Device or resource busy
# lsof -L | grep loop
loop0 11198 root cwd DIR 253,3
4096 2 /
Who is process 11198 ?
it is a kernel thread.
USER PID %CPU %MEM VSZ RSS TTY
STAT START TIME COMMAND
root 11198 0.0 0.0 0 0 ?
S< 02:32 0:00 [loop0]
loop0 11198 root rtd DIR 253,3
4096 2 /
loop0 11198 root txt unknown
/proc/11198/exe
loop1 11287 root cwd DIR 253,3
4096 2 /
loop1 11287 root rtd DIR 253,3
4096 2 /
loop1 11287 root txt unknown
/proc/11287/exe
loop2 11309 root cwd DIR 253,3
4096 2 /
loop2 11309 root rtd DIR 253,3
4096 2 /
loop2 11309 root txt unknown
/proc/11309/exe
loop3 11327 root cwd DIR 253,3
4096 2 /
loop3 11327 root rtd DIR 253,3
4096 2 /
loop3 11327 root txt unknown
/proc/11327/exe
loop4 11350 root cwd DIR 253,3
4096 2 /
loop4 11350 root rtd DIR 253,3
4096 2 /
loop4 11350 root txt unknown
/proc/11350/exe
loop5 11372 root cwd DIR 253,3
4096 2 /
loop5 11372 root rtd DIR 253,3
4096 2 /
loop5 11372 root txt unknown
/proc/11372/exe
loop6 11391 root cwd DIR 253,3
4096 2 /
loop6 11391 root rtd DIR 253,3
4096 2 /
loop6 11391 root txt unknown
/proc/11391/exe
loop7 11408 root cwd DIR 253,3
4096 2 /
loop7 11408 root rtd DIR 253,3
4096 2 /
loop7 11408 root txt unknown
/proc/11408/exe
should I use the strace to watch the syscall about what happened to
/dev/loop
# strace -f -F -o ./strace.log ./run_tests.sh mountTests
or any other way to get more info?
_______________________________________________
vdsm-devel mailing list
vdsm-devel@lists.fedorahosted.org
https://fedorahosted.org/mailman/listinfo/vdsm-devel
