[EMAIL PROTECTED] wrote on Tue, 23 May 2006 11:10 -0500:
> The pvfs2-migrate-collection binary worked perfectly. Thanks!
>
> Unfortunately, now that I can actually start up pvfs2-server, I've found
> out that my infiniband problem still exists. Any sort of file read
> operation causes pvfs2-server to take up about 20% of the CPU. Writes
> are even worse (causing pvfs2-client and pvfs2-server to both take 50%
> of the CPU each). Doing a simple ls of a directory with only 3 files in
> it take about 5 seconds. Removing an empty directory takes about the
> same amount of time.
>
> The pvfs2-server.log doesn't show anything strange that I can tell. Any
> clues?
That doesn't sound familiar to me. I guess the first thing to do is
enable debugging and get a server log with timestamps so we can try
to figure it out. You may have to mail the log off-list as they
tend to be big.
In the bottom of src/io/bmi/bmi_ib/ib.h, be sure that those
debugging macros are both "#if 1", and change the DEBUG_LEVEL to 4.
Start your pvfs2 servers, and start the client: module install,
-client, mount.
On the client do "pvfs2-set-debugmask -m /pvfs verbose", replacing
/pvfs with whatever mount point is listed in your pvfs2tab.
Do a single thing that is slow, like "cat /pvfs/foo > /dev/null".
Send me the pvfs2.log from the server.
Another nice way to debug is to avoid the kernel module completely.
Just use the userspace tools and see if it also tends to be slow:
pvfs2-ls -la
pvfs2-cp -t /tmp/foo /pvfs/foo
pvfs2-cp -t /pvfs/foo /tmp/foo-2
Knowing if these things are nice and snappy, or also very slow, will
help to rule in or out the kernel module. You're running an oldish
2.4, which is quite different from most developers' setups.
Also be sure to do "cvs update ; make ; make install" periodically
in case something gets fixed elsewhere in the tree. Then your
results can be compared directly with ours against CVS HEAD.
-- Pete
_______________________________________________
Pvfs2-developers mailing list
[email protected]
http://www.beowulf-underground.org/mailman/listinfo/pvfs2-developers
