Dear All,
I'm running PVFS version 2.7.1 (with a bunch of patches) and am creating
PVFS
filesystems on the fly for PBS jobs.
I can sun a 64 node job, creating a 64 node filesystem AOK, but things
break at 128 nodes. I believe my problems are associated with rsh and PBS,
but to verify that there isn't a problem with pvfs2-genconfig I tried
generating
config files for large numbers of nodes.
For the all the nodes in our cluster (just over 1000) pvfs2-genconfig will
create a config file, but for anywhere over about 500 nodes it outputs
the warning:
Warning: Generated config file:
/scratch/1188301.bono.ccr.buffalo.edu/pvfs2-fs.conf.tmp
has size: 73271, which is larger than the current PVFS request: 65536
Increase the value of PVFS_REQ_LIMIT_CONFIG_FILE_BYTES in
src/proto/pvfs2-req-proto.h
-rw-r--r-- 1 tonykew ccrstaff 73271 Jan 28 14:19
/scratch/1188301.bono.ccr.buffalo.edu/pvfs2-fs.conf.tmp
c14n32$
A config file for the whole cluster is 149693 characters in size.
Am I likely to run into problems if I, change
PVFS_REQ_LIMIT_CONFIG_FILE_BYTES
to 262144 (for example)?
Many Thanks,
Tony
Tony Kew
SAN Administrator
The Center for Computational Research
New York State Center of Excellence
in Bioinformatics & Life Sciences
701 Ellicott Street, Buffalo, NY 14203
CoE Office: (716) 881-8930 Fax: (716) 849-6656
CSE Office: (716) 645-3797 x2174
Cell: (716) 560-0910 Home: (716) 874-2126
"I love deadlines, I love the whooshing noise they make as they go by."
Douglas Adams
_______________________________________________
Pvfs2-developers mailing list
[email protected]
http://www.beowulf-underground.org/mailman/listinfo/pvfs2-developers