Re: [Pvfs2-developers] Squashed server configuration bug

2008-05-23 Thread Phil Carns
Good catch. Patch is committed. We fixed this once before but it must have unfixed itself somewhere along the line :) As a side note, in testing this I happened to try a configuration file that had a completely bogus line in it (ie, a bad keyword, not just a bad parameter). Despite the patc

Re: [Pvfs2-developers] Review : Get PVFS2 exports working with NFS

2008-06-02 Thread Phil Carns
Murali Vilayannur wrote: Hello, Apologies for the duplicate effort, if someone already got or is actively working on fixing NFS exports off pvfs2 volumes. I havent been following pvfs2 list that closely over the last several months. Patch is against HEAD and I got it to work on on Ubuntu 64 run

Re: [Pvfs2-developers] Review : Get PVFS2 exports working with NFS

2008-06-04 Thread Phil Carns
file.c line 2611: pvfs2_file_aio_write_iovec: not implemented yet (aio with 13 segments) Not sure if I got it right, but I used the attached patch to build with --disable-kernel-aio. I went ahead and committed this patch (to let --disable-kernel-aio compile properly). Looks like Troy Benjeg

Re: [Pvfs2-developers] Review : Get PVFS2 exports working with NFS

2008-06-04 Thread Phil Carns
At this point I can definitely create, remove, read, and write files, but I don't think that rename ("mv") is working, though. Whoops- false alarm. The mv problem was a bug in trunk unrelated to NFS. It is now fixed in cvs. I haven't tested it very thoroughly, but for me Murali's patch wo

[Pvfs2-developers] pvfs2-drop-caches

2008-06-06 Thread Phil Carns
There is a new command line utility in trunk now called "pvfs2-drop-caches". It sends a SETPARAM request to all servers for a given file system to have them try to sync() and and drop all file system caches. This is linux specific, but it will compile and just return an error at runtime on o

Re: [Pvfs2-developers] Review : Get PVFS2 exports working with NFS

2008-06-10 Thread Phil Carns
Thanks Murali. I went ahead and committed this to cvs head. I only found one spot that needed an extra up_read() call. I'll try building it on a few older systems today as well to see if we need any extra configure tests for older kernels. Otherwise it looks fine to me. -Phil Murali Vila

Re: [Pvfs2-developers] Re: Review : Get PVFS2 exports working with NFS

2008-06-11 Thread Phil Carns
Emmanuel Florac wrote: Le Tue, 10 Jun 2008 20:24:36 -0700 vous écriviez: No, no, please don't disable --with-kernel-aio I can help you with the build/symbol version issues if you wish OK, I'll try and recompile it with kernel-aio then. I'll try to catch the warnings too. Even so, Murali's

Re: [Pvfs2-developers] Problem with kernel module

2008-06-20 Thread Phil Carns
Which PVFS version/branch are you using? This sounds like a problem that I ran into a while back; if so it should be fixed in trunk now. tracker: https://trac.mcs.anl.gov/projects/pvfs/ticket/42 bug fix: http://www.pvfs.org/fisheye/browse/PVFS/src/io/trove/trove-dbpf/dbpf-keyval.c?r1=1.86&r2=

Re: [Pvfs2-developers] Problem with kernel module

2008-06-20 Thread Phil Carns
It looks like this bug was present in 2.7.1 as well, unfortunately. For now the only way to get the fix is to either run trunk or apply the one line bug fix listed from fisheye in the earlier email. -Phil Emmanuel Florac wrote: Le Fri, 20 Jun 2008 11:39:46 -0400 vous écriviez: I am using t

[Pvfs2-developers] Re: [PATCH] 64bit pointer aliasing in dist-twod

2008-06-23 Thread Phil Carns
Thanks Kyle. This is checked into trunk now with some minor updates to keep the gossip messages clean on 32bit builds. Does this resolve everything from your previous bug report? http://www.beowulf-underground.org/pipermail/pvfs2-developers/2008-June/004069.html thanks, -Phil Kyle Schochenmai

Re: [Pvfs2-developers] Hot additions/subtractions

2008-06-23 Thread Phil Carns
Server nodes can be added to an existing file system, but not without bringing down the file system. An overview of the normal process looks like this: - unmount pvfs on clients - stop old servers - modify configuration file to add new servers (using unused handle ranges) - create storage spac

Re: [Pvfs2-developers] Long file names

2008-06-26 Thread Phil Carns
Hi Bart, I can't get those specific commands to cause a problem for me (using trunk at least, I haven't tried 2.7.1 yet). However, I definitely see some problems in LTP. For me it eventually hangs on the rename06 test, but valgrind is complaining about some memory problems in the pvfs2-clie

[Pvfs2-developers] inode locking in d_revalidate

2008-06-27 Thread Phil Carns
I've narrowed down a deadlock situation that I need some help untangling. I got started down this path trying to reproduce a bug that Bart reported in this thread: http://www.beowulf-underground.org/pipermail/pvfs2-developers/2008-June/004080.html Before I got to that point I got sidetracked w

Re: [Pvfs2-developers] inode locking in d_revalidate

2008-06-30 Thread Phil Carns
trunk and will run some simul tests to make sure everything is in working order. -Phil Phil Carns wrote: I've narrowed down a deadlock situation that I need some help untangling. I got started down this path trying to reproduce a bug that Bart reported in this thread: http://www.beowulf-

Re: [Pvfs2-developers] Patch to add option to pvfs2-genconfig to set the filesystem name

2008-06-30 Thread Phil Carns
Hi Tony, This patch seems reasonable to me. It is committed into CVS head now. thanks! -Phil Tony Kew wrote: Dear Dev Team, Attached is a patch against pvfs2-genconfig from pvfs 2.7.1 to allow setting of the filesystem name on the command line by adding the option: --fsname This makes

Re: [Pvfs2-developers] Long file names

2008-06-30 Thread Phil Carns
Hi Bart, Does the attached patch help this issue any? -Phil Phil Carns wrote: Hi Bart, I can't get those specific commands to cause a problem for me (using trunk at least, I haven't tried 2.7.1 yet). However, I definitely see some problems in LTP. For me it eventually ha

[Pvfs2-developers] Re: [PATCH] modify twod-stripe's default params and add some documentation

2008-07-07 Thread Phil Carns
I went ahead and committed the portion of the patch that adds more comments to the twod_stripe code for now. -Phil Kyle Schochenmaier wrote: Patch is against cvs head, and modifies the default num_groups to be 1 and the group_strip_factor = 1 so twod-stripe's defaults still work when you use

Re: [Pvfs2-developers] [PATCH] modify twod-stripe's default params and add some documentation

2008-07-07 Thread Phil Carns
There are a couple of options for dealing with the case where num_groups > num_dfiles if we want to keep the current defaults: 1) Transparently reduce the num_groups within the distribution calculation. From the user's perspective the params wouldn't change; the distribution would just automa

Re: [Pvfs2-developers] [PATCH] modify twod-stripe's default params and add some documentation

2008-07-07 Thread Phil Carns
Sam Lang wrote: On Jul 7, 2008, at 10:24 AM, Phil Carns wrote: There are a couple of options for dealing with the case where num_groups > num_dfiles if we want to keep the current defaults: 1) Transparently reduce the num_groups within the distribution calculation. From the use

Re: [Pvfs2-developers] Small patch to install the shared libraries if you configure with --enable-threaded-kmod-helper

2008-07-09 Thread Phil Carns
Seems reasonable to me. I went ahead and committed the patch to trunk as is. -Phil Pete Wyckoff wrote: [EMAIL PROTECTED] wrote on Thu, 03 Jul 2008 14:34 -0400: Hear is a trivial patch to install the shared libraries if you use the --enable-threaded-kmod-helper configure option. The patch is

[Pvfs2-developers] Re: twod-dist patch

2008-07-16 Thread Phil Carns
Thanks Kyle. This is committed to cvs head now. -Phil Kyle Schochenmaier wrote: Re-work of the original patch, this patch now handles a single-server case as discussed in the last thread. Is this what everyone was wanting? Compiles and tests fine. ~Kyle Index: src/io/description/dist-twod-

Re: [Pvfs2-developers] Long file names

2008-07-21 Thread Phil Carns
te: It did not seem to make a difference. I do not see any log message, client or kernel, that indicate what is happening. The pvfs2-client-core does die after the long file name commands run though. Bart. On Mon, Jun 30, 2008 at 2:10 PM, Phil Carns <[EMAIL PROTECTED] <mailto:[EMAIL PR

Re: [Pvfs2-developers] Error with concurrent opens

2008-07-24 Thread Phil Carns
Bart Taylor wrote: I am having a problem with an LTP test from the 20080630 set of LTP tests. The 'openfile01' test does 10 threaded opens of 10 files. It is attached in case you need a copy. The test completes successfully, but an 'ls' command immediately after that hangs and cannot be killed

Re: [Pvfs2-developers] Error with concurrent opens

2008-07-25 Thread Phil Carns
Phil Carns wrote: Bart Taylor wrote: I am having a problem with an LTP test from the 20080630 set of LTP tests. The 'openfile01' test does 10 threaded opens of 10 files. It is attached in case you need a copy. The test completes successfully, but an 'ls' command immediate

Re: [Pvfs2-developers] Error with concurrent opens

2008-07-29 Thread Phil Carns
but I am not sure where. Do you have an idea where it might be lurking? Bart. On Fri, Jul 25, 2008 at 7:16 AM, Phil Carns <[EMAIL PROTECTED] <mailto:[EMAIL PROTECTED]>> wrote: Phil Carns wrote: Bart Taylor wrote: I am having a problem with an LTP test

Re: [Pvfs2-developers] Error with concurrent opens

2008-08-01 Thread Phil Carns
since we never got a chance to test it. Sam added an op_release in namei.c to fix a kmem_cache leak, and it sneaked in twice without warning. Taking that out fixed the problem. Bart. On Tue, Jul 29, 2008 at 8:03 AM, Phil Carns <[EMAIL PROTECTED] <mailto:[EMAIL PROTECTED]>> wrote:

Re: [Pvfs2-developers] Patch for PVFS2 heartbeat resource script (add [-a alias] to file system creation command)

2008-08-04 Thread Phil Carns
Thanks David, and good catch on both counts. The patch has been committed to trunk. -Phil David Metheny wrote: Attached is a patch against the trunk CVS for the PVFS2 example resource heartbeat script. The patch changes the location of the pvfs2-server and pvfs2-check-server executable

Re: [Pvfs2-developers] Listing performance patch

2008-09-04 Thread Phil Carns
Sam Lang wrote: Hi Bart, Thanks for the patch. For users with that many files in a directory, using pvfs2-ls is probably a good alternative. The kernel does readdir requests 32 entries at a time, so increasing MAX_NUM_DIRENTS won't help for ls. Long listings requires getting the size of

Re: [Pvfs2-developers] Listing performance patch

2008-09-11 Thread Phil Carns
turns more entries than filldir() can consume. -Phil Rob Ross wrote: Has the internal kernel value changed since we last looked? Rob On Sep 4, 2008, at 4:16 PM, Phil Carns wrote: Sam Lang wrote: Hi Bart, Thanks for the patch. For users with that many files in a directory, using pvfs2-ls is

Re: [Pvfs2-developers] Listing performance patch

2008-09-11 Thread Phil Carns
) = 4080 getdents64(3, /* 132 entries */, 4096) = 3168 getdents64(3, /* 0 entries */, 4096)= 0 So even with just 300 entries your patch takes us from 11 getdents system calls down to 3 to do an ls. Thanks! -Phil Phil Carns wrote: I looked at the code a little just now. The getdents

Re: [Pvfs2-developers] Re: Message during compilation

2008-10-03 Thread Phil Carns
I don't have any changes to commit. I was actually playing with IBM's compiler last time rather than Intel's, but regardless I didn't go far enough with it to have any worthwhile changes. PVFS used to compile with Intel's compiler in the not too distant past, so I wouldn't think it is too far

Re: [Pvfs2-developers] SSL symbols and PVFS2

2008-10-03 Thread Phil Carns
Hi Brad, There is a "--without-openssl" option to PVFS that keeps it from using those symbols altogether. That's helped me in a couple of cases where it was hard to drag the ssl libraries around. -Phil Bradley Settlemyer wrote: Hello, Has there been any thought on trying to drag in the s

Re: [Pvfs2-developers] SSL symbols and PVFS2

2008-10-03 Thread Phil Carns
stclean is broken, or PVFS now requires those symbols. Cheers, Brad On Fri, Oct 3, 2008 at 10:26 AM, Phil Carns <[EMAIL PROTECTED] <mailto:[EMAIL PROTECTED]>> wrote: Hi Brad, There is a "--without-openssl" option to PVFS that keeps it from using those symbols

Re: [Pvfs2-developers] PVFS2 Removal of large files

2008-10-03 Thread Phil Carns
It sounds like there are really two problems in this case: a) the remove takes a long time b) trove won't work on other metadata operations until the remove completes I don't know if this is a good idea or not, but here is a potential quick way to make the remove work in the background: Right

[Pvfs2-developers] readdir count and token position

2008-10-08 Thread Phil Carns
We recently applied a patch from Bart Taylor to increase the default directory entry count from 32 to up to 512 in trunk: http://www.beowulf-underground.org/pipermail/pvfs2-developers/2008-September/004147.html Unfortunately, it looks like this has brought back an old problem of how to deal wi

Re: [Pvfs2-developers] Re: [Pvfs-developers] Pvfs client-server communication doubt

2008-10-09 Thread Phil Carns
Hi Ankur, Just to clarify, have you added a new request type called "ecreate" or is that a typo and you have just added a field to the existing "create" struct? This makes a difference in the extent of the changes that you will need to make. If you are modifying an existing struct then the

Re: [Pvfs2-developers] Re: [Pvfs-developers] Pvfs client-server communication doubt

2008-10-09 Thread Phil Carns
Pai, Ankur G wrote: Hi Phil, Thanks a lot for replying. So here is the deal. I am working on an enhanced PVFS with an entirely new set of state machines added to create a new struct called ecreate. Its working fine (all state machines and everything). Unfortunately, the guy who made these changes

Re: [Pvfs2-developers] PVFS2 Removal of large files

2008-10-14 Thread Phil Carns
tries sent, there were some cases where canceling those jobs didn't quite stop accesses to the jobs memory. Phil Carns sent me a patch to fix this. I've ran a small sample of tests on a single PVFS2 server with a separate machine for the PVFS2 client. Both machines are running RHEL4 U

Re: [Pvfs2-developers] readdir count and token position

2008-10-15 Thread Phil Carns
FYI, I reduced the limit (in the kernel only, not pvfs2-ls) down to 96 for the time being in cvs trunk. This avoids the token rewind problem triggered by bonnie++, but hopefully still keeps some of the ls speed improvement. -Phil Phil Carns wrote: We recently applied a patch from Bart

Re: [Pvfs2-developers] readdir count and token position

2008-10-15 Thread Phil Carns
Robert Latham wrote: On Wed, Oct 15, 2008 at 10:42:23AM -0400, Phil Carns wrote: FYI, I reduced the limit (in the kernel only, not pvfs2-ls) down to 96 for the time being in cvs trunk. This avoids the token rewind problem triggered by bonnie++, but hopefully still keeps some of the ls speed

Re: [Pvfs2-developers] Operation cancelled (possibly due to timeout) error

2008-10-17 Thread Phil Carns
Hi Brian, The second error message that you reported (final-response.sm line 127) is a minor bug that was triggered by the timeouts. That has been fixed in CVS, and you can find a description and patch at the following links if you want to try it: http://www.pvfs.org/fisheye/changelog/PVFS/

Re: [Pvfs2-developers] Operation cancelled (possibly due to timeout) error

2008-10-22 Thread Phil Carns
brain wrote: * Phil Carns <[EMAIL PROTECTED]> [2008 10 17, 10:46]: I have two configuration suggestions that you can try. Hello Phil, hello everybody, I followed your suggestions and I verified that adding TroveMethod alt-aio *and* increasing the ServerJobFlowTimeoutSecs to 300 I

Re: [Pvfs2-developers] Listing performance patch

2008-11-03 Thread Phil Carns
= 3168 getdents64(3, /* 0 entries */, 4096)= 0 So even with just 300 entries your patch takes us from 11 getdents system calls down to 3 to do an ls. Thanks! -Phil Phil Carns wrote: I looked at the code a little just now. The getdents system call passes a filldir() callback function

Re: [Pvfs2-developers] Listing performance patch

2008-11-04 Thread Phil Carns
Just a quick update for anyone following this bug report. So far I haven't been able to reproduce this yet on a single server file system using either 2.6.3 (patched to increase dirent count) or trunk code. We are still trying to narrow down what the key factor is. -Phil Phil Carns

Re: [Pvfs2-developers] concurrent metadata and pvfs2-lsplus improvements

2008-11-10 Thread Phil Carns
Phil Carns wrote: Rob Ross wrote: Should we just replace pvfs2-ls with pvfs2-lsplus? -- Rob I don't know of any reason not to. They are feature equivalent in terms of command line arguments and output format. -Phil This is done now in CVS. I don't know if anyone needs it,

Re: [Pvfs2-developers] patches: Trusted Networks, Root Squashing & Multicast

2008-11-17 Thread Phil Carns
Thanks David. This is integrated into the CVS trunk now. -Phil David Metheny wrote: I ran into some issues where I was entering IP/netmask in the Trusted Network and was not able to get connectivity from the full range of IP’s via the subnet mask. I could enter 10.105.24.108/24 and would only

Re: [Pvfs2-developers] bmi-tcp doubt

2008-11-20 Thread Phil Carns
Hi Ankur, I think we could clean up this path some. Just to clarify what you are looking for though, are you planning to send a response all the way back to the client? The server does not normally send a response back for a failed unexpected message. In the case you describe, you would nee

Re: [Pvfs2-developers] bmi-tcp doubt

2008-11-20 Thread Phil Carns
oach? Thanks, Ankur - Original Message ----- From: "Phil Carns" <[EMAIL PROTECTED]> To: "Ankur G Pai" <[EMAIL PROTECTED]> Cc: pvfs2-developers@beowulf-underground.org Sent: Thursday, November 20, 2008 10:07:44 AM GMT -05:00 Columbia Subject: Re: [Pvfs2-developers] bmi-tcp d

Re: [Pvfs2-developers] bmi-tcp doubt

2008-11-20 Thread Phil Carns
ur G wrote: Disregarding the connection is fine with me. But what do I return from bmi_tcp.c. If I return 0, the client call completes. If I return -1, server crashes. So if I want to disregard the request, what do I return from tcp_accept_init() ? Thanks, Ankur - Original Message ----- From: &

Re: [Pvfs2-developers] Re: patch for client data corruption with 2.4kernels

2008-11-21 Thread Phil Carns
Maybe the memory accounting is just handled differently in RHEL5? -Phil David Metheny wrote: I'm running the same types of tests I did with a RHEL3 and RHEL4 system. But not seeing the same results on the RHEL5 systems. So... I'm not sure if it really is a problem or not. Watching 'top' or u

Re: [Pvfs2-developers] Re: patch for client data corruption with 2.4 kernels

2008-11-24 Thread Phil Carns
Thanks Bart. I applied the patches to cvs trunk. -Phil Bart Taylor wrote: I neglected the header file; attached is an additional patch to catch it. Both of these patches should apply cleanly to head. Bart. On Thu, Nov 20, 2008 at 1:54 PM, Bart Taylor <[EMAIL PROTECTED]

Re: [Pvfs2-developers] bmi-tcp doubt

2008-11-24 Thread Phil Carns
Hi Ankur, This patch fixes the code so that it does the right thing if you just return an error code from the tcp_accept_init() function. It is already applied to cvs trunk. thanks, -Phil Phil Carns wrote: For an immediate solution you can just mimic the logic in the "BIG KLUDGE&quo

Re: [Pvfs2-developers] patch for trusted networks

2008-12-03 Thread Phil Carns
Thanks Bart. I committed a slightly modified version of your patch to cvs trunk. -Phil Bart Taylor wrote: Hey guys, This patch fixes an issue with trusted networks. If the TrustedNetworks field is present in the conf file but there is no value, the file system is unreachable from any clien

Re: [Pvfs2-developers] patch: for 2.7.1 tag to compile/support RHEL3 2.4.x kernels

2008-12-08 Thread Phil Carns
Thanks David; patch is now applied to CVS trunk. I hope the source code still fits on your punch cards :) -Phil David Metheny wrote: This patch #defines out the immutable code during the builds for 2.4.x kernels. I’m hoping our support of PVFS2 on 2.4.x kernels is nearing the end, but it has

Re: [Pvfs2-developers] bmi testcontext/testunexpected

2008-12-23 Thread Phil Carns
Sam Lang wrote: Hi All, I think Nawab has found a bug (or untested code path) in the BMI tcp method. He's running a daemon that both receives unexpected requests (as a server), and receives expected responses (as a client). In the BMI_testcontext call, if there aren't any completed (expect

Re: [Pvfs2-developers] bmi testcontext/testunexpected

2009-01-06 Thread Phil Carns
unexpected in a separate thread. Nawab, in the zoidfs init code after initializing BMI you need to call: int check = 0; BMI_set_info(0, BMI_TCP_CHECK_UNEXPECTED, &check); -sam On Dec 23, 2008, at 2:01 PM, Phil Carns wrote: Sam Lang wrote: Hi All, I think Nawab has found a bug (or untes

Re: [Pvfs2-developers] pvfs2-cli can't identify protocol

2009-01-08 Thread Phil Carns
Hi Amit, In your lsof output, do you see any other types of open files from pvfs2-client besides "sock"? The output that you are showing is unusual. Normally everything that pvfs2-client has open will show up as IPV4, REG, CHR, or DIR. Are you using tcp for PVFS communication? -Phil Kuma

Re: [Pvfs2-developers] pvfs2-cli can't identify protocol

2009-01-12 Thread Phil Carns
0 5654 infinibandevent pvfs2-cli 14793 root8r DIR 0,200 5654 infinibandevent Thank you, Amit -----Original Message- From: Phil Carns [mailto:pca...@gmail.com] On Behalf Of Phil Carns Sent: Thursday, January 08, 2009 2:25 PM To: K

Re: [Pvfs2-developers] question RE readdir rewind bug

2009-01-15 Thread Phil Carns
What version of PVFS are you testing (or is it trunk)? We have had a couple of permutations of this bug in the past, but I hope it is sorted out now in trunk. -Phil Walter Ligon wrote: Hey, I was looking at the "readdir rewind bug" and wondering, could this be responsible for reporting the

Re: [Pvfs2-developers] question RE readdir rewind bug

2009-01-15 Thread Phil Carns
Walt and I continued this discussion off list. I think it can be narrowed down to a specific bug in 2.7.1. This is the patch that fixed it, which will also be available in the next release: http://www.pvfs.org/fisheye/rdiff/PVFS?csid=MAIN:pcarns:20080514170124&u&N -Phil Phil Car

Re: [Pvfs2-developers] Patch for recursive pvfs2-ls

2009-02-02 Thread Phil Carns
Thanks Bart! The patch has been applied to PVFS trunk. -Phil Bart Taylor wrote: Hey guys, Attached are two patches for giving pvfs2-lsplus (now just pvfs2-ls) a recursive option. One patch is for pvfs2-lsplus against pvfs-2-6-branch and the other is for pvfs2-ls against HEAD. The output was

Re: [Pvfs2-developers] [patch] Enabling TCPBindSpecific

2009-02-22 Thread Phil Carns
Thanks Bart. The patch is applied to trunk now with a minor update to the --help description. -Phil Bart Taylor wrote: Hey guys, Attached is a small patch that allows you to enable the TCPBindSpecific option when running pvfs2-genconfig. It can help simplify setting up a file system with H

[Pvfs2-developers] Re: shadowed function declarations in 2.8.0

2009-02-22 Thread Phil Carns
Thanks Kyle. Patch is applied in cvs trunk now. -Phil Kyle Schochenmaier wrote: While compiling 2.8.0 I ran into some shadowed function declaration warnings, I believe the correct solution is to just rename the offending functions/variables, however the compiler is supposed to use the correct

Re: [Pvfs2-developers] patch: PVFS2 group permission checking for groups with large number of members

2009-03-24 Thread Phil Carns
Thanks David! This is a big improvement over the way the code worked before. The patch is in cvs trunk now with some minor formatting updates. -Phil David Metheny wrote: The attached patch corrects a bug where group permission checking was failing for a group with 221 members. The patch chan

Re: [Pvfs2-developers] Is there a patch for flow proto errors?

2009-03-30 Thread Phil Carns
Hi Elaine, That error code corresponds to a broken pipe error from TCP, so it is probably a side effect of something else going wrong (for example, possibly a server or client crashing, or a peer hitting some other error and closing the socket unexpectedly). Are you seeing this on the server

Re: [Pvfs2-developers] Compiling Kernel Module (make kmod) on OpenSuSE 11.1

2009-04-01 Thread Phil Carns
I just mentioned this on another thread on pvfs2-users, but I'm not sure if you are having the same problem or not. Could you try compiling the cvs trunk version of PVFS and let us know if that fixes the problem? Instructions for how to check out the cvs code can be found here: http://www.pvfs

Re: [Pvfs2-developers] Is there a patch for flow proto errors?

2009-04-03 Thread Phil Carns
p. [E 03/30 15:18] handle_io_error: flow proto 0x487d8f0 error cleanup finished, error_code: -1073741959 - Elaine -Original Message- From: Phil Carns [mailto:pca...@gmail.com] On Behalf Of Phil Carns Sent: Monday, March 30, 2009 3:15 PM To: Elaine Quarles Cc: pvfs2-developers@be

Re: [Pvfs2-developers] [patch] SIGHUP handler to reload config file values

2009-04-06 Thread Phil Carns
Thanks David! The patch is applied to cvs trunk now. -Phil David Metheny wrote: The attached patch is against 2.7.1 and implements a SIGHUP handler to reload the root squash, all squash, read only, anonymous UID/GID, and trusted network values from the config file. The patch also adds th

Re: [Pvfs2-developers] Copy commands segfault on 2.4 kernels

2009-04-07 Thread Phil Carns
Hi Bart, From your strace output, my guess is that cp is running into trouble with the value of one of the fstat() fields, but its hard to say which one. Are you able to reproduce this reliably? Could you run the strace again with the -v option to see if it gives a full listing of what value

Re: [Pvfs2-developers] Copy commands segfault on 2.4 kernels

2009-04-07 Thread Phil Carns
nk=1, st_uid=0, st_gid=0, st_blksize=4096, st_blocks=8, st_size=5, st_atime=2009/04/07-15:29:59, st_mtime=2009/04/07-14:45:08, st_ctime=2009/04/07-14:46:32}) = 0 --- SIGSEGV (Segmentation fault) @ 0 (0) --- +++ killed by SIGSEGV +++ [r...@node1 root]# On Tue, Apr 7, 2009 at 2:53 PM, Phil Ca

Re: [Pvfs2-developers] Copy commands segfault on 2.4 kernels

2009-04-08 Thread Phil Carns
You might also want to turn on all of the kernel module debugging by echo'ing 32767 into /proc/sys/pvfs2/debug and looking at what it generated in dmesg and/or /var/log/messages in the crashing cp case. thanks, -Phil Phil Carns wrote: I don't see anything offensive in the stat outp

Re: [Pvfs2-developers] Copy commands segfault on 2.4 kernels

2009-04-08 Thread Phil Carns
nd against the working copy command on a linux 2.6 box, but it was obviously quite different. Bart. On Wed, Apr 8, 2009 at 7:56 AM, Phil Carns <mailto:ca...@mcs.anl.gov>> wrote: You might also want to turn on all of the kernel module debugging by echo'ing 32767 into /pro

Re: [Pvfs2-developers] Question in pvfs I/O

2009-04-21 Thread Phil Carns
Hi Christina, I answered some of your specific questions in line below: Christina Patrick wrote: Hi All, I am doing a project where I need to implement simple prefetching in pvfs. While I was going through the pvfs code, I couldn't understand the following and hence have to ask the below quest

Re: [Pvfs2-developers] Re: compilation errors while adding some new routines in pvfs

2009-04-27 Thread Phil Carns
Sure thing. When you run "make", just add "V=1" to your command line arguments. That will show all of the compilation details. -Phil Christina Patrick wrote: Hi, I guess the error is because the definitions are not reaching all the files in which the file quicklist.h is included. However, I

Re: [Pvfs2-developers] File truncated on failed permissions check

2009-05-14 Thread Phil Carns
Hi Bart, I think I understand what's going on in this case. There are actually two issues: a) allowing truncate to proceed after the permissions are revoked b) returning enoent when the permission check finally fails a) is tough if the acache is enabled. The acache is not consistent across

Re: [Pvfs2-developers] Trove DBPF error

2009-05-28 Thread Phil Carns
There is actually an admin tool (pvfs2-rm-object) that does what Kevin described (used for testing pvfs2-fsck mainly). That can be used to get rid of each handle/object in the file, but that would still leave a directory entry to get rid of... Does pvfs2-rm not remove the entire file? It may

Re: [Pvfs2-developers] recent commit

2009-06-29 Thread Phil Carns
Thanks Kevin! -Phil Kevin Harms wrote: I committed some changes to HEAD in an attempt to address trac item #50. https://trac.mcs.anl.gov/projects/pvfs/ticket/50 The changes will allow an accept failure with the error code of ENFILE or EMFILE to continue rather than propagate a failure

Re: [Pvfs2-developers] File truncated on failed permissions check

2009-06-30 Thread Phil Carns
The ENOENT part of the problem is fixed in CVS trunk now. -Phil b) is a bug. That is coming from a follow up operation (setattr or getattr) after the truncate that has its permissions checked by the metadata server. There is a problem there in which if all permission checks fail on the se

Re: [Pvfs2-developers] [patch] Kernel side patch to fix a persistent permission denied state on clients

2009-06-30 Thread Phil Carns
Thanks David. The patch is applied in cvs trunk now, with some minor formatting updates. -Phil David Metheny wrote: We ran into a scenario where some signal interrupts were being caught in the middle of PVFS2 calls and then the pvfs2 client ended up in a bad state where any accesses to a par

Re: [Pvfs2-developers] pvfs kernel module compilation fix for 2.6.30

2009-06-30 Thread Phil Carns
Thanks Dries. It looks like fs_struct.h goes back even into the 2.4 series. I went ahead and dropped the change into CVS trunk. -Phil Dries Kimpe wrote: It seems in that, in 2.6.30, fs_struct.h is no longer included from some other headers, causing acl.c (src/kernel/linux-2.6/acl.c) to fail

Re: [Pvfs2-developers] patch: PVFS2 group permission checking for groups with large number of members

2009-06-30 Thread Phil Carns
bytes failed at around 200 members of a group, and since the system can't determine the correct size via sysconf, I just picked something that would take a long time to break. -Original Message----- From: Phil Carns [mailto:pca...@gmail.com] On Behalf Of Phil Carns Sent: Tuesday, March 24,

Re: [Pvfs2-developers] [patch] Truncate Permission Check

2009-07-21 Thread Phil Carns
Thanks Bart! Patch is in cvs trunk now. -Phil Bart Taylor wrote: Hey guys, Attached is a patch for a permission case that addresses an issue we saw occasionally where a user's write permission is revoked and they trigger a truncate before the cache entry expires. It will force a permission ch

Re: [Pvfs2-developers] patch: Filesystem-qla-monitor patch

2009-07-21 Thread Phil Carns
Thanks David! Patch is in cvs trunk now. -Phil David Metheny wrote: The attached patch fixes the cases where the Filesytem-qla-monitor script prints out message “ERROR: Filesystem-qla-monitor must specify fsname!” on a call with command ‘meta-data’. The operation check for ‘meta-data’ doesn’

Re: [Pvfs2-developers] Changing the number of I/O servers

2009-07-22 Thread Phil Carns
Hi Christina, Thanks for trying out those test cases. That narrowed down the problem quite a bit. I think the attached patch fixes the problem. This has also been committed to cvs head. thanks, -Phil Christina Patrick wrote: Hi Rob, Thank you very much for your help, Regards, Christin

Re: [Pvfs2-developers] [patch] pvsf2-ls

2009-07-22 Thread Phil Carns
Bart and I hashed through this a little more off list and got a slightly modified version of this patch committed to cvs trunk. Thanks Bart! -Phil Bart Taylor wrote: Hey guys, I attached a patch for pvfs2-ls that does a few things. First, there is an off by one error from my previous patch w

Re: [Pvfs2-developers] pvfs2-stat question

2009-07-24 Thread Phil Carns
That sounds like a bug to me. -Phil Kevin Harms wrote: Is there any reason for pvfs2-stat not to return a non-zero exit code when the path doesn't exist? That seems to behavior of a stat shell command. fs1:~/bin # pvfs2-stat /pvfs2/path PVFS_sys_lookup: No such file or directory (error c

Re: [Pvfs2-developers] Client hangs with 2.8.1

2009-08-26 Thread Phil Carns
The patch looks good to me. I went ahead and committed it to cvs trunk. Thanks for tracking that down! -Phil David Metheny wrote: For the RHEL3 systems (2.4.21-27 smp) this was configured with –disable-epoll, since the systems don’t support epoll. Attaching with gdb to the pvfs2-client-

Re: [Pvfs2-developers] help with changes to configure and configure.in....

2009-09-09 Thread Phil Carns
Becky Ligon wrote: I have modified the configure script by adding "src/apps/user/module.mk" to the list of files in the definition of $ac_config_files. I also modified configure.in by adding "src/apps/user/module.mk" to the definition of AC_OUTPUT. Do I need to "commit" both files to CVS? Are

Re: [Pvfs2-developers] Latest kernel missing class_device_create

2009-09-11 Thread Phil Carns
Hi Nick, I just put a variation on your patch into cvs trunk. It needed a few tweaks to work on RHEL4, which has an odd variation on what class functions are available. -Phil Nicholas Mills wrote: All, In src/kernel/linux-2.6/devpvfs2-req.c:1037 there is a call to class_device_create().

Re: [Pvfs2-developers] EMERGENCY: Need help recovering one of our META/IO servers....

2009-09-14 Thread Phil Carns
Have you actually tried db_recover yet? It can fix some things even without a transaction log. I would recommend making a backup of your .db files first. After you have tried Kevin's suggestion, you can go into the directory for the collection (where the dataspace_attributes.db and collecti

Re: [Pvfs2-developers] EMERGENCY: Need help recovering one of our META/IO servers....

2009-09-14 Thread Phil Carns
Becky Ligon wrote: Phil: When we run db_verify, it is telling us what we already knew, that a region of the database is corrupted. It give us a page number, but don't think that will do us any good. db_recover seems to stop when it reaches the bad page. Michael and I are thinking that we can r

Re: [Pvfs2-developers] Latest kernel missing class_device_create

2009-09-14 Thread Phil Carns
Whoops, I had to back out my version of that change too- it caused a segfault on 2.6.24. It might require some more careful modifications. Do you need this class support specifically? The kernel module should compile ok without it, as far as I know. -Phil Phil Carns wrote: Hi Nick, I

Re: [Pvfs2-developers] PVFS2: files with ?---?--? permissions

2009-09-16 Thread Phil Carns
Becky Ligon wrote: Amit: This means that the PVFS system cannot access the attributes database containing the information about the particular file. It also means that the file is unusable. You need to determine which metadata server is having problems. If you don't have a backup, then you ma

Re: [Pvfs2-developers] PVFS2: files with ?---?--? permissions

2009-09-17 Thread Phil Carns
opt/pvfs2/sbin/pvfs2-client -p /opt/pvfs2/sbin/pvfs2-client-core root 20435 20434 0 Sep14 ?00:00:05 pvfs2-client-core --child -a 5 -n 5 --logtype file -L /tmp/pvfs2-client.log root 23623 19719 0 15:28 pts/200:00:00 grep pvfs Any thoughts??? greatly appreciated!!! -Ami

Re: [Pvfs2-developers] unlink system call....

2009-09-22 Thread Phil Carns
Unlink() actually shows up as a directory operation rather than a file operation (look in namei.c). -Phil Becky Ligon wrote: Does PVFS support the unlink system call? I am not seeing where we define a function for it in pvfs2_file_inode_operations. Becky ___

Re: [Pvfs2-developers] Create state machine in pvfs-2.8.1.

2009-10-05 Thread Phil Carns
Erik Nieto wrote: Hello Everybody: I have some questions about the create system interface operation in the 2.8.1 version of pvfs2. In the earlier version (pvfs-2.7.1), the state machine: 1.- First create a space for the metafile. 2.- Next, create the datafiles in the indicated serv

Re: [Pvfs2-developers] free() additions in pvfs2-server.c, dbpf-attr-cache.c

2009-11-11 Thread Phil Carns
Thanks Michael. Looks fine to me so I dropped the patch into trunk and pvfs-2-8-branch. -Phil Michael Moore wrote: While running valgrind I noticed two spots with memory not being free'd, but having fairly small impact. In pvfs2-server.c an array for holding BMI addresses of metadata server

Re: [Pvfs2-developers] [patch] SIGHUP fix

2009-12-04 Thread Phil Carns
Thanks Bart. This is integrated into CVS now. -Phil Bart Taylor wrote: Attached is a small patch that fixes a problem with handling SIGHUP signals. The server alias string is freed early in server.c, so garbage gets passed into PINT_parse_config when a SIGHUP is received. I moved the free in

Re: [Pvfs2-developers] [patch] clear stranded bstreams

2009-12-09 Thread Phil Carns
Thanks Bart. I put the patch into cvs with some minor adjustments to comments and log messages. thanks, -Phil Bart Taylor wrote: Hey guys, I noticed today that we have a patch that may not have made it to you. It checks the stranded bstreams directory on start for the remnants of any delet

Re: [Pvfs2-developers] Re: [patch] QLA monitor script checks for read only device

2009-12-09 Thread Phil Carns
Hi Bart, Should that dd command in there have an extra flag like "oflag=direct" to make sure it doesn't just write to the buffer cache when you check the device? oflag=fsync would probably work too. -Phil Bart Taylor wrote: I attached the patch this time. On Wed, Dec 9, 2009 at 10:27 AM

<    1   2   3   4   5   >