Hello, thank you very much for your useful info. From: [email protected] To: [email protected] CC: [email protected] Subject: RE: [Pvfs2-users] Error:FS config file integrity checks failed Date: Fri, 2 Dec 2011 16:18:21 -0500
The file system does not replicate metadata. That feature is something we are designing, but have not yet implemented. The TroveSyncMeta setting controls how soon the metadata is written to disk. lf set to "no" it will wait to sync when a flush or close operation is called. You could see it as a sort of lazy write for metadata. This can improve performance, but if the system goes down unexpectedly it may leave some information uncommitted to disk. Hope that answers your question. Thanks,Elaine From: [email protected] [mailto:[email protected]] On Behalf Of g_p g_p Sent: Friday, December 02, 2011 3:34 PM To: [email protected] Cc: pvfs2 Subject: RE: [Pvfs2-users] Error:FS config file integrity checks failed Thank you very much! My problem is solved, i typed "sudo kill 15820" and now the system sees the new pvfs2-fs.conf file. The reason i modified the "TroveSyncMeta no" is because i would like to check if the replication of the metadatahas a better performance. Did i do well? Or shall i change some other variable in Trove, related to metadata replication? Thanks again!Date: Fri, 2 Dec 2011 15:26:41 -0500 From: [email protected] To: [email protected] CC: [email protected] Subject: Re: [Pvfs2-users] Error:FS config file integrity checks failed The server daemon is running as root. Change "kill 15820" to "sudo kill 15820". That daemon is still running with an old configuration file (based on the date shown by ps) so you should be good to go once you get it restarted with your new configuration file. thanks, -Phil On 12/02/2011 03:06 PM, g_p g_p wrote: Hello, i did "cksum /etc/pvfs2-fs.conf" to all the servers and i received to all the output: output = 3507433560 945 /etc/pvfs2-fs.conf Then i did in each server: $ ps auwwx|grep pvfs2-serveruser 23414 0.0 0.0 61148 760 pts/3 S+ 21:43 0:00 grep pvfs2-server $ kill 23414-bash: kill: (23414) - No such process $ ps auwwx|grep pvfs2-serveruser 2887 0.0 0.0 61176 740 pts/0 S+ 21:05 0:00 grep pvfs2-serverroot 15820 0.1 0.1 58316 3444 ? Ssl Nov12 57:41 /usr/sbin/pvfs2-server /etc/pvfs2-fs.conf -a datanode $kill 15820-bash: kill: (15820) - Operation not permitted I can't stop the daemons, but why? In my system i use a pvfs2tab file. What am i doing wrong?How can i stop the processes? Thanks, in advance Date: Fri, 2 Dec 2011 14:52:42 -0500 From: [email protected] To: [email protected] CC: [email protected]; [email protected] Subject: Re: [Pvfs2-users] Error:FS config file integrity checks failed Maybe it would be good for you to post your pvfs2-fs.conf file if you don't mind. You can also do a "cksum /etc/pvfs2-fs.conf" on each server to make sure that the configuration files match. Are you mounting the file system on the client or just using a pvfs2tab file? If you are mounting the file system you might want to unmount the file system everywhere, stop the server daemons one more time (check with "ps auwwx|grep pvfs2-server" on all servers to make certain no daemons are running after you stop them), restart the servers, and then try remounting the file system. It still sounds like there is stale configuration information somewhere. -Phil On 12/02/2011 02:29 PM, g_p g_p wrote: Hello, when i start the datanode/client i do: ---- sudo /usr/sbin/pvfs2-server /etc/pvfs2-fs.conf -a mynode So i specify the folder /etc/pvfs2-fs.conf for the datanode For the metadata servers i do: ---- sudo /usr/sbin/pvfs2-server /etc/pvfs2-fs.conf -d -a datanodeIP Am i doing something wrong? Thanks, in advance From: [email protected] To: [email protected] CC: [email protected] Subject: RE: [Pvfs2-users] Error:FS config file integrity checks failed Date: Fri, 2 Dec 2011 12:27:44 -0500You aren't specifying an alternate location for the .conf file in the command line for pvfs2-server, are you? -- Elaine From: [email protected] [mailto:[email protected]] On Behalf Of g_p g_p Sent: Friday, December 02, 2011 8:38 AM To: [email protected] Cc: pvfs2 Subject: RE: [Pvfs2-users] Error:FS config file integrity checks failed Hello, i checked that all the /etc/pvfs-fs.conf files have the same size 945. Well i didn't use scp but just copy, i hope that cp didn't create any problem. It seems that the client sees a file that has a block size of 946. But this file for sure is not located under /etc/ dir.All of the nodes, under /etc/ have a file pvfs-fs.conf file with 945 size. So i take again the message when i try to ls or create a dir: sudo /usr/bin/pvfs2-ls -l mnt/pvfs2/ FS config file integrity checks failed; FS config file on tcp:// -> (size) 945 FS config file on tcp:// -> (size) 946 Error: could not initialize any file systems from /etc/pvfs2tab $ sudo /usr/bin/pvfs2-mkdir mnt/pvfs2/test FS config file integrity checks failed; FS config file on tcp:// -> (size) 945 FS config file on tcp:// -> (size) 946 ERROR: could not initialize any file systems in /etc/pvfs2tab. PVFS_util_init_defaults: No such device (error class: 0) It seems that th file pvfs2tab has a problem, but i don't know what.What shall i do in order to correct the problem?Thanks, in advance Date: Thu, 1 Dec 2011 16:53:08 -0500 From: [email protected] To: [email protected] CC: [email protected] Subject: Re: [Pvfs2-users] Error:FS config file integrity checks failed On 12/01/2011 04:25 PM, g_p g_p wrote: Thanks for replying, I' ll try to use scp command and i hope it works. That should do the trick. After i do shall i execute any other command like "make""make install"or something else in order for the fs to see the updates in the configuration file? No, don't run any more make commands. You just need to stop the server daemons and restart them once you have scp'd the config files. -Phil Thanks, in advance Date: Thu, 1 Dec 2011 16:14:08 -0500 From: [email protected] To: [email protected] CC: [email protected] Subject: Re: [Pvfs2-users] Error:FS config file integrity checks failed You might need to just pick one of the config files and copy it verbatim to each of the other nodes to make sure that they match exactly. The config file integrity check doesn't take into account things like white space differences so its easy for them to get out of sync if you edit by hand. -Phil On 12/01/2011 04:04 PM, g_p g_p wrote: Hello, i have installed pvfs2 and i have two metadata servers and one client and datanode. My system was running. I tried to make a modification to all the /etc/pvfs2-fs.conf files in all the nodes and i did //initial file <StorageHints> TroveSyncMeta yes TroveSyncData no TroveMethod alt-aio </StorageHints> to //modified file<StorageHints> TroveSyncMeta no <-- THIS CHANGE ONLY from yes -> no TroveSyncData no TroveMethod alt-aio </StorageHints> but the fs doesn' t run now and i take this output: FS config file integrity checks failed;FS config file on tcp:// -> (size) 945FS config file on tcp:// -> (size) 946Error: could not initialize any file systems from /etc/pvfs2tab What shall i do in order for all the nodes to see the update in the /etc/pvfs2-fs.conf file? Thanks, in advance _______________________________________________Pvfs2-users mailing [email protected]http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users _______________________________________________Pvfs2-users mailing [email protected]http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users _______________________________________________Pvfs2-users mailing [email protected]http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users _______________________________________________Pvfs2-users mailing [email protected]http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users
_______________________________________________ Pvfs2-users mailing list [email protected] http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users
