Re: [gentoo-user] Fwd: reiserfs file size issue
The solution has arrived. Thanks Richard for the cifs tip, to lay it out :- mount.smbfs //NEWSTU/genstubackup /mnt/NEWSTU/genstubackup = This command has a limit on file transfer of 2Gb mount.cifs //NEWSTU/genstubackup /mnt/NEWSTU/genstubackup = This command has been tested with a 3.7Gb file and transfered without fault Many thanks for the help people stu On 9/13/05, Stuart Howard [EMAIL PROTECTED] wrote: FYI Will try this CIFS later on stu -- Forwarded message -- From: Richard Fish [EMAIL PROTECTED] Date: Sep 13, 2005 4:57 AM Subject: Re: [gentoo-user] Fwd: reiserfs file size issue To: gentoo-user@lists.gentoo.org Stuart Howard wrote: Yes I am using samba to connect to the XP box as you suggested. The error report arrived via mail from a cron, prehaps the garbling of the message occured there? Anyway thanks again for responses, I usually clean up /tmp after the script runs so I made the assumption later on that the error was at the point of creation of the file and not during the cp, so as a way of confirming this I have set it off again to make the very large tgz and then try too cp it via samba transport to the XP box. [will run overnight now] If it works ie. if the full file is created [waiting in /tmp] then it is samba or if not then a post back to the shell limit. Should know by morning. An interesting chase regardless and if it is samba then will have to split the tgz. Mounting it as a smbfs filesystem (which does not support file larger than 2G) is almost certainly the problem. Try mounting the XP box as a cifs (mount.cifs) filesystem and you should have better luck. -Richard -- gentoo-user@gentoo.org mailing list -- There are 10 types of people in this world: those who understand binary, those who don't --Unknown -- There are 10 types of people in this world: those who understand binary, those who don't --Unknown -- There are 10 types of people in this world: those who understand binary, those who don't --Unknown -- gentoo-user@gentoo.org mailing list
[gentoo-user] Fwd: reiserfs file size issue
Further reading further problem, I have been through the reiserfs FAQ and discovered that with 2.4 - 2.6 kernels that the file size limit I have posted below should not be an issue ie. I should be version 3.6 and therefore file size is well ... biG So I now need to discover where the fault lies, the error message was File size limit exceededcp no google, dogpile or yahoo search admits to ever knowing this error however I suppose the clue is in -cp ? /me reads GNU docs for tar report no issue's with file sizes below 8Gb and then only when using specific formats that I am not so far as I am aware. To recap the commands I am calling are tar -czf /tmp/fullsysbackupusr.tgz /usr cp /tmp/fullsysbackupusr.tgz /mnt/NEWSTU/genstubackup/fullsysbackup The source is Gentoo box 2.6.11.5 on a reiserfs partition, the file is created but will not exceed 2Gb or 2,147,483,647. Once created [though the file should be larger] it is dutifully transfered to the XP box via cp. any suggestions on this ? Beginning to suspect I am not seeing wood for tree's but if anyone has an axe please throw it my way. stu ps. For my North American cousins, cricket is a game where 13 men stand in a field for 5 days and hurl a small leather ball at 3 sticks in the ground with the aim of disturbing 2 smaller pieces of wood from the top of the aforesaid 3 sticks :) -- Forwarded message -- From: Stuart Howard [EMAIL PROTECTED] Date: Sep 12, 2005 9:09 PM Subject: reiserfs file size issue To: gentoo-user@lists.gentoo.org Hi people This question follows on from a post I made regarding a hard drive death and backup problems, I made a little script that tar and gzip's each of the root directories in order. At the point of /usr which is a very large one I get the following error /root/fullsysbackup.sh: line 30: 18492 File size limit exceededcp /tmp/fullsysbackupusr.tgz When checking the file size I see that it is approx 2.1Gb and to be exact = 2^31 -1 After a fair bit of checking around into possible causes of the error [samba, cp, backup box runs XP, and finally reiserfs] I discovered from the reiser site that it has a file size limit of ... 2^31 -1. However this seemed strange but I accepted it. I asked a friend who is of the beleif that reiserfs 3.5 had the limit but 3.6 does not. Now for the silly question of the day, how do I know what version of reiserfs I have installed? OK well it is possible that I have got the wrong end of the stick at this point and indeed the file size limit is 2.1Gb, the solution would be to split the tgz on backup but I also have some rather large movie type files and Iwould rather have a fs that works for me rather than the other way around. I dont want to turn this thread into everyones favorite which fs for me? but any simplistic advice on the status of reiserfs file size limits and such would be helpful. stu ps. Comon England and up the Aussies :) we won the ashes! pps. Its a cricket thing ^^ ;) -- There are 10 types of people in this world: those who understand binary, those who don't --Unknown -- There are 10 types of people in this world: those who understand binary, those who don't --Unknown -- gentoo-user@gentoo.org mailing list
Re: [gentoo-user] Fwd: reiserfs file size issue
On Mon, Sep 12, 2005 at 11:40:05PM +0200, Stuart Howard wrote: Further reading further problem, I have been through the reiserfs FAQ and discovered that with 2.4 - 2.6 kernels that the file size limit I have posted below should not be an issue ie. I should be version 3.6 and therefore file size is well ... biG So I now need to discover where the fault lies, the error message was File size limit exceededcp no google, dogpile or yahoo search admits to ever knowing this error however I suppose the clue is in -cp ? the cp is from your command: cp /tmp/fullsysbackupusr.tgz ... The error message is NOT File size limit exceededcp. The error message should be line 30: cp /tmp/fullsysbackupusr.tgz ... File size limit exceeded I am not quite sure why the error message got jumbled up the way it did in your case. To recap the commands I am calling are tar -czf /tmp/fullsysbackupusr.tgz /usr cp /tmp/fullsysbackupusr.tgz /mnt/NEWSTU/genstubackup/fullsysbackup The source is Gentoo box 2.6.11.5 on a reiserfs partition, the file is created but will not exceed 2Gb or 2,147,483,647. Once created [though the file should be larger] it is dutifully transfered to the XP box via cp. The problem is here. The kernel code used to access smbfs (I presume that is how you mount your XP box to /mnt/NEWSTU?) has a file size limit of 2/4GB (I am not quite sure about the number). http://lists.suse.com/archive/suse-amd64/2004-May/0058.html W -- Thesaurus: ancient reptile with an excellent vocabulary. Sortir en Pantoufles: up 32 days, 1:31 -- gentoo-user@gentoo.org mailing list
Re: [gentoo-user] Fwd: reiserfs file size issue
On Monday 12 September 2005 22:40, Stuart Howard wrote: To recap the commands I am calling are tar -czf /tmp/fullsysbackupusr.tgz /usr cp /tmp/fullsysbackupusr.tgz /mnt/NEWSTU/genstubackup/fullsysbackup Is NEWSTU a samba mount from the XP box? The source is Gentoo box 2.6.11.5 on a reiserfs partition, the file is created but will not exceed 2Gb or 2,147,483,647. Once created [though the file should be larger] it is dutifully transfered to the XP box via cp. OK, I assume you're running this from some sort of script? If the file isn't getting created fully, I'd go for it being tar at fault, as I know reiser has no problems with files well over 2GB. Personally, I'd just bypass the whole issue, and use a better method for backing up. My favourite system is rdiff-backup (rdiff-backup /usr /mnt/NEWSTU/genstubackup/fullsysbackup). -- Mike Williams -- gentoo-user@gentoo.org mailing list
Re: [gentoo-user] Fwd: reiserfs file size issue
Stuart Howard wrote: Yes I am using samba to connect to the XP box as you suggested. The error report arrived via mail from a cron, prehaps the garbling of the message occured there? Anyway thanks again for responses, I usually clean up /tmp after the script runs so I made the assumption later on that the error was at the point of creation of the file and not during the cp, so as a way of confirming this I have set it off again to make the very large tgz and then try too cp it via samba transport to the XP box. [will run overnight now] If it works ie. if the full file is created [waiting in /tmp] then it is samba or if not then a post back to the shell limit. Should know by morning. An interesting chase regardless and if it is samba then will have to split the tgz. Mounting it as a smbfs filesystem (which does not support file larger than 2G) is almost certainly the problem. Try mounting the XP box as a cifs (mount.cifs) filesystem and you should have better luck. -Richard -- gentoo-user@gentoo.org mailing list
