it must happen somewhere in NodeRevisionContent.bufferContent(InputStrem in), because this method returns the "wrong" value.
I am trying to find where exactly it happens and submit a patch if I found it. thank you for your help and hints >-----Original Message----- >From: Oliver Zeigermann [mailto:[EMAIL PROTECTED] >Sent: Thursday, January 27, 2005 3:57 PM >To: Slide Developers Mailing List >Subject: Re: file size limitation in slide 2.1 final > > >No, as you correctly analyzed before the length is determined using >req.getContentLength() which of course is wrong when larger then 2GB. >So, this is likely to be the problem. Would you try setting it with >req.getHeader("content-length")? > >If this does not help and the web container delivers the correct >request body then the last resort is to step through Slide from the >PUT request to the store level in a debugger. Doing this you *will* >find the problem, but it will take time :( If you submitted a patch >then I would happily commit it to Slide. > >Good luck, > >Oliver > > >On Thu, 27 Jan 2005 13:37:30 +0100, Sven Pfeiffer ><[EMAIL PROTECTED]> wrote: >> I just continued trying and something strange happend. >> >> when trying to upload a file with 4 GB,using webfolders, the content length >> is not correct. >> >> but when using DAVExplorer the content-length is delivered correct (if read >> from req.getHeader("content-length")). >> >> But still only the first 280 MB of the 4GB file are uploaded, but I think >> this is because there is somewhere another int >in Slide?! >> >> I am trying to find it. >> >> Thanks for your help >> >> SVen >> >> >-----Original Message----- >> >From: Sven Pfeiffer [mailto:[EMAIL PROTECTED] >> >Sent: Thursday, January 27, 2005 10:40 AM >> >To: Slide Developers Mailing List; [EMAIL PROTECTED] >> >Subject: RE: file size limitation in slide 2.1 final >> > >> > >> >Hello Oliver >> > >> >how can I get the amount of data copied? >> > >> >I tried to read the content-length directly from request-objects header >(Long.valueOf(req.getHeader("content-length")).longValue()) >> >and this seems to return the correct length, so I guess it is no limitation >> >inside the web container, what do you think? >> > >> >thanks in advance >> >SVen >> > >> > >> > >> >>-----Original Message----- >> >>From: Oliver Zeigermann [mailto:[EMAIL PROTECTED] >> >>Sent: Wednesday, January 26, 2005 5:16 PM >> >>To: Slide Developers Mailing List >> >>Subject: Re: file size limitation in slide 2.1 final >> >> >> >> >> >>That's bad news :( >> >> >> >>Sounds like a limitation inside the web container (Tomcat?) then. >> >>Seems that request bodies longer than 2GB are not even passed properly >> >>to the application. Could you verify this, e.g. by adding output for >> >>the actual amount of data copied in the PutMethod lines 421 and 244? >> >> >> >>If so, maybe changing the web container or upgrading to a more recent >> >>version of it could help. >> >> >> >>Oliver >> >> >> >>On Wed, 26 Jan 2005 16:05:06 +0100, Sven Pfeiffer >> >><[EMAIL PROTECTED]> wrote: >> >>> thank you again for your fast help. >> >>> >> >>> now i'm no longer getting exceptions on the server, but the file is >> >>> still not uploaded. >> >>> a file with the name is created, and 201 "Created" is printed on the >> >>> server, but there is no content, the size is 0 kb. >> >>> >> >>> Files smaller then 2 GB are copied normal. >> >>> >> >>> >-----Original Message----- >> >>> >From: Oliver Zeigermann [mailto:[EMAIL PROTECTED] >> >>> >> >>> >Sent: Wednesday, January 26, 2005 2:40 PM >> >>> >To: Slide Developers Mailing List >> >>> >Subject: Re: file size limitation in slide 2.1 final >> >>> > >> >>> > >> >>> >Agreed. However, I have just committed a fix that should allow you to >> >>> >store files of any size. The stream is streamed to a file first and >> >>> >the amount of bytes copied now correctly is stored into a long instead >> >>> >of an int. >> >>> > >> >>> >You will need to have >> >>> > >> >>> > <parameter name="repeat-upon-conflict">true</parameter> >> >>> > >> >>> >in your configuration section which is the case in the default >> >>> >Domain.xml. >> >>> > >> >>> >Please try it, maybe it helps. >> >>> > >> >>> >Oliver >> >>> > >> >>> >On Wed, 26 Jan 2005 13:07:47 +0100, Sven Pfeiffer >> >>> ><[EMAIL PROTECTED]> wrote: >> >>> >> if I am right, I am in trouble. >> >>> >> >> >>> >> I just tried to find out where the problem was and found that the >> >>> >> size of the file is read from >> >>> >> javax.servlet.http.HttpServletRequests getContentLength()-Method >> >>> >> which returns an int. >> >>> >> >> >>> >> and if the file is larger then 2 GB the maximum capacity of int is >> >>> >> exceeded and so it is -xyz. >> >>> >> >> >>> >> that would explain why it seemed to work with the 4GB-file because >> >>> >> then we are back in the positiv range and so it >> >>> >stores the file. >> >>> >> >> >>> >> What do you think? >> >>> >> Am I right with this? >> >>> >> >> >>> >> Thanks in advance >> >>> >> >> >>> >> >-----Original Message----- >> >>> >> >From: Oliver Zeigermann [mailto:[EMAIL PROTECTED] >> >>> >> >> >>> >> >Sent: Wednesday, January 26, 2005 9:04 AM >> >>> >> >To: Slide Developers Mailing List >> >>> >> >Subject: Re: file size limitation in slide 2.1 final >> >>> >> > >> >>> >> > >> >>> >> >Does a file that is a bit smaller than 2 GB work? If so maybe there >> >>> >> >are places inside the Slide code that use integers which can only >> >>> >> >represent up to 2 GB... >> >>> >> > >> >>> >> >Oliver >> >>> >> > >> >>> >> > >> >>> >> >On Wed, 26 Jan 2005 08:59:05 +0100, Sven Pfeiffer >> >>> >> ><[EMAIL PROTECTED]> wrote: >> >>> >> >> Hello again, >> >>> >> >> >> >>> >> >> I just tried it again. >> >>> >> >> >> >>> >> >> This time I build Slide myself, from Slide head, just downloaded >> >>> >> >> the sources yesterday. >> >>> >> >> >> >>> >> >> Again I tried to put a large file (>4 GB), I am getting >> >>> >> >> >> >>> >> >> TP-Processor3, 26-Jan-2005 08:30:04, sep, PUT, 204 "No >> >>> >> >> Content", 87703 ms, /files/public/1suse.iso >> >>> >> >> >> >>> >> >> and the file is created, but it has just 287 MB. >> >>> >> >> >> >>> >> >> When trying to put a smaller file (780 MB) everything works fine. >> >>> >> >> >> >>> >> >> I can't imaging this has something to do with a limitation of the >> >>> >> >> filesystem, because afaik the maximum >filesize of NTFS >> >>> >> >is about 16 >> >>> >> >> EB or so. >> >>> >> >> >> >>> >> >> I tried it running slide on Windows 2000, inside a JBoss/Tomcat >> >>> >> >> using the >> >org.apache.slide.store.txfile.TxFileContentStore. >> >>> >> >> >> >>> >> >> And I put the file on it using WindowsXPs netfolders. >> >>> >> >> >> >>> >> >> Has anyone an idea why I can't upload larger files? >> >>> >> >> >> >>> >> >> thanks in advance >> >>> >> >> SVen >> >>> >> >> >> >>> >> >> >-----Original Message----- >> >>> >> >> >From: Oliver Zeigermann [mailto:[EMAIL PROTECTED] >> >>> >> >> >> >>> >> >> >Sent: Friday, January 07, 2005 3:21 PM >> >>> >> >> >To: Sven Pfeiffer >> >>> >> >> >Cc: Slide Developers Mailing List >> >>> >> >> >Subject: Re: file size limitation in slide 2.1 final >> >>> >> >> > >> >>> >> >> > >> >>> >> >> >OK, I just tried it with my installation (built from Slide head, >> >>> >> >> >however) and I just copied a file more than 600MB long and it >> >>> >> >> >worked. >> >>> >> >> > >> >>> >> >> >What I have seen from the 2.1 sources is that when the client >> >>> >> >> >does not >> >>> >> >> >pass the content length, the whole file is buffered in memory to >> >>> >> >> >find >> >>> >> >> >it out. This is different in the Slide head. >> >>> >> >> > >> >>> >> >> >I did my test with Windows web folders which correctly passes the >> >>> >> >> >length anyway. >> >>> >> >> > >> >>> >> >> >Maybe this is somewhat related to your problem? >> >>> >> >> > >> >>> >> >> >Oliver >> >>> >> >> > >> >>> >> >> >On Fri, 7 Jan 2005 14:58:57 +0100, Sven Pfeiffer >> >>> >> >> ><[EMAIL PROTECTED]> wrote: >> >>> >> >> >> on the system from wich i upload the file the properties first >> >>> >> >> >> say the original size (8,7 GB), after >refresh it shows >> >>> >> >> >the real size >> >>> >> >> >> 561 MB which is also shown on the server. >> >>> >> >> >> >> >>> >> >> >> if i take a look at the work/content folder the filesize >> >>> >> >> >> constantly increases until it reaches the 561 MB than >> >it stops. >> >>> >> >> >the client >> >>> >> >> >> seems to continue copying for about 5 minutes. >> >>> >> >> >> >> >>> >> >> >> the system returns 201 (created) >> >>> >> >> >> >> >>> >> >> >> the server is running on a windows 2k computer, of course there >> >>> >> >> >> is enough free disk space ;o) >> >>> >> >> >> >> >>> >> >> >> and i don't think that the filesystem (NTFS) has a problem with >> >>> >> >> >> larger files. >> >>> >> >> >> >> >>> >> >> >> i think it is to aovid the OutOfMemoryError that I received in >> >>> >> >> >> the earlier version of slide, but I am not sure. >> >>> >> >> >> >> >>> >> >> >> thank you for your support >> >>> >> >> >> >> >>> >> >> >> SVen >> >>> >> >> >> >> >>> >> >> >> >-----Original Message----- >> >>> >> >> >> >From: Oliver Zeigermann [mailto:[EMAIL PROTECTED] >> >>> >> >> >> >Sent: Friday, January 07, 2005 2:50 PM >> >>> >> >> >> >To: Sven Pfeiffer >> >>> >> >> >> >Cc: Slide Developers Mailing List >> >>> >> >> >> >Subject: Re: file size limitation in slide 2.1 final >> >>> >> >> >> > >> >>> >> >> >> > >> >>> >> >> >> >What do the properties say? The original size? Does your file >> >>> >> >> >> >system >> >>> >> >> >> >support larger files? >> >>> >> >> >> > >> >>> >> >> >> >Oliver >> >>> >> >> >> > >> >>> >> >> >> > >> >>> >> >> >> >On Fri, 7 Jan 2005 14:42:14 +0100, Sven Pfeiffer >> >>> >> >> >> ><[EMAIL PROTECTED]> wrote: >> >>> >> >> >> >> TxFileContentStore >> >>> >> >> >> >> >> >>> >> >> >> >> >> >>> >> >> >> >> >-----Original Message----- >> >>> >> >> >> >> >From: Oliver Zeigermann [mailto:[EMAIL PROTECTED] >> >>> >> >> >> >> >Sent: Friday, January 07, 2005 2:37 PM >> >>> >> >> >> >> >To: Slide Developers Mailing List >> >>> >> >> >> >> >Subject: Re: file size limitation in slide 2.1 final >> >>> >> >> >> >> > >> >>> >> >> >> >> > >> >>> >> >> >> >> >Which store? >> >>> >> >> >> >> > >> >>> >> >> >> >> >Oliver >> >>> >> >> >> >> > >> >>> >> >> >> >> > >> >>> >> >> >> >> >On Fri, 7 Jan 2005 14:33:40 +0100, Sven Pfeiffer >> >>> >> >> >> >> ><[EMAIL PROTECTED]> wrote: >> >>> >> >> >> >> >> Hi List >> >>> >> >> >> >> >> >> >>> >> >> >> >> >> there seems to be a limitation of the file site in slide >> >>> >> >> >> >> >> 2.1 final. >> >>> >> >> >> >> >> >> >>> >> >> >> >> >> no matter how large the files are, if they are larger >> >>> >> >> >> >> >> than round about 561 MB and if I want to store >larger files >> >>> >> >> >> >they are simply >> >>> >> >> >> >> >> cut. >> >>> >> >> >> >> >> >> >>> >> >> >> >> >> Is there a way to avoid this? >> >>> >> >> >> >> >> >> >>> >> >> >> >> >> thanks in advance >> >>> >> >> >> >> >> >> >>> >> >> >> >> >> SVen >> >>> >> >> >> >> >> >> >>> >> >> >> >> >> --------------------------------------------------------------------- >> >>> >> >> >> >> >> To unsubscribe, e-mail: [EMAIL PROTECTED] >> >>> >> >> >> >> >> For additional commands, e-mail: [EMAIL PROTECTED] >> >>> >> >> >> >> >> >> >>> >> >> >> >> >> >> >>> >> >> >> >> > >> >>> >> >> >> >> >--------------------------------------------------------------------- >> >>> >> >> >> >> >To unsubscribe, e-mail: [EMAIL PROTECTED] >> >>> >> >> >> >> >For additional commands, e-mail: [EMAIL PROTECTED] >> >>> >> >> >> >> > >> >>> >> >> >> >> >> >>> >> >> >> >> >> >>> >> >> >> >> >>> >> >> >> >> >>> >> >> > >> >>> >> >> >--------------------------------------------------------------------- >> >>> >> >> >To unsubscribe, e-mail: [EMAIL PROTECTED] >> >>> >> >> >For additional commands, e-mail: [EMAIL PROTECTED] >> >>> >> >> > >> >>> >> >> >> >>> >> >> --------------------------------------------------------------------- >> >>> >> >> To unsubscribe, e-mail: [EMAIL PROTECTED] >> >>> >> >> For additional commands, e-mail: [EMAIL PROTECTED] >> >>> >> >> >> >>> >> >> >> >>> >> > >> >>> >> >--------------------------------------------------------------------- >> >>> >> >To unsubscribe, e-mail: [EMAIL PROTECTED] >> >>> >> >For additional commands, e-mail: [EMAIL PROTECTED] >> >>> >> > >> >>> >> >> >>> >> --------------------------------------------------------------------- >> >>> >> To unsubscribe, e-mail: [EMAIL PROTECTED] >> >>> >> For additional commands, e-mail: [EMAIL PROTECTED] >> >>> >> >> >>> >> >> >>> > >> >>> >--------------------------------------------------------------------- >> >>> >To unsubscribe, e-mail: [EMAIL PROTECTED] >> >>> >For additional commands, e-mail: [EMAIL PROTECTED] >> >>> > >> >>> >> >>> --------------------------------------------------------------------- >> >>> To unsubscribe, e-mail: [EMAIL PROTECTED] >> >>> For additional commands, e-mail: [EMAIL PROTECTED] >> >>> >> >>> >> >> >> >>--------------------------------------------------------------------- >> >>To unsubscribe, e-mail: [EMAIL PROTECTED] >> >>For additional commands, e-mail: [EMAIL PROTECTED] >> >> >> > >> > >> >--------------------------------------------------------------------- >> >To unsubscribe, e-mail: [EMAIL PROTECTED] >> >For additional commands, e-mail: [EMAIL PROTECTED] >> > >> >> --------------------------------------------------------------------- >> To unsubscribe, e-mail: [EMAIL PROTECTED] >> For additional commands, e-mail: [EMAIL PROTECTED] >> >> > >--------------------------------------------------------------------- >To unsubscribe, e-mail: [EMAIL PROTECTED] >For additional commands, e-mail: [EMAIL PROTECTED] > --------------------------------------------------------------------- To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
