No, as you correctly analyzed before the length is determined using
req.getContentLength() which of course is wrong when larger then 2GB.
So, this is likely to be the problem. Would you try setting it with
req.getHeader("content-length")?
If this does not help and the web container delivers the correct
request body then the last resort is to step through Slide from the
PUT request to the store level in a debugger. Doing this you *will*
find the problem, but it will take time :( If you submitted a patch
then I would happily commit it to Slide.
Good luck,
Oliver
On Thu, 27 Jan 2005 13:37:30 +0100, Sven Pfeiffer
<[EMAIL PROTECTED]> wrote:
> I just continued trying and something strange happend.
>
> when trying to upload a file with 4 GB,using webfolders, the content length
> is not correct.
>
> but when using DAVExplorer the content-length is delivered correct (if read
> from req.getHeader("content-length")).
>
> But still only the first 280 MB of the 4GB file are uploaded, but I think
> this is because there is somewhere another int in Slide?!
>
> I am trying to find it.
>
> Thanks for your help
>
> SVen
>
> >-----Original Message-----
> >From: Sven Pfeiffer [mailto:[EMAIL PROTECTED]
> >Sent: Thursday, January 27, 2005 10:40 AM
> >To: Slide Developers Mailing List; [EMAIL PROTECTED]
> >Subject: RE: file size limitation in slide 2.1 final
> >
> >
> >Hello Oliver
> >
> >how can I get the amount of data copied?
> >
> >I tried to read the content-length directly from request-objects header
> >(Long.valueOf(req.getHeader("content-length")).longValue())
> >and this seems to return the correct length, so I guess it is no limitation
> >inside the web container, what do you think?
> >
> >thanks in advance
> >SVen
> >
> >
> >
> >>-----Original Message-----
> >>From: Oliver Zeigermann [mailto:[EMAIL PROTECTED]
> >>Sent: Wednesday, January 26, 2005 5:16 PM
> >>To: Slide Developers Mailing List
> >>Subject: Re: file size limitation in slide 2.1 final
> >>
> >>
> >>That's bad news :(
> >>
> >>Sounds like a limitation inside the web container (Tomcat?) then.
> >>Seems that request bodies longer than 2GB are not even passed properly
> >>to the application. Could you verify this, e.g. by adding output for
> >>the actual amount of data copied in the PutMethod lines 421 and 244?
> >>
> >>If so, maybe changing the web container or upgrading to a more recent
> >>version of it could help.
> >>
> >>Oliver
> >>
> >>On Wed, 26 Jan 2005 16:05:06 +0100, Sven Pfeiffer
> >><[EMAIL PROTECTED]> wrote:
> >>> thank you again for your fast help.
> >>>
> >>> now i'm no longer getting exceptions on the server, but the file is still
> >>> not uploaded.
> >>> a file with the name is created, and 201 "Created" is printed on the
> >>> server, but there is no content, the size is 0 kb.
> >>>
> >>> Files smaller then 2 GB are copied normal.
> >>>
> >>> >-----Original Message-----
> >>> >From: Oliver Zeigermann [mailto:[EMAIL PROTECTED]
> >>>
> >>> >Sent: Wednesday, January 26, 2005 2:40 PM
> >>> >To: Slide Developers Mailing List
> >>> >Subject: Re: file size limitation in slide 2.1 final
> >>> >
> >>> >
> >>> >Agreed. However, I have just committed a fix that should allow you to
> >>> >store files of any size. The stream is streamed to a file first and
> >>> >the amount of bytes copied now correctly is stored into a long instead
> >>> >of an int.
> >>> >
> >>> >You will need to have
> >>> >
> >>> > <parameter name="repeat-upon-conflict">true</parameter>
> >>> >
> >>> >in your configuration section which is the case in the default
> >>> >Domain.xml.
> >>> >
> >>> >Please try it, maybe it helps.
> >>> >
> >>> >Oliver
> >>> >
> >>> >On Wed, 26 Jan 2005 13:07:47 +0100, Sven Pfeiffer
> >>> ><[EMAIL PROTECTED]> wrote:
> >>> >> if I am right, I am in trouble.
> >>> >>
> >>> >> I just tried to find out where the problem was and found that the size
> >>> >> of the file is read from
> >>> >> javax.servlet.http.HttpServletRequests getContentLength()-Method which
> >>> >> returns an int.
> >>> >>
> >>> >> and if the file is larger then 2 GB the maximum capacity of int is
> >>> >> exceeded and so it is -xyz.
> >>> >>
> >>> >> that would explain why it seemed to work with the 4GB-file because
> >>> >> then we are back in the positiv range and so it
> >>> >stores the file.
> >>> >>
> >>> >> What do you think?
> >>> >> Am I right with this?
> >>> >>
> >>> >> Thanks in advance
> >>> >>
> >>> >> >-----Original Message-----
> >>> >> >From: Oliver Zeigermann [mailto:[EMAIL PROTECTED]
> >>> >>
> >>> >> >Sent: Wednesday, January 26, 2005 9:04 AM
> >>> >> >To: Slide Developers Mailing List
> >>> >> >Subject: Re: file size limitation in slide 2.1 final
> >>> >> >
> >>> >> >
> >>> >> >Does a file that is a bit smaller than 2 GB work? If so maybe there
> >>> >> >are places inside the Slide code that use integers which can only
> >>> >> >represent up to 2 GB...
> >>> >> >
> >>> >> >Oliver
> >>> >> >
> >>> >> >
> >>> >> >On Wed, 26 Jan 2005 08:59:05 +0100, Sven Pfeiffer
> >>> >> ><[EMAIL PROTECTED]> wrote:
> >>> >> >> Hello again,
> >>> >> >>
> >>> >> >> I just tried it again.
> >>> >> >>
> >>> >> >> This time I build Slide myself, from Slide head, just downloaded
> >>> >> >> the sources yesterday.
> >>> >> >>
> >>> >> >> Again I tried to put a large file (>4 GB), I am getting
> >>> >> >>
> >>> >> >> TP-Processor3, 26-Jan-2005 08:30:04, sep, PUT, 204 "No
> >>> >> >> Content", 87703 ms, /files/public/1suse.iso
> >>> >> >>
> >>> >> >> and the file is created, but it has just 287 MB.
> >>> >> >>
> >>> >> >> When trying to put a smaller file (780 MB) everything works fine.
> >>> >> >>
> >>> >> >> I can't imaging this has something to do with a limitation of the
> >>> >> >> filesystem, because afaik the maximum filesize of NTFS
> >>> >> >is about 16
> >>> >> >> EB or so.
> >>> >> >>
> >>> >> >> I tried it running slide on Windows 2000, inside a JBoss/Tomcat
> >>> >> >> using the
> >org.apache.slide.store.txfile.TxFileContentStore.
> >>> >> >>
> >>> >> >> And I put the file on it using WindowsXPs netfolders.
> >>> >> >>
> >>> >> >> Has anyone an idea why I can't upload larger files?
> >>> >> >>
> >>> >> >> thanks in advance
> >>> >> >> SVen
> >>> >> >>
> >>> >> >> >-----Original Message-----
> >>> >> >> >From: Oliver Zeigermann [mailto:[EMAIL PROTECTED]
> >>> >> >>
> >>> >> >> >Sent: Friday, January 07, 2005 3:21 PM
> >>> >> >> >To: Sven Pfeiffer
> >>> >> >> >Cc: Slide Developers Mailing List
> >>> >> >> >Subject: Re: file size limitation in slide 2.1 final
> >>> >> >> >
> >>> >> >> >
> >>> >> >> >OK, I just tried it with my installation (built from Slide head,
> >>> >> >> >however) and I just copied a file more than 600MB long and it
> >>> >> >> >worked.
> >>> >> >> >
> >>> >> >> >What I have seen from the 2.1 sources is that when the client does
> >>> >> >> >not
> >>> >> >> >pass the content length, the whole file is buffered in memory to
> >>> >> >> >find
> >>> >> >> >it out. This is different in the Slide head.
> >>> >> >> >
> >>> >> >> >I did my test with Windows web folders which correctly passes the
> >>> >> >> >length anyway.
> >>> >> >> >
> >>> >> >> >Maybe this is somewhat related to your problem?
> >>> >> >> >
> >>> >> >> >Oliver
> >>> >> >> >
> >>> >> >> >On Fri, 7 Jan 2005 14:58:57 +0100, Sven Pfeiffer
> >>> >> >> ><[EMAIL PROTECTED]> wrote:
> >>> >> >> >> on the system from wich i upload the file the properties first
> >>> >> >> >> say the original size (8,7 GB), after refresh it shows
> >>> >> >> >the real size
> >>> >> >> >> 561 MB which is also shown on the server.
> >>> >> >> >>
> >>> >> >> >> if i take a look at the work/content folder the filesize
> >>> >> >> >> constantly increases until it reaches the 561 MB than
> >it stops.
> >>> >> >> >the client
> >>> >> >> >> seems to continue copying for about 5 minutes.
> >>> >> >> >>
> >>> >> >> >> the system returns 201 (created)
> >>> >> >> >>
> >>> >> >> >> the server is running on a windows 2k computer, of course there
> >>> >> >> >> is enough free disk space ;o)
> >>> >> >> >>
> >>> >> >> >> and i don't think that the filesystem (NTFS) has a problem with
> >>> >> >> >> larger files.
> >>> >> >> >>
> >>> >> >> >> i think it is to aovid the OutOfMemoryError that I received in
> >>> >> >> >> the earlier version of slide, but I am not sure.
> >>> >> >> >>
> >>> >> >> >> thank you for your support
> >>> >> >> >>
> >>> >> >> >> SVen
> >>> >> >> >>
> >>> >> >> >> >-----Original Message-----
> >>> >> >> >> >From: Oliver Zeigermann [mailto:[EMAIL PROTECTED]
> >>> >> >> >> >Sent: Friday, January 07, 2005 2:50 PM
> >>> >> >> >> >To: Sven Pfeiffer
> >>> >> >> >> >Cc: Slide Developers Mailing List
> >>> >> >> >> >Subject: Re: file size limitation in slide 2.1 final
> >>> >> >> >> >
> >>> >> >> >> >
> >>> >> >> >> >What do the properties say? The original size? Does your file
> >>> >> >> >> >system
> >>> >> >> >> >support larger files?
> >>> >> >> >> >
> >>> >> >> >> >Oliver
> >>> >> >> >> >
> >>> >> >> >> >
> >>> >> >> >> >On Fri, 7 Jan 2005 14:42:14 +0100, Sven Pfeiffer
> >>> >> >> >> ><[EMAIL PROTECTED]> wrote:
> >>> >> >> >> >> TxFileContentStore
> >>> >> >> >> >>
> >>> >> >> >> >>
> >>> >> >> >> >> >-----Original Message-----
> >>> >> >> >> >> >From: Oliver Zeigermann [mailto:[EMAIL PROTECTED]
> >>> >> >> >> >> >Sent: Friday, January 07, 2005 2:37 PM
> >>> >> >> >> >> >To: Slide Developers Mailing List
> >>> >> >> >> >> >Subject: Re: file size limitation in slide 2.1 final
> >>> >> >> >> >> >
> >>> >> >> >> >> >
> >>> >> >> >> >> >Which store?
> >>> >> >> >> >> >
> >>> >> >> >> >> >Oliver
> >>> >> >> >> >> >
> >>> >> >> >> >> >
> >>> >> >> >> >> >On Fri, 7 Jan 2005 14:33:40 +0100, Sven Pfeiffer
> >>> >> >> >> >> ><[EMAIL PROTECTED]> wrote:
> >>> >> >> >> >> >> Hi List
> >>> >> >> >> >> >>
> >>> >> >> >> >> >> there seems to be a limitation of the file site in slide
> >>> >> >> >> >> >> 2.1 final.
> >>> >> >> >> >> >>
> >>> >> >> >> >> >> no matter how large the files are, if they are larger than
> >>> >> >> >> >> >> round about 561 MB and if I want to store larger files
> >>> >> >> >> >they are simply
> >>> >> >> >> >> >> cut.
> >>> >> >> >> >> >>
> >>> >> >> >> >> >> Is there a way to avoid this?
> >>> >> >> >> >> >>
> >>> >> >> >> >> >> thanks in advance
> >>> >> >> >> >> >>
> >>> >> >> >> >> >> SVen
> >>> >> >> >> >> >>
> >>> >> >> >> >> >> ---------------------------------------------------------------------
> >>> >> >> >> >> >> To unsubscribe, e-mail: [EMAIL PROTECTED]
> >>> >> >> >> >> >> For additional commands, e-mail: [EMAIL PROTECTED]
> >>> >> >> >> >> >>
> >>> >> >> >> >> >>
> >>> >> >> >> >> >
> >>> >> >> >> >> >---------------------------------------------------------------------
> >>> >> >> >> >> >To unsubscribe, e-mail: [EMAIL PROTECTED]
> >>> >> >> >> >> >For additional commands, e-mail: [EMAIL PROTECTED]
> >>> >> >> >> >> >
> >>> >> >> >> >>
> >>> >> >> >> >>
> >>> >> >> >>
> >>> >> >> >>
> >>> >> >> >
> >>> >> >> >---------------------------------------------------------------------
> >>> >> >> >To unsubscribe, e-mail: [EMAIL PROTECTED]
> >>> >> >> >For additional commands, e-mail: [EMAIL PROTECTED]
> >>> >> >> >
> >>> >> >>
> >>> >> >> ---------------------------------------------------------------------
> >>> >> >> To unsubscribe, e-mail: [EMAIL PROTECTED]
> >>> >> >> For additional commands, e-mail: [EMAIL PROTECTED]
> >>> >> >>
> >>> >> >>
> >>> >> >
> >>> >> >---------------------------------------------------------------------
> >>> >> >To unsubscribe, e-mail: [EMAIL PROTECTED]
> >>> >> >For additional commands, e-mail: [EMAIL PROTECTED]
> >>> >> >
> >>> >>
> >>> >> ---------------------------------------------------------------------
> >>> >> To unsubscribe, e-mail: [EMAIL PROTECTED]
> >>> >> For additional commands, e-mail: [EMAIL PROTECTED]
> >>> >>
> >>> >>
> >>> >
> >>> >---------------------------------------------------------------------
> >>> >To unsubscribe, e-mail: [EMAIL PROTECTED]
> >>> >For additional commands, e-mail: [EMAIL PROTECTED]
> >>> >
> >>>
> >>> ---------------------------------------------------------------------
> >>> To unsubscribe, e-mail: [EMAIL PROTECTED]
> >>> For additional commands, e-mail: [EMAIL PROTECTED]
> >>>
> >>>
> >>
> >>---------------------------------------------------------------------
> >>To unsubscribe, e-mail: [EMAIL PROTECTED]
> >>For additional commands, e-mail: [EMAIL PROTECTED]
> >>
> >
> >
> >---------------------------------------------------------------------
> >To unsubscribe, e-mail: [EMAIL PROTECTED]
> >For additional commands, e-mail: [EMAIL PROTECTED]
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: [EMAIL PROTECTED]
> For additional commands, e-mail: [EMAIL PROTECTED]
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]
