I just continued trying and something strange happend.
when trying to upload a file with 4 GB,using webfolders, the content length is
not correct.
but when using DAVExplorer the content-length is delivered correct (if read
from req.getHeader("content-length")).
But still only the first 280 MB of the 4GB file are uploaded, but I think this
is because there is somewhere another int in Slide?!
I am trying to find it.
Thanks for your help
SVen
>-----Original Message-----
>From: Sven Pfeiffer [mailto:[EMAIL PROTECTED]
>Sent: Thursday, January 27, 2005 10:40 AM
>To: Slide Developers Mailing List; [EMAIL PROTECTED]
>Subject: RE: file size limitation in slide 2.1 final
>
>
>Hello Oliver
>
>how can I get the amount of data copied?
>
>I tried to read the content-length directly from request-objects header
>(Long.valueOf(req.getHeader("content-length")).longValue())
>and this seems to return the correct length, so I guess it is no limitation
>inside the web container, what do you think?
>
>thanks in advance
>SVen
>
>
>
>>-----Original Message-----
>>From: Oliver Zeigermann [mailto:[EMAIL PROTECTED]
>>Sent: Wednesday, January 26, 2005 5:16 PM
>>To: Slide Developers Mailing List
>>Subject: Re: file size limitation in slide 2.1 final
>>
>>
>>That's bad news :(
>>
>>Sounds like a limitation inside the web container (Tomcat?) then.
>>Seems that request bodies longer than 2GB are not even passed properly
>>to the application. Could you verify this, e.g. by adding output for
>>the actual amount of data copied in the PutMethod lines 421 and 244?
>>
>>If so, maybe changing the web container or upgrading to a more recent
>>version of it could help.
>>
>>Oliver
>>
>>On Wed, 26 Jan 2005 16:05:06 +0100, Sven Pfeiffer
>><[EMAIL PROTECTED]> wrote:
>>> thank you again for your fast help.
>>>
>>> now i'm no longer getting exceptions on the server, but the file is still
>>> not uploaded.
>>> a file with the name is created, and 201 "Created" is printed on the
>>> server, but there is no content, the size is 0 kb.
>>>
>>> Files smaller then 2 GB are copied normal.
>>>
>>> >-----Original Message-----
>>> >From: Oliver Zeigermann [mailto:[EMAIL PROTECTED]
>>>
>>> >Sent: Wednesday, January 26, 2005 2:40 PM
>>> >To: Slide Developers Mailing List
>>> >Subject: Re: file size limitation in slide 2.1 final
>>> >
>>> >
>>> >Agreed. However, I have just committed a fix that should allow you to
>>> >store files of any size. The stream is streamed to a file first and
>>> >the amount of bytes copied now correctly is stored into a long instead
>>> >of an int.
>>> >
>>> >You will need to have
>>> >
>>> > <parameter name="repeat-upon-conflict">true</parameter>
>>> >
>>> >in your configuration section which is the case in the default Domain.xml.
>>> >
>>> >Please try it, maybe it helps.
>>> >
>>> >Oliver
>>> >
>>> >On Wed, 26 Jan 2005 13:07:47 +0100, Sven Pfeiffer
>>> ><[EMAIL PROTECTED]> wrote:
>>> >> if I am right, I am in trouble.
>>> >>
>>> >> I just tried to find out where the problem was and found that the size
>>> >> of the file is read from
>>> >> javax.servlet.http.HttpServletRequests getContentLength()-Method which
>>> >> returns an int.
>>> >>
>>> >> and if the file is larger then 2 GB the maximum capacity of int is
>>> >> exceeded and so it is -xyz.
>>> >>
>>> >> that would explain why it seemed to work with the 4GB-file because then
>>> >> we are back in the positiv range and so it
>>> >stores the file.
>>> >>
>>> >> What do you think?
>>> >> Am I right with this?
>>> >>
>>> >> Thanks in advance
>>> >>
>>> >> >-----Original Message-----
>>> >> >From: Oliver Zeigermann [mailto:[EMAIL PROTECTED]
>>> >>
>>> >> >Sent: Wednesday, January 26, 2005 9:04 AM
>>> >> >To: Slide Developers Mailing List
>>> >> >Subject: Re: file size limitation in slide 2.1 final
>>> >> >
>>> >> >
>>> >> >Does a file that is a bit smaller than 2 GB work? If so maybe there
>>> >> >are places inside the Slide code that use integers which can only
>>> >> >represent up to 2 GB...
>>> >> >
>>> >> >Oliver
>>> >> >
>>> >> >
>>> >> >On Wed, 26 Jan 2005 08:59:05 +0100, Sven Pfeiffer
>>> >> ><[EMAIL PROTECTED]> wrote:
>>> >> >> Hello again,
>>> >> >>
>>> >> >> I just tried it again.
>>> >> >>
>>> >> >> This time I build Slide myself, from Slide head, just downloaded the
>>> >> >> sources yesterday.
>>> >> >>
>>> >> >> Again I tried to put a large file (>4 GB), I am getting
>>> >> >>
>>> >> >> TP-Processor3, 26-Jan-2005 08:30:04, sep, PUT, 204 "No
>>> >> >> Content", 87703 ms, /files/public/1suse.iso
>>> >> >>
>>> >> >> and the file is created, but it has just 287 MB.
>>> >> >>
>>> >> >> When trying to put a smaller file (780 MB) everything works fine.
>>> >> >>
>>> >> >> I can't imaging this has something to do with a limitation of the
>>> >> >> filesystem, because afaik the maximum filesize of NTFS
>>> >> >is about 16
>>> >> >> EB or so.
>>> >> >>
>>> >> >> I tried it running slide on Windows 2000, inside a JBoss/Tomcat using
>>> >> >> the
>org.apache.slide.store.txfile.TxFileContentStore.
>>> >> >>
>>> >> >> And I put the file on it using WindowsXPs netfolders.
>>> >> >>
>>> >> >> Has anyone an idea why I can't upload larger files?
>>> >> >>
>>> >> >> thanks in advance
>>> >> >> SVen
>>> >> >>
>>> >> >> >-----Original Message-----
>>> >> >> >From: Oliver Zeigermann [mailto:[EMAIL PROTECTED]
>>> >> >>
>>> >> >> >Sent: Friday, January 07, 2005 3:21 PM
>>> >> >> >To: Sven Pfeiffer
>>> >> >> >Cc: Slide Developers Mailing List
>>> >> >> >Subject: Re: file size limitation in slide 2.1 final
>>> >> >> >
>>> >> >> >
>>> >> >> >OK, I just tried it with my installation (built from Slide head,
>>> >> >> >however) and I just copied a file more than 600MB long and it worked.
>>> >> >> >
>>> >> >> >What I have seen from the 2.1 sources is that when the client does
>>> >> >> >not
>>> >> >> >pass the content length, the whole file is buffered in memory to find
>>> >> >> >it out. This is different in the Slide head.
>>> >> >> >
>>> >> >> >I did my test with Windows web folders which correctly passes the
>>> >> >> >length anyway.
>>> >> >> >
>>> >> >> >Maybe this is somewhat related to your problem?
>>> >> >> >
>>> >> >> >Oliver
>>> >> >> >
>>> >> >> >On Fri, 7 Jan 2005 14:58:57 +0100, Sven Pfeiffer
>>> >> >> ><[EMAIL PROTECTED]> wrote:
>>> >> >> >> on the system from wich i upload the file the properties first say
>>> >> >> >> the original size (8,7 GB), after refresh it shows
>>> >> >> >the real size
>>> >> >> >> 561 MB which is also shown on the server.
>>> >> >> >>
>>> >> >> >> if i take a look at the work/content folder the filesize
>>> >> >> >> constantly increases until it reaches the 561 MB than
>it stops.
>>> >> >> >the client
>>> >> >> >> seems to continue copying for about 5 minutes.
>>> >> >> >>
>>> >> >> >> the system returns 201 (created)
>>> >> >> >>
>>> >> >> >> the server is running on a windows 2k computer, of course there is
>>> >> >> >> enough free disk space ;o)
>>> >> >> >>
>>> >> >> >> and i don't think that the filesystem (NTFS) has a problem with
>>> >> >> >> larger files.
>>> >> >> >>
>>> >> >> >> i think it is to aovid the OutOfMemoryError that I received in the
>>> >> >> >> earlier version of slide, but I am not sure.
>>> >> >> >>
>>> >> >> >> thank you for your support
>>> >> >> >>
>>> >> >> >> SVen
>>> >> >> >>
>>> >> >> >> >-----Original Message-----
>>> >> >> >> >From: Oliver Zeigermann [mailto:[EMAIL PROTECTED]
>>> >> >> >> >Sent: Friday, January 07, 2005 2:50 PM
>>> >> >> >> >To: Sven Pfeiffer
>>> >> >> >> >Cc: Slide Developers Mailing List
>>> >> >> >> >Subject: Re: file size limitation in slide 2.1 final
>>> >> >> >> >
>>> >> >> >> >
>>> >> >> >> >What do the properties say? The original size? Does your file
>>> >> >> >> >system
>>> >> >> >> >support larger files?
>>> >> >> >> >
>>> >> >> >> >Oliver
>>> >> >> >> >
>>> >> >> >> >
>>> >> >> >> >On Fri, 7 Jan 2005 14:42:14 +0100, Sven Pfeiffer
>>> >> >> >> ><[EMAIL PROTECTED]> wrote:
>>> >> >> >> >> TxFileContentStore
>>> >> >> >> >>
>>> >> >> >> >>
>>> >> >> >> >> >-----Original Message-----
>>> >> >> >> >> >From: Oliver Zeigermann [mailto:[EMAIL PROTECTED]
>>> >> >> >> >> >Sent: Friday, January 07, 2005 2:37 PM
>>> >> >> >> >> >To: Slide Developers Mailing List
>>> >> >> >> >> >Subject: Re: file size limitation in slide 2.1 final
>>> >> >> >> >> >
>>> >> >> >> >> >
>>> >> >> >> >> >Which store?
>>> >> >> >> >> >
>>> >> >> >> >> >Oliver
>>> >> >> >> >> >
>>> >> >> >> >> >
>>> >> >> >> >> >On Fri, 7 Jan 2005 14:33:40 +0100, Sven Pfeiffer
>>> >> >> >> >> ><[EMAIL PROTECTED]> wrote:
>>> >> >> >> >> >> Hi List
>>> >> >> >> >> >>
>>> >> >> >> >> >> there seems to be a limitation of the file site in slide 2.1
>>> >> >> >> >> >> final.
>>> >> >> >> >> >>
>>> >> >> >> >> >> no matter how large the files are, if they are larger than
>>> >> >> >> >> >> round about 561 MB and if I want to store larger files
>>> >> >> >> >they are simply
>>> >> >> >> >> >> cut.
>>> >> >> >> >> >>
>>> >> >> >> >> >> Is there a way to avoid this?
>>> >> >> >> >> >>
>>> >> >> >> >> >> thanks in advance
>>> >> >> >> >> >>
>>> >> >> >> >> >> SVen
>>> >> >> >> >> >>
>>> >> >> >> >> >> ---------------------------------------------------------------------
>>> >> >> >> >> >> To unsubscribe, e-mail: [EMAIL PROTECTED]
>>> >> >> >> >> >> For additional commands, e-mail: [EMAIL PROTECTED]
>>> >> >> >> >> >>
>>> >> >> >> >> >>
>>> >> >> >> >> >
>>> >> >> >> >> >---------------------------------------------------------------------
>>> >> >> >> >> >To unsubscribe, e-mail: [EMAIL PROTECTED]
>>> >> >> >> >> >For additional commands, e-mail: [EMAIL PROTECTED]
>>> >> >> >> >> >
>>> >> >> >> >>
>>> >> >> >> >>
>>> >> >> >>
>>> >> >> >>
>>> >> >> >
>>> >> >> >---------------------------------------------------------------------
>>> >> >> >To unsubscribe, e-mail: [EMAIL PROTECTED]
>>> >> >> >For additional commands, e-mail: [EMAIL PROTECTED]
>>> >> >> >
>>> >> >>
>>> >> >> ---------------------------------------------------------------------
>>> >> >> To unsubscribe, e-mail: [EMAIL PROTECTED]
>>> >> >> For additional commands, e-mail: [EMAIL PROTECTED]
>>> >> >>
>>> >> >>
>>> >> >
>>> >> >---------------------------------------------------------------------
>>> >> >To unsubscribe, e-mail: [EMAIL PROTECTED]
>>> >> >For additional commands, e-mail: [EMAIL PROTECTED]
>>> >> >
>>> >>
>>> >> ---------------------------------------------------------------------
>>> >> To unsubscribe, e-mail: [EMAIL PROTECTED]
>>> >> For additional commands, e-mail: [EMAIL PROTECTED]
>>> >>
>>> >>
>>> >
>>> >---------------------------------------------------------------------
>>> >To unsubscribe, e-mail: [EMAIL PROTECTED]
>>> >For additional commands, e-mail: [EMAIL PROTECTED]
>>> >
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: [EMAIL PROTECTED]
>>> For additional commands, e-mail: [EMAIL PROTECTED]
>>>
>>>
>>
>>---------------------------------------------------------------------
>>To unsubscribe, e-mail: [EMAIL PROTECTED]
>>For additional commands, e-mail: [EMAIL PROTECTED]
>>
>
>
>---------------------------------------------------------------------
>To unsubscribe, e-mail: [EMAIL PROTECTED]
>For additional commands, e-mail: [EMAIL PROTECTED]
>
---------------------------------------------------------------------
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]
