The error is coming from Fedora's API-A SOAP implementation when it catches an OutOfMemoryError. The datastream is too large to be delivered via SOAP[1], but if it's retrieved via REST it should be fine.
- Chris [1] The GSoC project that Jiri Kremser worked on should help with this in the future (hopefully in Fedora 3.6) by enabling MTOM in Fedora's SOAP endpoints, where appropriate. But currently the SOAP APIs are memory bound (and have been for a while). On Wed, Sep 7, 2011 at 6:32 AM, Pablo Casas <pca...@ateneubcn.org> wrote: > Hello again. > > Thanks for answering. > > I am sorry for my leak of information. I was trying to reproduce the error > again. > > There are more details: > About your questions... > 1) We think the error is produced by Gsearch when trying to retrieve, via > SOAP, the datastreams with uploaded files for indexing. > 2) Yes, the type of datastream is Managed Content. > 3) Here is the only error we receive: > > <Unkown error > location>dk.defxws.fedoragsearch.server.errors.GenericSearchException: > java.lang.Exception: The datastream you are attempting to retrieve is too > large to transfer via getDatastreamDissemination (as determined by the server > memory allocation.) Consider retrieving this datastream via REST at: > http://localhost:9080/fedora/get/video:1/VideoHR: java.lang.Exception: The > datastream you are attempting to retrieve is too large to transfer via > getDatastreamDissemination (as determined by the server memory allocation.) > Consider retrieving this datastream via REST at: > http://localhost:9080/fedora/get/video:1/VideoHR > > > Let me know if you need more info. > > > Greetings, > > Pablo Casas > pca...@ateneubcn.org > http://biblioteca.ateneubcn.cat > Sistemes d'informació i tecnologia > Ateneu Barcelonès > Canuda, 6 · 08002 Barcelona > Tel. 93 343 61 20 · Fax 93 317 15 25 > > > > -----Mensaje original----- > De: Edwin Shin [mailto:ed...@fedora-commons.org] > Enviado el: lunes, 29 de agosto de 2011 12:59 > Para: fedora-commons-developers@lists.sourceforge.net > Asunto: Re: [fcrepo-dev] Uploading large media files > > Pablo, > > Short answer is yes, Fedora can store and manage large files. > > However, there have been bugs such as > https://jira.duraspace.org/browse/FCREPO-704 which caused errors for > uploading larger files. > > Can you provide some more detail, e.g.: > 1) Are you seeing the error with the SOAP or REST API, or both? > 2) I assume you're adding datastreams of type M (managed)? > 3) the error/stacktrace you're receiving > > FYI, adding large datastream content is made considerably more practical as > of Fedora 3.3, see: https://jira.duraspace.org/browse/FCREPO-453. > > -Eddie > > On 29 Aug 2011, at 10:57 AM, Pablo Casas wrote: > >> Hello everybody. >> >> We are using Fedora 3.2.1 under our own web, and using Tomcat 5.5. We can >> upload light media files (less than 200MB) to Fedora, but when we try to >> upload large file (4GB above) Fedora returns an error in datastream. Our >> question is: is Fedora able to store and manage high-weight media files? I >> have read that files may not be checksummed, but this is not a problem for >> now. We only want to know if it is possible to upload these large files into >> our Fedora. >> >> Thanks a lot. >> Best regards, >> >> <image001.gif> >> >> Pablo Casas >> pca...@ateneubcn.org >> http://biblioteca.ateneubcn.cat >> Sistemes d'informació i tecnologia >> Ateneu Barcelonès >> Canuda, 6 · 08002 Barcelona >> Tel. 93 343 61 20 · Fax 93 317 15 25 >> >> Seguiu-nos a les xarxes socials: >> >> <image002.jpg><image003.jpg><image004.jpg><image005.jpg><image006.jpg> >> >> >> ------------------------------------------------------------------------------ >> EMC VNX: the world's simplest storage, starting under $10K >> The only unified storage solution that offers unified management >> Up to 160% more powerful than alternatives and 25% more efficient. >> Guaranteed. >> http://p.sf.net/sfu/emc-vnx-dev2dev_______________________________________________ >> Fedora-commons-developers mailing list >> Fedora-commons-developers@lists.sourceforge.net >> https://lists.sourceforge.net/lists/listinfo/fedora-commons-developers > > > ------------------------------------------------------------------------------ > EMC VNX: the world's simplest storage, starting under $10K > The only unified storage solution that offers unified management > Up to 160% more powerful than alternatives and 25% more efficient. > Guaranteed. http://p.sf.net/sfu/emc-vnx-dev2dev > _______________________________________________ > Fedora-commons-developers mailing list > Fedora-commons-developers@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/fedora-commons-developers > > ------------------------------------------------------------------------------ > Using storage to extend the benefits of virtualization and iSCSI > Virtualization increases hardware utilization and delivers a new level of > agility. Learn what those decisions are and how to modernize your storage > and backup environments for virtualization. > http://www.accelacomm.com/jaw/sfnl/114/51434361/ > _______________________________________________ > Fedora-commons-developers mailing list > Fedora-commons-developers@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/fedora-commons-developers > ------------------------------------------------------------------------------ Doing More with Less: The Next Generation Virtual Desktop What are the key obstacles that have prevented many mid-market businesses from deploying virtual desktops? How do next-generation virtual desktops provide companies an easier-to-deploy, easier-to-manage and more affordable virtual desktop model.http://www.accelacomm.com/jaw/sfnl/114/51426474/ _______________________________________________ Fedora-commons-developers mailing list Fedora-commons-developers@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/fedora-commons-developers
