Andrew Woods, I cancelled by ongoing copy and tried a single pid list as you suggested and it says it completed successfully but I do not see the pid in the list. is there a way to see the real status of a cloud sync operation?
________________________________________ From: [email protected] [[email protected]] Sent: Wednesday, June 19, 2013 5:08 AM To: [email protected] Subject: Fedora-commons-users Digest, Vol 76, Issue 16 Send Fedora-commons-users mailing list submissions to [email protected] To subscribe or unsubscribe via the World Wide Web, visit https://lists.sourceforge.net/lists/listinfo/fedora-commons-users or, via email, send a message with subject or body 'help' to [email protected] You can reach the person managing the list at [email protected] When replying, please edit your Subject line so it is more specific than "Re: Contents of Fedora-commons-users digest..." Today's Topics: 1. Re: size limitation issue? (Jeff Minelli) 2. hi having problems with cloudsync (Bias, James) 3. Re: hi having problems with cloudsync (Andrew Woods) 4. Re: gsearch killing tomcat (Alistair Young) ---------------------------------------------------------------------- Message: 1 Date: Tue, 18 Jun 2013 14:43:48 -0400 From: Jeff Minelli <[email protected]> Subject: Re: [fcrepo-user] size limitation issue? To: "Support and info exchange list for Fedora users." <[email protected]> Message-ID: <[email protected]> Content-Type: text/plain; charset=windows-1252 Offline Eddie also suggested using fedora/upload. Problem is (or I believe it to be a problem) that hydra uses rubydora, and if I am correct (I have no doubts I could be wrong here, I did a cursory check of the gem), rubydora uses the same datastream REST method. If so this will cause some pain hydra side.. If I ever get some spare time, I will attempt tests via upload and on 3.6+ for completeness. Thanks, -jeff On Jun 14, 2013, at 3:38 PM, Benjamin Armintor <[email protected]> wrote: > Jeff- > > Embarrassingly, I'm still trying to put together an optional test in the > fcrepo 3 test suite that tries your request. I'll get back to you about > that, but in the meantime it appears to be the case that POSTing to > fedora/upload works, so you could use the location that's returned as the > dsLocation in a two-step process. > > - Ben > > > On Thu, Jun 13, 2013 at 10:47 AM, Jeff Minelli <[email protected]> wrote: > Output attached for a second test: > curl -H "Content-type:application/octet-stream" -vv -X POST -u > "myname:mypassword" --data-binary "@3g.data" > http://ss1test:8080/SStest2Fedora/objects/scholarsphere:5425k9692/datastreams/blah?controlGroup=M > > It fails in a similar way. > > -jeff > > On Jun 13, 2013, at 10:25 AM, Benjamin Armintor <[email protected]> wrote: > > > Jeff- > > > > Are you doing a multipart upload? If yes, can you try posting the file as > > the body of the request? I know that's not ideal, but it will test my > > hypothesis. > > > > > > On Thu, Jun 13, 2013 at 9:11 AM, Jeff Minelli <[email protected]> wrote: > > Attached are two files, the curl with errors, and the relevant part of > > fedora.log. > > > > Being desperate, I even tried to blame tomcat myself. :) I've toyed with > > maxPostSize, both using 0 and 4294967296. I even tried the web.xml config > > offered in > > http://tomcat.markmail.org/thread/6jxxcfg2s6rigl6w#query:+page:1+mid:e2l7wd7xhqiwwlpn+state:results > > to no success. > > > > -jeff > > > > On Jun 13, 2013, at 8:45 AM, Benjamin Armintor <[email protected]> wrote: > > > > > It's possible this is a bug in FCRepo- I'd need to see more of the > > > stacktrace, but we've seen issues like this before > > > (https://jira.duraspace.org/browse/FCREPO-704). You should also check the > > > limits on the maxPostSize in your tomcat configuration, though I would > > > expect a different error if that was the problem. > > > > > > > > > On Wed, Jun 12, 2013 at 2:43 PM, Jeff Minelli <[email protected]> wrote: > > > I have a version of fedora 3.5 running that errors with > > > > > > javax.ws.rs.WebApplicationException: > > > org.fcrepo.server.errors.StreamWriteException: Error writing temp stream > > > at > > > org.fcrepo.server.rest.BaseRestResource.handleException(BaseRestResource.java:172) > > > at > > > org.fcrepo.server.rest.DatastreamResource.addOrUpdateDatastream(DatastreamResource.java:583) > > > ? > > > > > > when I write a file 2GB in size (1024*1024*2048) via the API: > > > curl -H "Content-type:application/octet-stream" -X POST -u > > > "name:pass" --upload-file 3g.data \ > > > > > > http://host:8080/fedora/objects/scholarsphere:5425k9692/datastreams/blah?controlGroup=M > > > > > > But when I write a 2GB-1MB file (1024*1024*2047) via the API, it works > > > without issue. > > > > > > Any ideas? > > > > > > Thanks, > > > > > > -jeff > > > > > > ------------------------------------------------------------------------------ > This SF.net email is sponsored by Windows: > > Build for Windows Store. > > http://p.sf.net/sfu/windows-dev2dev > _______________________________________________ > Fedora-commons-users mailing list > [email protected] > https://lists.sourceforge.net/lists/listinfo/fedora-commons-users > > > ------------------------------------------------------------------------------ > This SF.net email is sponsored by Windows: > > Build for Windows Store. > > http://p.sf.net/sfu/windows-dev2dev_______________________________________________ > Fedora-commons-users mailing list > [email protected] > https://lists.sourceforge.net/lists/listinfo/fedora-commons-users ------------------------------ Message: 2 Date: Tue, 18 Jun 2013 21:27:41 +0000 From: "Bias, James" <[email protected]> Subject: [fcrepo-user] hi having problems with cloudsync To: "[email protected]" <[email protected]>, "Koeser, Rebecca Sutton" <[email protected]>, "Mitchell, Michael" <[email protected]> Message-ID: <75967481fe40c7458d967b1e2422a5b5678a4...@e14mbx22n.enterprise.emory.net> Content-Type: text/plain; charset="us-ascii" anyone ever use it to transfer from a legacy fs to akubra-fs? it seems like its working but I dont get anything useful in the logs and it just seems to sit there. I am monitoring network traffic on the box that has cloudsync and the copy of fedora I am copying too and it just seems to be sitting there. The new copy of fedora has pretty much all auth turned off except the admin in fedora-users.xml. I also turned off messaging. I am just trying to eliminate all possible problems. Both copies of fedora are 3.4.2, sorry cant upgrade just yet. Currently I have it running but its almost 5TB of data so I expect a high lead up time before the actual copy/conversion takes place. Is this correct or should I see files start to copy right away, what should I expect to see in the logs? Any ideas how long 5TB will take? Anyone else do anything else similar? ________________________________ This e-mail message (including any attachments) is for the sole use of the intended recipient(s) and may contain confidential and privileged information. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution or copying of this message (including any attachments) is strictly prohibited. If you have received this message in error, please contact the sender by reply e-mail message and destroy all copies of the original message (including attachments). ------------------------------ Message: 3 Date: Tue, 18 Jun 2013 18:07:04 -0400 From: Andrew Woods <[email protected]> Subject: Re: [fcrepo-user] hi having problems with cloudsync To: "Support and info exchange list for Fedora users." <[email protected]> Cc: "Mitchell, Michael" <[email protected]> Message-ID: <CADz=0UkFap=oop0wlg7kkxkqrkdd7p8iggkfmu71s+alper...@mail.gmail.com> Content-Type: text/plain; charset="iso-8859-1" Hello James, Have you tried to sanity test the setup by creating a task that copies a PID List set containing a single PID? Andrew On Tue, Jun 18, 2013 at 5:27 PM, Bias, James <[email protected]> wrote: > anyone ever use it to transfer from a legacy fs to akubra-fs? > it seems like its working but I dont get anything useful in the logs and > it just seems to sit there. > > I am monitoring network traffic on the box that has cloudsync and the copy > of fedora I am copying too and it just seems to be sitting there. > > The new copy of fedora has pretty much all auth turned off except the > admin in fedora-users.xml. > I also turned off messaging. > I am just trying to eliminate all possible problems. > > Both copies of fedora are 3.4.2, sorry cant upgrade just yet. > > Currently I have it running but its almost 5TB of data so I expect a high > lead up time before the actual copy/conversion takes place. > > Is this correct or should I see files start to copy right away, what > should I expect to see in the logs? > > Any ideas how long 5TB will take? > Anyone else do anything else similar? > > ________________________________ > > This e-mail message (including any attachments) is for the sole use of > the intended recipient(s) and may contain confidential and privileged > information. If the reader of this message is not the intended > recipient, you are hereby notified that any dissemination, distribution > or copying of this message (including any attachments) is strictly > prohibited. > > If you have received this message in error, please contact > the sender by reply e-mail message and destroy all copies of the > original message (including attachments). > > > ------------------------------------------------------------------------------ > This SF.net email is sponsored by Windows: > > Build for Windows Store. > > http://p.sf.net/sfu/windows-dev2dev > _______________________________________________ > Fedora-commons-users mailing list > [email protected] > https://lists.sourceforge.net/lists/listinfo/fedora-commons-users > -------------- next part -------------- An HTML attachment was scrubbed... ------------------------------ Message: 4 Date: Wed, 19 Jun 2013 09:08:22 +0000 From: Alistair Young <[email protected]> Subject: Re: [fcrepo-user] gsearch killing tomcat To: Support and info exchange list for Fedora users. <[email protected]> Message-ID: <cde73303.36eb%[email protected]> Content-Type: text/plain; charset="us-ascii" there is no fedoragsearch.log that I can find and no errors in the tomcat logs. It just does a lot of indexing then kills tomcat. Alistair -- mov eax,1 mov ebx,0 int 80h From: Gert Schmeltz Pedersen <[email protected]<mailto:[email protected]>> Reply-To: "Support and info exchange list for Fedora users." <[email protected]<mailto:[email protected]>> Date: Friday, 14 June 2013 09:42 To: "Support and info exchange list for Fedora users." <[email protected]<mailto:[email protected]>> Subject: Re: [fcrepo-user] gsearch killing tomcat Could you please find the log lines in fedoragsearch.log before and including the lines, where the offending fedora object gets indexed. Please show these lines. Gert On 13/06/2013, at 17.03, Alistair Young wrote: Perhaps this is how it works but if I index the entire repo, it gets so far then kills tomcat. Ingesting objects into fedora always cause this solr error: Jun 13, 2013 2:57:39 PM org.apache.solr.update.processor.LogUpdateProcessor finish INFO: [collection1] webapp=/solr path=/update params={} {} 0 275 Jun 13, 2013 2:57:39 PM org.apache.solr.common.SolrException log SEVERE: org.apache.solr.common.SolrException: Illegal character (NULL, unicode 0) encountered: not valid in any content at [row,col {unknown-source}]: [159,39] and the index is never optimised or current. Have to go into the solr admin and do it manually. Is there something I must be doing wrong? thanks, Alistair -- mov eax,1 mov ebx,0 int 80h ------------------------------------------------------------------------------ This SF.net<http://SF.net> email is sponsored by Windows: Build for Windows Store. http://p.sf.net/sfu/windows-dev2dev_______________________________________________ Fedora-commons-users mailing list [email protected]<mailto:[email protected]> https://lists.sourceforge.net/lists/listinfo/fedora-commons-users -------------- next part -------------- An HTML attachment was scrubbed... ------------------------------ ------------------------------------------------------------------------------ This SF.net email is sponsored by Windows: Build for Windows Store. http://p.sf.net/sfu/windows-dev2dev ------------------------------ _______________________________________________ Fedora-commons-users mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/fedora-commons-users End of Fedora-commons-users Digest, Vol 76, Issue 16 **************************************************** ------------------------------------------------------------------------------ This SF.net email is sponsored by Windows: Build for Windows Store. http://p.sf.net/sfu/windows-dev2dev _______________________________________________ Fedora-commons-users mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/fedora-commons-users
