Hi, I've recently used xqsync to back up some 500K small files on a dev machine and to restore them on the test server.
while the dump of the files caused no problems, trying to import them gave a number of intermittent "non-fatal" errors (see http://pastebin.com/m263dba50 for more) like this: WARNING: error in input package E:\data-000.zip Aug 6, 2009 4:43:00 PM com.marklogic.ps.SimpleLogger logException SEVERE: non-fatal java.util.concurrent.ExecutionException: com.marklogic.ps.xqsync.SyncException: com.marklogic.xcc.exceptions.XQueryException: SVC-MEMALLOC: Memory allocation error: VirtualAlloc 134217728 bytes: Not enough storage is available to process this command. the commandline I used to import the files is this one (based on Michael Blakeley's very useful tutorial): java -cp "xqsync.jar;xcc.jar;xstream-1.3.1.jar;xpp3-1.1.4.jar" -Xmx1024m -DTHREADS=20 -Dfile.encoding=UTF-8 -DOUTPUT_CONNECTION_STRING=xcc://admin:x...@10.101.4.118:8088 -DINPUT_PACKAGE=E: com.marklogic.ps.xqsync.XQSync following the xqsync readme file, I chose a generous heapsize of 1Gb for 500K documents and increased the number of concurrent threads as the docs are small, about 1Kb in size. a big chunk of the error messages in context can be seen here: http://pastebin.com/m263dba50 what I'd like to know is whether these errors mean that some documents have not been imported, and what would the best strategy to make sure all documents are imported correctly? cheers, Jakob. _______________________________________________ General mailing list General@developer.marklogic.com http://xqzone.com/mailman/listinfo/general
