Micah Dubinko, Using Information Studio, I was loaded 83,000 *.xml files form a Directory with subdirectories into MarkLogic within 37 minutes.
Thanks, James Ragland Micah Dubinko wrote: > James, > > Since you are on 4.2, you should consider Information Studio as a > low-reisistance path to loading documents. > > Go to <your server>:8002 and click "+ New Flow", and follow the UI from > there. If you have all the files in a directory somewhere accessible to the > server, enter the full path in the prompt behind the "Configure" button then > click the large "Start Loading" button at the top. > > This will automatically handle breaking up the load into smaller > transactions, and has many other settings you might want to experiment with. > If anything goes wrong, it also does detailed error logging. > > Best wishes, > > -m > > > On Jul 29, 2010, at 6:56 AM, James Ragland wrote: > > >> I am running the ENTERPRISE EDITION (4.2-20100514) >> On the Database Configuration Page: I run the Load Program >> >> -James Ragland >> >> Lee, David wrote: >> >>> What program or process/commands are you using to load the files ? >>> The timeout means a single transaction took longer than the specified >>> timeout. >>> You can either increase the timeout (using the MarkLogic Admin Tool), >>> batch file loads into smaller transactions, >>> or use a tool which does such a batching (like RecordLoader, or the put >>> command in the MarkLogic extension to xmlsh) >>> >>> -David >>> >>> >>> >>> -----Original Message----- >>> From: [email protected] >>> [mailto:[email protected]] On Behalf Of James >>> Ragland >>> Sent: Thursday, July 29, 2010 8:15 AM >>> To: 'General Mark Logic Developer Discussion' >>> Subject: [MarkLogic Dev General] Database Bulk File Load ( Load Failed : >>> SVC-EXTIME: Time limit exceeded ) >>> >>> My Name is James Ragland and I am new to MarkLogic. >>> This is my first time creating and loading data into MarkLogic. >>> I need to know the basic to/for creating Marklogic Databases,Forests, >>> Triggers and ???. >>> >>> I tried to create and load 67,000 *.xml files into a database, and got >>> the above errors, can someone help me with this problem. >>> >>> Thanks, >>> James Ragland >>> Phone: 256-313-7419 >>> >>> _______________________________________________ >>> General mailing list >>> [email protected] >>> http://developer.marklogic.com/mailman/listinfo/general >>> _______________________________________________ >>> General mailing list >>> [email protected] >>> http://developer.marklogic.com/mailman/listinfo/general >>> >>> >> _______________________________________________ >> General mailing list >> [email protected] >> http://developer.marklogic.com/mailman/listinfo/general >> > > _______________________________________________ > General mailing list > [email protected] > http://developer.marklogic.com/mailman/listinfo/general > _______________________________________________ General mailing list [email protected] http://developer.marklogic.com/mailman/listinfo/general
