Hi Nagaraj,
Looking at your other mails, it looks like you are currently investigating the option of scheduling mlcp using crontab. That should be a viable option. There are various alternatives to mlcp. Recordloader has been mentioned, xqsync could be useful, and also xmlsh is worth mentioning I think. You can probably find more here: http://developer.marklogic.com/code. All of the ones I mentioned run outside MarkLogic, and it should be possible to schedule them with crontab as well. Scheduled Tasks has also been mentioned. But that is used to run an XQuery from inside MarkLogic. It is a different approach. It is not difficult to write a bit of code that you can schedule with the Scheduled Tasks page; it just takes a main module within reach of MarkLogic. But there is existing code that can help with a jump start, and give a very robust basis as well. You could use the Information Studio interface to create a flow that takes a directory and loads it (preferably each file as one doc). Then you would only need a very small xquery module that takes the id of that flow, and call info:flow-start (http://docs.marklogic.com/info:flow-start). A scheduled task from within MarkLogic would prevent the need from something external to MarkLogic. Kind regards, Geert *Van:* [email protected] [mailto: [email protected]] *Namens *[email protected] *Verzonden:* donderdag 30 januari 2014 7:13 *Aan:* [email protected] *CC:* [email protected] *Onderwerp:* [MarkLogic Dev General] Pull xml files from hdfs to marklogic database in an automated way?.. *Dell - Internal Use - Confidential * Hi Team, We have xml files in hdfs (remote). And we need to load those files into marklogic database in an automated way. Is there any option to schedule this? Thanks and regards, [image: cid:[email protected]] *Nagaraj H M* Administrator - BIG DATA Business Innovation Services - BIDW Dell Services Mobile - +91 9980727542
<<image001.jpg>>
_______________________________________________ General mailing list [email protected] http://developer.marklogic.com/mailman/listinfo/general
