You should only need hadoop configured if you use the hadoop (HDFS) mode for mlcp. Something else is amis. I don't know the details of mlcp engough to be more help, sorry. Now that its morning in the pacific maybe someone else can help.
----------------------------------------------------------------------------- David Lee Lead Engineer MarkLogic Corporation [email protected] Phone: +1 812-482-5224 Cell: +1 812-630-7622 www.marklogic.com<http://www.marklogic.com/> From: [email protected] [mailto:[email protected]] On Behalf Of sini narayanan Sent: Monday, November 19, 2012 10:21 AM To: MarkLogic Developer Discussion Subject: Re: [MarkLogic Dev General] Content Pump and Schema validation Hi David, Is it required that Hadoop is installed on my Unix server to use mlcp. Please help. Thanks, Ini On Mon, Nov 19, 2012 at 3:50 PM, sini narayanan <[email protected]<mailto:[email protected]>> wrote: The command that i tried is : mlcp.sh import -host abc.def.ghi-jkl.com<http://abc.def.ghi-jkl.com> -port 8005 -username admin -password admin -input_file_path /tmp/test -document_type xml -mode local On Mon, Nov 19, 2012 at 3:47 PM, sini narayanan <[email protected]<mailto:[email protected]>> wrote: It didnot show any error 12/11/19 15:41:06 INFO contentpump.LocalJobRunner: Content type: XML 12/11/19 15:41:06 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId= 12/11/19 15:41:06 INFO input.FileInputFormat: Total input paths to process : 1 12/11/19 15:41:06 INFO contentpump.LocalJobRunner: completed 0% 12/11/19 15:41:06 INFO contentpump.LocalJobRunner: Total execution time: 0 sec On Mon, Nov 19, 2012 at 3:46 PM, David Lee <[email protected]<mailto:[email protected]>> wrote: Do you get any other errors ? ----------------------------------------------------------------------------- David Lee Lead Engineer MarkLogic Corporation [email protected]<mailto:[email protected]> Phone: +1 812-482-5224<tel:%2B1%20812-482-5224> Cell: +1 812-630-7622<tel:%2B1%20812-630-7622> www.marklogic.com<http://www.marklogic.com/> From: [email protected]<mailto:[email protected]> [mailto:[email protected]<mailto:[email protected]>] On Behalf Of sini narayanan Sent: Monday, November 19, 2012 9:44 AM To: MarkLogic Developer Discussion Subject: Re: [MarkLogic Dev General] Content Pump and Schema validation Hi David, The authentication error is resolved. It was due to the special character that the password contained. I changed the password and the error is resolved. But even now, the files are not loaded into the database. Thanks, Sini On Mon, Nov 19, 2012 at 3:17 PM, David Lee <[email protected]<mailto:[email protected]>> wrote: Have you created a user called "user" with a password "pswd" and given it the appropriate permissions ? Alternatively you could substitute the username and password with an existing user. ----------------------------------------------------------------------------- David Lee Lead Engineer MarkLogic Corporation [email protected]<mailto:[email protected]> Phone: +1 812-482-5224<tel:%2B1%20812-482-5224> Cell: +1 812-630-7622<tel:%2B1%20812-630-7622> www.marklogic.com<http://www.marklogic.com/> From: [email protected]<mailto:[email protected]> [mailto:[email protected]<mailto:[email protected]>] On Behalf Of sini narayanan Sent: Monday, November 19, 2012 9:11 AM To: MarkLogic Developer Discussion Subject: Re: [MarkLogic Dev General] Content Pump and Schema validation Hi, I was trying to import files to MarkLogic database using content pump. I have a database created and also and XDBC created for the DB, with port 8005. But when i try to execute the below command, mlcp.sh import -host host-name.com<https://xnet.infosys.com/owa/redir.aspx?C=564c6883a7bd4049b5897b30f7cb98c6&URL=http%3a%2f%2fhost-name.com> -port 8005 -username user -password pswd -input_file_path /tmp/Development -mode local It is giving some exception : ERROR contentpump.LocalJobRunner: java.io.IOException: com.marklogic.xcc.exceptions.RequestPermissionException: Authorization failed for user 'user'. Please help. Thanks, Sini On Mon, Nov 12, 2012 at 7:41 PM, David Lee <[email protected]<mailto:[email protected]>> wrote: Another avenue ... Is mclp a requirement or an artifact ? You might consider xmlsh with the marklogic extensions http://www.xmlsh.org/ModuleMarkLogic You can validate documents against xsd/dtd/rng in a pipeline before they are sent to ML ----------------------------------------------------------------------------- David Lee Lead Engineer MarkLogic Corporation [email protected]<mailto:[email protected]> Phone: +1 812-482-5224<tel:%2B1%20812-482-5224> Cell: +1 812-630-7622<tel:%2B1%20812-630-7622> www.marklogic.com<http://www.marklogic.com> -----Original Message----- From: [email protected]<mailto:[email protected]> [mailto:[email protected]<mailto:[email protected]>] On Behalf Of Michael Blakeley Sent: Monday, November 12, 2012 1:24 PM To: MarkLogic Developer Discussion Subject: Re: [MarkLogic Dev General] Content Pump and Schema validation I don't see anything relevant at http://docs.marklogic.com/guide/ingestion/content-pump - but mlcp is designed to work with hadoop. Possibly you could validate the XML in hadoop tasks? Also mlcp is open-source, so you could always patch it to do what you want. RecordLoader would do this using a CONTENT_MODULE_URI written in XQuery, and invoked via XCC or HTTP requests. See http://marklogic.github.com/recordloader/ for details. Since we know from your other email that you are thinking of using CPF, you might also consider using the CPF validation pipeline. -- Mike On 12 Nov 2012, at 01:39 , sini narayanan <[email protected]<mailto:[email protected]>> wrote: > Hi, > > I have a requirement where I need to use content pump to load the files into > the MarkLogic DB. While loading contents, I need to make sure that the input > xml file conforms to the schema. Is it possible to perform a strict schema > validation on the xml files, while inserting them through content pump? > > Please help... > > > > Thanks, > > Sini > > _______________________________________________ > General mailing list > [email protected]<mailto:[email protected]> > http://developer.marklogic.com/mailman/listinfo/general _______________________________________________ General mailing list [email protected]<mailto:[email protected]> http://developer.marklogic.com/mailman/listinfo/general _______________________________________________ General mailing list [email protected]<mailto:[email protected]> http://developer.marklogic.com/mailman/listinfo/general _______________________________________________ General mailing list [email protected]<mailto:[email protected]> http://developer.marklogic.com/mailman/listinfo/general _______________________________________________ General mailing list [email protected]<mailto:[email protected]> http://developer.marklogic.com/mailman/listinfo/general
_______________________________________________ General mailing list [email protected] http://developer.marklogic.com/mailman/listinfo/general
