Michael, you will have to pass the jobId along with the -transform_param arguments, like below
-transform_param "entity=mainParty,flow=mainParty-InputFlow,flowType=input,jobId=<Insert random UUID/number>" Thanks, Pradeep ________________________________ From: general-boun...@developer.marklogic.com <general-boun...@developer.marklogic.com> on behalf of Michael Malgeri <michael.malg...@marklogic.com> Sent: Friday, June 30, 2017 10:36 PM To: MarkLogic Developer Discussion Subject: [MarkLogic Dev General] Data hub input flow error Hi, I’m running a data-hub Input flow The input file is only 7 lines of a csv file (Pipe delimited) including the header line, so just 6 data lines(see below my signature) The generated mlcp command is as follows: mlcp.sh import -host localhost -port 8010 -username admin -password admin -input_file_path /Users/mmalgeri/Documents/workspace/demos/marklogic-data-hub/ciscouserx/data/ciscodata -input_file_type "delimited_text" -output_collections "mainParty" -output_permissions "rest-reader,read,rest-writer,update" -output_uri_replace "/Users/mmalgeri/Documents/workspace/demos/marklogic-data-hub/ciscouserx/data/ciscodata,''" -document_type "xml" -input_file_pattern "mainParties.csv" -delimiter "|" -uri_id "org_party_id" -transform_module "/com.marklogic.hub/mlcp-flow-transform.xqy" -transform_namespace "http://marklogic.com/data-hub/mlcp-flow-transform"; -transform_param "entity=mainParty,flow=mainParty-InputFlow,flowType=input" -mode local Each row fails with “xs:string -- Invalid coercion: () as xs:string” as follows: 17/06/30 19:30:36 INFO contentpump.LocalJobRunner: Content type: XML 17/06/30 19:30:36 INFO contentpump.ContentPump: Job name: local_1426617768_1 17/06/30 19:30:36 INFO contentpump.FileAndDirectoryInputFormat: Total input paths to process : 1 17/06/30 19:30:37 ERROR mapreduce.ContentWriter: XDMP-AS: (err:XPTY0004) $job-id as xs:string -- Invalid coercion: () as xs:string 17/06/30 19:30:37 WARN mapreduce.ContentWriter: Failed document 80621 in file:/Users/mmalgeri/Documents/workspace/demos/marklogic-data-hub/ciscouserx/data/ciscodata/mainParties.csv at line 5 17/06/30 19:30:37 ERROR mapreduce.ContentWriter: XDMP-AS: (err:XPTY0004) $job-id as xs:string -- Invalid coercion: () as xs:string 17/06/30 19:30:37 WARN mapreduce.ContentWriter: Failed document 26695 in file:/Users/mmalgeri/Documents/workspace/demos/marklogic-data-hub/ciscouserx/data/ciscodata/mainParties.csv at line 3 17/06/30 19:30:37 ERROR mapreduce.ContentWriter: XDMP-AS: (err:XPTY0004) $job-id as xs:string -- Invalid coercion: () as xs:string 17/06/30 19:30:37 WARN mapreduce.ContentWriter: Failed document 45267 in file:/Users/mmalgeri/Documents/workspace/demos/marklogic-data-hub/ciscouserx/data/ciscodata/mainParties.csv at line 4 17/06/30 19:30:37 ERROR mapreduce.ContentWriter: XDMP-AS: (err:XPTY0004) $job-id as xs:string -- Invalid coercion: () as xs:string 17/06/30 19:30:37 WARN mapreduce.ContentWriter: Failed document 49981 in file:/Users/mmalgeri/Documents/workspace/demos/marklogic-data-hub/ciscouserx/data/ciscodata/mainParties.csv at line 2 17/06/30 19:30:37 INFO contentpump.LocalJobRunner: completed 100% 17/06/30 19:30:37 ERROR mapreduce.ContentWriter: XDMP-AS: (err:XPTY0004) $job-id as xs:string -- Invalid coercion: () as xs:string 17/06/30 19:30:37 WARN mapreduce.ContentWriter: Failed document 3977030 in file:/Users/mmalgeri/Documents/workspace/demos/marklogic-data-hub/ciscouserx/data/ciscodata/mainParties.csv at line 7 17/06/30 19:30:37 ERROR mapreduce.ContentWriter: XDMP-AS: (err:XPTY0004) $job-id as xs:string -- Invalid coercion: () as xs:string 17/06/30 19:30:37 WARN mapreduce.ContentWriter: Failed document 94813 in file:/Users/mmalgeri/Documents/workspace/demos/marklogic-data-hub/ciscouserx/data/ciscodata/mainParties.csv at line 6 17/06/30 19:30:37 INFO contentpump.LocalJobRunner: com.marklogic.mapreduce.MarkLogicCounter: 17/06/30 19:30:37 INFO contentpump.LocalJobRunner: INPUT_RECORDS: 6 17/06/30 19:30:37 INFO contentpump.LocalJobRunner: OUTPUT_RECORDS: 6 17/06/30 19:30:37 INFO contentpump.LocalJobRunner: OUTPUT_RECORDS_COMMITTED: 0 17/06/30 19:30:37 INFO contentpump.LocalJobRunner: OUTPUT_RECORDS_FAILED: 6 17/06/30 19:30:37 INFO contentpump.LocalJobRunner: Total execution time: 1 sec Any suggestions? Michael Malgeri Principal Technologist MarkLogic Corporation 310-704-6403 org_party_id|gu_party_id|hq_party_id|parent_party_id|last_transaction_dt|last_source_system|party_update_date|party_status_code|introduction_source_system|introduction_date|encoding_code|primary_name|secondary_name|cisco_competitor_role|partner_site_role|unregistered_party_flag|line_1_address|line_2_address|line_3_address|line_4_address|city_name|state_or_province_name|county_name|postal_code|iso_country_code|iso_country_name|postal_theatre|mktg_region|telephone_country_code|telephone_area_code|telephone_number|telephone_extension_number|duns_number|activity_indicator|annual_sales_indicator|annual_sales_local|annual_sales_usd|currency_code|employees_count|employees_here_ind|employees_total|employees_total_ind|hq_branch_code|imp_exp_agt_indicator|legal_status_code|line_of_business|govt_identification_number|govt_identification_system|family_sites_count|sic_code|sic_code2|sic_code3|sic_code4|sic_code5|sic_code6|sic_code8|sic_code8_desc|sic_desc|sic_rank|site_ceo|site_ceo_title|parent_subsidiary_code|year_established_date|principles_indicator|dnb_business_name_kanji|dnb_business_name_kana|out_of_business_flag|reason_code|vertical_market_top|vertical_market_sub|vertical_market_detail|vertical_market_sub_desc|vertical_market_detail_desc|vertical_market_top_desc|sales_channel_code|rep_account_type|rep_duns_number|rep_dnb_lob|rep_site_type|rep_site_group|rep_site_region|rep_num_sites|rep_national_id|rep_site_in_charge_name|rep_site_in_charge_title|rep_company_revenue|rep_company_url|rep_server_num|rep_owner_level|rep_primary_vertical|rep_secondary_vertical|rep_tertiary_vertical|rep_fourth_vertical|rep_pri_biz_1|rep_pri_biz_2|rep_pri_biz_3|rep_telephone_number|rep_num_telephone_ext|rep_num_employees|rep_num_pc|update_date|regional_mktg_business_segment|sfdc_account_id|named_account_flag|customer_market_segment|bdo_update_date 49981|49981|||2013-11-09 02:01:38.0|CUSTOMER_REGISTRY|2017-06-22 16:13:59.0|ACTIVE|MODS_SITES|2002-11-11 23:08:37.0|WE8ISO8859P1|ORACLE CORPORATION|||Y|N|500 ORACLE PKWY||||REDWOOD CITY|CA|SAN MATEO|94065|US|UNITED STATES|US AND CANADA|US AND CANADA|1|650|+1(650)506-7000||144709193||0|23252000000|37180000000|0020|120368|N|2300||HQ||LSC/3|PREPACKAGED SOFTWARE|||884|7372|7379|8243||||7372||Prepackaged software||LAWRENCE J ELLISON|CHIEF EXECUTIVE OFFICER|N|1977-11-01 00:00:00.0|Y|||||MFG|HI_TECH|HI_TECH|Hi-tech/Computers Manufacturing|Hi-tech/Computers Manufacturing|Manufacturing|END_CUSTOMER||||||||||||||||||||||||||2017-06-22 16:56:01.0|US ENTERPRISE|0018000001Dy8bcAAB|Y|ENT|2017-06-23 10:18:05.0 26695|26695|||2016-12-05 05:09:43.0|CUSTOMER_REGISTRY|2017-06-15 13:55:32.0|ACTIVE|MODS_SITES|2002-11-11 22:59:04.0|WE8ISO8859P1|WAL-MART STORES INC||||N|702 SW 8TH ST||||BENTONVILLE|AR|BENTON|72716|US|UNITED STATES|US AND CANADA|US AND CANADA|1|479|+1(479)273-4000||051957769||0|405607000000|469162000000|0020|2200000|N|11700||HQ||LSC/3|DEPARTMENT STORES|||7232|5311|5411|5399||||5311||Department stores||MICHAEL T DUKE|PRESIDENT|N||Y|||||RETAIL|RE_OT|RE_OT|Other (Retail)|Other (Retail)|Retail|END_CUSTOMER||||||||||||||||||||||||||2017-06-15 14:27:49.0||0013000000GBsqtAAD|Y|ENT|2017-06-23 10:18:06.0 45267|45267|||2017-05-18 06:23:40.0|CUSTOMER_REGISTRY|2017-05-19 03:11:28.0|ACTIVE|MODS_SITES|2002-11-11 22:52:32.0|WE8ISO8859P1|VERIZON COMMUNICATIONS INC|||Y|N|140 WEST ST||||NEW YORK|NY|NEW YORK|100072141|US|UNITED STATES|US AND CANADA|US AND CANADA|1|212|+1(212)395-1000||107212169||0|97354000000|115846000000|0020|183400|N|400||HQ||LSC/3|TELEPHONE COMMUNICATION, EXCEPT RADIO|||7048|4813|4812|4841||||4813||Telephone communication, except radio||LOWELL C MCADAM|CHAIRMAN OF THE BOARD|N||Y|||||SP|INC|INC|Incumbent|Incumbent|Service Provider|SP_CABLE||||||||||||||||||||||||||2017-05-19 03:40:31.0|GL SP - MOBILITY AND WEB|0018000000o9IsfAAE||SP|2017-06-23 10:18:06.0 80621|80621|||2017-05-17 18:02:14.0|CUSTOMER_REGISTRY|2017-05-19 03:11:29.0|ACTIVE|MODS_SITES|2002-11-12 00:29:24.0|WE8ISO8859P1|HSBC HOLDINGS PLC||||N|8 CANADA SQUARE||||LONDON|LONDON||E14 5HQ|UK|UNITED KINGDOM|EUROPEAN MARKETS|EUROPEAN MARKETS|||||288451024||0|83942000000|83942000000|0020|43000|Y|0||HQ||LSC/3|HOLDING COMPANIES, NEC, NSK|617987||8077|6719||||||6719||Holding companies, nec||DOUGLAS JARDINE FLINT||N|||||||FIN_SRV|BNK|BNK|Banking|Banking|Financial Services|END_CUSTOMER||||||||||||||||||||||||||2017-05-19 03:39:50.0||0013000000AlhNjAAJ||ENT|2017-06-23 10:18:06.0 94813|94813|||2017-05-15 16:43:02.0|CUSTOMER_REGISTRY|2017-05-17 03:05:05.0|ACTIVE|MODS_SITES|2002-11-12 00:03:27.0|WE8ISO8859P1|ALLIANZ SE||||N|KONIGINSTR. 28||||MUENCHEN|BAYERN|MUENCHEN|80802|DE|GERMANY|EUROPEAN MARKETS|EUROPEAN MARKETS|||8938000||320311889|060|2|0|0|5080|140000|Y|1345||HQ||LSC/3|HOLDING COMPANIES, NEC, NSK|80333B164232|00020|2028|6719|6321|6036|6726|6311||6719||Holding companies, nec||MICHAEL DIEKMANN|CHIEF EXECUTIVE OFFICER|N||N|||||FIN_SRV|INS|INS|Insurance|Insurance|Financial Services|END_CUSTOMER||||||||||||||||||||||||||2017-05-17 03:31:58.0||0018000000Yj8z7AAB||ENT|2017-06-23 10:18:08.0 3977030|3977030|||2017-05-12 16:45:05.0|CUSTOMER_REGISTRY|2017-05-15 03:08:08.0|ACTIVE|MODS_SITES|2002-11-12 15:24:44.0|WE8ISO8859P1|DAIMLER AG||||N|MERCEDESSTR. 137||||STUTTGART|BADEN-WUERTTEMBERG|STUTTGART|70327|DE|GERMANY|EUROPEAN MARKETS|EUROPEAN MARKETS|||711170||498999044||0|95873000000|145282916700|5080|275000|Y|0||HQ||LSC/3|MOTOR VEHICLE PARTS AND ACCESSORIES|70190B19360|00020|1386|3714|3711|3531||||3714||Motor vehicle parts and accessories||DIETER ZETSCHE|CHIEF EXECUTIVE OFFICER|N||N|||||||||||IVAR||||||||||||||||||||||||||2017-05-15 03:49:20.0||0013000000CYkcbAAD||ENT|2017-06-23 10:18:27.0
_______________________________________________ General mailing list General@developer.marklogic.com Manage your subscription at: http://developer.marklogic.com/mailman/listinfo/general
