Thanks Shakila for pointing this out. We have updated the doc. [1]. https://docs.wso2.com/display/ESBCONNECTORS/Working+with+the+File+Connector#WorkingwiththeFileConnector-splitFile
Thanks, Keerthika. On Mon, Apr 2, 2018 at 5:57 PM, Shakila Sasikaran <[email protected]> wrote: > Hi, > > As per the doc, we have to provide either chunkSize or numberOfLines. The > provided sample request [1] consists of chunkSize along with the > xpathExpression. > > If we don't have to provide the chunkSize, shall we update the sample > request documentation? > > [1] https://docs.wso2.com/display/ESBCONNECTORS/Working+with > +the+File+Connector#WorkingwiththeFileConnector-splitFile > > Thanks > > On Mon, Apr 2, 2018 at 5:06 PM, Keerthika Mahendralingam < > [email protected]> wrote: > >> Hi Aditya, >> >> If you need to split the file based on the xpath expression, you don't >> need to provide the chunkSize. If you provide the chunkSize, files will be >> splitted in to files with the chunkSize. So could you please only pass >> xpath expression and check. >> >> Thanks, >> Keerthika. >> >> On Wed, Mar 28, 2018 at 10:49 AM, aditya shivankar < >> [email protected]> wrote: >> >>> Respected Madam/Sir, >>> >>> Using below proxy I am able to split the file . But splitting in not >>> done proper. >>> >>> Even though in the proxy configuration I have provided the structure >>> which needs to be maintained in each file , using Xpath Expression >>> "<property name="xpathExpression" scope="default" type="STRING" >>> value="//catalog/book"/>" >>> >>> Still file gets ended randomly without even maintaining the proper >>> structure.Like below >>> >>> </book> >>> <book id="bk102"> >>> <author>Ralls Kim</author> >>> <title>Midnight Rain</title> >>> <genre>Fantasy</genre> >>> <price>5.95</price> >>> <publish_date>2000-12 >>> >>> Attaching Input file(books1000.xml) and 2 files which are produced as >>> the result of the split (books1000.xml0 and books1000.xml1). >>> >>> Proxy which I am using is. >>> >>> <?xml version="1.0" encoding="UTF-8"?> >>> <proxy name="FileConnectorProxy" startOnLoad="true" transports="http >>> https" xmlns="http://ws.apache.org/ns/synapse";> >>> <target> >>> <inSequence> >>> <property name="destination" scope="default" type="STRING" >>> value="file:///C:/Flatfile/FileConnOutput"/> >>> <property name="source" scope="default" type="STRING" >>> value="file:///C:/Flatfile/FileConnInput/books1000.xml"/> >>> <property name="xpathExpression" scope="default" >>> type="STRING" value="//catalog/book"/> >>> <fileconnector.splitFile> >>> <source>{$ctx:source}</source> >>> <destination>{$ctx:destination}</destination> >>> <chunkSize>4096</chunkSize> >>> <xpathExpression>{$ctx:xpathEx >>> pression}</xpathExpression> >>> </fileconnector.splitFile> >>> <respond/> >>> </inSequence> >>> <outSequence/> >>> <faultSequence/> >>> </target> >>> </proxy> >>> >>> I am expecting each file to start with structure like below : >>> >>> <?xml version="1.0"?> >>> <catalog> >>> <book id="bk101"> >>> >>> and each file end with structure like below : >>> >>> </book> >>> </catalog> >>> >>> Please guide . >>> >>> >>> With Regards, >>> Aditya >>> >>> On Wed, Mar 28, 2018 at 9:25 AM, Chanika Geeganage <[email protected]> >>> wrote: >>> >>>> Hi Aditya, >>>> >>>> This proxy service will not poll files iteratively, like vfs transport. >>>> Have you invoked the proxy service to do the file operation (ie. split) >>>> over HTTP/HTTPS? >>>> >>>> Thanks >>>> >>>> On Wed, Mar 28, 2018 at 8:52 AM, Shakila Sasikaran <[email protected]> >>>> wrote: >>>> >>>>> Hi Aditya, >>>>> >>>>> Could you please attach the source file and the log file >>>>> (repository/logs/wso2carbon.log) for the investigation? >>>>> >>>>> Thanks >>>>> >>>>> On Tue, Mar 27, 2018 at 10:26 PM, aditya shivankar < >>>>> [email protected]> wrote: >>>>> >>>>>> Respected Madam/Sir, >>>>>> >>>>>> Pointed the source to the file " file:///C:/Flatfile/FileConnIn >>>>>> put/inputfor_writeToDb1.xml " . But still the file is not getting >>>>>> processed. Please guide. >>>>>> >>>>>> <?xml version="1.0" encoding="UTF-8"?> >>>>>> <proxy name="FileConnectorProxy" startOnLoad="true" transports="http >>>>>> https" xmlns="http://ws.apache.org/ns/synapse";> >>>>>> <target> >>>>>> <inSequence> >>>>>> <property name="destination" scope="default" >>>>>> type="STRING" value="file:///C:/Flatfile/FileConnOutput"/> >>>>>> <property name="source" scope="default" type="STRING" >>>>>> value="file:///C:/Flatfile/FileConnInput/inputfor_writeToDb1.xml"/> >>>>>> <property name="xpathExpression" scope="default" >>>>>> type="STRING" value="//catalog/book"/> >>>>>> <fileconnector.splitFile> >>>>>> <source>{$ctx:source}</source> >>>>>> <destination>{$ctx:destination}</destination> >>>>>> <chunkSize>4096</chunkSize> >>>>>> <xpathExpression>{$ctx:xpathEx >>>>>> pression}</xpathExpression> >>>>>> </fileconnector.splitFile> >>>>>> <respond/> >>>>>> </inSequence> >>>>>> <outSequence/> >>>>>> <faultSequence/> >>>>>> </target> >>>>>> </proxy> >>>>>> >>>>>> With Regards, >>>>>> Aditya >>>>>> >>>>>> >>>>>> On Mon, Mar 26, 2018 at 6:02 PM, Shakila Sasikaran <[email protected]> >>>>>> wrote: >>>>>> >>>>>>> Hi Aditya, >>>>>>> >>>>>>> Please point the file as the source. For example >>>>>>> *"source":"/home/vive/Desktop/file/outTest/sample.txt"*. >>>>>>> >>>>>>> Thanks >>>>>>> >>>>>>> On Mon, Mar 26, 2018 at 3:49 PM, aditya shivankar < >>>>>>> [email protected]> wrote: >>>>>>> >>>>>>>> Respected Madam/Sir, >>>>>>>> >>>>>>>> Changed the transport from 'vfs' to "http https". Still the proxy >>>>>>>> is not able to poll the file from source location. Please guide. >>>>>>>> I have placed a file at C:/Flatfile/FileConnInput . but it is >>>>>>>> not getting polled and not triggereing the flow. >>>>>>>> >>>>>>>> <?xml version="1.0" encoding="UTF-8"?> >>>>>>>> <proxy name="FileConnectorProxy" startOnLoad="true" >>>>>>>> transports="http https" xmlns="http://ws.apache.org/ns/synapse";> >>>>>>>> <target> >>>>>>>> <inSequence> >>>>>>>> <property name="destination" scope="default" >>>>>>>> type="STRING" value="file:///C:/Flatfile/ "/> >>>>>>>> <property name="source" scope="default" type="STRING" >>>>>>>> value="file:///C:/Flatfile/FileConnInput"/> >>>>>>>> <property name="xpathExpression" scope="default" >>>>>>>> type="STRING" value="//catalog/book"/> >>>>>>>> <fileconnector.splitFile> >>>>>>>> <source>{$ctx:source}</source> >>>>>>>> <destination>{$ctx:destination}</destination> >>>>>>>> <chunkSize>4096</chunkSize> >>>>>>>> <xpathExpression>{$ctx:xpathEx >>>>>>>> pression}</xpathExpression> >>>>>>>> </fileconnector.splitFile> >>>>>>>> <respond/> >>>>>>>> </inSequence> >>>>>>>> <outSequence/> >>>>>>>> <faultSequence/> >>>>>>>> </target> >>>>>>>> </proxy> >>>>>>>> >>>>>>>> With Regards, >>>>>>>> Aditya >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> On Mon, Mar 26, 2018 at 2:16 PM, Chanika Geeganage < >>>>>>>> [email protected]> wrote: >>>>>>>> >>>>>>>>> Hi Aditya, >>>>>>>>> >>>>>>>>> The error has come from VFSTransportListener as you have set the >>>>>>>>> transport as 'vfs', but there are no vfs endpoint configured. Since >>>>>>>>> you are >>>>>>>>> using file connector, you can use transports such as http/ https. A >>>>>>>>> sample >>>>>>>>> can be found from [1] >>>>>>>>> >>>>>>>>> [1] https://docs.wso2.com/display/ESBCONNECTORS/Working+with+the >>>>>>>>> +File+Connector#WorkingwiththeFileConnector-sampleconfigurat >>>>>>>>> ionSampleconfiguration >>>>>>>>> >>>>>>>>> Thanks >>>>>>>>> >>>>>>>>> On Mon, Mar 26, 2018 at 1:58 PM, aditya shivankar < >>>>>>>>> [email protected]> wrote: >>>>>>>>> >>>>>>>>>> Respected Sir, >>>>>>>>>> >>>>>>>>>> Please find the screenshot of Faulty proxy service in console. >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> With Regards, >>>>>>>>>> Aditya >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> On Mon, Mar 26, 2018 at 1:47 PM, aditya shivankar < >>>>>>>>>> [email protected]> wrote: >>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> Respected Sir, >>>>>>>>>>> >>>>>>>>>>> I am trying to split a file using file connector >>>>>>>>>>> >>>>>>>>>>> Below is my FileConnector Proxy : >>>>>>>>>>> >>>>>>>>>>> <?xml version="1.0" encoding="UTF-8"?> >>>>>>>>>>> <proxy name="FileConnectorProxy" startOnLoad="true" >>>>>>>>>>> transports="vfs" xmlns="http://ws.apache.org/ns/synapse";> >>>>>>>>>>> <target> >>>>>>>>>>> <inSequence> >>>>>>>>>>> <property name="destination" scope="default" >>>>>>>>>>> type="STRING" value="file:///C:/Flatfile/ "/> >>>>>>>>>>> <property name="source" scope="default" >>>>>>>>>>> type="STRING" value="file:///C:/Flatfile/FileConnInput"/> >>>>>>>>>>> <property name="xpathExpression" scope="default" >>>>>>>>>>> type="STRING" value="//catalog/book"/> >>>>>>>>>>> <fileconnector.splitFile> >>>>>>>>>>> <source>{$ctx:source}</source> >>>>>>>>>>> <destination>{$ctx:destination}</destination> >>>>>>>>>>> <chunkSize>4096</chunkSize> >>>>>>>>>>> <xpathExpression>{$ctx:xpathEx >>>>>>>>>>> pression}</xpathExpression> >>>>>>>>>>> </fileconnector.splitFile> >>>>>>>>>>> </inSequence> >>>>>>>>>>> <outSequence/> >>>>>>>>>>> <faultSequence/> >>>>>>>>>>> </target> >>>>>>>>>>> </proxy> >>>>>>>>>>> >>>>>>>>>>> I added the fileconnector following below link in wso2ei server. >>>>>>>>>>> https://docs.wso2.com/display/ESB490/Managing+Connectors+in+ >>>>>>>>>>> Your+ESB+Instance >>>>>>>>>>> >>>>>>>>>>> To add a connector: >>>>>>>>>>> On the Main tab in the ESB Management Console, under Connectors >>>>>>>>>>> click Add. >>>>>>>>>>> Click Browse, specify the ZIP file, and click Open. >>>>>>>>>>> Click Upload. >>>>>>>>>>> The connector will now appear in the Connectors list and is >>>>>>>>>>> ready to be enabled in your ESB instance. >>>>>>>>>>> >>>>>>>>>>> To enable a connector: >>>>>>>>>>> On the Main tab in the ESB Management Console, under Connectors >>>>>>>>>>> click List to view the uploaded connectors. >>>>>>>>>>> Click Enable next to a connector you want to enable, and then >>>>>>>>>>> confirm that you want to change its status. Repeat this step for >>>>>>>>>>> each >>>>>>>>>>> connector you want to enable. >>>>>>>>>>> >>>>>>>>>>> While deploying the application it is giving me the following >>>>>>>>>>> error. >>>>>>>>>>> >>>>>>>>>>> [2018-03-26 13:29:10,334] [EI-Core] ERROR - VFSTransportListener >>>>>>>>>>> Unable to stop service : FileConnectorProxy - unable to find the >>>>>>>>>>> corresponding protocol endpoint >>>>>>>>>>> >>>>>>>>>>> and the application gets deployed as the faulty application . >>>>>>>>>>> >>>>>>>>>>> [2018-03-26 13:29:10,533] [EI-Core] INFO - ApplicationManager >>>>>>>>>>> Successfully Deployed Carbon Application : >>>>>>>>>>> FileConnectorAppCompositeApplication_1.0.0 >>>>>>>>>>> {super-tenant} >>>>>>>>>>> >>>>>>>>>>> It is not able to pick the file from "FileConnInput" folder. >>>>>>>>>>> Please find attached error logs. >>>>>>>>>>> Please guide. >>>>>>>>>>> >>>>>>>>>>> With Regards, >>>>>>>>>>> Aditya >>>>>>>>>>> >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> _______________________________________________ >>>>>>>>>> Dev mailing list >>>>>>>>>> [email protected] >>>>>>>>>> http://wso2.org/cgi-bin/mailman/listinfo/dev >>>>>>>>>> >>>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> -- >>>>>>>>> Best Regards.. >>>>>>>>> >>>>>>>>> Chanika Geeganage >>>>>>>>> +94773522586 <+94%2077%20352%202586> >>>>>>>>> WSO2, Inc.; http://wso2.com >>>>>>>>> >>>>>>>>> >>>>>>>> >>>>>>>> _______________________________________________ >>>>>>>> Dev mailing list >>>>>>>> [email protected] >>>>>>>> http://wso2.org/cgi-bin/mailman/listinfo/dev >>>>>>>> >>>>>>>> >>>>>>> >>>>>>> >>>>>>> -- >>>>>>> Shakila Sasikaran >>>>>>> Software Engineer >>>>>>> Mobile :+94 (0) 77 526 6848 <+94%2077%20526%206848> >>>>>>> [email protected] >>>>>>> WSO2, Inc. >>>>>>> lean . enterprise . middleware >>>>>>> http://www.wso2.com/ >>>>>>> >>>>>> >>>>>> >>>>> >>>>> >>>>> -- >>>>> Shakila Sasikaran >>>>> Software Engineer >>>>> Mobile :+94 (0) 77 526 6848 <+94%2077%20526%206848> >>>>> [email protected] >>>>> WSO2, Inc. >>>>> lean . enterprise . middleware >>>>> http://www.wso2.com/ >>>>> >>>> >>>> >>>> >>>> -- >>>> Best Regards.. >>>> >>>> Chanika Geeganage >>>> +94773522586 <+94%2077%20352%202586> >>>> WSO2, Inc.; http://wso2.com >>>> >>>> >>> >>> _______________________________________________ >>> Dev mailing list >>> [email protected] >>> http://wso2.org/cgi-bin/mailman/listinfo/dev >>> >>> >> >> >> -- >> <[email protected]> >> Keerthika Mahendralingam >> Senior Software Engineer >> Mobile :+94 (0) 776 121144 <+94%2077%20612%201144> >> [email protected] >> WSO2, Inc. >> lean . enterprise . middleware >> >> _______________________________________________ >> Dev mailing list >> [email protected] >> http://wso2.org/cgi-bin/mailman/listinfo/dev >> >> > > > -- > Shakila Sasikaran > Software Engineer > Mobile :+94 (0) 77 526 6848 <+94%2077%20526%206848> > [email protected] > WSO2, Inc. > lean . enterprise . middleware > http://www.wso2.com/ > -- <[email protected]> Keerthika Mahendralingam Senior Software Engineer Mobile :+94 (0) 776 121144 [email protected] WSO2, Inc. lean . enterprise . middleware
_______________________________________________ Dev mailing list [email protected] http://wso2.org/cgi-bin/mailman/listinfo/dev
