Hi Aditya, If you need to split the file based on the xpath expression, you don't need to provide the chunkSize. If you provide the chunkSize, files will be splitted in to files with the chunkSize. So could you please only pass xpath expression and check.
Thanks, Keerthika. On Wed, Mar 28, 2018 at 10:49 AM, aditya shivankar < [email protected]> wrote: > Respected Madam/Sir, > > Using below proxy I am able to split the file . But splitting in not done > proper. > > Even though in the proxy configuration I have provided the structure > which needs to be maintained in each file , using Xpath Expression > "<property name="xpathExpression" scope="default" type="STRING" > value="//catalog/book"/>" > > Still file gets ended randomly without even maintaining the proper > structure.Like below > > </book> > <book id="bk102"> > <author>Ralls Kim</author> > <title>Midnight Rain</title> > <genre>Fantasy</genre> > <price>5.95</price> > <publish_date>2000-12 > > Attaching Input file(books1000.xml) and 2 files which are produced as the > result of the split (books1000.xml0 and books1000.xml1). > > Proxy which I am using is. > > <?xml version="1.0" encoding="UTF-8"?> > <proxy name="FileConnectorProxy" startOnLoad="true" transports="http > https" xmlns="http://ws.apache.org/ns/synapse";> > <target> > <inSequence> > <property name="destination" scope="default" type="STRING" > value="file:///C:/Flatfile/FileConnOutput"/> > <property name="source" scope="default" type="STRING" > value="file:///C:/Flatfile/FileConnInput/books1000.xml"/> > <property name="xpathExpression" scope="default" type="STRING" > value="//catalog/book"/> > <fileconnector.splitFile> > <source>{$ctx:source}</source> > <destination>{$ctx:destination}</destination> > <chunkSize>4096</chunkSize> > <xpathExpression>{$ctx:xpathExpression}</xpathExpression> > </fileconnector.splitFile> > <respond/> > </inSequence> > <outSequence/> > <faultSequence/> > </target> > </proxy> > > I am expecting each file to start with structure like below : > > <?xml version="1.0"?> > <catalog> > <book id="bk101"> > > and each file end with structure like below : > > </book> > </catalog> > > Please guide . > > > With Regards, > Aditya > > On Wed, Mar 28, 2018 at 9:25 AM, Chanika Geeganage <[email protected]> > wrote: > >> Hi Aditya, >> >> This proxy service will not poll files iteratively, like vfs transport. >> Have you invoked the proxy service to do the file operation (ie. split) >> over HTTP/HTTPS? >> >> Thanks >> >> On Wed, Mar 28, 2018 at 8:52 AM, Shakila Sasikaran <[email protected]> >> wrote: >> >>> Hi Aditya, >>> >>> Could you please attach the source file and the log file >>> (repository/logs/wso2carbon.log) for the investigation? >>> >>> Thanks >>> >>> On Tue, Mar 27, 2018 at 10:26 PM, aditya shivankar < >>> [email protected]> wrote: >>> >>>> Respected Madam/Sir, >>>> >>>> Pointed the source to the file " file:///C:/Flatfile/FileConnIn >>>> put/inputfor_writeToDb1.xml " . But still the file is not getting >>>> processed. Please guide. >>>> >>>> <?xml version="1.0" encoding="UTF-8"?> >>>> <proxy name="FileConnectorProxy" startOnLoad="true" transports="http >>>> https" xmlns="http://ws.apache.org/ns/synapse";> >>>> <target> >>>> <inSequence> >>>> <property name="destination" scope="default" type="STRING" >>>> value="file:///C:/Flatfile/FileConnOutput"/> >>>> <property name="source" scope="default" type="STRING" >>>> value="file:///C:/Flatfile/FileConnInput/inputfor_writeToDb1.xml"/> >>>> <property name="xpathExpression" scope="default" >>>> type="STRING" value="//catalog/book"/> >>>> <fileconnector.splitFile> >>>> <source>{$ctx:source}</source> >>>> <destination>{$ctx:destination}</destination> >>>> <chunkSize>4096</chunkSize> >>>> <xpathExpression>{$ctx:xpathEx >>>> pression}</xpathExpression> >>>> </fileconnector.splitFile> >>>> <respond/> >>>> </inSequence> >>>> <outSequence/> >>>> <faultSequence/> >>>> </target> >>>> </proxy> >>>> >>>> With Regards, >>>> Aditya >>>> >>>> >>>> On Mon, Mar 26, 2018 at 6:02 PM, Shakila Sasikaran <[email protected]> >>>> wrote: >>>> >>>>> Hi Aditya, >>>>> >>>>> Please point the file as the source. For example >>>>> *"source":"/home/vive/Desktop/file/outTest/sample.txt"*. >>>>> >>>>> Thanks >>>>> >>>>> On Mon, Mar 26, 2018 at 3:49 PM, aditya shivankar < >>>>> [email protected]> wrote: >>>>> >>>>>> Respected Madam/Sir, >>>>>> >>>>>> Changed the transport from 'vfs' to "http https". Still the proxy >>>>>> is not able to poll the file from source location. Please guide. >>>>>> I have placed a file at C:/Flatfile/FileConnInput . but it is not >>>>>> getting polled and not triggereing the flow. >>>>>> >>>>>> <?xml version="1.0" encoding="UTF-8"?> >>>>>> <proxy name="FileConnectorProxy" startOnLoad="true" transports="http >>>>>> https" xmlns="http://ws.apache.org/ns/synapse";> >>>>>> <target> >>>>>> <inSequence> >>>>>> <property name="destination" scope="default" >>>>>> type="STRING" value="file:///C:/Flatfile/ "/> >>>>>> <property name="source" scope="default" type="STRING" >>>>>> value="file:///C:/Flatfile/FileConnInput"/> >>>>>> <property name="xpathExpression" scope="default" >>>>>> type="STRING" value="//catalog/book"/> >>>>>> <fileconnector.splitFile> >>>>>> <source>{$ctx:source}</source> >>>>>> <destination>{$ctx:destination}</destination> >>>>>> <chunkSize>4096</chunkSize> >>>>>> <xpathExpression>{$ctx:xpathEx >>>>>> pression}</xpathExpression> >>>>>> </fileconnector.splitFile> >>>>>> <respond/> >>>>>> </inSequence> >>>>>> <outSequence/> >>>>>> <faultSequence/> >>>>>> </target> >>>>>> </proxy> >>>>>> >>>>>> With Regards, >>>>>> Aditya >>>>>> >>>>>> >>>>>> >>>>>> On Mon, Mar 26, 2018 at 2:16 PM, Chanika Geeganage <[email protected]> >>>>>> wrote: >>>>>> >>>>>>> Hi Aditya, >>>>>>> >>>>>>> The error has come from VFSTransportListener as you have set the >>>>>>> transport as 'vfs', but there are no vfs endpoint configured. Since you >>>>>>> are >>>>>>> using file connector, you can use transports such as http/ https. A >>>>>>> sample >>>>>>> can be found from [1] >>>>>>> >>>>>>> [1] https://docs.wso2.com/display/ESBCONNECTORS/Working+with+the >>>>>>> +File+Connector#WorkingwiththeFileConnector-sampleconfigurat >>>>>>> ionSampleconfiguration >>>>>>> >>>>>>> Thanks >>>>>>> >>>>>>> On Mon, Mar 26, 2018 at 1:58 PM, aditya shivankar < >>>>>>> [email protected]> wrote: >>>>>>> >>>>>>>> Respected Sir, >>>>>>>> >>>>>>>> Please find the screenshot of Faulty proxy service in console. >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> With Regards, >>>>>>>> Aditya >>>>>>>> >>>>>>>> >>>>>>>> On Mon, Mar 26, 2018 at 1:47 PM, aditya shivankar < >>>>>>>> [email protected]> wrote: >>>>>>>> >>>>>>>>> >>>>>>>>> Respected Sir, >>>>>>>>> >>>>>>>>> I am trying to split a file using file connector >>>>>>>>> >>>>>>>>> Below is my FileConnector Proxy : >>>>>>>>> >>>>>>>>> <?xml version="1.0" encoding="UTF-8"?> >>>>>>>>> <proxy name="FileConnectorProxy" startOnLoad="true" >>>>>>>>> transports="vfs" xmlns="http://ws.apache.org/ns/synapse";> >>>>>>>>> <target> >>>>>>>>> <inSequence> >>>>>>>>> <property name="destination" scope="default" >>>>>>>>> type="STRING" value="file:///C:/Flatfile/ "/> >>>>>>>>> <property name="source" scope="default" type="STRING" >>>>>>>>> value="file:///C:/Flatfile/FileConnInput"/> >>>>>>>>> <property name="xpathExpression" scope="default" >>>>>>>>> type="STRING" value="//catalog/book"/> >>>>>>>>> <fileconnector.splitFile> >>>>>>>>> <source>{$ctx:source}</source> >>>>>>>>> <destination>{$ctx:destination}</destination> >>>>>>>>> <chunkSize>4096</chunkSize> >>>>>>>>> <xpathExpression>{$ctx:xpathEx >>>>>>>>> pression}</xpathExpression> >>>>>>>>> </fileconnector.splitFile> >>>>>>>>> </inSequence> >>>>>>>>> <outSequence/> >>>>>>>>> <faultSequence/> >>>>>>>>> </target> >>>>>>>>> </proxy> >>>>>>>>> >>>>>>>>> I added the fileconnector following below link in wso2ei server. >>>>>>>>> https://docs.wso2.com/display/ESB490/Managing+Connectors+in+ >>>>>>>>> Your+ESB+Instance >>>>>>>>> >>>>>>>>> To add a connector: >>>>>>>>> On the Main tab in the ESB Management Console, under Connectors >>>>>>>>> click Add. >>>>>>>>> Click Browse, specify the ZIP file, and click Open. >>>>>>>>> Click Upload. >>>>>>>>> The connector will now appear in the Connectors list and is ready >>>>>>>>> to be enabled in your ESB instance. >>>>>>>>> >>>>>>>>> To enable a connector: >>>>>>>>> On the Main tab in the ESB Management Console, under Connectors >>>>>>>>> click List to view the uploaded connectors. >>>>>>>>> Click Enable next to a connector you want to enable, and then >>>>>>>>> confirm that you want to change its status. Repeat this step for each >>>>>>>>> connector you want to enable. >>>>>>>>> >>>>>>>>> While deploying the application it is giving me the following >>>>>>>>> error. >>>>>>>>> >>>>>>>>> [2018-03-26 13:29:10,334] [EI-Core] ERROR - VFSTransportListener >>>>>>>>> Unable to stop service : FileConnectorProxy - unable to find the >>>>>>>>> corresponding protocol endpoint >>>>>>>>> >>>>>>>>> and the application gets deployed as the faulty application . >>>>>>>>> >>>>>>>>> [2018-03-26 13:29:10,533] [EI-Core] INFO - ApplicationManager >>>>>>>>> Successfully Deployed Carbon Application : >>>>>>>>> FileConnectorAppCompositeApplication_1.0.0 >>>>>>>>> {super-tenant} >>>>>>>>> >>>>>>>>> It is not able to pick the file from "FileConnInput" folder. >>>>>>>>> Please find attached error logs. >>>>>>>>> Please guide. >>>>>>>>> >>>>>>>>> With Regards, >>>>>>>>> Aditya >>>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> _______________________________________________ >>>>>>>> Dev mailing list >>>>>>>> [email protected] >>>>>>>> http://wso2.org/cgi-bin/mailman/listinfo/dev >>>>>>>> >>>>>>>> >>>>>>> >>>>>>> >>>>>>> -- >>>>>>> Best Regards.. >>>>>>> >>>>>>> Chanika Geeganage >>>>>>> +94773522586 <+94%2077%20352%202586> >>>>>>> WSO2, Inc.; http://wso2.com >>>>>>> >>>>>>> >>>>>> >>>>>> _______________________________________________ >>>>>> Dev mailing list >>>>>> [email protected] >>>>>> http://wso2.org/cgi-bin/mailman/listinfo/dev >>>>>> >>>>>> >>>>> >>>>> >>>>> -- >>>>> Shakila Sasikaran >>>>> Software Engineer >>>>> Mobile :+94 (0) 77 526 6848 <+94%2077%20526%206848> >>>>> [email protected] >>>>> WSO2, Inc. >>>>> lean . enterprise . middleware >>>>> http://www.wso2.com/ >>>>> >>>> >>>> >>> >>> >>> -- >>> Shakila Sasikaran >>> Software Engineer >>> Mobile :+94 (0) 77 526 6848 <+94%2077%20526%206848> >>> [email protected] >>> WSO2, Inc. >>> lean . enterprise . middleware >>> http://www.wso2.com/ >>> >> >> >> >> -- >> Best Regards.. >> >> Chanika Geeganage >> +94773522586 <+94%2077%20352%202586> >> WSO2, Inc.; http://wso2.com >> >> > > _______________________________________________ > Dev mailing list > [email protected] > http://wso2.org/cgi-bin/mailman/listinfo/dev > > -- <[email protected]> Keerthika Mahendralingam Senior Software Engineer Mobile :+94 (0) 776 121144 [email protected] WSO2, Inc. lean . enterprise . middleware
_______________________________________________ Dev mailing list [email protected] http://wso2.org/cgi-bin/mailman/listinfo/dev
