Hello,

Have you tried starting your route with a 15 min timer, and then using the
pollEnrich DSL to fetch the remote files?

http://camel.apache.org/content-enricher.html#ContentEnricher-Contentenrichmentusingthe%7B%7Benrich%7D%7DDSLelement

from("timer:foo?fixedRate=true&period=900000")
   .multicast().parallelProcessing()
      .pollEnrich("ftp:...", new MyFtpAggregationStrategy())    // store
results in Exchange property?
      .pollEnrich("ftp:...", new MyFtpAggregationStrategy())    // store
results in Exchange property?
   .end()
   ... process the files ...;

Regards,

*Raúl Kripalani*
Apache Camel PMC Member & Committer | Enterprise Architect, Open Source
Integration specialist
http://about.me/raulkripalani | http://www.linkedin.com/in/raulkripalani
http://blog.raulkr.net | twitter: @raulvk

On Wed, Oct 9, 2013 at 7:14 AM, gudiseashok <[email protected]> wrote:

> Hi
>
> I am trying to achieve concurrent/parallel processing in my requirement,
> but
> I did not get appropriate help in my multiple attempts in this regard.
>
> I have 5 remote directories ( which may be added or removed) which contains
> log files, I want to Dow load them for every 15 minutes to my local
> directory and want to perform Lucene indexing after completion of ftp
> transfer job, I want to add routers dynamically.
>
> Since all those remote machines are different end points , and different
> routes. I don't have any particular end point to kickoff all these.
>
> Start
> <parallel>
>         <download remote dir from: sftp1>
>        <download remote dir from: sftp2>
>           ....
> </parallel>
> <After above task complete>
> <start Lucene indexing>
> <end>
>
> Repeat above for every 15 minutes,
>
> I wan to download all folders paralally, Kindly suggest the solution if
> anybody worked on similar requirement.
>
> This was my one of previous post:
>
> http://camel.465427.n5.nabble.com/Need-Help-in-configuring-a-router-to-run-to-run-parallally-amp-every-30-minutes-td5740755.html
>
> I tried to use splitter, competive consumer patters but I felt
> Like those didn't serve my purpose because I don't need any external end
> point or internasl producer to kick of my routes.
>
> I appreciate your help in this regard.
>
>
>
> --
> View this message in context:
> http://camel.465427.n5.nabble.com/I-am-stuck-with-Dynamic-router-multicast-design-tp5741210.html
> Sent from the Camel - Users mailing list archive at Nabble.com.
>

Reply via email to