Re: Why can not get the data
Do you just need an Http server for unit testing? Maybe take a look
at the class "HttpTestServer.java" in this directory in Git:
https://fisheye6.atlassian.com/browse/camel-git/tests/camel-itest/src/test/java/org/apache/camel/itest/http
On Wed, Aug 14, 2013 at 11:01 PM, yiwang wrote:
> I rewrite code is as follows:
> public class TestHttpCamel {
> private Main main;
>
> public static void main(String args[]) throws Exception {
>
> TestHttpCamel example = new TestHttpCamel();
> example.boot();
>
> }
>
> public void boot() throws Exception {
> main = new Main();
> main.enableHangupSupport();
> main.addRouteBuilder(new RouteBuilder() {
> public void configure() {
>
> from("http://localhost:8080/wms/query_all_handlover_note?type=source";)
>
> .to("file:d:/temp/outbox?fileName=data.txt");
>
> }
> });
> main.run();
> }
>
> }
> still not get the data.I have direct access to
> "http://localhost:8080/wms/query_all_handlover_note? Type = source",can
> obtain the json data. The HTTP routing write wrong or need what
> configuration?
>
>
>
> --
> View this message in context:
> http://camel.465427.n5.nabble.com/Why-can-not-get-the-data-tp5737243p5737285.html
> Sent from the Camel - Users mailing list archive at Nabble.com.
Re: How to use hawtio with Camel web app?
Thanks for getting back to me. >> >> This didn't work - the first problem was an incompletely declared >> WEB-INF/web.xml root element, which I fixed, > > What change did you make? Any chance of a pull request or at least a > gist of the latest version? :) > It was very minor. I think it it fails because JBoss-6 is configured to perform schema validation of web.xml, so I changed the declaration of the root element from: http://java.sun.com/xml/ns/javaee";> to: http://java.sun.com/xml/ns/javaee"; xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"; xsi:schemaLocation="http://java.sun.com/xml/ns/javaee http://java.sun.com/xml/ns/javaee/web-app_2_5.xsd";> I don't think you need version 2.5, but I just had another web.xml I copy/pasted from, with the schemaLocation for 2.5. I will get back to you on the other items, right now I have it all ripped apart, temporarily.. Thanks, Chris
How to use hawtio with Camel web app?
I would like to use hawtio's Camel route diagram view for inspecting and displaying routes. http://hawt.io/getstarted/index.html Since the app will be deployed in a private Intranet, I tried their "offline" WAR: https://oss.sonatype.org/content/repositories/public/io/hawt/hawtio-default-offline/1.2-M1/hawtio-default-offline-1.2-M1.war This didn't work - the first problem was an incompletely declared WEB-INF/web.xml root element, which I fixed, this allowed the web app to deploy, but I still see this error in the server log: 13:02:21,940 ERROR [org.apache.catalina.core.ContainerBase.[jboss.web].[localhost].[/hawtio]] Failed to startup blueprint container. org.osgi.service.blueprint.container.ComponentDefinitionException: Unable to intialize bean aetherFacade: org.osgi.service.blueprint.container.ComponentDefinitionException: Unable to intialize bean aetherFacade Although I can navigate and inspect MBeans through the JMX view. If I download the full WAR, which includes a sample Camel context: https://oss.sonatype.org/content/repositories/public/io/hawt/sample/1.2-M1/sample-1.2-M1.war This also works, although with a large volume of assorted stack traces in the log. I don't need all the extra stuff that the full sample WAR has, e.g. ActiveMQ because JBoss6 uses HornetQ, etc. I just want to know how to combine my Camel web app with the most minimal hawtio web app to be able to view/inspect context(s) and routes in diagram view? I searched the list archive and only found a thread concerning the initial announcement: http://camel.465427.n5.nabble.com/ANN-hawtio-a-new-lightweight-HTML5-console-for-Apache-Camel-ActiveMQ-JMX-OSGi-amp-Fuse-Fabric-td5726244.html#a5726248 Does anyone have an idea? Thanks, Chris
Re: conditional uri
It depends on what you mean by "conditional" - if you mean conditional at route-definition time, you can use property placeholders and/or Language Expressions. If you mean conditional at runtime, then I'm pretty sure you can only do that with producer endpoints (i.e. "to" endpoints) see: http://camel.apache.org/how-do-i-use-dynamic-uri-in-to.html If you want conditional runtime consumer endpoints, the only solution I have been able to come up with is dynamically created routes that are created at runtime; this logic is encapsulated in a custom processor. -Chris On Tue, Jul 16, 2013 at 9:46 AM, boris wrote: > How could I have a conditional uri string? > For example, > I have for testing. > I want to have a single xml file for both and manage uri string > conditionally. > Thanks, > Boris > > > > -- > View this message in context: > http://camel.465427.n5.nabble.com/conditional-uri-tp5735724.html > Sent from the Camel - Users mailing list archive at Nabble.com.
Re: Problem: file language expression being interpreted as Spring property-placeholder.
Thank you! that worked, I used:
fileName=$simple{file:onlyname.noext}.$simple{id}
On Wed, Jul 10, 2013 at 2:57 PM, Claus Ibsen wrote:
> You can use $simple{ xxx } as well as the syntax
>
> On Wed, Jul 10, 2013 at 7:10 PM, Chris Wolf wrote:
>> Hello,
>>
>> I have an endpoint defined as:
>>
>> >
>> uri="file://{{jboss.server.data.dir}}?idempotent=true&preMove={{jboss.server.data.dir}}/holding/${file:onlyname.noext}.${id}&move={{jboss.server.data.dir}}/archive&moveFailed={{jboss.server.data.dir}}/errors&readLock=changed"/>
>>
>>
>> Which throws this exception:
>>
>> Caused by: org.springframework.beans.factory.BeanDefinitionStoreException:
>> Invalid bean definition with name 'file.to.data-decrypted' defined in
>> null: Could not resolve placeholder 'id'
>> at
>> org.springframework.beans.factory.config.PlaceholderConfigurerSupport.doProcessProperties(PlaceholderConfigurerSupport.java:209)
>> at
>> org.springframework.beans.factory.config.PropertyPlaceholderConfigurer.processProperties(PropertyPlaceholderConfigurer.java:220)
>>
>> I am quite sure, previously, I was able to use "${id}" in the filename
>> expression and it was not interpreted as a Spring property
>> placeholder,
>> and I didn't reconfigure the opening/closing tokens for property
>> placeholders. Anyone have a clue?
>>
>> Thanks,
>>
>>
>> Chris
>
>
>
> --
> Claus Ibsen
> -
> Red Hat, Inc.
> Email: cib...@redhat.com
> Twitter: davsclaus
> Blog: http://davsclaus.com
> Author of Camel in Action: http://www.manning.com/ibsen
Problem: file language expression being interpreted as Spring property-placeholder.
Hello,
I have an endpoint defined as:
Which throws this exception:
Caused by: org.springframework.beans.factory.BeanDefinitionStoreException:
Invalid bean definition with name 'file.to.data-decrypted' defined in
null: Could not resolve placeholder 'id'
at
org.springframework.beans.factory.config.PlaceholderConfigurerSupport.doProcessProperties(PlaceholderConfigurerSupport.java:209)
at
org.springframework.beans.factory.config.PropertyPlaceholderConfigurer.processProperties(PropertyPlaceholderConfigurer.java:220)
I am quite sure, previously, I was able to use "${id}" in the filename
expression and it was not interpreted as a Spring property
placeholder,
and I didn't reconfigure the opening/closing tokens for property
placeholders. Anyone have a clue?
Thanks,
Chris
Re: Cannot get filter() to work with "mandatoryBodyAs"
Christian - this was a "user error" on my part and I forgot that I
could/should just overwrite and replace the "in" body of the
exchange, in which case, I didn't need to filter out the
no-longer-needed upstream message body.
Thanks,
Chris
On Tue, Jun 11, 2013 at 11:19 AM, Christian Müller
wrote:
> Can you try
> ".filter(simple("${mandatoryBodyAs(org.apache.camel.component.file.remote.RemoteFile)}"))"?
>
> Best,
>
> Christian Müller
> -
>
> Software Integration Specialist
>
> Apache Camel committer: https://camel.apache.org/team
> V.P. Apache Camel: https://www.apache.org/foundation/
> Apache Member: https://www.apache.org/foundation/members.html
>
> https://www.linkedin.com/pub/christian-mueller/11/551/642
>
>
> On Tue, Jun 11, 2013 at 4:12 PM, Chris Wolf wrote:
>
>> I want to impose a filter such that only messages whose body is of
>> type RemoteFile get through,
>> So per the documentation:
>>
>> http://camel.apache.org/message-filter.html
>> http://camel.apache.org/predicate.html
>> http://camel.apache.org/simple.html
>>
>> I have:
>>
>> .filter(simple("${mandatoryBodyAs(RemoteFile.class)}"))
>>
>> But I get:
>>
>> org.apache.camel.CamelExecutionException: Exception occurred during
>> execution on the exchange: Exchange[Message: {}]
>> at
>> org.apache.camel.util.ObjectHelper.wrapCamelExecutionException(ObjectHelper.java:1332)
>> at
>> org.apache.camel.builder.ExpressionBuilder$33.evaluate(ExpressionBuilder.java:781)
>> at
>> org.apache.camel.support.ExpressionAdapter.evaluate(ExpressionAdapter.java:36)
>> at
>> org.apache.camel.support.ExpressionSupport.matches(ExpressionSupport.java:32)
>> at
>> org.apache.camel.util.ExpressionToPredicateAdapter.matches(ExpressionToPredicateAdapter.java:32)
>> at
>> org.apache.camel.builder.SimpleBuilder.matches(SimpleBuilder.java:75)
>> at
>> org.apache.camel.processor.FilterProcessor.process(FilterProcessor.java:47)
>> []
>> Caused by: java.lang.ClassNotFoundException: RemoteFile.class
>> at
>> org.apache.camel.impl.DefaultClassResolver.resolveMandatoryClass(DefaultClassResolver.java:52)
>> at
>> org.apache.camel.builder.ExpressionBuilder$33.evaluate(ExpressionBuilder.java:779)
>> ... 67 more
>>
>> ...even though I imported RemoteFile. So then I tried:
>>
>>
>> .filter(simple("${mandatoryBodyAs(org.apache.camel.component.file.remote.RemoteFile.class)}"))
>>
>> and I get the same ClassNotFoundException, but with the full classname.
>>
>> How can I filter messages, such that only messages whose in-body is
>> non-null and of a certain type get through?
>>
>> Thanks,
>>
>> Chris
>>
Re: Problem with DefaultCamelContext EndpointRegistry
Claus,
Thanks, but the fact that attempting to add another instance of the
same Endpoint type results in the
name getting and instance number appended means that some
consideration must have been
given to accommodating multiple instances of the same Endpoint in the
registry, right?
In any case, I gave up on the idea of writing a custom component to
solve the dynamic
consumer problem and instead, create consumer routes, at runtime, with
static consumer URIs,
which solves my problem.
Thanks,
Chris
On Fri, Jun 14, 2013 at 7:16 AM, Claus Ibsen wrote:
> Only singleton endpoints should be in the registry.
>
> Non singleton is prototype based and therefore a new instance is
> created when you call getEndpoint.
>
>
>
> On Wed, Jun 12, 2013 at 7:41 PM, Chris Wolf wrote:
>> Ok, have a partial answer - since my Endpoint is not a singleton, I see that
>> DefaultCamelContext.getEndpointKey(String uri, Endpoint endpoint)
>> appends that "%3A2" -
>> i.e. ":2" - which appears to be an instance qualifier. The trouble is,
>> DefaultEndpoint.getEndpointUri() will always return the URI *without*
>> that instance qualifier,
>> so it won;t be found in the endpoint registry.
>>
>> Is there an example of a Component whose Endpoint is not a singleton,
>> that I can look at?
>> Or are non-singleton Endpoints some new, untested feature?
>>
>> Thanks,
>>
>> Chris
>>
>> On Wed, Jun 12, 2013 at 3:28 PM, Chris Wolf wrote:
>>> I am trying to develop a new component, but it needs to be able to
>>> have it's endpoint be registered in
>>> the CamelContext endpoint registry. Whenever the runtime tries to
>>> call DefaultCamelContext.getEndpoint(String uri)
>>> it returns null, even though, in the debugger, I can expand
>>> DefaultCamelContext.endpoints.map
>>>
>>> ...and see that, for sure, the endpoint is in the registry, except the
>>> key now has "%3A2" appended, so of course,
>>> the EndpointKey, which looks like:
>>>
>>> dsftp://localhost:21000?binary=true&directory=target%2Fres%2Fhome&filter=%23cpmdFileFilter&idempotent=true&localWorkDirectory=target%2Fres%2Ftmp%2Flocal&move=archive%2F%24%7Bfile%3Aname%7D&password=adpt5&separator=UNIX&username=adpt5
>>>
>>> ...won't match, so that explains why
>>> DefaultCamelContext.getEndpoint(String uri) returns null.
>>>
>>>
>>> DefaultCamelContext.endpoints.map: (other entries removed for clarity)
>>> {dsftp://localhost:21000binary=true&directory=target%2Fres%2Fhome&filter=%23cpmdFileFilter&idempotent=true&localWorkDirectory=target%2Fres%2Ftmp%2Flocal&move=archive%2F%24%7Bfile%3Aname%7D&password=adpt5&separator=UNIX&username=adpt5%3A2=java.lang.ref.SoftReference@f7e5307}
>>>
>>> *** So why does the key in the endpoints.map have "%3A2" appended to it?
>>> ***
>>>
>>> Thanks,
>>>
>>> Chris
>
>
>
> --
> Claus Ibsen
> -
> www.camelone.org: The open source integration conference.
>
> Red Hat, Inc.
> FuseSource is now part of Red Hat
> Email: cib...@redhat.com
> Web: http://fusesource.com
> Twitter: davsclaus
> Blog: http://davsclaus.com
> Author of Camel in Action: http://www.manning.com/ibsen
Re: Why is the file component parameter, "consumer.regexPattern" not recognized?
Bilgin,
Thanks for that - I was always assuming "file2" meant additionally
added. I ended up using include=,
as suggested in file2.html.
Thanks,
Chris
On Wed, Jun 26, 2013 at 7:40 PM, Bilgin Ibryam wrote:
> Hi Chris,
>
> are you using Camel 1.x?
> As it says in the documentation, for Camel 2.x, the doc page of file
> component is
> http://camel.apache.org/file2.html
>
> Bilgin
>
>
>
> On 26 June 2013 22:24, Chris Wolf wrote:
>
>> ResolveEndpointFailedException: Failed to resolve endpoint:
>> file://src/test/data?consumer.regexPattern=.*uu%24&noop=true
>> due to: There are 1 parameters that couldn't be set on the endpoint
>> consumer.
>> Check the uri if the parameters are spelt correctly and that they are
>> properties
>> of the endpoint. Unknown consumer parameters=[{regexPattern=.*uu$}]
>>
>> I copy&pasted the parameter name directly from the doc page:
>> http://camel.apache.org/file.html
>>
>> Thanks,
>>
>>
>> Chris
>>
Why is the file component parameter, "consumer.regexPattern" not recognized?
ResolveEndpointFailedException: Failed to resolve endpoint:
file://src/test/data?consumer.regexPattern=.*uu%24&noop=true
due to: There are 1 parameters that couldn't be set on the endpoint consumer.
Check the uri if the parameters are spelt correctly and that they are
properties
of the endpoint. Unknown consumer parameters=[{regexPattern=.*uu$}]
I copy&pasted the parameter name directly from the doc page:
http://camel.apache.org/file.html
Thanks,
Chris
Re: SFTP: disconnect on route-suspend
Our project has similar requirements - in addition to parameterizing the SFTP connection at runtime, not just at route declaration-time. I was led to believe that, generally, consumers can't be parameterized at runtime, so I made a few attempts at creating my own custom component to do SFTP with parameters passed in at runtime, triggered by Quartz cron trigger. This worked, but didn't get automatically wrapped in JMX wrappers, plus other clunky issues. I ended up having the quartz/cron trigger send the parameters to a custom processor which creates a route at runtime, starting with an SFTP consumer - plus a background thread that defines the poll time duration, after which, the thread stops the route, then removes it. This all works for us now, including multiple, concurrent connections (well, only two simultaneous tested so far) You might want to try an approach like that. On Tue, Jun 25, 2013 at 11:21 AM, mdo wrote: > Claus Ibsen-2 wrote >> Use stop instead of suspend. > > I know that stopping the route does shut down the endpoints. But we changed > to suspend/resume a month ago because we noticed that stop/restart leaks > threads in GlassFish. If I did stop the route I would have to remove and > recreate it each time Quartz fires. This would also knock down my whole > approach of initially setting up routes on application startup. > > At the moment I'm looking into endpoint options, something like: > serverAliveInterval 900 > serverAliveCountMax 0 > > This idea was inspired by http://serverfault.com/a/450916 > > But this doesn't seem to work neither. JSCH goes nuts and disconnects right > before logging in and "SSH_MSG_KEXDH_INIT sent" should get logged. > > Regards, mdo. > > > > > > -- > View this message in context: > http://camel.465427.n5.nabble.com/SFTP-disconnect-on-route-suspend-tp5734742p5734744.html > Sent from the Camel - Users mailing list archive at Nabble.com.
camel-jms sometimes not closing connections/sessions
I have a camel app deployed on JBoss-6, which is using HornetQ as the JMS implementation. There is a route which listens to JMS topic traffic between some 3rd party MDBs, which, I believe use durable, transacted topics, but since the camel route is just listening (consuming) I have the most basic configuration: jms://topic:foo?connectionFactory=#connectionFactory ...where connectionFactory is what is returned by a JNDI lookup, of type org.hornetq.ra.HornetQRAConnectionFactoryImpl - which is a JCA Resource Adapter. When I run the process, everything works, but then JBoss complains of improperly closed JMS sessions. In the server log, I see hundreds of messages like: 09:40:21,397 WARN [org.hornetq.core.protocol.core.impl.RemotingConnectionImpl] Connection failure has been detected: Did not receive data from invm:0. It is likely the client has exited or crashed without closing its connection, or the network between the server and client has failed. You also might have configured connection-ttl and client-failure-check-period incorrectly. Please check user manual for more information. The connection will now be closed. [code=3] 09:40:21,397 WARN [org.hornetq.core.server.impl.ServerSessionImpl] Client connection failed, clearing up resources for session c7b542a4-da06-11e2-84bb-0250f205 ...other times none of these warnings appear. When run without the camel part deployed, I never see these warnings, so I'm thinking it's the Camel JMS component. Is there a way to log that session id to positively verify this is the case, or not? Also do I see to configure some other settings, such as TTL, etc.? Any suggestions appreciated, thanks, Chris In JBoss, this is the setting to auto-cleanup RA resources, such as JMS sessions: https://community.jboss.org/wiki/ConfigCachedConnectionManager
Re: Problem with DefaultCamelContext EndpointRegistry
Ok, have a partial answer - since my Endpoint is not a singleton, I see that
DefaultCamelContext.getEndpointKey(String uri, Endpoint endpoint)
appends that "%3A2" -
i.e. ":2" - which appears to be an instance qualifier. The trouble is,
DefaultEndpoint.getEndpointUri() will always return the URI *without*
that instance qualifier,
so it won;t be found in the endpoint registry.
Is there an example of a Component whose Endpoint is not a singleton,
that I can look at?
Or are non-singleton Endpoints some new, untested feature?
Thanks,
Chris
On Wed, Jun 12, 2013 at 3:28 PM, Chris Wolf wrote:
> I am trying to develop a new component, but it needs to be able to
> have it's endpoint be registered in
> the CamelContext endpoint registry. Whenever the runtime tries to
> call DefaultCamelContext.getEndpoint(String uri)
> it returns null, even though, in the debugger, I can expand
> DefaultCamelContext.endpoints.map
>
> ...and see that, for sure, the endpoint is in the registry, except the
> key now has "%3A2" appended, so of course,
> the EndpointKey, which looks like:
>
> dsftp://localhost:21000?binary=true&directory=target%2Fres%2Fhome&filter=%23cpmdFileFilter&idempotent=true&localWorkDirectory=target%2Fres%2Ftmp%2Flocal&move=archive%2F%24%7Bfile%3Aname%7D&password=adpt5&separator=UNIX&username=adpt5
>
> ...won't match, so that explains why
> DefaultCamelContext.getEndpoint(String uri) returns null.
>
>
> DefaultCamelContext.endpoints.map: (other entries removed for clarity)
> {dsftp://localhost:21000binary=true&directory=target%2Fres%2Fhome&filter=%23cpmdFileFilter&idempotent=true&localWorkDirectory=target%2Fres%2Ftmp%2Flocal&move=archive%2F%24%7Bfile%3Aname%7D&password=adpt5&separator=UNIX&username=adpt5%3A2=java.lang.ref.SoftReference@f7e5307}
>
> *** So why does the key in the endpoints.map have "%3A2" appended to it? ***
>
> Thanks,
>
> Chris
Problem with DefaultCamelContext EndpointRegistry
I am trying to develop a new component, but it needs to be able to
have it's endpoint be registered in
the CamelContext endpoint registry. Whenever the runtime tries to
call DefaultCamelContext.getEndpoint(String uri)
it returns null, even though, in the debugger, I can expand
DefaultCamelContext.endpoints.map
...and see that, for sure, the endpoint is in the registry, except the
key now has "%3A2" appended, so of course,
the EndpointKey, which looks like:
dsftp://localhost:21000?binary=true&directory=target%2Fres%2Fhome&filter=%23cpmdFileFilter&idempotent=true&localWorkDirectory=target%2Fres%2Ftmp%2Flocal&move=archive%2F%24%7Bfile%3Aname%7D&password=adpt5&separator=UNIX&username=adpt5
...won't match, so that explains why
DefaultCamelContext.getEndpoint(String uri) returns null.
DefaultCamelContext.endpoints.map: (other entries removed for clarity)
{dsftp://localhost:21000binary=true&directory=target%2Fres%2Fhome&filter=%23cpmdFileFilter&idempotent=true&localWorkDirectory=target%2Fres%2Ftmp%2Flocal&move=archive%2F%24%7Bfile%3Aname%7D&password=adpt5&separator=UNIX&username=adpt5%3A2=java.lang.ref.SoftReference@f7e5307}
*** So why does the key in the endpoints.map have "%3A2" appended to it? ***
Thanks,
Chris
Re: Cannot get filter() to work with "mandatoryBodyAs" ***DISREGARD***
In the "simple" language, a "type" is a string, not a class, so instead of
.filter(simple("${mandatoryBodyAs(org.apache.camel.component.file.remote.RemoteFile.class)}"))
...I needed:
.filter(simple("${mandatoryBodyAs(org.apache.camel.component.file.remote.RemoteFile)}"))
(removed ".class")
On Tue, Jun 11, 2013 at 10:12 AM, Chris Wolf wrote:
> I want to impose a filter such that only messages whose body is of
> type RemoteFile get through,
> So per the documentation:
>
> http://camel.apache.org/message-filter.html
> http://camel.apache.org/predicate.html
> http://camel.apache.org/simple.html
>
> I have:
>
> .filter(simple("${mandatoryBodyAs(RemoteFile.class)}"))
>
> But I get:
>
> org.apache.camel.CamelExecutionException: Exception occurred during
> execution on the exchange: Exchange[Message: {}]
> at
> org.apache.camel.util.ObjectHelper.wrapCamelExecutionException(ObjectHelper.java:1332)
> at
> org.apache.camel.builder.ExpressionBuilder$33.evaluate(ExpressionBuilder.java:781)
> at
> org.apache.camel.support.ExpressionAdapter.evaluate(ExpressionAdapter.java:36)
> at
> org.apache.camel.support.ExpressionSupport.matches(ExpressionSupport.java:32)
> at
> org.apache.camel.util.ExpressionToPredicateAdapter.matches(ExpressionToPredicateAdapter.java:32)
> at
> org.apache.camel.builder.SimpleBuilder.matches(SimpleBuilder.java:75)
> at
> org.apache.camel.processor.FilterProcessor.process(FilterProcessor.java:47)
> []
> Caused by: java.lang.ClassNotFoundException: RemoteFile.class
> at
> org.apache.camel.impl.DefaultClassResolver.resolveMandatoryClass(DefaultClassResolver.java:52)
> at
> org.apache.camel.builder.ExpressionBuilder$33.evaluate(ExpressionBuilder.java:779)
> ... 67 more
>
> ...even though I imported RemoteFile. So then I tried:
>
> .filter(simple("${mandatoryBodyAs(org.apache.camel.component.file.remote.RemoteFile.class)}"))
>
> and I get the same ClassNotFoundException, but with the full classname.
>
> How can I filter messages, such that only messages whose in-body is
> non-null and of a certain type get through?
>
> Thanks,
>
> Chris
Cannot get filter() to work with "mandatoryBodyAs"
I want to impose a filter such that only messages whose body is of
type RemoteFile get through,
So per the documentation:
http://camel.apache.org/message-filter.html
http://camel.apache.org/predicate.html
http://camel.apache.org/simple.html
I have:
.filter(simple("${mandatoryBodyAs(RemoteFile.class)}"))
But I get:
org.apache.camel.CamelExecutionException: Exception occurred during
execution on the exchange: Exchange[Message: {}]
at
org.apache.camel.util.ObjectHelper.wrapCamelExecutionException(ObjectHelper.java:1332)
at
org.apache.camel.builder.ExpressionBuilder$33.evaluate(ExpressionBuilder.java:781)
at
org.apache.camel.support.ExpressionAdapter.evaluate(ExpressionAdapter.java:36)
at
org.apache.camel.support.ExpressionSupport.matches(ExpressionSupport.java:32)
at
org.apache.camel.util.ExpressionToPredicateAdapter.matches(ExpressionToPredicateAdapter.java:32)
at org.apache.camel.builder.SimpleBuilder.matches(SimpleBuilder.java:75)
at
org.apache.camel.processor.FilterProcessor.process(FilterProcessor.java:47)
[]
Caused by: java.lang.ClassNotFoundException: RemoteFile.class
at
org.apache.camel.impl.DefaultClassResolver.resolveMandatoryClass(DefaultClassResolver.java:52)
at
org.apache.camel.builder.ExpressionBuilder$33.evaluate(ExpressionBuilder.java:779)
... 67 more
...even though I imported RemoteFile. So then I tried:
.filter(simple("${mandatoryBodyAs(org.apache.camel.component.file.remote.RemoteFile.class)}"))
and I get the same ClassNotFoundException, but with the full classname.
How can I filter messages, such that only messages whose in-body is
non-null and of a certain type get through?
Thanks,
Chris
Re: Camel Mustache & Handlebars components
Oh, I see, ok. Actually, upon further thinking, instead of wrapping the in-memory object graph in "SimpleHash" - there's an interface called "TemplateModelIterator", where, I think I could implement it such that the iterator returned would be an iterator whose next() could return a "TemplateModel" representing the current record and have a special end-of-group record that signals next() to return null, thus closing the file.I haven't tried that, but hopefully it will work. I see what you're saying about having a single client-side and server-side template language. Thanks, Chris On Mon, Jun 10, 2013 at 11:52 AM, gquintana wrote: > No these components won't help you, they work exactly like FreeMarker. On > Mustache Java, I think you can customize the way your object graph is walked > when rendering the template (see BaseObjectHandler). But the whole message > must fit in memory. > > I produced theses components because I am using Handlebars on the client > side (in JavaScript) and I didn't want to introduce another templating > language. > > > > > > -- > View this message in context: > http://camel.465427.n5.nabble.com/Camel-Mustache-Handlebars-components-tp5734043p5734068.html > Sent from the Camel - Users mailing list archive at Nabble.com.
Re: Communication between Camel and JBoss AS7
We use JBoss-6 and HornetQ MDBs. (i.e. JMS) On Mon, Jun 10, 2013 at 11:55 AM, ak-dak wrote: > Hi all, > > I want to develop a camel route which processes a xml message. Below a > simple route to demonstrate my use case. > > > > > > > > > > I want to do all business JPA persist logic by EJB's within a JBoss AS 7. > See the methods of "jbossService" within my example. > > And now my question. What's the "best" solution to communicate with a JBoss > AS 7 to invoke EJB's synchronously? Wrapping of the EJB calls within > Soap-Webservices could be a solution but I'am concerned about the > performance. When the system goes into production we have to process 1 > and more messages as fast as possible. > > Maybe someone has a more faster solution? > > Best regards > > > > -- > View this message in context: > http://camel.465427.n5.nabble.com/Communication-between-Camel-and-JBoss-AS7-tp5734069.html > Sent from the Camel - Users mailing list archive at Nabble.com.
Re: Camel Mustache & Handlebars components
I'm just curious - how is this any better/different that camel-freemarker? What are the advantages? I ask because am using camel-freemarker and am having the following issue with Freemarker: POJOs correspond to records in a document, normally you pass a collection of POJOs into Freemarker to get the output document. The issue I face is the size of the document could be gigantic/undetermined, so in my route, everything is streamed record-by-record - reading in the whole document into memory is not an option, therefore I was not able to use the "freemarker://" component and had to write yet another custom processor which opens (with append=true) writes and closes the output file on every record, since the number of records is unknown - this works except it's probably not efficient and I get spurious blank lines. Would your "Handlerbar" and/or "Mustache" template solution handle this record-streaming scenario, or does the whole input have to be read into memory also? Thanks, Chris On Sat, Jun 8, 2013 at 4:21 PM, gquintana wrote: > Hi all, > > Just for the fun, I wrote Camel components using Mustache or Handlebars > templating engines: > https://github.com/gquintana/camel-stuff > > Cheers, > Gérald > > > > -- > View this message in context: > http://camel.465427.n5.nabble.com/Camel-Mustache-Handlebars-components-tp5734043.html > Sent from the Camel - Users mailing list archive at Nabble.com.
How to get JMX-wrapped Component, Endpoint and Consumer?
I notice the standard, "out-of-the-box" components automatically get the Component, Endpoint and Consumer/Producer wrapped in JMX-managed wrappers - all without the JMX annotations. Poking around in the code, I see: DefaultManagementLifecycleStrategy.onRoutesAdd(...) ..but I don't know how this ties into normal RouteBuilder usages.. I see also: ManagedCamelContext.createEndpoint(...) ...but, again, I don't know how this ties into normal RouteBuilder usage. So how would I do that? Thanks, Chris
Re: Cannot get SFTP component to stop polling
Thanks for the suggestions. So far, I have not done anything programmatically - just tried suspending the route via JMX (jconsole) and when that didn't work, tried stopping the route - that didn't work either. I can't remove the route since it is declarative from Spring-DSL, however, I guess I could resort to changing it to dynamic with yet another custom Processor to add/remove the route. Regards, Chris On Fri, Jun 7, 2013 at 5:15 PM, swwyatt wrote: > We are doing something similar. How are you stopping the route? > > I ended up doing this: > > camelContext.stopRoute(routeId); > camelContext.removeRoute(routeId); > > We are having several dynamic consumer routes in the same context, so we > additionally call camelContext.stop(), hopefully this would just stop the > single route. > > > > -- > View this message in context: > http://camel.465427.n5.nabble.com/Cannot-get-SFTP-component-to-stop-polling-tp5734021p5734023.html > Sent from the Camel - Users mailing list archive at Nabble.com.
Cannot get SFTP component to stop polling
I am using Camel 2.10.4 and need to use SFTP to fetch files. Since
the sftp consumer does not support dynamic properties (connecting to
different host/directory/user/pass, etc.) I implemented a custom
processor which sets up the SftpComponent, SftpEndpoint and
SftpConsumer, in what I believe to be very similar to the "sftp://";
component, but instead of parsing the URI for the settings, it gets
the settings from the inbound body of type Map.
It all works, except after a certain time period, I need it to stop
polling. I tried to suspend the route it's in, but it is still
polling - I tried to
stop the route - it's still polling! How can I get it to stop??
Though JMX, I can see that the route is definitely stopped, so how can
the SftpConsumer
be still polling???
Thanks,
Chris
Here's roughly what my custom Processor looks like (logging, error
handling stripped out)
public class SftpDownloader implements Processor {
protected SftpComponent sftpComponent;
protected SftpEndpoint sftpEndpoint;
protected SftpConsumer sftpConsumer;
protected org.apache.camel.ProducerTemplate producer;
protected String toEndpointURI;
public void process(Exchange exchange) throws Exception {
Map ftpProps = exchange.getIn().getBody(Map.class);
CamelContext context = exchange.getContext();
if (this.producer == null) {
this.producer = context.createProducerTemplate();
this.producer.setDefaultEndpointUri(this.toEndpointURI);
}
configure(context, ftpProps, endpointURIQueryString);
}
void configure(CamelContext context, Map
parameters, String queryStr) throws Exception {
String initialURI = String.format("sftp://%s/%s";,
parameters.get("host"), parameters.get("directory"));
sftpEndpoint = context.getEndpoint(initialURI, SftpEndpoint.class);
sftpComponent = (SftpComponent) sftpEndpoint.getComponent();
SftpConfiguration conf = sftpEndpoint.getConfiguration();
// set reference properties first as they use # syntax that
fools the regular properties setter
EndpointHelper.setReferenceProperties(context, conf, parameters);
EndpointHelper.setProperties(context, conf, parameters);
EndpointHelper.setReferenceProperties(context, sftpEndpoint,
parameters);
EndpointHelper.setProperties(context, sftpEndpoint, parameters);
sftpConsumer = (SftpConsumer)
sftpEndpoint.createConsumer(new Processor() {
@Override
public void process(Exchange exchange) throws Exception {
producer.send(exchange);
}
});
((ScheduledPollConsumer) sftpConsumer).setStartScheduler(true);
sftpConsumer.start();
}
Re: idempotentConsumer is not idempotent?
Although you may be wishing for a strict interpretation of "idempotent", there are also practical interpretations, e.g. the "idempotent" option for the "file://" component - the whole purpose of this option is to read the file only once, even if it remains in the directory. On Thu, Jun 6, 2013 at 10:07 AM, jannecamel wrote: > At first look I was getting excited about idempotentConsumer - this would > help me nicely in creating idempotent services. > > But looking closer, it does not seem to do what it says? > > Looks like it takes first request and processes it. Then if duplicate > messages come, it just discards those. > > A true idempotent consumer would discard the duplicate messages AND return > the same (cached) response as the first one got. For example if I have > service add(x,y) and I call add(2,5) multiple times, each call should return > 7. Now first returns 7 and duplicate ones return nothing. Or did I > understand it wrong? > > http://www.enterpriseintegrationpatterns.com/IdempotentReceiver.html > "The term idempotent is used in mathematics to describe a function that > produces the same result if it is applied to itself, i.e. f(x) = f(f(x)). In > Messaging this concepts translates into the a message that has the same > effect whether it is received once or multiple times. This means that a > message can safely be resent without causing any problems even if the > receiver receives duplicates of the same message." > > > > -- > View this message in context: > http://camel.465427.n5.nabble.com/idempotentConsumer-is-not-idempotent-tp5733945.html > Sent from the Camel - Users mailing list archive at Nabble.com.
Re: Camel Quartz and JobStore
Don't forget that JBoss runs it's own instance of Quartz as a service. I'm not sure how you're configuring the JobStore implementation, but if it's via the quartz.properties and the JBoss instance of quartz reads the same properties, then maybe there's a conflict? On Mon, May 20, 2013 at 5:41 PM, mpaivafontes wrote: > Hello, > > I'm trying to use the misfire property from Camel-Quartz persisting the data > at the database ( SQL server ) with JobStore from Quartz but i'm facing a > strange problem after the restart of the application. > > For some reason after the restart, all data disappear for some reason and > the misfire is not getting triggered. > > When i setted the xx.isClustered=true the all data is kept what does make > sense, but it's not my case. > > I would like to know if is there any way to keep the data intact after the > app restart so i can see the misfire working properly. > > The class used to control the transaction is > org.quartz.impl.jdbcjobstore.JobStoreTX > > Regards ! > > > > -- > View this message in context: > http://camel.465427.n5.nabble.com/Camel-Quartz-and-JobStore-tp5732853.html > Sent from the Camel - Users mailing list archive at Nabble.com.
Re: How can I dynamically add or modify endpoints in a route?
Actually, after further experimenting, my "reconfgure" worked, but
only after the
CamelContext was started. So the implementation was to just have an initial
route consuming from a direct:, then, when an message comes in, I dynamically
create and add new routes, each headed by a unique instance of
"quartz://", who's
name corresponds to the customer-id, so each customer has their own crontab.
Thanks,
Chris
On Sat, May 18, 2013 at 3:42 AM, Claus Ibsen wrote:
> The RouteBuilder is just java code, so I suggest to add getter/setter
> to a MyCronRouteBuilder class which extends RouteBuilder. Then you can
> create a new instance of that, and then use the setter to set your
> options.
>
> And in the configure method you can use the getter to get your
> options, which you can use in the DSL to set the options you want.
>
> On Fri, May 17, 2013 at 6:53 PM, Chris Wolf wrote:
>> I need to schedule multiple cron jobs in a route. The number and
>> schedules are not known at compile-time,
>> so I need to programatically configure the route at run-time. An
>> abbreviated version of my non-working
>> attempt is shown below. I created an anonymous RouteBuilder, in which
>> I created a route.
>>
>> After, calling context.addRoutes(...), but before starting the
>> context, I want to programmatically
>> tweak the route definition, as shown by the "reconfigure(...)"
>> function, unfortunately any attempt
>> to lookup the route I just created fails - no routes found. Why? I
>> suspect that the route may actually
>> need to be started for it's initialization to complete, so should I
>> start it, then stop or suspend, then
>> programmatically modify?
>>
>>
>> BTW, I already checked my copy of "Camel In Action" and
>> http://camel.apache.org/faq.html but
>> no answers for me there
>>
>> context.addRoutes(new RouteBuilder() {
>> public void configure() {
>> from("quartz://demo-1/{{custId}}?cron=* * * * * ? 2036").routeId("sched")
>> .process(new Processor() {
>> @Override
>> public void process(Exchange exchange) throws Exception {
>> // Do something at cron trigger time
>> }
>> }).id("sched.pipline")
>> .to("log:demo-1?showAll=true&multiline=true&level=INFO");
>> }
>> });
>>
>> reconfigure("sched.pipline", context);
>>
>> void reconfigure(String downstreamNodeId, CamelContext context) {
>> for (Route route : context.getRoutes()) { // getRoutes()
>> returns zero-length list - why
>> String id = route.getId(); // null - why???
>> List svcs = route.getServices();
>> Consumer c = route.getConsumer();
>> }
>> Route sched = context.getRoute("sched"); // null
>
>
>
> --
> Claus Ibsen
> -
> www.camelone.org: The open source integration conference.
>
> Red Hat, Inc.
> FuseSource is now part of Red Hat
> Email: cib...@redhat.com
> Web: http://fusesource.com
> Twitter: davsclaus
> Blog: http://davsclaus.com
> Author of Camel in Action: http://www.manning.com/ibsen
Re: I want to call CamelContext.addRouteDefinition, but it's deprecated - how do I get ModelCamelContext?
So was (is) the root package supposed to be internal and "model" the ideal external API? I'm still not certain of the purpose of the "model" package Thanks, Chris On Sat, May 18, 2013 at 3:33 AM, Claus Ibsen wrote: > Hi > > Yeah its IMHO a bit unfortunate with the @deprecated on the > CamelContext. But the point was to use ModelCamelContext as this > interface is from the model package. Where as CamelContext is from the > root. > So with the ModelCamelContext you dont have root -> model in the > dependency triage. > > > > > On Fri, May 17, 2013 at 10:08 PM, Chris Wolf wrote: >> In a custom Processor, I am calling CamelContext.addRouteDefinition - >> but the javadoc says it's deprecated and >> to use org.apache.camel.model.ModelCamelContex.addRouteDefinition(..) >> instead. >> >> I see that DefaultCamelContext implements ModelCamelContext, so I just >> cast it like: >> >> ModelCamelContext context = (ModelCamelContext)exchange.getContext(); >> >> That seems to work too. What is the difference between these two >> interfaces and the "model" >> sub-package, in general? (I searched the FAQ and CiA book, but didn't >> find anything) >> >> Thanks, >> >> >> Chris > > > > -- > Claus Ibsen > - > www.camelone.org: The open source integration conference. > > Red Hat, Inc. > FuseSource is now part of Red Hat > Email: cib...@redhat.com > Web: http://fusesource.com > Twitter: davsclaus > Blog: http://davsclaus.com > Author of Camel in Action: http://www.manning.com/ibsen
I want to call CamelContext.addRouteDefinition, but it's deprecated - how do I get ModelCamelContext?
In a custom Processor, I am calling CamelContext.addRouteDefinition - but the javadoc says it's deprecated and to use org.apache.camel.model.ModelCamelContex.addRouteDefinition(..) instead. I see that DefaultCamelContext implements ModelCamelContext, so I just cast it like: ModelCamelContext context = (ModelCamelContext)exchange.getContext(); That seems to work too. What is the difference between these two interfaces and the "model" sub-package, in general? (I searched the FAQ and CiA book, but didn't find anything) Thanks, Chris
How can I dynamically add or modify endpoints in a route?
I need to schedule multiple cron jobs in a route. The number and
schedules are not known at compile-time,
so I need to programatically configure the route at run-time. An
abbreviated version of my non-working
attempt is shown below. I created an anonymous RouteBuilder, in which
I created a route.
After, calling context.addRoutes(...), but before starting the
context, I want to programmatically
tweak the route definition, as shown by the "reconfigure(...)"
function, unfortunately any attempt
to lookup the route I just created fails - no routes found. Why? I
suspect that the route may actually
need to be started for it's initialization to complete, so should I
start it, then stop or suspend, then
programmatically modify?
BTW, I already checked my copy of "Camel In Action" and
http://camel.apache.org/faq.html but
no answers for me there
context.addRoutes(new RouteBuilder() {
public void configure() {
from("quartz://demo-1/{{custId}}?cron=* * * * * ? 2036").routeId("sched")
.process(new Processor() {
@Override
public void process(Exchange exchange) throws Exception {
// Do something at cron trigger time
}
}).id("sched.pipline")
.to("log:demo-1?showAll=true&multiline=true&level=INFO");
}
});
reconfigure("sched.pipline", context);
void reconfigure(String downstreamNodeId, CamelContext context) {
for (Route route : context.getRoutes()) { // getRoutes()
returns zero-length list - why
String id = route.getId(); // null - why???
List svcs = route.getServices();
Consumer c = route.getConsumer();
}
Route sched = context.getRoute("sched"); // null
Can I deploy multiple instances of the same RoutePolicy on the same route?
I implemented a custom route policy that is similar to the CronScheduledRoutePolicy, except instead of start/resume suspend crontabs, it only has a start/resume crontab and a duration. Well, now I need to support multiple customers,each having different schedules. I was thinking of just adding multiple instances via the bean factory option "singleton=false" because I notice that you can have multiple RoutePolicies on a route, but can you have multiple instances of the same RoutePolicy, where each has a different crontab? Or maybe, I should probably implement a custom processor to call on the quartz component in a loop to create the per-customer crontabs? Any thoughts? Thanks, Chris
Re: what's wrong with oracle configuration
First, I see that you're using Oracle-XE. If you're on Windows, be advised that Oracle-XE is only supported on 32bit versions of Windows. I learned the hard way - strange erratic behavior, etc. I advise that if you have 64bit Windows, that you uninstall Oracle-XE and install the standard release: http://www.oracle.com/technetwork/database/enterprise-edition/downloads/112010-win64soft-094461.html What is your deployment environment? Servlet container/webapp? Standalone? Generally it's a good idea to mention the Operating System type and version, Camel version, etc. I am developing our app on 64bit Windows-7 and standard Oracle release 11.2g works find in all deployment modes: standalone app, servlet container and application server. Since I'm using OpenJPA, I am using DBCP connection pooling for standalone and non-managed servlet container (e.g. Jetty) for JBoss, the pooling is managed by JBoss. You should also use the JDBC driver jar that comes with 11.2g: $ORACLE_HOME/jdbc/lib i.e. C:/oraclexe/app/oracle/product/11.2.0/server/jdbc/lib ojdbc6_g.jar or ojdbc6.jar Chris On Thu, May 16, 2013 at 6:42 AM, takidean wrote: > should id add something here > > > > > class="org.springframework.jdbc.datasource.DriverManagerDataSource"> > > > > > > > i add the jar file to the classphath , it works fine for mysql but bugs for > oracle > > the error that i got > > Property 'driverClassName' threw exception; nested exception is > java.lang.IllegalStateException: Could not load JDBC driver class > [oracle.jdbc.OracleDriver] > > > > -- > View this message in context: > http://camel.465427.n5.nabble.com/what-s-wrong-with-oracle-configuration-tp5732673.html > Sent from the Camel - Users mailing list archive at Nabble.com.
Re: What is the best approach to do an "asynchronous rendezvous"?
Hello Raúl, The more I analyze the requirements, the more complicated it seems to get - it's looking like I need to have a per-customer state machine to manage the flow. To answer your questions: >- How many batches per day will you receive per customer? one per day per customer - 3 predecessor events in, 1 result event out. >- Can the event batches interleave? Yes, for sure, which raises another issue - now I'm thinking I need per-customer, dynamically added route/route-policy >- What identifies a concrete batch of events? * a per-customer arrival of config info from external system via JMS * a per-customer arrival of message indicating certain external processing is ready for next step from Camel-based process * a per-customer indication of a set of files have arrived via SFTP >- Do you have a finite list of customers? (and customer ids?) * I don't see how that factors in - assume the less restrictive case >- What is the payload of the fourth event? * an advisory JMS message that SFTP-processed files has completed and that the external system can proceed base on these results. Thanks, Chris On Wed, May 15, 2013 at 4:42 PM, Raul Kripalani wrote: > Let me try and understand the timeline of these events. I will call a > logical grouping of events "event batch". > If you don't mind answering the following questions, I can assist better: > >- How many batches per day will you receive per customer? >- Can the event batches interleave? >- What identifies a concrete batch of events? >- Do you have a finite list of customers? (and customer ids?) >- What is the payload of the fourth event? Am I right asserting that you >receive 3 raw events, and you build some sort of composite or merged >message and release it as the 4th event? > > Regards, > > *Raúl Kripalani* > Enterprise Architect, Open Source Integration specialist, Program > Manager | Apache > Camel Committer > http://about.me/raulkripalani | http://www.linkedin.com/in/raulkripalani > http://blog.raulkr.net | twitter: @raulvk > > On Wed, May 15, 2013 at 9:30 PM, Chris Wolf wrote: > >> Raúl, >> >> Thanks for your ideas. Now it's 3 events without guaranteed order to >> arrive before triggering the fourth event. As for correlation key, I >> guess it would be customer-id plus a timestamp >> that shows the event happened in the last several hours. >> >> The more I look into it, the more it seems like the Camel resequencer >> process may apply >> here: http://camel.apache.org/resequencer.html >> >> The thing is, I'm not sure about setting batch size and/or timeout. >> The documentation >> states: >> >> "...messages are collected into a batch, either by a maximum number of >> messages per batch or using a timeout..." >> >> So it seems I would set batch size to 3 in my case, but our process is >> supporting >> multiple customers, so really, it's 3 predecessor events *per customer*. >> Also, >> I think I would need persistent state in the even of a crash. >> Although I'd like to >> avoid it, I can't help thinking I may have to implement yet another custom >> Processor to support this use case. (I already had to implement a custom >> SFTP Processor to handle dynamic endpoint settings based on the >> customer-id). >> >> I know that Camel is intended for ETL-ish sorts of problems, but I >> think the Camel >> approach is also appropriate for interactive, online processing, but >> in that case, >> it would be really helpful if endpoint configurations had the >> additional dimension >> of settings/configs indexed by id (such as customer-id, user-id, >> account-id, etc.) >> >> I could be wrong, but it seems that the static URI way of configuring >> endpoints >> doesn't scale to process-flow/per-identity. Those endpoints that do take >> expressions help in this regard, but not all of them work with >> expression-language >> configuration, e.g. SFTP Consumer. >> >> Thanks, >> >> Chris >> >> On Wed, May 15, 2013 at 3:46 PM, Raul Kripalani wrote: >> > Hi Chris, >> > >> > I like this kind of problems ;-) Do these two messages share a >> correlation >> > key? >> > >> > If yes, you can create a bean which acts like a Repository, accumulating >> > message bodies or Exchanges under the correlation key. Could be >> implemented >> > using Guava's MultiMap, or a DB if you need durable persistence, or a >> > distributed cache if you require clustering withou
Re: What is the best approach to do an "asynchronous rendezvous"?
Raúl, Thanks for your ideas. Now it's 3 events without guaranteed order to arrive before triggering the fourth event. As for correlation key, I guess it would be customer-id plus a timestamp that shows the event happened in the last several hours. The more I look into it, the more it seems like the Camel resequencer process may apply here: http://camel.apache.org/resequencer.html The thing is, I'm not sure about setting batch size and/or timeout. The documentation states: "...messages are collected into a batch, either by a maximum number of messages per batch or using a timeout..." So it seems I would set batch size to 3 in my case, but our process is supporting multiple customers, so really, it's 3 predecessor events *per customer*. Also, I think I would need persistent state in the even of a crash. Although I'd like to avoid it, I can't help thinking I may have to implement yet another custom Processor to support this use case. (I already had to implement a custom SFTP Processor to handle dynamic endpoint settings based on the customer-id). I know that Camel is intended for ETL-ish sorts of problems, but I think the Camel approach is also appropriate for interactive, online processing, but in that case, it would be really helpful if endpoint configurations had the additional dimension of settings/configs indexed by id (such as customer-id, user-id, account-id, etc.) I could be wrong, but it seems that the static URI way of configuring endpoints doesn't scale to process-flow/per-identity. Those endpoints that do take expressions help in this regard, but not all of them work with expression-language configuration, e.g. SFTP Consumer. Thanks, Chris On Wed, May 15, 2013 at 3:46 PM, Raul Kripalani wrote: > Hi Chris, > > I like this kind of problems ;-) Do these two messages share a correlation > key? > > If yes, you can create a bean which acts like a Repository, accumulating > message bodies or Exchanges under the correlation key. Could be implemented > using Guava's MultiMap, or a DB if you need durable persistence, or a > distributed cache if you require clustering without persistence. > > When a message arrives, you query the Repository for a previous message > with the same correlation key. If it exists, you pick it up, do whatever > manipulation is needed, and release the 3rd event. Kind of like a > CyclicBarrier that stores the messages for later usage. > > P.S.: You could consider using the Aggregator EIP, but it'll block a thread > until the 2nd event comes through. > > Regards, > > *Raúl Kripalani* > Enterprise Architect, Open Source Integration specialist, Program > Manager | Apache > Camel Committer > http://about.me/raulkripalani | http://www.linkedin.com/in/raulkripalani > http://blog.raulkr.net | twitter: @raulvk > > On Wed, May 15, 2013 at 6:56 PM, Chris Wolf wrote: > >> In my process, I have two events that must be completed before the >> third can proceed. >> One event is the arrival of a certain JMS message and the other is the >> arrival of >> a certain file type. The problem is, I cannot represent this in a >> route pipeline because >> one event may occur before the other and it's totally random from one >> run to another. >> >> In the abstract, I'm thinking one of the EIP patterns, either >> "resequencer" or "scatter-gather" >> applies, but I'm not certain how to do this in a concrete way with >> Camel. If anyone has >> ideas, that would be great... >> >> Thanks, >> >> >> Chris >>
What is the best approach to do an "asynchronous rendezvous"?
In my process, I have two events that must be completed before the third can proceed. One event is the arrival of a certain JMS message and the other is the arrival of a certain file type. The problem is, I cannot represent this in a route pipeline because one event may occur before the other and it's totally random from one run to another. In the abstract, I'm thinking one of the EIP patterns, either "resequencer" or "scatter-gather" applies, but I'm not certain how to do this in a concrete way with Camel. If anyone has ideas, that would be great... Thanks, Chris
Re: Why is Camel silently dropping exceptions? *** DISREGARD ***
After RTFM, I see what's happening - sorry for the noise...
On Tue, May 14, 2013 at 11:49 AM, Chris Wolf wrote:
> I implemented a custom route policy, which never appeared to be
> starting. I finally traced with a debugger
> and found that it's throwing an exception, which appears to be discarded.
>
> In the DefaultCamelContext.addRoutes(...) is this code:
>
> if (routePolicyList != null && !routePolicyList.isEmpty()) {
> for (RoutePolicy policy : routePolicyList) {
> // add policy as service if we have not already done that (eg
> possible if two routes have the same service)
> // this ensures Camel can control the lifecycle of the policy
> if (!camelContext.hasService(policy)) {
> try {
> camelContext.addService(policy);
> } catch (Exception e) {
> throw ObjectHelper.wrapRuntimeCamelException(e); <=== Never seen
> in log or console- where is it?
> }
> }
> }
>
> Obviously, I am not understanding how exceptions are handled in Camel
> - can someone help me?
>
> Thanks,
>
> Chris
Why is Camel silently dropping exceptions?
I implemented a custom route policy, which never appeared to be
starting. I finally traced with a debugger
and found that it's throwing an exception, which appears to be discarded.
In the DefaultCamelContext.addRoutes(...) is this code:
if (routePolicyList != null && !routePolicyList.isEmpty()) {
for (RoutePolicy policy : routePolicyList) {
// add policy as service if we have not already done that (eg
possible if two routes have the same service)
// this ensures Camel can control the lifecycle of the policy
if (!camelContext.hasService(policy)) {
try {
camelContext.addService(policy);
} catch (Exception e) {
throw ObjectHelper.wrapRuntimeCamelException(e); <=== Never seen
in log or console- where is it?
}
}
}
Obviously, I am not understanding how exceptions are handled in Camel
- can someone help me?
Thanks,
Chris
How do we have the "log:" component log to a file?
I notice all kinds of options for the log compenent, except for how to log to a file, as opposed to stdout: http://camel.apache.org/log.html I'm sure I'm some obvious piece of documentation on that, but I just can't find it... Any help? Thanks, Chris
Re: Will camel-websocket work in producer mode from a web app?
Thanks, ok. On Sat, May 4, 2013 at 4:28 AM, Claus Ibsen wrote: > Hi > > No the current camel-websocket is Jetty based. > There is a ticket to create a new component using the Atmosphere > framework which is container agnostic. > > On Sat, May 4, 2013 at 4:27 AM, Chris Wolf wrote: >> I see that it uses Jetty to launch a web server for camel-websocket in >> producer mode. I'm seeing some >> dependency clashes with JBoss - before I sort that out - let me ask, >> will it even work? >> >> It seems a bit unconventional to launch an embedded servlet container >> from within a web application. >> >> >> Thanks, >> >> >> Chris > > > > -- > Claus Ibsen > - > Red Hat, Inc. > FuseSource is now part of Red Hat > Email: cib...@redhat.com > Web: http://fusesource.com > Twitter: davsclaus > Blog: http://davsclaus.com > Author of Camel in Action: http://www.manning.com/ibsen
Will camel-websocket work in producer mode from a web app?
I see that it uses Jetty to launch a web server for camel-websocket in producer mode. I'm seeing some dependency clashes with JBoss - before I sort that out - let me ask, will it even work? It seems a bit unconventional to launch an embedded servlet container from within a web application. Thanks, Chris
Re: Class Cast error upon deploying Camel web app
Actually, I forgot the baked-in xerces/xalan are in namespace javax.xml, but the standalone xerces/xalan are in org.apache. In any case, I added some other components which caused Maven to pull in xalan-2.7.0 and there was already xalan-2.7.1 proved by JBoss, so I added exclusions in the pom.xml Thanks, Chris On Fri, May 3, 2013 at 8:28 PM, Chris Wolf wrote: > Thanks, I tried that and now the error as shown below. > > Note that jboss6 was built with jdk-1.5, so it comes with it's own > xerces/xalan, so I'm > thinking there's a class with the JRE baked-in xerces/xalan (I'm running with > jre-1.6). On the other hand, I have been able to deploy successfully > before and I did > even without the special camel-jboss classloader. So do I need that? > > > 20:18:03,218 INFO > org.springframework.beans.factory.BeanDefinitionStoreException: > Unexpected exception parsing XML document from ServletContext resource > [/WEB-INF/applicationContext.xml]; nested exception is > java.lang.ClassCastException: > org.apache.xerces.jaxp.DocumentBuilderFactoryImpl cannot be cast to > javax.xml.parsers.DocumentBuilderFactory > [STDOUT] > [...] > Caused by: java.lang.ClassCastException: > org.apache.xerces.jaxp.DocumentBuilderFactoryImpl cannot be cast to > javax.xml.parsers.DocumentBuilderFactory > at javax.xml.parsers.DocumentBuilderFactory.newInstance(Unknown > Source) [:1.6.0_29] > at > org.springframework.beans.factory.xml.DefaultDocumentLoader.createDocumentBuilderFactory(DefaultDocumentLoader.java:89) > [:3.1.0.RELEASE] > at > org.springframework.beans.factory.xml.DefaultDocumentLoader.loadDocument(DefaultDocumentLoader.java:70) > [:3.1.0.RELEASE] > at > org.springframework.beans.factory.xml.XmlBeanDefinitionReader.doLoadBeanDefinitions(XmlBeanDefinitionReader.java:388) > [:3.1.0.RELEASE] > > On Fri, May 3, 2013 at 5:15 PM, Babak Vahdat > wrote: >> Hi >> >> I assume the JAXB version being provided by JBoss 6 is pretty outdated and >> not really compliant with Camel 2.10.4 as JBoss 6 is from end 2010. >> >> Do you have any jaxb-impl inside your WAR/EAR being included? If not maybe >> try to add the following dependency inside the POM of your Web-App so that >> jaxb-impl-2.1.13.jar gets included into your WEB-INF/lib folder of your WAR >> getting precedence to the one from JBoss AS. >> >> >> com.sun.xml.bind >> jaxb-impl >> 2.1.13 >> >> >> Babak >> >> >> Chris Wolf wrote >>> Has anyone seen this error? I'm trying to deploy on JBoss6. I was >>> able to deploy before without issues. I guess >>> it's some kind of "classloader-Hell" issue due to JEE weirdness. >>> >>> Caused by: java.lang.ClassCastException: >>> org.apache.xerces.dom.DeferredElementNSImpl cannot be cast to >>> org.w3c.dom.Element >>> at com.sun.xml.bind.unmarshaller.DOMScanner.scan(DOMScanner.java:100) >>> [:2.2] >>> at >>> com.sun.xml.bind.v2.runtime.BinderImpl.associativeUnmarshal(BinderImpl.java:156) >>> [:2.2] >>> at >>> com.sun.xml.bind.v2.runtime.BinderImpl.unmarshal(BinderImpl.java:127) >>> [:2.2] >>> at >>> org.apache.camel.spring.handler.CamelNamespaceHandler.parseUsingJaxb(CamelNamespaceHandler.java:166) >>> [:2.10.4] >>> at >>> org.apache.camel.spring.handler.CamelNamespaceHandler$CamelContextBeanDefinitionParser.doParse(CamelNamespaceHandler.java:306) >>> [:2.10.4] >>> at >>> org.springframework.beans.factory.xml.AbstractSingleBeanDefinitionParser.parseInternal(AbstractSingleBeanDefinitionParser.java:85) >>> [:3.1.0.RELEASE] >>> at >>> org.springframework.beans.factory.xml.AbstractBeanDefinitionParser.parse(AbstractBeanDefinitionParser.java:59) >>> [:3.1.0.RELEASE] >>> at >>> org.springframework.beans.factory.xml.NamespaceHandlerSupport.parse(NamespaceHandlerSupport.java:73) >>> [:3.1.0.RELEASE] >>> at >>> org.springframework.beans.factory.xml.BeanDefinitionParserDelegate.parseCustomElement(BeanDefinitionParserDelegate.java:1419) >>> [:3.1.0.RELEASE] >>> at >>> org.springframework.beans.factory.xml.BeanDefinitionParserDelegate.parseCustomElement(BeanDefinitionParserDelegate.java:1409) >>> [:3.1.0.RELEASE] >>> at >>> org.springframework.beans.factory.xml.DefaultBeanDefinitionDocumentReader.parseBeanDefinitions(DefaultBeanDefinitionDocumentReader.java:184) >>> [:3.1.0.RELEASE] >>> at >>> org
Re: Class Cast error upon deploying Camel web app
Thanks, I tried that and now the error as shown below. Note that jboss6 was built with jdk-1.5, so it comes with it's own xerces/xalan, so I'm thinking there's a class with the JRE baked-in xerces/xalan (I'm running with jre-1.6). On the other hand, I have been able to deploy successfully before and I did even without the special camel-jboss classloader. So do I need that? 20:18:03,218 INFO org.springframework.beans.factory.BeanDefinitionStoreException: Unexpected exception parsing XML document from ServletContext resource [/WEB-INF/applicationContext.xml]; nested exception is java.lang.ClassCastException: org.apache.xerces.jaxp.DocumentBuilderFactoryImpl cannot be cast to javax.xml.parsers.DocumentBuilderFactory [STDOUT] [...] Caused by: java.lang.ClassCastException: org.apache.xerces.jaxp.DocumentBuilderFactoryImpl cannot be cast to javax.xml.parsers.DocumentBuilderFactory at javax.xml.parsers.DocumentBuilderFactory.newInstance(Unknown Source) [:1.6.0_29] at org.springframework.beans.factory.xml.DefaultDocumentLoader.createDocumentBuilderFactory(DefaultDocumentLoader.java:89) [:3.1.0.RELEASE] at org.springframework.beans.factory.xml.DefaultDocumentLoader.loadDocument(DefaultDocumentLoader.java:70) [:3.1.0.RELEASE] at org.springframework.beans.factory.xml.XmlBeanDefinitionReader.doLoadBeanDefinitions(XmlBeanDefinitionReader.java:388) [:3.1.0.RELEASE] On Fri, May 3, 2013 at 5:15 PM, Babak Vahdat wrote: > Hi > > I assume the JAXB version being provided by JBoss 6 is pretty outdated and > not really compliant with Camel 2.10.4 as JBoss 6 is from end 2010. > > Do you have any jaxb-impl inside your WAR/EAR being included? If not maybe > try to add the following dependency inside the POM of your Web-App so that > jaxb-impl-2.1.13.jar gets included into your WEB-INF/lib folder of your WAR > getting precedence to the one from JBoss AS. > > > com.sun.xml.bind > jaxb-impl > 2.1.13 > > > Babak > > > Chris Wolf wrote >> Has anyone seen this error? I'm trying to deploy on JBoss6. I was >> able to deploy before without issues. I guess >> it's some kind of "classloader-Hell" issue due to JEE weirdness. >> >> Caused by: java.lang.ClassCastException: >> org.apache.xerces.dom.DeferredElementNSImpl cannot be cast to >> org.w3c.dom.Element >> at com.sun.xml.bind.unmarshaller.DOMScanner.scan(DOMScanner.java:100) >> [:2.2] >> at >> com.sun.xml.bind.v2.runtime.BinderImpl.associativeUnmarshal(BinderImpl.java:156) >> [:2.2] >> at >> com.sun.xml.bind.v2.runtime.BinderImpl.unmarshal(BinderImpl.java:127) >> [:2.2] >> at >> org.apache.camel.spring.handler.CamelNamespaceHandler.parseUsingJaxb(CamelNamespaceHandler.java:166) >> [:2.10.4] >> at >> org.apache.camel.spring.handler.CamelNamespaceHandler$CamelContextBeanDefinitionParser.doParse(CamelNamespaceHandler.java:306) >> [:2.10.4] >> at >> org.springframework.beans.factory.xml.AbstractSingleBeanDefinitionParser.parseInternal(AbstractSingleBeanDefinitionParser.java:85) >> [:3.1.0.RELEASE] >> at >> org.springframework.beans.factory.xml.AbstractBeanDefinitionParser.parse(AbstractBeanDefinitionParser.java:59) >> [:3.1.0.RELEASE] >> at >> org.springframework.beans.factory.xml.NamespaceHandlerSupport.parse(NamespaceHandlerSupport.java:73) >> [:3.1.0.RELEASE] >> at >> org.springframework.beans.factory.xml.BeanDefinitionParserDelegate.parseCustomElement(BeanDefinitionParserDelegate.java:1419) >> [:3.1.0.RELEASE] >> at >> org.springframework.beans.factory.xml.BeanDefinitionParserDelegate.parseCustomElement(BeanDefinitionParserDelegate.java:1409) >> [:3.1.0.RELEASE] >> at >> org.springframework.beans.factory.xml.DefaultBeanDefinitionDocumentReader.parseBeanDefinitions(DefaultBeanDefinitionDocumentReader.java:184) >> [:3.1.0.RELEASE] >> at >> org.springframework.beans.factory.xml.DefaultBeanDefinitionDocumentReader.doRegisterBeanDefinitions(DefaultBeanDefinitionDocumentReader.java:140) >> [:3.1.0.RELEASE] >> at >> org.springframework.beans.factory.xml.DefaultBeanDefinitionDocumentReader.registerBeanDefinitions(DefaultBeanDefinitionDocumentReader.java:111) >> [:3.1.0.RELEASE] >> at >> org.springframework.beans.factory.xml.XmlBeanDefinitionReader.registerBeanDefinitions(XmlBeanDefinitionReader.java:493) >> [:3.1.0.RELEASE] >> at >> org.springframework.beans.factory.xml.XmlBeanDefinitionReader.doLoadBeanDefinitions(XmlBeanDefinitionReader.java:390) >> [: > > > > > > -- > View this message in context: > http://camel.465427.n5.nabble.com/Class-Cast-error-upon-deploying-Camel-web-app-tp5732000p5732001.html > Sent from the Camel - Users mailing list archive at Nabble.com.
Class Cast error upon deploying Camel web app
Has anyone seen this error? I'm trying to deploy on JBoss6. I was able to deploy before without issues. I guess it's some kind of "classloader-Hell" issue due to JEE weirdness. Caused by: java.lang.ClassCastException: org.apache.xerces.dom.DeferredElementNSImpl cannot be cast to org.w3c.dom.Element at com.sun.xml.bind.unmarshaller.DOMScanner.scan(DOMScanner.java:100) [:2.2] at com.sun.xml.bind.v2.runtime.BinderImpl.associativeUnmarshal(BinderImpl.java:156) [:2.2] at com.sun.xml.bind.v2.runtime.BinderImpl.unmarshal(BinderImpl.java:127) [:2.2] at org.apache.camel.spring.handler.CamelNamespaceHandler.parseUsingJaxb(CamelNamespaceHandler.java:166) [:2.10.4] at org.apache.camel.spring.handler.CamelNamespaceHandler$CamelContextBeanDefinitionParser.doParse(CamelNamespaceHandler.java:306) [:2.10.4] at org.springframework.beans.factory.xml.AbstractSingleBeanDefinitionParser.parseInternal(AbstractSingleBeanDefinitionParser.java:85) [:3.1.0.RELEASE] at org.springframework.beans.factory.xml.AbstractBeanDefinitionParser.parse(AbstractBeanDefinitionParser.java:59) [:3.1.0.RELEASE] at org.springframework.beans.factory.xml.NamespaceHandlerSupport.parse(NamespaceHandlerSupport.java:73) [:3.1.0.RELEASE] at org.springframework.beans.factory.xml.BeanDefinitionParserDelegate.parseCustomElement(BeanDefinitionParserDelegate.java:1419) [:3.1.0.RELEASE] at org.springframework.beans.factory.xml.BeanDefinitionParserDelegate.parseCustomElement(BeanDefinitionParserDelegate.java:1409) [:3.1.0.RELEASE] at org.springframework.beans.factory.xml.DefaultBeanDefinitionDocumentReader.parseBeanDefinitions(DefaultBeanDefinitionDocumentReader.java:184) [:3.1.0.RELEASE] at org.springframework.beans.factory.xml.DefaultBeanDefinitionDocumentReader.doRegisterBeanDefinitions(DefaultBeanDefinitionDocumentReader.java:140) [:3.1.0.RELEASE] at org.springframework.beans.factory.xml.DefaultBeanDefinitionDocumentReader.registerBeanDefinitions(DefaultBeanDefinitionDocumentReader.java:111) [:3.1.0.RELEASE] at org.springframework.beans.factory.xml.XmlBeanDefinitionReader.registerBeanDefinitions(XmlBeanDefinitionReader.java:493) [:3.1.0.RELEASE] at org.springframework.beans.factory.xml.XmlBeanDefinitionReader.doLoadBeanDefinitions(XmlBeanDefinitionReader.java:390) [:
Re: Issue in JSON marshalling
Disregard my remark about using Spring to configure - I should have
read further down
on that page I referenced. You can do this:
On Fri, May 3, 2013 at 2:55 PM, Chris Wolf wrote:
> I an answer the first part:
>
> xmlJsonFormat.setForceTopLevelObject(true);
>
> See:
>
> http://camel.apache.org/xmljson.html
>
> You might need to instantiate the XmlJsonDataFormat using Spring bean rather
> then Camel
>
> Currently I'm using Java-DSL, but I think it would look like:
>
>
>
>
>
> or, if you include the 'p' namespace:
>
> xmlns:p="http://www.springframework.org/schema/p";
>
>
>p:setForceTopLevelObject="true"/>
>
>
> On Fri, May 3, 2013 at 9:03 AM, sarfaraj wrote:
>>
>> I have camel route which exposes web service. I want to accept a data from
>> web client and convert to JSON object.
>> Curently i am using SOAP UI to send input to above web service.
>>
>> # Here is my input...
>>
>>
>>
>> 1
>> abc
>>
>>
>>
>>
>> # My camel route is
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>> After running this, I get following Output i.e JSON data
>> [{"id":1,"name":"abc"}]
>>
>> So instead of [{"id":1,"name":"abc"}] , I need
>> {"*myData*":{"id":1,"name":"abc"}} because id and name are member of
>> myData
>> class.
>> Here it only return class member not the class.
>> Addition to above i also want to remove "[]" from JSON output.
>>
>> *Could some one tell me what changes i need to do on JSON data format to
>> achive this?*
>>
>> /Note: i referred http://camel.apache.org/json.html/
>>
>> /Sarfaraj
>>
>>
>>
>> --
>> View this message in context:
>> http://camel.465427.n5.nabble.com/Issue-in-JSON-marshalling-tp5731970.html
>> Sent from the Camel - Users mailing list archive at Nabble.com.
Re: Issue in JSON marshalling
I an answer the first part:
xmlJsonFormat.setForceTopLevelObject(true);
See:
http://camel.apache.org/xmljson.html
You might need to instantiate the XmlJsonDataFormat using Spring bean rather
then Camel
Currently I'm using Java-DSL, but I think it would look like:
or, if you include the 'p' namespace:
xmlns:p="http://www.springframework.org/schema/p";
On Fri, May 3, 2013 at 9:03 AM, sarfaraj wrote:
>
> I have camel route which exposes web service. I want to accept a data from
> web client and convert to JSON object.
> Curently i am using SOAP UI to send input to above web service.
>
> # Here is my input...
>
>
>
> 1
> abc
>
>
>
>
> # My camel route is
>
>
>
>
>
>
>
>
>
>
>
> After running this, I get following Output i.e JSON data
> [{"id":1,"name":"abc"}]
>
> So instead of [{"id":1,"name":"abc"}] , I need
> {"*myData*":{"id":1,"name":"abc"}} because id and name are member of
> myData
> class.
> Here it only return class member not the class.
> Addition to above i also want to remove "[]" from JSON output.
>
> *Could some one tell me what changes i need to do on JSON data format to
> achive this?*
>
> /Note: i referred http://camel.apache.org/json.html/
>
> /Sarfaraj
>
>
>
> --
> View this message in context:
> http://camel.465427.n5.nabble.com/Issue-in-JSON-marshalling-tp5731970.html
> Sent from the Camel - Users mailing list archive at Nabble.com.
Re: CamelHttpUri and Enricher
You didn't paste any of your code
In any case, here's what I'm doing and it works:
from("direct:readSFTPConfig").routeId("sftp.config")
.setHeader(Exchange.HTTP_URI, simple("http://
{{ds.host}}:{{ds.port}}/web/rest/client"))
.setHeader(Exchange.HTTP_QUERY, simple("clientId=${in.header.clientId}"))
.setHeader(Exchange.HTTP_METHOD, constant("GET"))
.enrich("http://ignored-set-by-header?throwExceptionOnFailure=false";)
[...]
On Fri, May 3, 2013 at 9:35 AM, Al Ferguson wrote:
> Hi,
>
> It seems I cannot enrich, what am I doing wrong?
>
> Why is the originalExchange is null?
>
>
> Thanks,
> Al. F
>
>
>
> --
> View this message in context:
> http://camel.465427.n5.nabble.com/CamelHttpUri-and-Enricher-tp5731924p5731975.html
> Sent from the Camel - Users mailing list archive at Nabble.com.
>
Re: JPA Component Behavior
If you look back at the entire thread:
http://camel.465427.n5.nabble.com/JPA-Component-Behavior-td5725781.html#a5731377
You can see that I solved this requirement by implementing a custom
PollingConsumerPollStrategy
called you use that plus configure the JPA consumer with "startScheduler=false"
Then, from your actionPerformed button code, or whatever code needs to trigger
the JPA poll, call a function with this code:
JpaConsumer jpaConsumer = null;
Route route = ctx.getRoute(routeId);
if (route == null) {
log.error("No route found with id \"{}\"", routeId);
return;
}
if ( ! (route.getConsumer() instanceof JpaConsumer)) {
log.error("Consumer must be of type JpaConsumer, the
configured consumer is of type {}",
route.getConsumer().getClass().getName());
return;
}
try {
if (jpaConsumer.isSuspended() || jpaConsumer.isSuspending()) {
jpaConsumer.resume();
} else {
// first time here - need to start scheduler
// why is startScheduler() "protected" - can't it be "public"?
Class superClass = jpaConsumer.getClass().getSuperclass();
superClass = superClass.getSuperclass();
Method m = superClass.getDeclaredMethod("startScheduler",
(Class[]) null);
m.setAccessible(true);
m.invoke(jpaConsumer, (Object[]) null);
}
} catch (Exception e1) {
e1.printStackTrace();
}
This is working fine for my use-case which is the same as yours...
Regards,
Chris
On Tue, Apr 23, 2013 at 5:10 PM, Christian Jacob wrote:
> Hi Claus,I'm very eager to get that feature, too. My requirements for a new
> project are:
> run on every 1st of a month (or some other Quartz clause) and then select
> all objects with status = 0
> have a user interface for an administrator in which he/she can customize
> some search arguments such as a time range in which a JPA object was
> created, different values for the status field, and so on. I'm surely fit
> enough to deliver such a UI, e.g. as JEE2. From that UI, I can produce a
> route with customized query criteria. But the point is: how do I make the
> JPA consumer run on a button click?
> In my opinion, scheduled poll consuming is not the only sceanrio in which
> database or JPA retrieval is required. Do you see a way with which I can
> achieve that? Or do I have to wait?
>
>
>
> --
> View this message in context:
> http://camel.465427.n5.nabble.com/JPA-Component-Behavior-tp5725781p5731377.html
> Sent from the Camel - Users mailing list archive at Nabble.com.
Getting a JMS RA-managed ConnectionFactory on JBoss-6.1.0
I am using the jms:// component in a Spring DSL route in JBoss6. I want to publish and subscribe to a topic. If I package my Camel in a web app, it cannot do a JNDI lookup on "java:JmsXA", which is the JMS connection factory managed by a resource adapter. If I package the same code as just a plain Spring app and deploy via JBoss "snowdrop" (kind of like CDI, but with Spring) - then the code successfully looks up "java:JmsXA". Does anyone have any experience with accessing JMS on a JEE server? I also posted a more detailed JBoss-specific question in this regard at: https://community.jboss.org/message/809836#809836 Thanks, Chris
Re: Problems with sftp in Camel 2.11.0
What happens if you specify the username as query parameter? sftp://myServer/subdir?username=myUser&password=myPassword&stepwise=false (I didn't upgrade, so I can't try it) On Tue, Apr 23, 2013 at 8:33 AM, Bengt Rodehav wrote: > I just upgraded from Camel 2.10.3 to 2.11.0 and I now cannot get my sftp > routes to work. > > I used to specify the sftp endpont as follows: > > sftp://myUser@myServer//subdir?password=myPassword&stepwise=false > > This worked fine in Camel 2.10.3. Note that I had to use double "/" to get > it to work. Using Camel 2.11.0 I get the following error: > > org.apache.camel.component.file.GenericFileOperationFailedException: Cannot > change directory to: // > > I tried removing the double "/", changing stepwise back and forth and also > tried changin the separator to UNIX/Windows. Nothing helps. I can't find > any combination that works. > > Does anyone have an idea what is happening and what has changed regarding > this in Camel 2.11.0. > > /Bengt
Re: FTP2: SFTP and target file paths
You should be able to do something like this:
to("file://tmp/${file:onlyname}");
See: http://camel.apache.org/file-language.html
On Mon, Apr 22, 2013 at 10:24 AM, mdo wrote:
> mdo wrote
>> from: sftp://localhost//home/user/
>> to: file://tmp/
>
> exchange.in.headers has the header "CamelFileName" where an SFTP consumed
> file has the complete path including the endpoint path whereas a file that
> comes from a FILE endpoint only has the relative path.
>
> When I insert this statement into my route I can fix this:
> .setHeader("CamelFileName",header("CamelFileRelativePath"))
>
> Is this meant to be that way?
>
> Regards, mdo.
>
>
>
>
>
> --
> View this message in context:
> http://camel.465427.n5.nabble.com/FTP2-SFTP-and-target-file-paths-tp5731220p5731265.html
> Sent from the Camel - Users mailing list archive at Nabble.com.
Re: Is the result of this builder reusable? XQueryBuilder.xquery("//foo");
Thanks Willem - that worked.
On Tue, Apr 2, 2013 at 10:33 PM, Willem jiang wrote:
> I think you can use the XQueryBuilder in the Processor just like you showed.
> If you want to call the evaluateAsString multiple times, you need to make
> sure the message body is reread able.
> You can convert the message body into String before you process it in your
> processor.
>
>
> --
> Willem Jiang
>
> Red Hat, Inc.
> FuseSource is now part of Red Hat
> Web: http://www.fusesource.com | http://www.redhat.com
> Blog: http://willemjiang.blogspot.com (http://willemjiang.blogspot.com/)
> (English)
> http://jnn.iteye.com (http://jnn.javaeye.com/) (Chinese)
> Twitter: willemjiang
> Weibo: 姜宁willem
>
>
>
>
> On Tuesday, April 2, 2013 at 11:01 PM, Chris Wolf wrote:
>
>> I want to perform an XQuery outside of DSL (in a Processor). Something like:
>>
>> XQueryBuilder hostXQ = XQueryBuilder
>> .xquery("//remote[remoteId/@value='CBOE34']/server/@value");
>> String host = hostXQ.evaluateAsString(exchange);
>>
>> Second question is can I parameterize the XQuery like so:
>>
>> XQueryBuilder hostXQ = XQueryBuilder
>> .xquery("//remote[remoteId/@value=$accountId]/server/@value");
>>
>> hostXQ.setParameters(new HashMap() {{
>> put("accountId", "CBOE34");}});
>> String host1 = hostXQ.evaluateAsString(exchange);
>>
>> hostXQ.setParameters(new HashMap() {{
>> put("accountId", "CBOE78");}});
>> String host2 = hostXQ.evaluateAsString(exchange);
>>
>>
>> Thanks,
>>
>>
>> Chris
>
>
Re: Why doesn't SFTP "move" option work??
I took the FromFtpMoveFileTest and modified it for SFTP - that works, so "move" works for SFTP. My problem is that because the current release requires hard-coding the URI for (s)ftp(s) consumer - I implemented a custom processor that instantiates the SFTP component, SFTP endpoint and SFTP consumer, all programatically. Obviously, I'm missing something. Unfortunately, it's pretty much a show-stopper for us to not be able to SFTP *from* (consume) dynamically (runtime-calculated) URIs. On Wed, Apr 17, 2013 at 4:54 PM, Chris Wolf wrote: > I notice there's a unit test, FromFtpMoveFileTest, for plain FTP, but > not for SFTP - should I file a bug, or am I doing something > wrong? > > On Wed, Apr 17, 2013 at 11:39 AM, Chris Wolf wrote: >> Trying to use Sftp component. I am using localWorkDirectory because >> I don't want the whole files loaded into memory. >> Seems like the files *are* being downloaded but they are NOT being >> moved, on the remote side to the directory indicated by the "move" >> option. >> >> >> Here, on a poll, it gets a file, while downloading to >> "localWorkDirectory", the file's name is appended with ".inprogress", >> then it's >> renamed to the base file name without ".inprogress" - so far, so good, >> except on the server-side, it's not moved to the "move" directory. >> >> [#4 - sftp://localhost/download] SftpOperations DEBUG Retrieve file to >> local work file result: true >> [#4 - sftp://localhost/download] SftpOperations TRACE Renaming local >> in progress file from: >> \tmp\local\ftpwork\ADPT5_MKT_20120319_VOIR_DAILY.csv.inprogress to: >> \tmp\local\ftpwork\ADPT5_MKT_20120319_VOIR_DAILY.csv >> [#4 - sftp://localhost/download] SftpConsumer TRACE Retrieved file: >> download/ADPT5_MKT_20120319_VOIR_DAILY.csv from: >> Endpoint[sftp://localhost/download] >> >> ...then, at poll n+1, I see: >> >> [#4 - sftp://localhost/download] SftpConsumer TRACE >> SftpFile[fileName=ADPT5_MKT_20120319_VOIR_DAILY.csv, >> longName=-rwxrwxrwx 1 adpt5adpt5 298313 Apr 17 09:42 >> ADPT5_MKT_20120319_VOIR_DAILY.csv, dir=false] >> [#4 - sftp://localhost/download] SftpConsumer TRACE Skipping as file >> is already in progress: ADPT5_MKT_20120319_VOIR_DAILY.csv >> >> I guess that's the idempotent mechanism, but that file should have >> been moved out of that directory. >> >> >> SftpConfiguration: >> >> chmod = null, >> ciphers = null, >> compression = 0, >> connectTimeout = 1, >> directory = download, >> host = localhost, >> knownHostsFile = null, >> password = adpt5, >> port = 22, >> privateKeyFile = null, >> privateKeyFilePassphrase = null, >> protocol = sftp, >> separator = UNIX, >> serverAliveCountMax = 1, >> serverAliveInterval = 0, >> siteCommand = null, >> soTimeout = 0, >> strictHostKeyChecking = no, >> timeout = 3, >> username = adpt5, >> binary = true, >> passiveMode = false, >> stepwise = true, >> throwExceptionOnConnectFailed = false >> >> [1) thread #0 - timer://kickoff] INFO SftpEndpoint: >> antFilter = null, >> bufferSize = 131072, >> camelContext = CamelContext(camel-1), >> charset = null, >> component = org.apache.camel.component.file.remote.SftpComponent@1e34f445, >> configuration = download, >> consumerProperties = null, >> doneFileName = null, >> endpointConfiguration = >> org.apache.camel.impl.MappedEndpointConfiguration@8292f75a, >> endpointKey = sftp://localhost/download, >> endpointUri = sftp://localhost/download, >> exchangePattern = InOnly, >> exchanges = [Exchange[ADPT5_MKT_20090211_MICF.csv], >> Exchange[ADPT5_MKT_20090211_MINOCF.csv], >> Exchange[ADPT5_MKT_20090305_VOE.csv], >> Exchange[ADPT5_MKT_20090305_VOIR.csv], >> Exchange[ADPT5_MKT_20120319_DAILY.csv], >> Exchange[ADPT5_MKT_20120319_FX.csv], >> Exchange[ADPT5_MKT_20120319_MTX_DAILY.csv], >> Exchange[ADPT5_MKT_20120319_VOIR_DAILY.csv], >> Exchange[ADPT5_MKT_20121121_HISTORY_EUR_IRBank-FZ-D.csv], >> Exchange[ADPT5_MKT_20121121_HISTORY_EUR_IRBank-FZ-M.csv], >> Exchange[ADPT5_MKT_20121121_HISTORY_EUR_IRBank-FZ-Y.csv]], >> exclude = null, >> exclusiveReadLockStrategy = null, >> fileExist = Override, >> fileName = null, >> fileSeparator = /, >> filter = ms.algo.adapt.camel.cpmd.CPMDFileFilter@54aa2db, >> genericFileProcessStrategy = >> org.apache.camel.component.file.strategy.GenericFileRenameProcessStrategy@67b14530, >>
Re: Why doesn't SFTP "move" option work??
I notice there's a unit test, FromFtpMoveFileTest, for plain FTP, but
not for SFTP - should I file a bug, or am I doing something
wrong?
On Wed, Apr 17, 2013 at 11:39 AM, Chris Wolf wrote:
> Trying to use Sftp component. I am using localWorkDirectory because
> I don't want the whole files loaded into memory.
> Seems like the files *are* being downloaded but they are NOT being
> moved, on the remote side to the directory indicated by the "move"
> option.
>
>
> Here, on a poll, it gets a file, while downloading to
> "localWorkDirectory", the file's name is appended with ".inprogress",
> then it's
> renamed to the base file name without ".inprogress" - so far, so good,
> except on the server-side, it's not moved to the "move" directory.
>
> [#4 - sftp://localhost/download] SftpOperations DEBUG Retrieve file to
> local work file result: true
> [#4 - sftp://localhost/download] SftpOperations TRACE Renaming local
> in progress file from:
> \tmp\local\ftpwork\ADPT5_MKT_20120319_VOIR_DAILY.csv.inprogress to:
> \tmp\local\ftpwork\ADPT5_MKT_20120319_VOIR_DAILY.csv
> [#4 - sftp://localhost/download] SftpConsumer TRACE Retrieved file:
> download/ADPT5_MKT_20120319_VOIR_DAILY.csv from:
> Endpoint[sftp://localhost/download]
>
> ...then, at poll n+1, I see:
>
> [#4 - sftp://localhost/download] SftpConsumer TRACE
> SftpFile[fileName=ADPT5_MKT_20120319_VOIR_DAILY.csv,
> longName=-rwxrwxrwx 1 adpt5adpt5 298313 Apr 17 09:42
> ADPT5_MKT_20120319_VOIR_DAILY.csv, dir=false]
> [#4 - sftp://localhost/download] SftpConsumer TRACE Skipping as file
> is already in progress: ADPT5_MKT_20120319_VOIR_DAILY.csv
>
> I guess that's the idempotent mechanism, but that file should have
> been moved out of that directory.
>
>
> SftpConfiguration:
>
> chmod = null,
> ciphers = null,
> compression = 0,
> connectTimeout = 1,
> directory = download,
> host = localhost,
> knownHostsFile = null,
> password = adpt5,
> port = 22,
> privateKeyFile = null,
> privateKeyFilePassphrase = null,
> protocol = sftp,
> separator = UNIX,
> serverAliveCountMax = 1,
> serverAliveInterval = 0,
> siteCommand = null,
> soTimeout = 0,
> strictHostKeyChecking = no,
> timeout = 3,
> username = adpt5,
> binary = true,
> passiveMode = false,
> stepwise = true,
> throwExceptionOnConnectFailed = false
>
> [1) thread #0 - timer://kickoff] INFO SftpEndpoint:
> antFilter = null,
> bufferSize = 131072,
> camelContext = CamelContext(camel-1),
> charset = null,
> component = org.apache.camel.component.file.remote.SftpComponent@1e34f445,
> configuration = download,
> consumerProperties = null,
> doneFileName = null,
> endpointConfiguration =
> org.apache.camel.impl.MappedEndpointConfiguration@8292f75a,
> endpointKey = sftp://localhost/download,
> endpointUri = sftp://localhost/download,
> exchangePattern = InOnly,
> exchanges = [Exchange[ADPT5_MKT_20090211_MICF.csv],
> Exchange[ADPT5_MKT_20090211_MINOCF.csv],
> Exchange[ADPT5_MKT_20090305_VOE.csv],
> Exchange[ADPT5_MKT_20090305_VOIR.csv],
> Exchange[ADPT5_MKT_20120319_DAILY.csv],
> Exchange[ADPT5_MKT_20120319_FX.csv],
> Exchange[ADPT5_MKT_20120319_MTX_DAILY.csv],
> Exchange[ADPT5_MKT_20120319_VOIR_DAILY.csv],
> Exchange[ADPT5_MKT_20121121_HISTORY_EUR_IRBank-FZ-D.csv],
> Exchange[ADPT5_MKT_20121121_HISTORY_EUR_IRBank-FZ-M.csv],
> Exchange[ADPT5_MKT_20121121_HISTORY_EUR_IRBank-FZ-Y.csv]],
> exclude = null,
> exclusiveReadLockStrategy = null,
> fileExist = Override,
> fileName = null,
> fileSeparator = /,
> filter = ms.algo.adapt.camel.cpmd.CPMDFileFilter@54aa2db,
> genericFileProcessStrategy =
> org.apache.camel.component.file.strategy.GenericFileRenameProcessStrategy@67b14530,
> id = endpoint13,
> idempotentRepository = null,
> include = null,
> inProgressRepository =
> org.apache.camel.processor.idempotent.MemoryIdempotentRepository@563b100c,
> localWorkDirectory = /tmp/local/ftpwork,
> maxDepth = 2147483647,
> maximumReconnectAttempts = 3,
> maxMessagesPerPoll = 0,
> minDepth = 0,
> move = ${file:parent}/../archive/${file:onlyname},,
> moveExisting = null,
> moveFailed = null,
> preMove = null,
> processStrategy =
> org.apache.camel.component.file.strategy.GenericFileRenameProcessStrategy@67b14530,
> readLock = none,
> readLockCheckInterval = 5000,
> readLockMinLength = 1,
> readLockTimeout = 2,
> reconnectDelay = 1000,
> scheme = sftp,
> sortBy = null,
> sorter = null,
> status = Started,
> tempFileName = null,
> tempPrefix = null,
> version = 2.10.4,
> allowNullBody = false,
> autoCreate = true,
> delete = false,
> directoryMustExist = false,
> disconnect = false,
> eagerDeleteTargetFile = true,
> eagerMaxMessagesPerPoll = true,
> fastExistsCheck = false,
> flatten = false,
> keepLastModified = false,
> lenientProperties = false,
> noop = false,
> recursive = false,
> runAllowed = true,
> singleton = true,
> started = true,
> starting = false,
> startingDirectoryMustExist = false,
> stopped = false,
> stopping = false,
> suspended = false,
> suspending = false,
> synchronous = false
Why doesn't SFTP "move" option work??
Trying to use Sftp component. I am using localWorkDirectory because
I don't want the whole files loaded into memory.
Seems like the files *are* being downloaded but they are NOT being
moved, on the remote side to the directory indicated by the "move"
option.
Here, on a poll, it gets a file, while downloading to
"localWorkDirectory", the file's name is appended with ".inprogress",
then it's
renamed to the base file name without ".inprogress" - so far, so good,
except on the server-side, it's not moved to the "move" directory.
[#4 - sftp://localhost/download] SftpOperations DEBUG Retrieve file to
local work file result: true
[#4 - sftp://localhost/download] SftpOperations TRACE Renaming local
in progress file from:
\tmp\local\ftpwork\ADPT5_MKT_20120319_VOIR_DAILY.csv.inprogress to:
\tmp\local\ftpwork\ADPT5_MKT_20120319_VOIR_DAILY.csv
[#4 - sftp://localhost/download] SftpConsumer TRACE Retrieved file:
download/ADPT5_MKT_20120319_VOIR_DAILY.csv from:
Endpoint[sftp://localhost/download]
...then, at poll n+1, I see:
[#4 - sftp://localhost/download] SftpConsumer TRACE
SftpFile[fileName=ADPT5_MKT_20120319_VOIR_DAILY.csv,
longName=-rwxrwxrwx 1 adpt5adpt5 298313 Apr 17 09:42
ADPT5_MKT_20120319_VOIR_DAILY.csv, dir=false]
[#4 - sftp://localhost/download] SftpConsumer TRACE Skipping as file
is already in progress: ADPT5_MKT_20120319_VOIR_DAILY.csv
I guess that's the idempotent mechanism, but that file should have
been moved out of that directory.
SftpConfiguration:
chmod = null,
ciphers = null,
compression = 0,
connectTimeout = 1,
directory = download,
host = localhost,
knownHostsFile = null,
password = adpt5,
port = 22,
privateKeyFile = null,
privateKeyFilePassphrase = null,
protocol = sftp,
separator = UNIX,
serverAliveCountMax = 1,
serverAliveInterval = 0,
siteCommand = null,
soTimeout = 0,
strictHostKeyChecking = no,
timeout = 3,
username = adpt5,
binary = true,
passiveMode = false,
stepwise = true,
throwExceptionOnConnectFailed = false
[1) thread #0 - timer://kickoff] INFO SftpEndpoint:
antFilter = null,
bufferSize = 131072,
camelContext = CamelContext(camel-1),
charset = null,
component = org.apache.camel.component.file.remote.SftpComponent@1e34f445,
configuration = download,
consumerProperties = null,
doneFileName = null,
endpointConfiguration =
org.apache.camel.impl.MappedEndpointConfiguration@8292f75a,
endpointKey = sftp://localhost/download,
endpointUri = sftp://localhost/download,
exchangePattern = InOnly,
exchanges = [Exchange[ADPT5_MKT_20090211_MICF.csv],
Exchange[ADPT5_MKT_20090211_MINOCF.csv],
Exchange[ADPT5_MKT_20090305_VOE.csv],
Exchange[ADPT5_MKT_20090305_VOIR.csv],
Exchange[ADPT5_MKT_20120319_DAILY.csv],
Exchange[ADPT5_MKT_20120319_FX.csv],
Exchange[ADPT5_MKT_20120319_MTX_DAILY.csv],
Exchange[ADPT5_MKT_20120319_VOIR_DAILY.csv],
Exchange[ADPT5_MKT_20121121_HISTORY_EUR_IRBank-FZ-D.csv],
Exchange[ADPT5_MKT_20121121_HISTORY_EUR_IRBank-FZ-M.csv],
Exchange[ADPT5_MKT_20121121_HISTORY_EUR_IRBank-FZ-Y.csv]],
exclude = null,
exclusiveReadLockStrategy = null,
fileExist = Override,
fileName = null,
fileSeparator = /,
filter = ms.algo.adapt.camel.cpmd.CPMDFileFilter@54aa2db,
genericFileProcessStrategy =
org.apache.camel.component.file.strategy.GenericFileRenameProcessStrategy@67b14530,
id = endpoint13,
idempotentRepository = null,
include = null,
inProgressRepository =
org.apache.camel.processor.idempotent.MemoryIdempotentRepository@563b100c,
localWorkDirectory = /tmp/local/ftpwork,
maxDepth = 2147483647,
maximumReconnectAttempts = 3,
maxMessagesPerPoll = 0,
minDepth = 0,
move = ${file:parent}/../archive/${file:onlyname},,
moveExisting = null,
moveFailed = null,
preMove = null,
processStrategy =
org.apache.camel.component.file.strategy.GenericFileRenameProcessStrategy@67b14530,
readLock = none,
readLockCheckInterval = 5000,
readLockMinLength = 1,
readLockTimeout = 2,
reconnectDelay = 1000,
scheme = sftp,
sortBy = null,
sorter = null,
status = Started,
tempFileName = null,
tempPrefix = null,
version = 2.10.4,
allowNullBody = false,
autoCreate = true,
delete = false,
directoryMustExist = false,
disconnect = false,
eagerDeleteTargetFile = true,
eagerMaxMessagesPerPoll = true,
fastExistsCheck = false,
flatten = false,
keepLastModified = false,
lenientProperties = false,
noop = false,
recursive = false,
runAllowed = true,
singleton = true,
started = true,
starting = false,
startingDirectoryMustExist = false,
stopped = false,
stopping = false,
suspended = false,
suspending = false,
synchronous = false
Re: I'm confused about FTP option "localWorkDirectory"
Ok, I forgot about implicit type conversion. I can see that if RemoteFile gets routed to, for example, a bean method with signature public void processFile(InputStream input), that Camel will convert RemoteFile to BufferedInputStream. I also was able to get a valid java.io.File instance by calling .convertBodyTo(File.class); Ok, I'm good to go... Thanks, Chris On Fri, Apr 12, 2013 at 12:25 PM, Chris Wolf wrote: > I read the documentation: > http://camel.apache.org/ftp.html > > and want to FTP large files, as such, I don't want the entire file > loaded into memory - I thought the "localWorkDirectory" option would > allow this. That web page says, > "It will download the remote file directly to a local file stream. The > java.io.File handle is then used as the Exchange body." > > Well, that's not what I'm seeing - what I see is that the body is of type > > , BodyType:org.apache.camel.component.file.remote.RemoteFile > , Body:[Body is file based: RemoteFile[giant_dataset.csv]] > > ...but I expected it to be of type java.io.File, like the local > file:// component and like the ftp documentation says. > > When stepping through the code, I see that the file *is* being > downloaded to the work dir. > If I look at the various fields of RemoteFile in the debugger, I don't > see anything indicating a file path which includes the local work > directory. > > So how, exactly, does the localWorkDirectory mechanism work and is it > true that it won't load the whole file into memory? Why isn't the > exchange body of type java.io.File or java.io.InputStream? - I'm > confused - please help... > > -Chris
Re: Is there a way to programmatically get the the downstream endpoint from a custom Processor?
I can see how that would work, but if I'm going to register the
down-stream endpoint,
I may as well just set the ProducerTemplate, but it's an interesting idea..
On Fri, Apr 12, 2013 at 12:35 PM, Raul Kripalani wrote:
> One solution is to parametrize the downstream endpoint in the Registry.
>
> from("...").process(new MyProcessor()).to(myDownstreamEndpoint);
>
> where myDownstreamEndpoint is a bean property of type String that gets
> injected via Spring or Blueprint during the route initialization.
>
> It should always have the same bean name in all contexts, e.g.
> ("myDownstreamEndpoint"), so then from MyProcessor you can do the following
> lookup:
>
> String uri = exchange.getRegistry().lookup("myDownstreamEndpoint",
> String.class);
>
> The condition is, of course, that all Camel Contexts using this processor
> must have this property in their Application/Blueprint Contexts.
>
> Hope that helps,
>
> *Raúl Kripalani*
> Enterprise Architect, Open Source Integration specialist, Program
> Manager | Apache
> Camel Committer
> http://about.me/raulkripalani | http://www.linkedin.com/in/raulkripalani
> http://blog.raulkr.net | twitter: @raulvk
>
> On Fri, Apr 12, 2013 at 4:36 PM, Chris Wolf wrote:
>
>> The reason I asked is because now I have to set default Endpoint or URI in
>> the producer template - it would be nice if the default setting would be
>> the next down-stream endpoint.
>>
>>
>> On Thu, Apr 11, 2013 at 8:53 PM, Willem jiang > >wrote:
>>
>> > ProducerTemplate can send the exchange to any other endpoints.
>> > Processor is decoupled with the camel route, I don't think you can get
>> the
>> > downstream endpoint from the custom Processor itself.
>> >
>> >
>> > --
>> > Willem Jiang
>> >
>> > Red Hat, Inc.
>> > FuseSource is now part of Red Hat
>> > Web: http://www.fusesource.com | http://www.redhat.com
>> > Blog: http://willemjiang.blogspot.com (http://willemjiang.blogspot.com/)
>> > (English)
>> > http://jnn.iteye.com (http://jnn.javaeye.com/) (Chinese)
>> > Twitter: willemjiang
>> > Weibo: 姜宁willem
>> >
>> >
>> >
>> >
>> >
>> > On Friday, April 12, 2013 at 8:08 AM, Chris Wolf wrote:
>> >
>> > > Hello,
>> > >
>> > > I'm implementing a custom Processor - it will have a ProducerTemplate,
>> > > which will always
>> > > send to the next Endpoint, downstream - why do I have to set the
>> > > defaultEndpoint
>> > > or defaultEndpointURI? That guarantees hardcoding. Isn't there someway
>> to
>> > > indicate,
>> > > upon CamelContext.createProducerTemplate() to imply next downstream
>> > > Endpoint?
>> > >
>> > > It's not a show-stopper, I can explicitly configure the Producer
>> > > defaultEndpoint, but I don't
>> > > know why it can't default to the next down-stream consuming endpoint...
>> > >
>> > > Thanks,
>> > >
>> > > Chris
>> >
>> >
>> >
>>
I'm confused about FTP option "localWorkDirectory"
I read the documentation: http://camel.apache.org/ftp.html and want to FTP large files, as such, I don't want the entire file loaded into memory - I thought the "localWorkDirectory" option would allow this. That web page says, "It will download the remote file directly to a local file stream. The java.io.File handle is then used as the Exchange body." Well, that's not what I'm seeing - what I see is that the body is of type , BodyType:org.apache.camel.component.file.remote.RemoteFile , Body:[Body is file based: RemoteFile[giant_dataset.csv]] ...but I expected it to be of type java.io.File, like the local file:// component and like the ftp documentation says. When stepping through the code, I see that the file *is* being downloaded to the work dir. If I look at the various fields of RemoteFile in the debugger, I don't see anything indicating a file path which includes the local work directory. So how, exactly, does the localWorkDirectory mechanism work and is it true that it won't load the whole file into memory? Why isn't the exchange body of type java.io.File or java.io.InputStream? - I'm confused - please help... -Chris
Re: Is there a standard, DSL way to put message body in registry?
Right - ok, that sounds good. I forgot that a property value can be an object not just a String. On Thu, Apr 11, 2013 at 9:46 PM, Willem jiang wrote: > If you put a object into the exchange properties, you can lookup it later > in other processor. > > > -- > Willem Jiang > > Red Hat, Inc. > FuseSource is now part of Red Hat > Web: http://www.fusesource.com | http://www.redhat.com > Blog: http://willemjiang.blogspot.com (http://willemjiang.blogspot.com/) > (English) > http://jnn.iteye.com (http://jnn.javaeye.com/) (Chinese) > Twitter: willemjiang > Weibo: 姜宁willem > > > > > > On Thursday, April 11, 2013 at 10:41 PM, Chris Wolf wrote: > > > I know I could implement a custom Processor, but I was wondering if there > > was a Java and Spring DSL way to put objects in the registry and lookup > > them up later. > > > > Thanks, > > > > > > Chris > > >
Re: Is there a way to programmatically get the the downstream endpoint from a custom Processor?
The reason I asked is because now I have to set default Endpoint or URI in the producer template - it would be nice if the default setting would be the next down-stream endpoint. On Thu, Apr 11, 2013 at 8:53 PM, Willem jiang wrote: > ProducerTemplate can send the exchange to any other endpoints. > Processor is decoupled with the camel route, I don't think you can get the > downstream endpoint from the custom Processor itself. > > > -- > Willem Jiang > > Red Hat, Inc. > FuseSource is now part of Red Hat > Web: http://www.fusesource.com | http://www.redhat.com > Blog: http://willemjiang.blogspot.com (http://willemjiang.blogspot.com/) > (English) > http://jnn.iteye.com (http://jnn.javaeye.com/) (Chinese) > Twitter: willemjiang > Weibo: 姜宁willem > > > > > > On Friday, April 12, 2013 at 8:08 AM, Chris Wolf wrote: > > > Hello, > > > > I'm implementing a custom Processor - it will have a ProducerTemplate, > > which will always > > send to the next Endpoint, downstream - why do I have to set the > > defaultEndpoint > > or defaultEndpointURI? That guarantees hardcoding. Isn't there someway to > > indicate, > > upon CamelContext.createProducerTemplate() to imply next downstream > > Endpoint? > > > > It's not a show-stopper, I can explicitly configure the Producer > > defaultEndpoint, but I don't > > know why it can't default to the next down-stream consuming endpoint... > > > > Thanks, > > > > Chris > > >
Is there a way to programmatically get the the downstream endpoint from a custom Processor?
Hello, I'm implementing a custom Processor - it will have a ProducerTemplate, which will always send to the next Endpoint, downstream - why do I have to set the defaultEndpoint or defaultEndpointURI? That guarantees hardcoding. Isn't there someway to indicate, upon CamelContext.createProducerTemplate() to imply next downstream Endpoint? It's not a show-stopper, I can explicitly configure the Producer defaultEndpoint, but I don't know why it can't default to the next down-stream consuming endpoint... Thanks, Chris
Is there a standard, DSL way to put message body in registry?
I know I could implement a custom Processor, but I was wondering if there was a Java and Spring DSL way to put objects in the registry and lookup them up later. Thanks, Chris
Re: How to use quartz to schedule a file transfer ?
You don't directly use the Quartz Component - you use a RoutePolicy, of
which two concrete implementations will setup
the Quartz Component and register it in the context for you.
Here's an example from:
http://camel.apache.org/simplescheduledroutepolicy.html
...which I changed a little to match your question.
See also:
http://camel.apache.org/routepolicy.html
http://camel.apache.org/scheduledroutepolicy.html
http://camel.apache.org/simplescheduledroutepolicy.html
http://camel.apache.org/cronscheduledroutepolicy.html
SimpleScheduledRoutePolicy policy = new
SimpleScheduledRoutePolicy();long startTime =
System.currentTimeMillis() + 3000L;
policy.setRouteStartDate(new Date(startTime));
policy.setRouteStartRepeatCount(1);
policy.setRouteStartRepeatInterval(3000);
from("file:/tmp/inputdir").routeId("file.test")
.routePolicy(policy).noAutoStartup()
.to("file:/tmp/destdir");
-Chris
On Wed, Apr 10, 2013 at 6:27 PM, lleclerc wrote:
> Hi,
>
> How to use quartz to schedule a file transfer ?
> from(quartzUri).to(fileUri1).to(fileUri2); doesn't seems to work.
>
> Thanks,
>
>
>
> --
> View this message in context:
> http://camel.465427.n5.nabble.com/How-to-use-quartz-to-schedule-a-file-transfer-tp5730696.html
> Sent from the Camel - Users mailing list archive at Nabble.com.
>
Re: Callback after startup from org.apache.camel.main.Main afterStart()
What I did was extend Main, overriding:
protected AbstractApplicationContext createDefaultApplicationContext();
The overridden method looks like:
@Override
public AbstractApplicationContext createDefaultApplicationContext() {
AbstractApplicationContext appctx =
super.createDefaultApplicationContext();
appctx.addApplicationListener(new
ApplicationListener() {
@Override
public void onApplicationEvent(ContextStartedEvent event) {
LOG.info("** CONTEXT STARTED...");
}});
return appctx;
}
Works for me...
-Chris
On Tue, Apr 9, 2013 at 9:49 AM, Claus Ibsen wrote:
> Hi
>
> Yeah we probably need some API on MainSupport so you can add a custom
> EventNotifier, which we then add to the CamelContext before its
> started.
>
> Though another option that may be easier is just to have a beforeStart
> | beforeStop method which you can implement and do your custom code
> there. A bit like what you did, but IMHO should have simpler api's
> than a Callable et all.
>
> On Mon, Apr 8, 2013 at 6:34 PM, Andrew Bailey
> wrote:
> > Claus, thanks for the reply.
> >
> > Ok I tried that, however, if in the bootstrap code in main just before
> > calling run() I place
> >
> > List contexts=getCamelContexts();
> > System.out.println(contexts); // []
> > CamelContext context=contexts.get(0);
> > //IndexOutOfBoundsException: Index: 0, Size: 0
> > context.getManagementStrategy().addEventNotifier(new
> > MyLoggingSentEventNotifer()); //as in
> >
> http://camel.apache.org/eventnotifier-to-log-details-about-all-sent-exchanges.html
> > run();
> >
> > It produces
> > []
> > Exception in thread "main" java.lang.IndexOutOfBoundsException: Index: 0,
> > Size: 0
> >
> > Is this a bug or am I doing something wrong?
> >
> >
> >
> > On Fri, Apr 5, 2013 at 9:24 AM, Claus Ibsen
> wrote:
> >
> >> Hi
> >>
> >> Yeah we could add some methods to the Main class you can override to
> >> have callbacks after start | before stop etc.
> >> But you can also just use the event notifier api in Camel for that.
> >>
> >>
> >>
> >> On Wed, Apr 3, 2013 at 4:17 PM, Andrew Bailey
> >> wrote:
> >> > I have a use case, where I require a fast startup time for camel and
> wish
> >> > to avoid classpath scanning.
> >> > I use the Main class however it appears that its not possible to
> obtain a
> >> > ProducerTemplate template = getCamelTemplate();
> >> > before calling the run method. (it produces an ArrayOutOfBounds
> >> exception -
> >> > I could file a bug for that if you like)
> >> >
> >> > What I did was to extend Main (see code fragment below) and add a
> >> callback
> >> > called from the afterStart() method, so that user code can access the
> >> > context, and TypeConverterRegistry (as before that it is not
> >> initialized).
> >> >
> >> > Is there a better way to do it?
> >> >
> >> > If not and the developers think its a good idea, I would like to
> >> contribute
> >> > the code for a future release.
> >> >
> >> >
> >> > Thanks
> >> >
> >> > Andy
> >> >
> >> >
> >> > import org.apache.camel.main.Main;
> >> >
> >> > public class ServiceManager extends Main {
> >> >
> >> >
> >> > public static void main(String[] args) throws Exception {
> >> > ServiceManager example = new ServiceManager();
> >> > example.boot();
> >> > }
> >> >
> >> > public void boot() throws Exception {
> >> > //cut
> >> >
> >> > setAfterStartCallback(new Callable(){
> >> > public Void call() throws Exception
> >> > {
> >> > ProducerTemplate template =
> getCamelTemplate();
> >> >
> >> > fileMonitor.setProducer(template);
> >> >
> >> >/*
> >> >List contexts=getCamelContexts();
> >> >System.out.println(contexts);
> >> >CamelContext context=contexts.get(0);
> >> >TypeConverterRegistry converterRegistry =
> >> > context.getTypeConverterRegistry();
> >> >TypeConverter converter =
> >> > converterRegistry.lookup(String[].class, String.class);
> >> >System.out.println("Converter "+converter);
> >> >
> >> >TypeConverter converter2 =
> >> > converterRegistry.lookup(List.class, String.class);
> >> >System.out.println("Converter "+converter2);
> >> >
> >> >*/
> >> >return null;
> >> > }
> >> > });
> >> > //code cut
> >> > System.out.println("Starting Camel. Use ctrl + c to terminate the
> >> > JVM.\n");
> >> > run();
> >> > }
> >> >
> >> > private Callable afterStartCallback;
> >> >
> >> > @Override
> >> > protected void afterStart() throws Exception {
> >> >
> >> > if (afterStartCallback!=null) afterStartC
Re: Camel routing issue
You're asking about a problem with "CARD_EVENT_PREDICATE" without including
the definition of that?
On Tue, Apr 9, 2013 at 8:31 AM, prabumc...@gmail.com
wrote:
> Hi Chris,
>
> from(CARD_TYPE_SPECIFIC_QNAME).choice()
> .when(SCHEDULE_PREDICATE).multicast().to(CARD_QNAME,SCHEDULE_QNAME);
> .when(CARD_EVENT_PREDICATE).to(CARD_EVENT_CARE_HANDLER_QNAME)
> .otherwise()
> .setHeader(PROPERTY_ORIGINAL_DESTINATION,
> constant(PROPERTY_ORIGINAL_DESTINATION_VALUE))
> .to(ERQ_QNAME)
> .end();
>
> When i compile above code i am getting followin
>
> lder.java:115: illegal start of expression
> .when(CARD_EVENT_PREDICATE).to(CARD_EVENT_CARE_HANDLER_QNAME)
> ^
>
> Please kindly help me,i am doing any syntax mistake here
>
> *Regards*
> Prabu.N
>
>
>
>
>
> On Fri, Apr 5, 2013 at 3:58 PM, Prabu wrote:
>
> > Thanks Chris/Claus it worked,
> >
> >
> > Hi Chris/Claus,
> >
> > When running active-mq 5.8 i am getting following issue,do you have any
> > idea.
> >
> > 2013-04-05 05:26:16,312 | WARN | Async error occurred:
> > java.lang.IllegalStateException: Cannot add a consumer to a connection
> that
> > had not been registered:
> >
> >
> > *Regards*
> > Prabu.N
> >
> >
> >
> >
> > On Thu, Apr 4, 2013 at 6:55 PM, Chris Wolf wrote:
> >
> >> 1.) You're NOT using my code - it's still the same as you had before
> >> 2.) You're still calling setHeader(java.lang.String, java.lang.String)
> >> even though I tried to tell you that it has to be
> >> setHeader(java.lang.String, org.apache.camel.Expression)
> >>
> >> On Wed, Apr 3, 2013 at 2:51 PM, Prabu wrote:
> >> > Please kindly help me...
> >> >
> >> > On Apr 3, 2013 8:54 PM, "Prabu" wrote:
> >> >>
> >> >> Hi Chris,
> >> >>
> >> >> I used your code.But i am getting following compilation error
> >> >>
> >> >> lder.java:92: cannot find symbol
> >> >> symbol : method setHeader(java.lang.String,java.lang.String)
> >> >> location: class org.apache.camel.model.ChoiceDefinition
> >> >> .otherwise().setHeader("MyHeader","sdfsdf")
> >> >>
> >> >>
> >> >> Note: I am using camel 2.10 version
> >> >>
> >> >>
> >> >>
> >> >> On Wed, Apr 3, 2013 at 8:22 PM, Chris Wolf
> >> wrote:
> >> >>>
> >> >>> Hi Prabu,
> >> >>>
> >> >>> I don't mind helping, but could you continue to use the
> >> >>> users@camel.apache.org rather then my private email? That way, if
> >> >>> other people have similar issues, they can benefit.
> >> >>>
> >> >>>
> >> >>> from(GMD_TEST_TYPE_SPECIFIC_QNAME).choice(
> >> >>>.when(TEST_EVENT_PREDICATE).to(LOGGING_HANDLER_QNAME)
> >> >>>.otherwise()
> >> >>>.setHeader("MyHeader", constant("some-value")) // <===
> Set
> >> >>> Header
> >> >>>.to(ERQ_QNAME)
> >> >>>.end();
> >> >>>
> >> >>> This technique will use the "simple" language function "constant" to
> >> >>> set a string constant value.
> >> >>> If the value you need to set is dynamic, then you could use a
> >> >>> property placeholder.
> >> >>>
> >> >>> from(GMD_TEST_TYPE_SPECIFIC_QNAME).choice(
> >> >>>.when(TEST_EVENT_PREDICATE).to(LOGGING_HANDLER_QNAME)
> >> >>>.otherwise()
> >> >>>.setHeader("MyHeader", constant("{{some-prop}}")) //
> <===
> >> Set
> >> >>> Header
> >> >>>.to(ERQ_QNAME)
> >> >>>.end();
> >> >>>
> >> >>> There are even more sophisticated ways to acquire dynamic values:
> >> >>>
> >> >>> http://camel.apache.org/python.html
> >> >>>
> >> >>> Regards,
> >> >>>
> >> >>> Chris
> >> >>>
> >> >>> On Wed, Apr 3, 2013 at 9:52 AM, Prabu wrote:
> >> >>> > I have code like t
When is an (S)FTP file no longer "in progress"?
Hi,
I created a custom Processor with producer template to perform SFTP
rather then using the sftp component normally,
due to the lack of dynamic URI capability for consumer.
onent.file.remote.SftpConsumer TRACE Skipping as file is already in
progress: CBOE34_MKT_20120319_DAILY.csv
The type of consumer created is ScheduledBatchPollingConsumer - how do
I indicate a batch is done? Do I need to
suspend or stop this consumer? Or does the down-stream endpoint, i.e.
"to(...)", have to indicate a response
(acknowledgement) on the exchange of file received?
Thanks for any assistance with this matter...
-Chris
(Note, gmail text-plain will mangle the formatting of this code)
@Override
public void process(Exchange exchange) throws Exception {
@SuppressWarnings("unchecked")
Map ftpProp = exchange.getIn().getBody(Map.class);
if (ftpProp == null)
throw new RuntimeCamelException("No object of type
Map in input exchange message.");
else
log.info("FTP Properites: {}", ftpProp);
Integer port = exchange.getIn().getHeader("SFTP_PORT",
Integer.class);
ftpProp.put("port", port);
CamelContext context = exchange.getContext();
//String routeId = exchange.getFromRouteId();
configure(context, ftpProp, endpointURIQueryString);
}
void configure(CamelContext context, Map
parameters, String queryStr) throws Exception {
parameters.put("separator", RemoteFileConfiguration.PathSeparator.UNIX);
parameters.put("binary", Boolean.TRUE);
//parameters.put("disconnect", Boolean.TRUE);
//parameters.put("passive", Boolean.TRUE);
String initialURI = String.format("sftp://%s/%s?%s";,
parameters.get("host"), parameters.get("directory"), queryStr);
sftpEndpoint = context.getEndpoint(initialURI, SftpEndpoint.class);
sftpComponent = (SftpComponent) sftpEndpoint.getComponent();
SftpConfiguration conf = sftpEndpoint.getConfiguration();
// set reference properties first as they use # syntax that
fools the regular properties setter
EndpointHelper.setReferenceProperties(context, conf, parameters);
EndpointHelper.setProperties(context, conf, parameters);
EndpointHelper.setReferenceProperties(context, sftpEndpoint,
parameters);
EndpointHelper.setProperties(context, sftpEndpoint, parameters);
ServiceStatus status = sftpComponent.getStatus();
log.info("* Component: {}", status);
status = sftpEndpoint.getStatus();
log.info("* Endpoint: {}", status);
//EventDrivenPollingConsumer consumer = (EventDrivenPollingConsumer)
//sftpEndpoint.createPollingConsumer();
sftpConsumer = (SftpConsumer)
sftpEndpoint.createConsumer(new Processor() {
@Override
public void process(Exchange exchange) throws Exception {
producer.send(exchange); // send file down-stream...
}
});
Map cprop = sftpEndpoint.getConsumerProperties();
((ScheduledPollConsumer) sftpConsumer).setStartScheduler(true);
sftpConsumer.start();
status = sftpConsumer.getStatus();
log.info("* Consumer: {}", status);
}
public void setProducer(ProducerTemplate producer) {
this.producer = producer;
}
public String getEndpointURIQueryString() {
return endpointURIQueryString;
}
public void setEndpointURIQueryString(String endpointURIQueryString) {
this.endpointURIQueryString = endpointURIQueryString;
}
Re: It is possible with Camel to use dynamic consumer? **after context start**
Sorry, but I'm still a little confused...
Can you compare and contrast EventDrivenPollingConsumer vs.
ScheduledBatchPollingConsumer?
They both seem to support reading multiple times in an exchange...
Thanks,
Chris
On Wed, Apr 3, 2013 at 5:07 AM, Claus Ibsen wrote:
> You may want to see a little about consumer template here
> http://camel.apache.org/polling-consumer.html
>
> Notice the the consumer template polls one message at a time.
>
> If you want to "download all available files" you would need to run
> the code in a while loop as the example on that link.
>
> Though you can also add a new route at runtime with the from uri
> computed. And then stop and remove the route if not longer needed.
>
>
> On Tue, Apr 2, 2013 at 9:36 PM, Chris Wolf wrote:
>> May I have the ticket #? (so I can watch/follow)
>>
>> When you say, "use a java bean" - what do you mean?
>>
>> Instantiate the FTP component like?
>>
>> FtpComponent comp = new FtpComponent(context);
>> @SuppressWarnings("unchecked")
>> FtpEndpoint endpt = (FtpEndpoint)
>>
>> comp.createEndpoint("ftp://localhost/download?localWorkDirectory=/tmp/local/data&noop=true&username=fred&password=secret";);
>> final FtpConsumer cons = (FtpConsumer)
>> endpt.createConsumer(new Processor() {
>> @Override
>> public void process(Exchange exchange)
>> throws Exception {
>> System.out.printf("%s\n",
>> exchange.toString());
>> }
>> });
>> cons.setStartScheduler(true);
>> comp.start();
>> endpt.start();
>> cons.start();
>>
>> On Tue, Apr 2, 2013 at 11:03 AM, Claus Ibsen wrote:
>>> Hi
>>>
>>> There is a ticket scheduled for Camel 3.0 to allow enrich and
>>> pollEnrich to support "dynamic uris" like the recipient list can do.
>>>
>>> Though implementing this requires an API change and thus scheduled for 3.0.
>>>
>>> You can always use a java bean to consume from an dynamic computed
>>> endpoint. For example using consumer template etc.
>>>
>>> For ftp endpoints you may want to set disconnect=true, to avoid having
>>> the connection running for a longer period.
>>>
>>>
>>>
>>>
>>> On Sun, Mar 31, 2013 at 10:08 PM, Chris Wolf wrote:
>>>> Claus,
>>>>
>>>> You addressed the issue of "dynamic URIs for Consumers" back in July-2009:
>>>>
>>>> http://camel.465427.n5.nabble.com/Dynamic-consumers-with-Camel-td476433.html
>>>>
>>>> However, all those use-cases, except for maybe #4, web console, which
>>>> I can't run all are about
>>>> calculating the URI *before* the context is started. What I'm looking
>>>> for is a way to create and insert
>>>> or update a polling consumer's URI - at runtime - *after* the context
>>>> is started.
>>>>
>>>> For example:
>>>>
>>>> from("direct:start")
>>>> .beanRef("config")
>>>> .convertBodyTo(Document.class)
>>>> .setHeader("Ftp_URI").xquery(
>>>> "concat('ftp://'" +...some more xpaths into the
>>>> inbound config doc...), String.class)
>>>> .pollEnrich(/* whoops! this is referenced at route
>>>> setup time, not route runtime... - it won't work */)
>>>> .to("log:...");
>>>>
>>>> So the question, more generally, is is it possible to alter the route
>>>> definition - at runtime? i.e. after the route/context are started?
>>>>
>>>> You sorted of hinted at this in that July-2009 posting when you said:
>>>>
>>>> "2) You can always stop, modify and start a route in Camel at runtime."
>>>>
>>>> I don't see how that would work since I would likely be attempting to
>>>> modify the route at runtime
>>>> from a bean method in the route - or are you suggesting one route
>>>> stops/modifies another route?
>>>>
>>>>
Re: It is possible with Camel to use dynamic consumer? **after context start**
I actually was basing my current attempts based on what I read on that
page. I thought if you used
a ScheduledPollingConsumer, that it would loop for you and didn't need
a while-loop.
I will just try plain PollingConsumer in a while-loop.
BTW, I found the ticket for dynamic URIs for FTP consumers: CAMEL-4596
Thanks,
Chris
On Wed, Apr 3, 2013 at 5:07 AM, Claus Ibsen wrote:
> You may want to see a little about consumer template here
> http://camel.apache.org/polling-consumer.html
>
> Notice the the consumer template polls one message at a time.
>
> If you want to "download all available files" you would need to run
> the code in a while loop as the example on that link.
>
> Though you can also add a new route at runtime with the from uri
> computed. And then stop and remove the route if not longer needed.
>
>
> On Tue, Apr 2, 2013 at 9:36 PM, Chris Wolf wrote:
>> May I have the ticket #? (so I can watch/follow)
>>
>> When you say, "use a java bean" - what do you mean?
>>
>> Instantiate the FTP component like?
>>
>> FtpComponent comp = new FtpComponent(context);
>> @SuppressWarnings("unchecked")
>> FtpEndpoint endpt = (FtpEndpoint)
>>
>> comp.createEndpoint("ftp://localhost/download?localWorkDirectory=/tmp/local/data&noop=true&username=fred&password=secret";);
>> final FtpConsumer cons = (FtpConsumer)
>> endpt.createConsumer(new Processor() {
>> @Override
>> public void process(Exchange exchange)
>> throws Exception {
>> System.out.printf("%s\n",
>> exchange.toString());
>> }
>> });
>> cons.setStartScheduler(true);
>> comp.start();
>> endpt.start();
>> cons.start();
>>
>> On Tue, Apr 2, 2013 at 11:03 AM, Claus Ibsen wrote:
>>> Hi
>>>
>>> There is a ticket scheduled for Camel 3.0 to allow enrich and
>>> pollEnrich to support "dynamic uris" like the recipient list can do.
>>>
>>> Though implementing this requires an API change and thus scheduled for 3.0.
>>>
>>> You can always use a java bean to consume from an dynamic computed
>>> endpoint. For example using consumer template etc.
>>>
>>> For ftp endpoints you may want to set disconnect=true, to avoid having
>>> the connection running for a longer period.
>>>
>>>
>>>
>>>
>>> On Sun, Mar 31, 2013 at 10:08 PM, Chris Wolf wrote:
>>>> Claus,
>>>>
>>>> You addressed the issue of "dynamic URIs for Consumers" back in July-2009:
>>>>
>>>> http://camel.465427.n5.nabble.com/Dynamic-consumers-with-Camel-td476433.html
>>>>
>>>> However, all those use-cases, except for maybe #4, web console, which
>>>> I can't run all are about
>>>> calculating the URI *before* the context is started. What I'm looking
>>>> for is a way to create and insert
>>>> or update a polling consumer's URI - at runtime - *after* the context
>>>> is started.
>>>>
>>>> For example:
>>>>
>>>> from("direct:start")
>>>> .beanRef("config")
>>>> .convertBodyTo(Document.class)
>>>> .setHeader("Ftp_URI").xquery(
>>>> "concat('ftp://'" +...some more xpaths into the
>>>> inbound config doc...), String.class)
>>>> .pollEnrich(/* whoops! this is referenced at route
>>>> setup time, not route runtime... - it won't work */)
>>>> .to("log:...");
>>>>
>>>> So the question, more generally, is is it possible to alter the route
>>>> definition - at runtime? i.e. after the route/context are started?
>>>>
>>>> You sorted of hinted at this in that July-2009 posting when you said:
>>>>
>>>> "2) You can always stop, modify and start a route in Camel at runtime."
>>>>
>>>> I don't see how that would work since I would likely be attempting to
>>>> modify the route at runtime
>>>> from a bean method in the route
Re: It is possible with Camel to use dynamic consumer? **after context start**
May I have the ticket #? (so I can watch/follow)
When you say, "use a java bean" - what do you mean?
Instantiate the FTP component like?
FtpComponent comp = new FtpComponent(context);
@SuppressWarnings("unchecked")
FtpEndpoint endpt = (FtpEndpoint)
comp.createEndpoint("ftp://localhost/download?localWorkDirectory=/tmp/local/data&noop=true&username=fred&password=secret";);
final FtpConsumer cons = (FtpConsumer)
endpt.createConsumer(new Processor() {
@Override
public void process(Exchange exchange)
throws Exception {
System.out.printf("%s\n",
exchange.toString());
}
});
cons.setStartScheduler(true);
comp.start();
endpt.start();
cons.start();
On Tue, Apr 2, 2013 at 11:03 AM, Claus Ibsen wrote:
> Hi
>
> There is a ticket scheduled for Camel 3.0 to allow enrich and
> pollEnrich to support "dynamic uris" like the recipient list can do.
>
> Though implementing this requires an API change and thus scheduled for 3.0.
>
> You can always use a java bean to consume from an dynamic computed
> endpoint. For example using consumer template etc.
>
> For ftp endpoints you may want to set disconnect=true, to avoid having
> the connection running for a longer period.
>
>
>
>
> On Sun, Mar 31, 2013 at 10:08 PM, Chris Wolf wrote:
>> Claus,
>>
>> You addressed the issue of "dynamic URIs for Consumers" back in July-2009:
>>
>> http://camel.465427.n5.nabble.com/Dynamic-consumers-with-Camel-td476433.html
>>
>> However, all those use-cases, except for maybe #4, web console, which
>> I can't run all are about
>> calculating the URI *before* the context is started. What I'm looking
>> for is a way to create and insert
>> or update a polling consumer's URI - at runtime - *after* the context
>> is started.
>>
>> For example:
>>
>> from("direct:start")
>> .beanRef("config")
>> .convertBodyTo(Document.class)
>> .setHeader("Ftp_URI").xquery(
>> "concat('ftp://'" +...some more xpaths into the
>> inbound config doc...), String.class)
>> .pollEnrich(/* whoops! this is referenced at route
>> setup time, not route runtime... - it won't work */)
>> .to("log:...");
>>
>> So the question, more generally, is is it possible to alter the route
>> definition - at runtime? i.e. after the route/context are started?
>>
>> You sorted of hinted at this in that July-2009 posting when you said:
>>
>> "2) You can always stop, modify and start a route in Camel at runtime."
>>
>> I don't see how that would work since I would likely be attempting to
>> modify the route at runtime
>> from a bean method in the route - or are you suggesting one route
>> stops/modifies another route?
>>
>> So the way I see it is - I would create the ftp route with a bogus URI
>> and option "&startScheduler=false",
>> on the ftp endpoint, or autoStart=false on the route. Then in
>> *another* route - the "configurer" route,
>> I guess, access the ftp route and reconfigure the endpoint with the
>> real settings, then start it's poll scheduler (or start it's route).
>>
>> Something like that? Any easier, more direct way?
>>
>> Thanks,
>>
>>
>> Chris
>
>
>
> --
> Claus Ibsen
> -
> Red Hat, Inc.
> FuseSource is now part of Red Hat
> Email: cib...@redhat.com
> Web: http://fusesource.com
> Twitter: davsclaus
> Blog: http://davsclaus.com
> Author of Camel in Action: http://www.manning.com/ibsen
Is the result of this builder reusable? XQueryBuilder.xquery("//foo");
I want to perform an XQuery outside of DSL (in a Processor). Something like:
XQueryBuilder hostXQ = XQueryBuilder
.xquery("//remote[remoteId/@value='CBOE34']/server/@value");
String host = hostXQ.evaluateAsString(exchange);
Second question is can I parameterize the XQuery like so:
XQueryBuilder hostXQ = XQueryBuilder
.xquery("//remote[remoteId/@value=$accountId]/server/@value");
hostXQ.setParameters(new HashMap() {{
put("accountId", "CBOE34");}});
String host1 = hostXQ.evaluateAsString(exchange);
hostXQ.setParameters(new HashMap() {{
put("accountId", "CBOE78");}});
String host2 = hostXQ.evaluateAsString(exchange);
Thanks,
Chris
Content-based routing with Expressions and Predicates
(I took the liberty to change the Subject since the message history has both my
FTP issue and Prabu's routing issue - my fault, sorry)
Prabu, I strongly recommend getting and reading Claus's book "Camel In Action",
like Thomas Walzer suggested upon your first post. You also should be
familiar with the concepts on these pages:
http://camel.apache.org/content-based-router.html
http://camel.apache.org/predicate.html
http://camel.apache.org/expression.html
http://camel.apache.org/languages.html
(and this is the page I mentioned before, but couldn't find at the time...)
http://camel.apache.org/why-can-i-not-use-when-or-otherwise-in-a-java-camel-route.html
...but, really, everything you're asking for is answered on this one page:
http://camel.apache.org/predicate.html
...in any case, I think your example 1 & 2 would be
implemented something as follows:
(Be advised, Gmail forces lines wraps around column 72 or so,
so the code formatting will be mangled)
Don't forget to statically import the predicates you will be using in
compound expressions..
import static org.apache.camel.builder.PredicateBuilder.and;
import static org.apache.camel.builder.PredicateBuilder.or;
Predicate cardEvent = PredicateBuilder.regex(header("Type"), "^card\\.event.*");
from("jms:Inbound.Test.DDD").choice()
// Your "Example 1"
.when(and(property("PAST_EVENT_INTERVAL").isEqualTo("0"),
or(header("Type").isEqualTo("card.test"),
header("Type").isEqualTo("card.expiry.test")
))).to("jms:SOUTHQueueName")
// Your "Example 2"
.when(and(property("PAST_EVENT_INTERVAL").isEqualTo("0"), cardEvent))
.to("jms:WESTQueueName")
.otherwise().to("jms:dead.letter.queue")
.end();
I also recommend that you not use a header named "Type", since that's
easily confused with
data type or type parameter. Maybe some like CARD_OP...
Regards,
Chris
On Mon, Apr 1, 2013 at 11:36 AM, prabumc...@gmail.com
wrote:
>
> Hi *Chris / **Claus*,
>
> I have one *Inbound* queue,based on header and content type,I want forward
> to outbound queue.
> *
> Example 1:
> *
> *
> Inbound.queue name : **Inbound.Test.DDD
> Outbound.queue name : SOURHQueueName
>
> *
> *Criteria or Condition :
> *
> Message property *PAST_EVENT_INTERVAL type* is : *0*
> *AND*
> Message *Type* value is : *card.test *or* card.expiry.test*
>
> *Example 2:*
>
> *Inbound.queue name : **Inbound.Test.SSS
> Outbound.queue name : WESTQueueName
> *
> *Criteria or Condition :*
> Message property *PAST_EVENT_INTERVAL type* is : *0*
> *AND
> *
> Message *Type *value *start with* :*card.event*
>
> I want achieve this using camel routing java DSL.
>
> Please help me.How can i use AND,OR and regular expression in camel routing
>
> *Regards*
> Prabu.N
>
> > >> >> On Sun, Mar 31, 2013 at 5:22 AM, [hidden
> > >> >> email]
> > >> >> <[hidden
> > >> >> email]>wrote:
> >
> > >> >>
> > >> >>> Thanks Walzer..
> > >> >>> *
> > >> >>> *
> > >> >>> *Queston1:
> > >> >>>
> > >> >>> *
> > >> >>> *Example*
> > >> >>>
> > >> >>> .when(header("foo").isEqualTo("bar"))
> > >> >>> .to("direct:b")
> > >> >>>
> > >> >>> In my case i have to add more than 80 condition and forwards to 80
> > >> >>> different queues.
> > >> >>>
> > >> >>> Above example i can only hard-code queue name,But what i want is
> > below.
> > >> >>>
> > >> >>> * .when(header("Type").isNotNull())
> > >> >>> .to("activemq.Inbound."+header("Type"))
> > >> >>> *
> > >> >>>
> > >> >>> Example:If queue type is test,It should forward to *Inbound.test*
> > >> queue.
> > >> >>>
> > >> >>> Above example i tried,but it did not worked,created queue something
> > >> >>> like this *Inbound.header("type")*
> > >> >>>
> > >> >>> *Question2*:
> > >> >>>
> > >> >>> from("direct:a")
> > >> >>> .multicast().to("direct:b", "direct:c", "direct:d");
> > >> >>>
> > >> >>> Based on messages header and content type i want forward to
> > different
> > >> >>> queue.
> > >> >>>
> > >> >>> condition will be *OR *and *AND*.How can i do that like above
> > example.*
> > >> >>> *
> > >> >>>
> > >> >>> Thanks in advance*
> > >> >>> *
> > >> >>>
> > >> >>> *Regards*
> > >> >>>
> > >> >>> Prabu.N
> > >> >>>
> > >> >>>
> > >> >>>
> > >> >>>
> > >> >>>
> > >> >>>
> > >> >>>
> > >> >>>
> > >> >>>
> > >> >>>
> > >> >>>
> > >> >>>
> > >> >>>
> > >> >>> On Sun, Mar 31, 2013 at 2:43 AM, Walzer, Thomas [via Camel] <
> > >> >>> [hidden email]>
> > wrote:
> > >> >>>
> > >> >>> > Hi,
> > >> >>> >
> > >> >>> > you could start by reading Claus´ book (p. 44ff) which has a
> > perfect
> > >> >>> > example or http://camel.apache.org/content-based-router.html (just
> >
> > >> >>> > replace the direct: with your queues).
> > >> >>> > If you need to fire your messages to multiple queues:
> > >> >>> > http://camel.apache.org/publish-subscribe-channel.html shows you
Re: Camel routing issue
Hi Claus,
Thanks for the response - I could not see any obvious way to configure
an FTP Consumer at ***runtime***,
either via bean, processor or consumer template. If you have a
concrete example, that would be great to see...
...otherwise, here's the solution I came up with:
-Chris
// simulate incoming message from JMS...
from("timer:kickoff?repeatCount=1")
.to("direct:start");
// upon receipt of FTP config from JMS, invoke FtpConfigurer bean
to reconfigure
// FTP route, then start it...
from("direct:start")
.beanRef("configRdr") // config reader bean not shown here
.convertBodyTo(Document.class)
// sets a bunch of headers from DOM, e.g.:
.setHeader("ftp-config.host").xquery("//remote[remoteId/@value='CBOE34']/server/@value",
String.class)
.setHeader("ftp-route-id", constant("ftp.route"))
.beanRef("ftpConfigurer");
// FTP route will only be started by FtpConfigurer bean after it's
dynamically re-configured...
from("ftp://bogushost/bogusdir?startScheduler=false";) // the URI
will be reconfigured...
.routeId("ftp.route").noAutoStartup()
.log("Received file ${file:onlyname}")
.to("file:/tmp/local/data");
public class FtpConfigurer {
public void configureFtpConsumer(Exchange exchange) throws Exception {
CamelContext context = exchange.getContext();
Map headers = exchange.getIn().getHeaders();
Map parameters = new HashMap();
// Filter headers for ftp-config specific headers...
for (Map.Entry entry : headers.entrySet()) {
String key = entry.getKey();
if (key.startsWith("ftp-config."))
parameters.put(key.substring("ftp-config.".length()),
entry.getValue());
}
String routeId = exchange.getIn().getHeader("ftp-route-id",
String.class);
Route ftpRoute = context.getRoute(routeId);
FtpConsumer c = (FtpConsumer) ftpRoute.getConsumer();
FtpEndpoint rfe = (FtpEndpoint) c.getEndpoint();
FtpConfiguration rfc = rfe.getConfiguration();
// Need to crack open FtpConsumer's "endpointPath" field since
// there's no mutator (setter)
Class cls = c.getClass();
Field endpointPath_fld = cls.getDeclaredField("endpointPath");
endpointPath_fld.setAccessible(true);
endpointPath_fld.set(c, (String)parameters.get("directory"));
// Need to crack open FtpEndpoint, actually DefaultEndpoint -
the ultimate base class
// since there's no mutator (setter) for the "endpointUri" field
cls = rfe.getClass();
Field endpointUri_fld = null;
while (endpointUri_fld == null) {
// TODO: maybe change logic to just stop at class=DefaultEndpoint
// rather then using NoSuchFieldException
try {
endpointUri_fld = cls.getDeclaredField("endpointUri");
} catch (NoSuchFieldException nsfe) {
cls = cls.getSuperclass();
}
}
endpointUri_fld.setAccessible(true);
endpointUri_fld.set(rfe,
String.format("ftp://%s/%s";,
(String)parameters.get("host"), (String)parameters.get("directory")));
// set reference properties first as they use # syntax that
fools the regular properties setter
EndpointHelper.setReferenceProperties(context, rfc, parameters);
EndpointHelper.setProperties(context, rfc, parameters);
EndpointHelper.setReferenceProperties(context, rfe, parameters);
EndpointHelper.setProperties(context, rfe, parameters);
c.setStartScheduler(true);
context.startRoute(routeId);
}
}
On Mon, Apr 1, 2013 at 4:32 AM, Claus Ibsen wrote:
> Hi
>
> See this EIP
> http://camel.apache.org/content-enricher.html
>
> About pollEnrich.
>
> Though pollEnrich currently does support dynamic uris. Its on the roadmap,
> for Camel 3.0.
> It requires an API change and thus isn't so easy to implement currently on
> 2.x.
>
> You can always use a java bean / camel processor, and consume the ftp file
> from java code.
> For example using consumer template.
>
> As you use FTP you may want to set disconnect=true so the connect is not
> remained open after usage.
>
>
>
> On Sun, Mar 31, 2013 at 7:51 PM, Chris Wolf wrote:
>
>> Ok, I'm starting to get it - a little bit. As for my concrete
>> example, so far, I have:
>>
>> from("direct:start")
>> .beanRef("config")
>> .convertBodyTo(Document.class)
>> .recipientList().xquery(
>> "concat(&#x
Re: Camel routing issue
Prabu,
There's a note on the Camel website about a potential compiler error
when using "otherwise()", along with a workaround. Unfortunately, I
can't find it now.
On the other hand, I think this might work:
from("direct:start")
.choice().when(header("Type").isNotNull())
.recipientList(simple("activemq.Inbound.${header.Type}"))
.end() // <=== added this to close "when" block
.otherwise()
.to("activemq:queue:Invalid.queue")
.endChoice();
N.B. this only solved compilation - I didn't actually do a runtime test.
-Chris
On Mon, Apr 1, 2013 at 7:18 AM, prabumc...@gmail.com
wrote:
> Chris,The following code worked fine.
>
> .choice().when(header("Type").isNotNull())
> .recipientList(simple("activemq.Inbound.${header.Type}"))
> .endChoice()
>
> but,one issue is that.I added *.otherwise()* , it giving error.
>
> .choice().when(header("Type").isNotNull())
> .recipientList(simple("activemq.Inbound.${header.Type}"))
> *.otherwise()
> .to("activemq:queue:Invalid.queue")*
> .endChoice();
>
> please kindly help me.
>
>
>
> On Mon, Apr 1, 2013 at 2:32 PM, Prabu wrote:
>
>> Like Chris suggest i tried below way
>>
>>
>> .when(header("TYPE").isNotNull())
>>.to("activemq:queue.Inbound.${header.Type}")
>>
>>
>> But queue created *${header.Type}* like this not *Inbound.test*
>>
>> Please kindly give me example.
>>
>> *Regards*
>> Prabu.N
>>
>>
>>
>> On Mon, Apr 1, 2013 at 2:03 PM, Claus Ibsen-2 [via Camel] <
>> ml-node+s465427n5730152...@n5.nabble.com> wrote:
>>
>>> Hi
>>>
>>> See this EIP
>>> http://camel.apache.org/content-enricher.html
>>>
>>> About pollEnrich.
>>>
>>> Though pollEnrich currently does support dynamic uris. Its on the
>>> roadmap,
>>> for Camel 3.0.
>>> It requires an API change and thus isn't so easy to implement currently
>>> on
>>> 2.x.
>>>
>>> You can always use a java bean / camel processor, and consume the ftp
>>> file
>>> from java code.
>>> For example using consumer template.
>>>
>>> As you use FTP you may want to set disconnect=true so the connect is not
>>> remained open after usage.
>>>
>>>
>>>
>>> On Sun, Mar 31, 2013 at 7:51 PM, Chris Wolf <[hidden
>>> email]<http://user/SendEmail.jtp?type=node&node=5730152&i=0>>
>>> wrote:
>>>
>>> > Ok, I'm starting to get it - a little bit. As for my concrete
>>> > example, so far, I have:
>>> >
>>> > from("direct:start")
>>> > .beanRef("config")
>>> > .convertBodyTo(Document.class)
>>> > .recipientList().xquery(
>>> > "concat('ftp://'" +
>>> > ",//remote[vendorId/@value='CBOE34']/server/@value"
>>> +
>>> >
>>> >
>>> >
>>> ",//remote[vendorId/@value='CBOE34']/param[name/@value='directory']/value/@value"
>>>
>>> > +
>>> > ",'?noop=true&username='" +
>>> >
>>> ",//remote[vendorId/@value='CBOE34']/username/@value" +
>>> > ",'&password='" +
>>> >
>>> > ",//remote[vendorId/@value='CBOE34']/password/@value)", String.class);
>>> >
>>> > Here's the problem - this will create an FTP Producer - that's not
>>> > what I need. I need a dynamically
>>> > constructed URI for a polling FTP consumer. I don't think
>>> > "recipientList" will work... Any ideas?
>>> >
>>> > Thanks,
>>> >
>>> > Chris
>>> >
>>> > On Sun, Mar 31, 2013 at 10:27 AM, Chris Wolf <[hidden
>>> > email]<http://user/SendEmail.jtp?type=node&node=5730152&i=1>>
>>> wrote:
>>> > > Hi Claus,
>>> > >
>>> > > I hate to ask this - but I still don't get it. I thought
>>> > > "recipientList" was for sending to mult
It is possible with Camel to use dynamic consumer? **after context start**
Claus,
You addressed the issue of "dynamic URIs for Consumers" back in July-2009:
http://camel.465427.n5.nabble.com/Dynamic-consumers-with-Camel-td476433.html
However, all those use-cases, except for maybe #4, web console, which
I can't run all are about
calculating the URI *before* the context is started. What I'm looking
for is a way to create and insert
or update a polling consumer's URI - at runtime - *after* the context
is started.
For example:
from("direct:start")
.beanRef("config")
.convertBodyTo(Document.class)
.setHeader("Ftp_URI").xquery(
"concat('ftp://'" +...some more xpaths into the
inbound config doc...), String.class)
.pollEnrich(/* whoops! this is referenced at route
setup time, not route runtime... - it won't work */)
.to("log:...");
So the question, more generally, is is it possible to alter the route
definition - at runtime? i.e. after the route/context are started?
You sorted of hinted at this in that July-2009 posting when you said:
"2) You can always stop, modify and start a route in Camel at runtime."
I don't see how that would work since I would likely be attempting to
modify the route at runtime
from a bean method in the route - or are you suggesting one route
stops/modifies another route?
So the way I see it is - I would create the ftp route with a bogus URI
and option "&startScheduler=false",
on the ftp endpoint, or autoStart=false on the route. Then in
*another* route - the "configurer" route,
I guess, access the ftp route and reconfigure the endpoint with the
real settings, then start it's poll scheduler (or start it's route).
Something like that? Any easier, more direct way?
Thanks,
Chris
Re: Camel routing issue
Here you go:
.choice().when(header("Type").isNotNull())
.recipientList(simple("activemq.Inbound.${header.Type}"))
.endChoice()
Sorry for hijacking your thread, but I also was not getting
"recipientList" to implement dynamic destinations. I get it now,
pretty much,
I just don't know how to specify a polling consumer with dynamic uri...
Regards,
Chris
On Sun, Mar 31, 2013 at 2:21 PM, prabumc...@gmail.com
wrote:
> Thanks for your faq url,but I did not understand anything from that faq.
>
> as I told already
>
> .to("activemq.Inbound."+ header(" Type")
>
> Please kindly provide with example.
>
> Thanks
> Prabu.n
> On Mar 31, 2013 11:22 PM, "Chris Wolf [via Camel]" <
> ml-node+s465427n5730134...@n5.nabble.com> wrote:
>
>> Ok, I'm starting to get it - a little bit. As for my concrete
>> example, so far, I have:
>>
>> from("direct:start")
>> .beanRef("config")
>> .convertBodyTo(Document.class)
>> .recipientList().xquery(
>> "concat('ftp://'" +
>> ",//remote[vendorId/@value='CBOE34']/server/@value" +
>>
>> ",//remote[vendorId/@value='CBOE34']/param[name/@value='directory']/value/@value"
>>
>> +
>> ",'?noop=true&username='" +
>> ",//remote[vendorId/@value='CBOE34']/username/@value"
>> +
>> ",'&password='" +
>>
>> ",//remote[vendorId/@value='CBOE34']/password/@value)", String.class);
>>
>> Here's the problem - this will create an FTP Producer - that's not
>> what I need. I need a dynamically
>> constructed URI for a polling FTP consumer. I don't think
>> "recipientList" will work... Any ideas?
>>
>> Thanks,
>>
>> Chris
>>
>> On Sun, Mar 31, 2013 at 10:27 AM, Chris Wolf <[hidden
>> email]<http://user/SendEmail.jtp?type=node&node=5730134&i=0>>
>> wrote:
>>
>> > Hi Claus,
>> >
>> > I hate to ask this - but I still don't get it. I thought
>> > "recipientList" was for sending to multiple, runtime-defined
>> > recipients. I don't see how this
>> > answers the question of sending to one, single recipient, whose URI is
>> > dynamically constructed - and in my use-case the dynamic settings
>> > are not in properties - so "simple" (property place-holders) won't help
>> me.
>> >
>> > Let me give you a concrete example. I need to do an ftp download and
>> > the connection information comes from up-stream in the route in the
>> > form of XML (DOM - a Document instance). Currently, I am trying to do
>> > this with bean binding and method params decorated with @XPath
>> > pointing into the Document with the ftp settings and inside the
>> > this method doing:
>> >
>> > FtpComponent ftpComponent = context.getComponent("ftp",
>> FtpComponent.class);
>> >
>> > ..and then attempt to get the endpoint and call createConsumer(...).
>> > I'm sure this is not the right way to do it, but I don't see how else
>> > - any ideas?
>> >
>> > Thanks,
>> >
>> >
>> > Chris
>> >
>> > On Sun, Mar 31, 2013 at 2:28 AM, Claus Ibsen <[hidden
>> > email]<http://user/SendEmail.jtp?type=node&node=5730134&i=1>>
>> wrote:
>> >> Hi
>> >>
>> >> See this FAQ
>> >> http://camel.apache.org/how-do-i-use-dynamic-uri-in-to.html
>> >>
>> >>
>> >>
>> >>
>> >> On Sun, Mar 31, 2013 at 5:22 AM, [hidden
>> >> email]<http://user/SendEmail.jtp?type=node&node=5730134&i=2>
>> >> <[hidden email]
>> >> <http://user/SendEmail.jtp?type=node&node=5730134&i=3>>wrote:
>>
>> >>
>> >>> Thanks Walzer..
>> >>> *
>> >>> *
>> >>> *Queston1:
>> >>>
>> >>> *
>> >>> *Example*
>> >>>
>> >>> .when(header("foo").isEqualTo("bar"))
>> >>> .to("direct:b")
>> >>>
>> >>> In
Re: Camel routing issue
Ok, I'm starting to get it - a little bit. As for my concrete
example, so far, I have:
from("direct:start")
.beanRef("config")
.convertBodyTo(Document.class)
.recipientList().xquery(
"concat('ftp://'" +
",//remote[vendorId/@value='CBOE34']/server/@value" +
",//remote[vendorId/@value='CBOE34']/param[name/@value='directory']/value/@value"
+
",'?noop=true&username='" +
",//remote[vendorId/@value='CBOE34']/username/@value" +
",'&password='" +
",//remote[vendorId/@value='CBOE34']/password/@value)", String.class);
Here's the problem - this will create an FTP Producer - that's not
what I need. I need a dynamically
constructed URI for a polling FTP consumer. I don't think
"recipientList" will work... Any ideas?
Thanks,
Chris
On Sun, Mar 31, 2013 at 10:27 AM, Chris Wolf wrote:
> Hi Claus,
>
> I hate to ask this - but I still don't get it. I thought
> "recipientList" was for sending to multiple, runtime-defined
> recipients. I don't see how this
> answers the question of sending to one, single recipient, whose URI is
> dynamically constructed - and in my use-case the dynamic settings
> are not in properties - so "simple" (property place-holders) won't help me.
>
> Let me give you a concrete example. I need to do an ftp download and
> the connection information comes from up-stream in the route in the
> form of XML (DOM - a Document instance). Currently, I am trying to do
> this with bean binding and method params decorated with @XPath
> pointing into the Document with the ftp settings and inside the
> this method doing:
>
> FtpComponent ftpComponent = context.getComponent("ftp", FtpComponent.class);
>
> ..and then attempt to get the endpoint and call createConsumer(...).
> I'm sure this is not the right way to do it, but I don't see how else
> - any ideas?
>
> Thanks,
>
>
> Chris
>
> On Sun, Mar 31, 2013 at 2:28 AM, Claus Ibsen wrote:
>> Hi
>>
>> See this FAQ
>> http://camel.apache.org/how-do-i-use-dynamic-uri-in-to.html
>>
>>
>>
>>
>> On Sun, Mar 31, 2013 at 5:22 AM, prabumc...@gmail.com
>> wrote:
>>
>>> Thanks Walzer..
>>> *
>>> *
>>> *Queston1:
>>>
>>> *
>>> *Example*
>>>
>>> .when(header("foo").isEqualTo("bar"))
>>> .to("direct:b")
>>>
>>> In my case i have to add more than 80 condition and forwards to 80
>>> different queues.
>>>
>>> Above example i can only hard-code queue name,But what i want is below.
>>>
>>> * .when(header("Type").isNotNull())
>>> .to("activemq.Inbound."+header("Type"))
>>> *
>>>
>>> Example:If queue type is test,It should forward to *Inbound.test* queue.
>>>
>>> Above example i tried,but it did not worked,created queue something
>>> like this *Inbound.header("type")*
>>>
>>> *Question2*:
>>>
>>> from("direct:a")
>>> .multicast().to("direct:b", "direct:c", "direct:d");
>>>
>>> Based on messages header and content type i want forward to different
>>> queue.
>>>
>>> condition will be *OR *and *AND*.How can i do that like above example.*
>>> *
>>>
>>> Thanks in advance*
>>> *
>>>
>>> *Regards*
>>>
>>> Prabu.N
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> On Sun, Mar 31, 2013 at 2:43 AM, Walzer, Thomas [via Camel] <
>>> ml-node+s465427n5730116...@n5.nabble.com> wrote:
>>>
>>> > Hi,
>>> >
>>> > you could start by reading Claus´ book (p. 44ff) which has a perfect
>>> > example or http://camel.apache.org/content-based-router.html (just
>>> > replace the direct: with your queues).
>>> > If you need to fire your messages to multiple queues:
>>> > http://camel.apache.org/publish-subscribe-channel.html shows you the
>>> > various ways.
>>> > When you get the concepts you can just "lego" them together.
>>> >
>&g
Re: Camel routing issue
Hi Claus,
I hate to ask this - but I still don't get it. I thought
"recipientList" was for sending to multiple, runtime-defined
recipients. I don't see how this
answers the question of sending to one, single recipient, whose URI is
dynamically constructed - and in my use-case the dynamic settings
are not in properties - so "simple" (property place-holders) won't help me.
Let me give you a concrete example. I need to do an ftp download and
the connection information comes from up-stream in the route in the
form of XML (DOM - a Document instance). Currently, I am trying to do
this with bean binding and method params decorated with @XPath
pointing into the Document with the ftp settings and inside the
this method doing:
FtpComponent ftpComponent = context.getComponent("ftp", FtpComponent.class);
..and then attempt to get the endpoint and call createConsumer(...).
I'm sure this is not the right way to do it, but I don't see how else
- any ideas?
Thanks,
Chris
On Sun, Mar 31, 2013 at 2:28 AM, Claus Ibsen wrote:
> Hi
>
> See this FAQ
> http://camel.apache.org/how-do-i-use-dynamic-uri-in-to.html
>
>
>
>
> On Sun, Mar 31, 2013 at 5:22 AM, prabumc...@gmail.com
> wrote:
>
>> Thanks Walzer..
>> *
>> *
>> *Queston1:
>>
>> *
>> *Example*
>>
>> .when(header("foo").isEqualTo("bar"))
>> .to("direct:b")
>>
>> In my case i have to add more than 80 condition and forwards to 80
>> different queues.
>>
>> Above example i can only hard-code queue name,But what i want is below.
>>
>> * .when(header("Type").isNotNull())
>> .to("activemq.Inbound."+header("Type"))
>> *
>>
>> Example:If queue type is test,It should forward to *Inbound.test* queue.
>>
>> Above example i tried,but it did not worked,created queue something
>> like this *Inbound.header("type")*
>>
>> *Question2*:
>>
>> from("direct:a")
>> .multicast().to("direct:b", "direct:c", "direct:d");
>>
>> Based on messages header and content type i want forward to different
>> queue.
>>
>> condition will be *OR *and *AND*.How can i do that like above example.*
>> *
>>
>> Thanks in advance*
>> *
>>
>> *Regards*
>>
>> Prabu.N
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>> On Sun, Mar 31, 2013 at 2:43 AM, Walzer, Thomas [via Camel] <
>> ml-node+s465427n5730116...@n5.nabble.com> wrote:
>>
>> > Hi,
>> >
>> > you could start by reading Claus´ book (p. 44ff) which has a perfect
>> > example or http://camel.apache.org/content-based-router.html (just
>> > replace the direct: with your queues).
>> > If you need to fire your messages to multiple queues:
>> > http://camel.apache.org/publish-subscribe-channel.html shows you the
>> > various ways.
>> > When you get the concepts you can just "lego" them together.
>> >
>> > Regards, Thomas.
>> >
>> > Am 30.03.2013 um 19:05 schrieb "[hidden email]<
>> http://user/SendEmail.jtp?type=node&node=5730116&i=0>"
>> > <[hidden email] >:
>> >
>> > > Hi Claus,
>> > >
>> > > Thanks so much Clus for help.It is working now.
>> > >
>> > > I need your guidance for the following requirement.
>> > >
>> > > 1.I have one *inbound queue* it will receive message frequently from my
>> > > application.
>> > > 2.From *inbound queue* i need camel routing to move message from
>> > > another *message
>> > > based inbound queue* based on message header value.
>> > > 3.From *message based inbound queue *i* *need camel routing to move
>> > message
>> > > to *one or more outbound queue *based on message content*
>> > > *
>> > >
>> > > I need *camel java DSL*sample code for above requirement.*
>> > > *
>> > > *
>> > > *
>> > > *Thanks in advance*
>> > >
>> > >
>> > > On Sat, Mar 30, 2013 at 3:10 PM, Claus Ibsen-2 [via Camel] <
>> > > [hidden email] >
>> > wrote:
>> > >
>> > >> Hi
>> > >>
>> > >> Do as the exception tells you. Check route 2. You route from
>> > >> "Inbound.SSS.TestEvent". And that is now know to Camel.
>> > >>
>> > >> Maybe you need to add "activemq:" as prefix so its
>> > >> "activemq:Inbound.SSS.TestEvent".
>> > >>
>> > >>
>> > >> On Fri, Mar 29, 2013 at 7:01 PM, [hidden email]<
>> > http://user/SendEmail.jtp?type=node&node=5730109&i=0>
>> > >> <[hidden email] > >>
>> >
>> > >> wrote:
>> > >>
>> > >>>
>> > >>> I have activemmq Project in that i have following requirement
>> > >>>
>> > >>> 1.Move message from Inbound queue to type based inbound queue.
>> > >>> 2.Move message from Message type inbound queue to outbound queue
>> > >>>
>> > >>> I have created two bean for to achieve this.
>> > >>>
>> > >>> 1.one for move from inbound to message type inbound queue
>> > >>> 2.one for move from inbound to outbound queue.
>> > >>>
>> > >>> I have following entry in camel.xml
>> > >>>
>> > >>> http://camel.apache.org/schema/spring";>
>> > >>
>> > >>>
>> > >>>
>> > >>>
>> > >>>
>> > >>>
>> > >>>
>> > >>>> > >>> class="com.came
Re: Is there a DataFormat to convert XML string to XML Document?
Thanks - that's exactly what I needed. Although I'm wondering when you would select .convertBodyTo(Class) vs. a DataFormat? Thanks again, Chris On Fri, Mar 29, 2013 at 8:38 PM, Raul Kripalani wrote: > .convertBodyTo(Document.class) > > Leverages a feature of Camel called Type Conversion. > > Raúl. > > Sent while on the move > On 29 Mar 2013 22:40, "Chris Wolf" wrote: > >> I don't see any listed here: >> >> http://camel.apache.org/data-format.html >> >> ...but I find it hard to believe there isn't a way to convert a string >> to XML without creating a custom processor to parse string data from a >> web service. >> >> Thanks, >> >> Chris >>
Is there a DataFormat to convert XML string to XML Document?
I don't see any listed here: http://camel.apache.org/data-format.html ...but I find it hard to believe there isn't a way to convert a string to XML without creating a custom processor to parse string data from a web service. Thanks, Chris
Re: Need help with cxfrs component, actually RESTful service consumption, in general
Hello - I just used camel-http to do my RESTful service invocation and it's good enough for my basic purposes. -Chris On Fri, Mar 29, 2013 at 11:30 AM, Chris Wolf wrote: > On Fri, Mar 29, 2013 at 9:23 AM, Sergey Beryozkin > wrote: >> On 29/03/13 11:05, Claus Ibsen wrote: >>> >>> Hi >>> >>> There is also camel-restlet >>> http://camel.apache.org/restlet >>> >>> It may be easier to get hold of and use. But CXF may have more >>> configuration options, but is also IMHO harder to get started with >>> using - some of that is us to blame, for not having better >>> documentation and samples. And the fact that IMHO camel-cxf has both >>> WS and RS in the same big giant component, which IMHO is becoming a >>> problem and hurts the lightweightness of Camel and CXF. >> >> Really ? I agree that it is not the easiest component to use - that is fare >> and personally I'd have no problems with sharing part of the 'blame' for not >> contributing, but please don't do this "hurts the Camel " thing, which is >> FUD IMHO - FYI, I'm perfectly fine with yourself having the preferences, no >> problems there at all ! >> >> Chris: feel free to experiment with all the other HTTP-aware components, >> some of them indeed are simpler to use for a given task. >> FYI, I'm going to work on doing a better demo of using CXF JAX-RS endpoints >> directly within Camel, specifically, using the Camel transport to link >> directly to CXF jaxrs:endpoints, and will update the list. >> >> Thanks, Sergey > > Even just a basic client making an HTTP GET and getting back some text > would be great. I still can't do that. > (See my recent reply to Claus) > > Thanks, > > Chris > >>> >>> >>> You may also take a look at some of the articles about Camel. There >>> should be some good ones about REST etc >>> http://camel.apache.org/articles >>> >>> For example this article >>> http://www.ofbizian.com/2012/02/apache-camel-rest-example.html >>> >>> But there is others as well. >>> >>> >>> >>> On Thu, Mar 28, 2013 at 11:35 PM, Chris Wolf wrote: >>>> >>>> So I have the book, "Camel In Action", which is a very good and >>>> thorough treatment of camel-core. However, now my development efforts >>>> are starting to hit severe turbulence upon making the jump from >>>> camel-core to camel-cxf, in particular, how to consume a RESTful >>>> service? >>>> >>>> I read these: >>>> http://camel.apache.org/cxfrs.html >>>> http://camel.apache.org/cxf-bean-component.html >>>> >>>> ...but these pages seem to be reference pages for people who have >>>> already mastered camel-cxfrs - not newbies, like me. Can anyone point >>>> me to an end-to-end example? I don't need the server-side - this is >>>> legacy and produces XML. >>>> >>>> N.B. Outside of Camel, I have had much previous experience using CXF >>>> for JAX-WS style services, client and server (never JAX-RS, though) >>>> >>>> Thanks for any help, >>>> >>>>-Chris >>> >>> >>> >>> >> >>
Re: Need help with cxfrs component, actually RESTful service consumption, in general
On Fri, Mar 29, 2013 at 9:23 AM, Sergey Beryozkin wrote: > On 29/03/13 11:05, Claus Ibsen wrote: >> >> Hi >> >> There is also camel-restlet >> http://camel.apache.org/restlet >> >> It may be easier to get hold of and use. But CXF may have more >> configuration options, but is also IMHO harder to get started with >> using - some of that is us to blame, for not having better >> documentation and samples. And the fact that IMHO camel-cxf has both >> WS and RS in the same big giant component, which IMHO is becoming a >> problem and hurts the lightweightness of Camel and CXF. > > Really ? I agree that it is not the easiest component to use - that is fare > and personally I'd have no problems with sharing part of the 'blame' for not > contributing, but please don't do this "hurts the Camel " thing, which is > FUD IMHO - FYI, I'm perfectly fine with yourself having the preferences, no > problems there at all ! > > Chris: feel free to experiment with all the other HTTP-aware components, > some of them indeed are simpler to use for a given task. > FYI, I'm going to work on doing a better demo of using CXF JAX-RS endpoints > directly within Camel, specifically, using the Camel transport to link > directly to CXF jaxrs:endpoints, and will update the list. > > Thanks, Sergey Even just a basic client making an HTTP GET and getting back some text would be great. I still can't do that. (See my recent reply to Claus) Thanks, Chris >> >> >> You may also take a look at some of the articles about Camel. There >> should be some good ones about REST etc >> http://camel.apache.org/articles >> >> For example this article >> http://www.ofbizian.com/2012/02/apache-camel-rest-example.html >> >> But there is others as well. >> >> >> >> On Thu, Mar 28, 2013 at 11:35 PM, Chris Wolf wrote: >>> >>> So I have the book, "Camel In Action", which is a very good and >>> thorough treatment of camel-core. However, now my development efforts >>> are starting to hit severe turbulence upon making the jump from >>> camel-core to camel-cxf, in particular, how to consume a RESTful >>> service? >>> >>> I read these: >>> http://camel.apache.org/cxfrs.html >>> http://camel.apache.org/cxf-bean-component.html >>> >>> ...but these pages seem to be reference pages for people who have >>> already mastered camel-cxfrs - not newbies, like me. Can anyone point >>> me to an end-to-end example? I don't need the server-side - this is >>> legacy and produces XML. >>> >>> N.B. Outside of Camel, I have had much previous experience using CXF >>> for JAX-WS style services, client and server (never JAX-RS, though) >>> >>> Thanks for any help, >>> >>>-Chris >> >> >> >> > >
Re: Need help with cxfrs component, actually RESTful service consumption, in general
I see that the default method is GET, but I urlendcoded the '?' that
is part of the service URL, rather then restlet URL.
However, it's getting a "no consumer error". My route is:
from("direct:readsvc")
.to("restlet:http://localhost:4040/some/service%3Fparam1=/root/level2[id='xyz']")
.to("log:readsvc?showAll=true&multiline=true&level=INFO");
Object response = xdsrdr.requestBody("direct:readsvc", "");
The error is:
org.apache.camel.CamelExchangeException: No consumers available on
endpoint: Endpoint[direct://readsvc]. Exchange[Message: ]
I thought I was following the client-side pattern show on the restlet
documentation web page,
but it's not working.
So my question is can restlet be use to perform an HTTP GET on a
RESTful service that returns a string (actually an xml document)?
If so, how?
Thanks,
Chris
On Fri, Mar 29, 2013 at 11:09 AM, Chris Wolf wrote:
> Ok, before I go the CXF-RS route (no pun intended) I want to try
> restlet. To clarify - can I use restlet to consume any RESTful
> service,
> or does the service have to be a restlet service?
>
> The example client-side code on the the page: http://camel.apache.org/restlet
>
> Has:
>
> from("direct:start-auth").to("restlet:http://localhost:"; + port +
> "/securedOrders?restletMethod=post");
> That is all we need. We are ready to send a request and try out the
> restlet component:
> final String id = "89531";
>
> Map headers = new HashMap();
> headers.put(RestletConstants.RESTLET_LOGIN, "admin");
> headers.put(RestletConstants.RESTLET_PASSWORD, "foo");
> headers.put("id", id);
>
> String response =
> (String)template.requestBodyAndHeaders("direct:start-auth", " foo='1'/>", headers);
>
> I don't need to authenticate, and I only need to do a GET, but the URL
> I'm consuming from
> has a query string with a parameter whose value is an Xpath
>
> http://localhost:4040/some/service?param1=/root/level2[id='xyz']
>
> Do I need to URL-Encode the first '?' so I can append "?restletMethod=GET"
>
> ?
>
> Thanks,
>
> Chris
>
> On Fri, Mar 29, 2013 at 4:05 AM, Claus Ibsen wrote:
>> Hi
>>
>> There is also camel-restlet
>> http://camel.apache.org/restlet
>>
>> It may be easier to get hold of and use. But CXF may have more
>> configuration options, but is also IMHO harder to get started with
>> using - some of that is us to blame, for not having better
>> documentation and samples. And the fact that IMHO camel-cxf has both
>> WS and RS in the same big giant component, which IMHO is becoming a
>> problem and hurts the lightweightness of Camel and CXF.
>>
>> You may also take a look at some of the articles about Camel. There
>> should be some good ones about REST etc
>> http://camel.apache.org/articles
>>
>> For example this article
>> http://www.ofbizian.com/2012/02/apache-camel-rest-example.html
>>
>> But there is others as well.
>>
>>
>>
>> On Thu, Mar 28, 2013 at 11:35 PM, Chris Wolf wrote:
>>> So I have the book, "Camel In Action", which is a very good and
>>> thorough treatment of camel-core. However, now my development efforts
>>> are starting to hit severe turbulence upon making the jump from
>>> camel-core to camel-cxf, in particular, how to consume a RESTful
>>> service?
>>>
>>> I read these:
>>> http://camel.apache.org/cxfrs.html
>>> http://camel.apache.org/cxf-bean-component.html
>>>
>>> ...but these pages seem to be reference pages for people who have
>>> already mastered camel-cxfrs - not newbies, like me. Can anyone point
>>> me to an end-to-end example? I don't need the server-side - this is
>>> legacy and produces XML.
>>>
>>> N.B. Outside of Camel, I have had much previous experience using CXF
>>> for JAX-WS style services, client and server (never JAX-RS, though)
>>>
>>> Thanks for any help,
>>>
>>> -Chris
>>
>>
>>
>> --
>> Claus Ibsen
>> -
>> Red Hat, Inc.
>> FuseSource is now part of Red Hat
>> Email: cib...@redhat.com
>> Web: http://fusesource.com
>> Twitter: davsclaus
>> Blog: http://davsclaus.com
>> Author of Camel in Action: http://www.manning.com/ibsen
Re: Need help with cxfrs component, actually RESTful service consumption, in general
Ok, before I go the CXF-RS route (no pun intended) I want to try
restlet. To clarify - can I use restlet to consume any RESTful
service,
or does the service have to be a restlet service?
The example client-side code on the the page: http://camel.apache.org/restlet
Has:
from("direct:start-auth").to("restlet:http://localhost:"; + port +
"/securedOrders?restletMethod=post");
That is all we need. We are ready to send a request and try out the
restlet component:
final String id = "89531";
Map headers = new HashMap();
headers.put(RestletConstants.RESTLET_LOGIN, "admin");
headers.put(RestletConstants.RESTLET_PASSWORD, "foo");
headers.put("id", id);
String response =
(String)template.requestBodyAndHeaders("direct:start-auth", "", headers);
I don't need to authenticate, and I only need to do a GET, but the URL
I'm consuming from
has a query string with a parameter whose value is an Xpath
http://localhost:4040/some/service?param1=/root/level2[id='xyz']
Do I need to URL-Encode the first '?' so I can append "?restletMethod=GET"
?
Thanks,
Chris
On Fri, Mar 29, 2013 at 4:05 AM, Claus Ibsen wrote:
> Hi
>
> There is also camel-restlet
> http://camel.apache.org/restlet
>
> It may be easier to get hold of and use. But CXF may have more
> configuration options, but is also IMHO harder to get started with
> using - some of that is us to blame, for not having better
> documentation and samples. And the fact that IMHO camel-cxf has both
> WS and RS in the same big giant component, which IMHO is becoming a
> problem and hurts the lightweightness of Camel and CXF.
>
> You may also take a look at some of the articles about Camel. There
> should be some good ones about REST etc
> http://camel.apache.org/articles
>
> For example this article
> http://www.ofbizian.com/2012/02/apache-camel-rest-example.html
>
> But there is others as well.
>
>
>
> On Thu, Mar 28, 2013 at 11:35 PM, Chris Wolf wrote:
>> So I have the book, "Camel In Action", which is a very good and
>> thorough treatment of camel-core. However, now my development efforts
>> are starting to hit severe turbulence upon making the jump from
>> camel-core to camel-cxf, in particular, how to consume a RESTful
>> service?
>>
>> I read these:
>> http://camel.apache.org/cxfrs.html
>> http://camel.apache.org/cxf-bean-component.html
>>
>> ...but these pages seem to be reference pages for people who have
>> already mastered camel-cxfrs - not newbies, like me. Can anyone point
>> me to an end-to-end example? I don't need the server-side - this is
>> legacy and produces XML.
>>
>> N.B. Outside of Camel, I have had much previous experience using CXF
>> for JAX-WS style services, client and server (never JAX-RS, though)
>>
>> Thanks for any help,
>>
>> -Chris
>
>
>
> --
> Claus Ibsen
> -
> Red Hat, Inc.
> FuseSource is now part of Red Hat
> Email: cib...@redhat.com
> Web: http://fusesource.com
> Twitter: davsclaus
> Blog: http://davsclaus.com
> Author of Camel in Action: http://www.manning.com/ibsen
Re: Need help with cxfrs component, actually RESTful service consumption, in general
Willem, Thanks for the link - I thought I had all the tests because I checked out the code a while ago - then I realized I had only checked out camel-core. BTW, the link you provided is a little off, but I found what I needed to at here: https://svn.apache.org/repos/asf/camel/trunk/components/camel-cxf/src/test/java/org/apache/camel/component/cxf/jaxrs/CxfRsConsumerTest.java Regards, Chris On Thu, Mar 28, 2013 at 9:47 PM, Willem jiang wrote: > Hi, > > If you have used CXF before, you can reuse most of you knowledge about the > CXF in camel-cxfrs or camel-cxf component. > If you just want to access the RESTful service from examples, you can take a > look at some unit tests[1] in the camel-cxfrs. > > [1]https://svn.apache.org/repos/asf/camel/trunk/camel-cxf/src/test/java/org/apache/camel/component/cxf/jaxrs/CxfRsProducerTest.java > > -- > Willem Jiang > > Red Hat, Inc. > FuseSource is now part of Red Hat > Web: http://www.fusesource.com | http://www.redhat.com > Blog: http://willemjiang.blogspot.com (http://willemjiang.blogspot.com/) > (English) > http://jnn.iteye.com (http://jnn.javaeye.com/) (Chinese) > Twitter: willemjiang > Weibo: 姜宁willem > > > > > On Friday, March 29, 2013 at 6:35 AM, Chris Wolf wrote: > >> So I have the book, "Camel In Action", which is a very good and >> thorough treatment of camel-core. However, now my development efforts >> are starting to hit severe turbulence upon making the jump from >> camel-core to camel-cxf, in particular, how to consume a RESTful >> service? >> >> I read these: >> http://camel.apache.org/cxfrs.html >> http://camel.apache.org/cxf-bean-component.html >> >> ...but these pages seem to be reference pages for people who have >> already mastered camel-cxfrs - not newbies, like me. Can anyone point >> me to an end-to-end example? I don't need the server-side - this is >> legacy and produces XML. >> >> N.B. Outside of Camel, I have had much previous experience using CXF >> for JAX-WS style services, client and server (never JAX-RS, though) >> >> Thanks for any help, >> >> -Chris > >
Need help with cxfrs component, actually RESTful service consumption, in general
So I have the book, "Camel In Action", which is a very good and thorough treatment of camel-core. However, now my development efforts are starting to hit severe turbulence upon making the jump from camel-core to camel-cxf, in particular, how to consume a RESTful service? I read these: http://camel.apache.org/cxfrs.html http://camel.apache.org/cxf-bean-component.html ...but these pages seem to be reference pages for people who have already mastered camel-cxfrs - not newbies, like me. Can anyone point me to an end-to-end example? I don't need the server-side - this is legacy and produces XML. N.B. Outside of Camel, I have had much previous experience using CXF for JAX-WS style services, client and server (never JAX-RS, though) Thanks for any help, -Chris
Re: How can I perform immediate shutdown of a context and all it's routes and services, etc.?
On Thu, Mar 28, 2013 at 3:36 AM, Claus Ibsen wrote: [...] >> have expected. Is there a way to restart >> the route from the top upon resuming? Or do you recommend any other >> "busy work" kind of route to use >> for RoutePolicy testing? >> > > The route only runs if there is messages available on the seda queue. > So send a message to the "seda:foo" queue to have it route that > message. [...] I'm new to this, but by now, I should have known that - sorry and thanks again for the help!
Re: Question about the implementation of routepolicy.quartz.ScheduledRoutePolicy
As for the issue with the consumer appearing to continue to poll - I
think my cron resume/suspend expressions were overlapping.
Thanks,
Chris
On Tue, Mar 26, 2013 at 10:06 PM, Chris Wolf wrote:
> Thanks for the clarification on that. The only problem is that, when
> using CronScheduledRoutePolicy
> on a route with an FTP endpoint configured as a consumer, it does NOT
> seem to prevent the FTP
> consumer to stop polling even after it has supposedly been suspended.
>
>
> 56:30,001 CronScheduledRoutePolicy DEBUG Suspended consumer
> FtpConsumer[ftp://localhost/download?filter=%23cpmdFileFilter&noop=true&password=**&username=adpt5]
> 56:35,100 FtpConsumerWARN Cannot connect/login
> to: ftp://adpt5@localhost:21. Will skip this poll.
> 56:35,100 FtpConsumerDEBUG Skipping poll as pre
> poll check returned false
>
>
> Any ideas?
>
> Thanks,
>
> Chris
>
> On Tue, Mar 26, 2013 at 9:11 PM, Raul Kripalani wrote:
>> You don't want to stop all endpoints in the route because there may be
>> inflight Exchanges. Instead, you want to stop the inflow of new messages
>> whilst you keep processing any inflight exchanges.
>>
>> That said, it's safe to stop the entire route (including endpoints) once
>> all inflight exchanges are completed (or immediately if none are alive) –
>> as keeping endpoints started unnecessarily could be a waste of resources.
>> Please feel free to log a JIRA.
>>
>> On the other hand, all routes start with a consumer of some kind. Mind you,
>> it doesn't have to listen on an external protocol. Take for example the
>> direct, seda or timer components, which are "virtual" endpoints.
>>
>> Regards,
>>
>> *Raúl Kripalani*
>> Enterprise Architect, Open Source Integration specialist, Program
>> Manager | Apache
>> Camel Committer
>> http://about.me/raulkripalani | http://www.linkedin.com/in/raulkripalani
>> http://blog.raulkr.net | twitter: @raulvk
>>
>> On Mon, Mar 25, 2013 at 8:08 PM, Chris Wolf wrote:
>>
>>> I am looking at code in
>>> org.apache.camel.routepolicy.quartz.ScheduledRoutePolicy -
>>> the code that starts/stops/resumes/suspends the route it is a policy for.
>>>
>>> The question is why is it separately acting on the Consumer? I thought
>>> if you call
>>> CamelContext.suspendRoute(route) and/or CamelContext.resumeRoute(route),
>>> that all the components in the route are suspended/resumed as well?
>>>
>>> Secondly, why does this code assume there is a Consumer? What if the
>>> route has
>>> a Producer?
>>>
>>> I am not being critical - I just want to understand, generally how
>>> route suspend/resume works
>>> since I am implementing a similar RoutePolicy.
>>>
>>> Thanks,
>>>
>>>
>>>-Chris
>>>
>>>
>>> protected void onJobExecute(Action action, Route route) throws Exception {
>>> [...]
>>> } else if (action == Action.SUSPEND) {
>>> if (routeStatus == ServiceStatus.Started) {
>>> stopConsumer(route.getConsumer());
>>> } else {
>>> LOG.warn("Route is not in a started state and cannot
>>> be suspended. The current route state is {}", routeStatus);
>>> }
>>> } else if (action == Action.RESUME) {
>>> if (routeStatus == ServiceStatus.Started) {
>>> if (ServiceHelper.isSuspended(route.getConsumer())) {
>>> startConsumer(route.getConsumer());
>>> } else {
>>> LOG.warn("The Consumer {} is not suspended and
>>> cannot be resumed.", route.getConsumer());
>>> }
>>>
>>> [...]
>>>
Re: How to schedule FTP with quartz?
Yes, and after Raul's clarification in his response this evening
(GMT-4), I changed my RoutePolicy implementation
and now it works!
For example, to kick off a cron job at 0615 daily, with a run duration
of 30 minutes, you would do:
CronRoutePolicy ftpPolicy = new CronRoutePolicy(TimeUnit.MINUTES);
ftpPolicy.setRouteStartTime("0 15 6 * * ?");
ftpPolicy.setPollWindowTime(30);
This implementation uses the same Quartz scheduler instance as
ScheduledRoutePolicy, but with
a different job/trigger naming convention, so there's no duplication
and (hopefully) no conflicts.
I appreciate your empty message solution, however, in my case, the
remote files will intermittently appear
during the 30 minute window time, so we have to keep trying, even
after getting some files.
On Tue, Mar 26, 2013 at 4:43 PM, Pontus Ullgren wrote:
> Sorry read your message a bit to quick.
>
> If you do not want to calculate the suspend cron expression I guess
> you need to mimic the behaviour of
> org.apache.camel.routepolicy.quartz.ScheduledRoutePolicy where (as you
> point out in another email) the consumer is suspended and not the
> route.
>
> I'm sorry can not explain why it's implemented this way, I just know
> that in the case of the existing scheduled route policies it seem to
> work as expected. :-)
> Hopefully somebody with more knowledge of the in and outs of Camel can
> explain this to us both.
>
> // Pontus
>
>
>
> On Tue, Mar 26, 2013 at 9:12 PM, Pontus Ullgren wrote:
>> Chris,
>>
>> Is there no way for you to calculate a cron expression for when the
>> suspend should occure ?
>>
>> Say that you want the route to start every 10 minutes (starting at 0)
>> and run for 5 minutes then suspend.
>> This would mean that you should be able to define the start/resume
>> cron as "0 0,10,20,30,40,50 * * * * ?".
>> And the suspend cron expression as "0 5,15,25,35,45,55 * * * * ?".
>>
>> The CronScheduledRoutePolicy will trigger a start/resum at 00:00:00
>> and then a suspend at 00:05:00, then a new start/resume at 00:10:00
>> and a new suspends at 00:15:00 and so on.
>>
>> // Pontus
>>
>> On Tue, Mar 26, 2013 at 7:39 PM, Chris Wolf wrote:
>>> Pontus,
>>>
>>> I actually gave up on CronScheduledRoutePolicy because I don't want to
>>> have to calculate an absolute suspend time based on the start/resume
>>> time. What I need is a cron-based policy that specifies the initial
>>> start time, which there-after becomes the resume time - this is a cron
>>> expression - then I just want a relative run duration, after which,
>>> the route is suspended until the next cron-specified resume time.
>>>
>>> So, after a few days, I finally have that and it works in the unit
>>> test - even the initial one-off route start will transparently switch
>>> to a resume schedule. The only problem is that I really need this
>>> policy to control a route with an FTP consumer. What I'm seeing is
>>> that
>>> even though the route is suspended, the FTP consumer continues to poll
>>> - this partially answers my question about the coding of
>>> ScheduleRoutePolicy - which only suspends the consumer - not the
>>> route, itself. While my policy suspends the route.
>>>
>>> I suspect that any route which has a component using
>>> PollingConsumerPollStrategy will not behave as I though - which is -
>>> you only need to suspend the route and all it's components will be
>>> suspended. My suspicion is that components whose Consumers are under
>>> the influence of PollingConsumerPollStrategy may not suspend by only
>>> suspended the route.
>>>
>>>-Chris
>>>
>>>
>>> On Sat, Mar 23, 2013 at 3:15 AM, Pontus Ullgren wrote:
>>>> This is probably because your route is autoStart=false. So you the first
>>>> time you need to start it. In my example you see I set both the start and
>>>> resume schedule to the same cron expression. So the policy will trigger
>>>> both a start and a resume action.
>>>>
>>>> And you will get a WARN log since the first time it can not resume (but it
>>>> will start) and after that it can not start but it will resume.
>>>>
>>>> Perhaps if you share some code it would be easier to help you.
>>>> //Pontus
>>>> On 22 Mar 2013 22:06, "Chris Wolf" wrote:
>>>>
>>>>> I found the issue with my custom CronScheduledRoutePolicy - initially
>>>>> the st
Re: Question about the implementation of routepolicy.quartz.ScheduledRoutePolicy
Thanks for the clarification on that. The only problem is that, when
using CronScheduledRoutePolicy
on a route with an FTP endpoint configured as a consumer, it does NOT
seem to prevent the FTP
consumer to stop polling even after it has supposedly been suspended.
56:30,001 CronScheduledRoutePolicy DEBUG Suspended consumer
FtpConsumer[ftp://localhost/download?filter=%23cpmdFileFilter&noop=true&password=**&username=adpt5]
56:35,100 FtpConsumerWARN Cannot connect/login
to: ftp://adpt5@localhost:21. Will skip this poll.
56:35,100 FtpConsumerDEBUG Skipping poll as pre
poll check returned false
Any ideas?
Thanks,
Chris
On Tue, Mar 26, 2013 at 9:11 PM, Raul Kripalani wrote:
> You don't want to stop all endpoints in the route because there may be
> inflight Exchanges. Instead, you want to stop the inflow of new messages
> whilst you keep processing any inflight exchanges.
>
> That said, it's safe to stop the entire route (including endpoints) once
> all inflight exchanges are completed (or immediately if none are alive) –
> as keeping endpoints started unnecessarily could be a waste of resources.
> Please feel free to log a JIRA.
>
> On the other hand, all routes start with a consumer of some kind. Mind you,
> it doesn't have to listen on an external protocol. Take for example the
> direct, seda or timer components, which are "virtual" endpoints.
>
> Regards,
>
> *Raúl Kripalani*
> Enterprise Architect, Open Source Integration specialist, Program
> Manager | Apache
> Camel Committer
> http://about.me/raulkripalani | http://www.linkedin.com/in/raulkripalani
> http://blog.raulkr.net | twitter: @raulvk
>
> On Mon, Mar 25, 2013 at 8:08 PM, Chris Wolf wrote:
>
>> I am looking at code in
>> org.apache.camel.routepolicy.quartz.ScheduledRoutePolicy -
>> the code that starts/stops/resumes/suspends the route it is a policy for.
>>
>> The question is why is it separately acting on the Consumer? I thought
>> if you call
>> CamelContext.suspendRoute(route) and/or CamelContext.resumeRoute(route),
>> that all the components in the route are suspended/resumed as well?
>>
>> Secondly, why does this code assume there is a Consumer? What if the
>> route has
>> a Producer?
>>
>> I am not being critical - I just want to understand, generally how
>> route suspend/resume works
>> since I am implementing a similar RoutePolicy.
>>
>> Thanks,
>>
>>
>>-Chris
>>
>>
>> protected void onJobExecute(Action action, Route route) throws Exception {
>> [...]
>> } else if (action == Action.SUSPEND) {
>> if (routeStatus == ServiceStatus.Started) {
>> stopConsumer(route.getConsumer());
>> } else {
>> LOG.warn("Route is not in a started state and cannot
>> be suspended. The current route state is {}", routeStatus);
>> }
>> } else if (action == Action.RESUME) {
>> if (routeStatus == ServiceStatus.Started) {
>> if (ServiceHelper.isSuspended(route.getConsumer())) {
>> startConsumer(route.getConsumer());
>> } else {
>> LOG.warn("The Consumer {} is not suspended and
>> cannot be resumed.", route.getConsumer());
>> }
>>
>> [...]
>>
Re: How to schedule FTP with quartz?
Pontus, Ok, I got rid of my RoutePolicy and put back the CronScheduledRoutePolicy and provided both start and resume cron schedules as you suggested, but CronScheduledRoutePolicy has the same issue as my RoutePolicy - suspending the FTPConsumer does NOT stop it from continuing to poll! 56:30,001 CronScheduledRoutePolicy DEBUG Suspended consumer FtpConsumer[ftp://localhost/download?filter=%23cpmdFileFilter&noop=true&password=**&username=adpt5] 56:35,100 FtpConsumerWARN Cannot connect/login to: ftp://adpt5@localhost:21. Will skip this poll. 56:35,100 FtpConsumerDEBUG Skipping poll as pre poll check returned false -Chris On Tue, Mar 26, 2013 at 4:12 PM, Pontus Ullgren wrote: > Chris, > > Is there no way for you to calculate a cron expression for when the > suspend should occure ? > > Say that you want the route to start every 10 minutes (starting at 0) > and run for 5 minutes then suspend. > This would mean that you should be able to define the start/resume > cron as "0 0,10,20,30,40,50 * * * * ?". > And the suspend cron expression as "0 5,15,25,35,45,55 * * * * ?". > > The CronScheduledRoutePolicy will trigger a start/resum at 00:00:00 > and then a suspend at 00:05:00, then a new start/resume at 00:10:00 > and a new suspends at 00:15:00 and so on. > > // Pontus > > On Tue, Mar 26, 2013 at 7:39 PM, Chris Wolf wrote: >> Pontus, >> >> I actually gave up on CronScheduledRoutePolicy because I don't want to >> have to calculate an absolute suspend time based on the start/resume >> time. What I need is a cron-based policy that specifies the initial >> start time, which there-after becomes the resume time - this is a cron >> expression - then I just want a relative run duration, after which, >> the route is suspended until the next cron-specified resume time. >> >> So, after a few days, I finally have that and it works in the unit >> test - even the initial one-off route start will transparently switch >> to a resume schedule. The only problem is that I really need this >> policy to control a route with an FTP consumer. What I'm seeing is >> that >> even though the route is suspended, the FTP consumer continues to poll >> - this partially answers my question about the coding of >> ScheduleRoutePolicy - which only suspends the consumer - not the >> route, itself. While my policy suspends the route. >> >> I suspect that any route which has a component using >> PollingConsumerPollStrategy will not behave as I though - which is - >> you only need to suspend the route and all it's components will be >> suspended. My suspicion is that components whose Consumers are under >> the influence of PollingConsumerPollStrategy may not suspend by only >> suspended the route. >> >>-Chris >> >> >> On Sat, Mar 23, 2013 at 3:15 AM, Pontus Ullgren wrote: >>> This is probably because your route is autoStart=false. So you the first >>> time you need to start it. In my example you see I set both the start and >>> resume schedule to the same cron expression. So the policy will trigger >>> both a start and a resume action. >>> >>> And you will get a WARN log since the first time it can not resume (but it >>> will start) and after that it can not start but it will resume. >>> >>> Perhaps if you share some code it would be easier to help you. >>> //Pontus >>> On 22 Mar 2013 22:06, "Chris Wolf" wrote: >>> >>>> I found the issue with my custom CronScheduledRoutePolicy - initially >>>> the startTime/resumeTime are only scheduled in >>>> onInit() - so to re-resume (re-start), you need to call >>>> scheduleRoute(Action.RESUME, route); in onStart() >>>> >>>> ...but now I'm getting: >>>> >>>> quartz.ScheduledRoutePolicy WARN Route is not in a started state and >>>> cannot be resumed. The current route state is Suspended >>>> >>>> What is the deal? I thought resumeRoute was the inverse of >>>> suspenRoute, but this log message seems to indicate that >>>> calling CamelContext.suspendRoute(routeId) will put the route into a >>>> state that cannot be resumed. >>>> >>>> Thanks, >>>> >>>> >>>> Chris >>>> >>>> On Fri, Mar 22, 2013 at 4:04 PM, Chris Wolf wrote: >>>> > Pontus, >>>> > >>>> > Thanks for that. Since I already has started implementing a class >>>> > derived from Cro
Re: How to schedule FTP with quartz?
Pontus, I actually gave up on CronScheduledRoutePolicy because I don't want to have to calculate an absolute suspend time based on the start/resume time. What I need is a cron-based policy that specifies the initial start time, which there-after becomes the resume time - this is a cron expression - then I just want a relative run duration, after which, the route is suspended until the next cron-specified resume time. So, after a few days, I finally have that and it works in the unit test - even the initial one-off route start will transparently switch to a resume schedule. The only problem is that I really need this policy to control a route with an FTP consumer. What I'm seeing is that even though the route is suspended, the FTP consumer continues to poll - this partially answers my question about the coding of ScheduleRoutePolicy - which only suspends the consumer - not the route, itself. While my policy suspends the route. I suspect that any route which has a component using PollingConsumerPollStrategy will not behave as I though - which is - you only need to suspend the route and all it's components will be suspended. My suspicion is that components whose Consumers are under the influence of PollingConsumerPollStrategy may not suspend by only suspended the route. -Chris On Sat, Mar 23, 2013 at 3:15 AM, Pontus Ullgren wrote: > This is probably because your route is autoStart=false. So you the first > time you need to start it. In my example you see I set both the start and > resume schedule to the same cron expression. So the policy will trigger > both a start and a resume action. > > And you will get a WARN log since the first time it can not resume (but it > will start) and after that it can not start but it will resume. > > Perhaps if you share some code it would be easier to help you. > //Pontus > On 22 Mar 2013 22:06, "Chris Wolf" wrote: > >> I found the issue with my custom CronScheduledRoutePolicy - initially >> the startTime/resumeTime are only scheduled in >> onInit() - so to re-resume (re-start), you need to call >> scheduleRoute(Action.RESUME, route); in onStart() >> >> ...but now I'm getting: >> >> quartz.ScheduledRoutePolicy WARN Route is not in a started state and >> cannot be resumed. The current route state is Suspended >> >> What is the deal? I thought resumeRoute was the inverse of >> suspenRoute, but this log message seems to indicate that >> calling CamelContext.suspendRoute(routeId) will put the route into a >> state that cannot be resumed. >> >> Thanks, >> >> >> Chris >> >> On Fri, Mar 22, 2013 at 4:04 PM, Chris Wolf wrote: >> > Pontus, >> > >> > Thanks for that. Since I already has started implementing a class >> > derived from CronScheduledRoutePolicy, I just finished it. >> > It works by starting a Timer thread in onStart/onResume at the end of >> > the time period, the route is suspended, but then upon >> > the next schedule cron start time, I don't see it being resumed - I >> > wonder if the RoutePolicy itself is being suspend too? >> > >> > Well, I try it your way also. >> > >> > >> > Thanks, >> > >> > >> > Chris >> > >> > On Wed, Mar 20, 2013 at 4:34 AM, Pontus Ullgren >> wrote: >> >> Hello, >> >> >> >> On Tue, Mar 19, 2013 at 11:22 PM, Chris Wolf >> wrote: >> >>> On Mon, Mar 18, 2013 at 4:57 PM, Pontus Ullgren >> wrote: >> >>>> Hello Chris, >> >>>> >> >>>> On Mon, Mar 18, 2013 at 8:54 PM, Chris Wolf >> wrote: >> >>>>> Claus, >> >>>>> >> >>>>> I have a few further questions about CronScheduledRoutePolicy. I >> >>>>> noticed that it has setters such as setRouteStartTime, >> >>>>> setRouteStopTime, each which takes a cron expression string. What >> I'm >> >>>>> looking for is to be able to use a cron expression for the start, but >> >>>>> a relative time length for stop. Otherwise, I need to write code to >> >>>>> parse the start time expression, then calculate a stop time cron >> >>>>> expression. Any ideas? >> >>>>> >> >>>> Depending on your needs you could enable "sendEmptyMessageWhenIdle" on >> >>>> the endpoint and then suspend the route when you receive a empty >> >>>> message. Which means that there is no more files to poll at the >> >>>> mom
Re: Clearing ThreadLocal when exchange completes
If you're willing to implement a custom policy, you could implement
onEchangeDone()
http://camel.apache.org/maven/current/camel-core/apidocs/org/apache/camel/spi/RoutePolicy.html#onExchangeDone%28org.apache.camel.Route,%20org.apache.camel.Exchange%29
You could subclass RoutePolicySupport and override onExchangeDone,
which is a no-op there.
The route would look like:
from("jms:somequeue")
.routeId("my.route").routePolicyRef("cleanupPolicy")
.processRef("someRandomProcessor")
.processRef("someProcessorThatSetsThreadLocalValue")
.to("jms:someotherqueue")
N.B. the route must have an explicit ID for the policy to find it.
On Tue, Mar 26, 2013 at 9:13 AM, davelund wrote:
> We are currently using ThreadLocal to store some information that gets
> included in a log4j converter (and is used in other projects that dont have
> camel in). Is there a callback I can use that for all routes in my context
> so that at the end of the route it will get called (without explicitly
> setting it) For example:
> from("jms:somequeue")
> .processRef("someRandomProcessor")
> .processRef("someProcessorThatSetsThreadLocalValue")
>
> .to("jms:someotherqueue")
>
>
> Ideally I'd like the threadlocal cleared when the exchange has been written
> to the queue, without adding a processor that explicitly clears it (as
> developers when adding new routes will forget to do it). I know the
> onCompletion runs in a seperate thread so isn't fit for my purpose. I've
> noticed syncronisations and unitofworks, but cant seem to find any
> documentation on it. Would this be fit for purpose?
>
>
>
> --
> View this message in context:
> http://camel.465427.n5.nabble.com/Clearing-ThreadLocal-when-exchange-completes-tp5729849.html
> Sent from the Camel - Users mailing list archive at Nabble.com.
Question about the implementation of routepolicy.quartz.ScheduledRoutePolicy
I am looking at code in
org.apache.camel.routepolicy.quartz.ScheduledRoutePolicy -
the code that starts/stops/resumes/suspends the route it is a policy for.
The question is why is it separately acting on the Consumer? I thought
if you call
CamelContext.suspendRoute(route) and/or CamelContext.resumeRoute(route),
that all the components in the route are suspended/resumed as well?
Secondly, why does this code assume there is a Consumer? What if the route has
a Producer?
I am not being critical - I just want to understand, generally how
route suspend/resume works
since I am implementing a similar RoutePolicy.
Thanks,
-Chris
protected void onJobExecute(Action action, Route route) throws Exception {
[...]
} else if (action == Action.SUSPEND) {
if (routeStatus == ServiceStatus.Started) {
stopConsumer(route.getConsumer());
} else {
LOG.warn("Route is not in a started state and cannot
be suspended. The current route state is {}", routeStatus);
}
} else if (action == Action.RESUME) {
if (routeStatus == ServiceStatus.Started) {
if (ServiceHelper.isSuspended(route.getConsumer())) {
startConsumer(route.getConsumer());
} else {
LOG.warn("The Consumer {} is not suspended and
cannot be resumed.", route.getConsumer());
}
[...]
Re: SMPP stop route problem
I don't know what your overall route looks like, but I think you will need to tell an upstream messaging component to stop accepting new messages, first, before calling context.stopRoute(rid) and also configure the shutdown strategy to allow sufficient time to process what was already in the queue: ShutdownStrategy sds = context.getShutdownStrategy(); sds.setTimeout(120); //<== 2 minutes On Mon, Mar 25, 2013 at 11:14 AM, fclose wrote: > Hello, > > > like I explained in a previous post I'm looking for recommendations about > how to stop a route listening for sms messages. > > Currently I'm stopping the route using the camel context > > camelContext.stopRoute(routeId); > > But doing so I'm losing some messages : > Here is the description of the problem from the guys at smsc side : > > My application returns an error code FF (Hex) or 255 (Dec) before unbinding. > Then SMSc will mark the message as an “invalid” and all next messages which > will be sent towards the same destination MSISDN will be put automatically > to “undeliverable” and no delivery attempt will be made until the > application connects again and starts accepting messages again for this > destination MSISDN. > > As error code FF or 255 is not according the SMPP specifications, the SMSc > will consider it as a permanent error (241). > > > > > > > -- > View this message in context: > http://camel.465427.n5.nabble.com/SMPP-stop-route-problem-tp5729769.html > Sent from the Camel - Users mailing list archive at Nabble.com.
Re: How can I perform immediate shutdown of a context and all it's routes and services, etc.?
Claus,
Ok, that worked - thanks a lot.
BTW, the unit test is for testing custom RoutePolicy. The route in
the test looks like:
from("seda:foo").routeId("foo").noAutoStartup().routePolicy(policy)
.loop(10).copy().delay(1000)
.log("*** loop ${property.CamelLoopIndex}")
.to("mock:foo");
The RoutePolicy suspends the route, then resume it after a period of
time - it performs this suspend/resume
cycle in a loop. I notice that this route, using the loop() method
only does the 10 iterations and does not
start from the top again after being resumed, which I guess I should
have expected. Is there a way to restart
the route from the top upon resuming? Or do you recommend any other
"busy work" kind of route to use
for RoutePolicy testing?
Thanks,
Chris
On Sat, Mar 23, 2013 at 4:02 AM, Claus Ibsen wrote:
> Hi
>
> Just set the shutdown timeout to 1 milli second (or 1 sec) etc. And
> just call stop on CamelContext.
>
> And if you extend the CamelTestSupport classes for your unit tests.
> There may be a method you can override and return 1 to indiciate 1 sec
> timeout.
>
>
>
> On Fri, Mar 22, 2013 at 5:23 PM, Chris Wolf wrote:
>> I am implementing some unit tests and if things go wrong I just want
>> to shutdown ASAP without regard for inconsistent
>> states, etc. There's no easy hook in DefaultShutDownStrategy to do
>> that because you need to know the route
>> startup order, so I ended up with this convoluted code (that I kick
>> off in a separate thread). It doesn't work, BTW.
>>
>> DefaultRouteStartupOrder rsuo = null;
>> int startOrder = 0;
>> List suo = new
>> ArrayList();
>> List routes = context.getRoutes();
>> for (Route route : routes) {
>> List services = route.getServices();
>> for (Service service : services) {
>> if (service instanceof RouteService) {
>> rsuo = new
>> DefaultRouteStartupOrder(startOrder, route, (RouteService) service);
>> suo.add(rsuo);
>> }
>> }
>> startOrder++;
>> }
>> ShutdownStrategy sds = context.getShutdownStrategy();
>> sds.shutdownForced(context, suo);
>>
>> I know there must be an easier way, but I haven't found such. Any ideas?
>>
>> Thanks,
>>
>> Chris
>
>
>
> --
> Claus Ibsen
> -
> Red Hat, Inc.
> FuseSource is now part of Red Hat
> Email: cib...@redhat.com
> Web: http://fusesource.com
> Twitter: davsclaus
> Blog: http://davsclaus.com
> Author of Camel in Action: http://www.manning.com/ibsen
Re: How to schedule FTP with quartz?
I found the issue with my custom CronScheduledRoutePolicy - initially
the startTime/resumeTime are only scheduled in
onInit() - so to re-resume (re-start), you need to call
scheduleRoute(Action.RESUME, route); in onStart()
...but now I'm getting:
quartz.ScheduledRoutePolicy WARN Route is not in a started state and
cannot be resumed. The current route state is Suspended
What is the deal? I thought resumeRoute was the inverse of
suspenRoute, but this log message seems to indicate that
calling CamelContext.suspendRoute(routeId) will put the route into a
state that cannot be resumed.
Thanks,
Chris
On Fri, Mar 22, 2013 at 4:04 PM, Chris Wolf wrote:
> Pontus,
>
> Thanks for that. Since I already has started implementing a class
> derived from CronScheduledRoutePolicy, I just finished it.
> It works by starting a Timer thread in onStart/onResume at the end of
> the time period, the route is suspended, but then upon
> the next schedule cron start time, I don't see it being resumed - I
> wonder if the RoutePolicy itself is being suspend too?
>
> Well, I try it your way also.
>
>
> Thanks,
>
>
> Chris
>
> On Wed, Mar 20, 2013 at 4:34 AM, Pontus Ullgren wrote:
>> Hello,
>>
>> On Tue, Mar 19, 2013 at 11:22 PM, Chris Wolf wrote:
>>> On Mon, Mar 18, 2013 at 4:57 PM, Pontus Ullgren wrote:
>>>> Hello Chris,
>>>>
>>>> On Mon, Mar 18, 2013 at 8:54 PM, Chris Wolf wrote:
>>>>> Claus,
>>>>>
>>>>> I have a few further questions about CronScheduledRoutePolicy. I
>>>>> noticed that it has setters such as setRouteStartTime,
>>>>> setRouteStopTime, each which takes a cron expression string. What I'm
>>>>> looking for is to be able to use a cron expression for the start, but
>>>>> a relative time length for stop. Otherwise, I need to write code to
>>>>> parse the start time expression, then calculate a stop time cron
>>>>> expression. Any ideas?
>>>>>
>>>> Depending on your needs you could enable "sendEmptyMessageWhenIdle" on
>>>> the endpoint and then suspend the route when you receive a empty
>>>> message. Which means that there is no more files to poll at the
>>>> moment.
>>>> You can use the content based route EIP for this.
>>>
>>> That is interesting to know, thanks. In my case, the files at the
>>> remote end are themselves deposited at an irregular rate, but within a
>>> defined time window, so during that time window, there will be
>>> intermittent idleness...
>>>>
>>>> Another solution would be to write your own RoutePolicy to take care
>>>> of your needs.
>>>
>>> Yes, this sounds like the best approach...
>>>
>>>
>>>>
>>>> I just started to wonder if it might be possible to combine the
>>>> CronScheduledRoutePolicy with a SimpleScheduledRoutePolicy.
>>>> I have _not_ tested this so I'm not sure if it works. It might be that
>>>> there is a collision in the way they work with Quartz.
>>>>
>>>>> Also I see that CronScheduledRoutePolicy has setRouteResumeTime,
>>>>> setRouteSuspendTime such that for my FTP poll window, I could either
>>>>> do start/stop or resume/suspend - which is recommended?
>>>>>
>>>> I would highly recommend resume/suspend.
>>>> I've had some thread leak problem with the file component when it was
>>>> repetitively started/stopped.
>>>
>>> Ok, but I guess the first policy callback with be onStart since the
>>> route will be
>>> configured with noAutoStartup(), so upon that first onStart, I'll
>>> suspend then toggle
>>> between onSuspend/onResume...
>>>
>> Yes this is what I do. We have a route that should start 06:30 each
>> day and then poll all files that are in the folder at that time.
>> After that it should suspend.
>>
>> Here is some pseudo code.
>> SuspendRouteProcessor is a processor that suspends the route based on route
>> id.
>> ---
>> String cronStr = "* 30 6 * * * ?";
>> String input =
>> "ftp://user@remotehost/inbox?sendEmptyMessageWhenIdle=true&password=secret";;
>> CronScheduledRoutePolicy scheduledRP = new CronScheduledRoutePolicy();
>> scheduledRoutePolicy.setRouteStartTime(cronStr);
>> scheduledRoutePolicy.setRouteResumeTime(cronStr);
>>
>> from(input)
>> .routeId("input1")
>> .routePolicy(version
Re: How to schedule FTP with quartz?
Pontus,
Thanks for that. Since I already has started implementing a class
derived from CronScheduledRoutePolicy, I just finished it.
It works by starting a Timer thread in onStart/onResume at the end of
the time period, the route is suspended, but then upon
the next schedule cron start time, I don't see it being resumed - I
wonder if the RoutePolicy itself is being suspend too?
Well, I try it your way also.
Thanks,
Chris
On Wed, Mar 20, 2013 at 4:34 AM, Pontus Ullgren wrote:
> Hello,
>
> On Tue, Mar 19, 2013 at 11:22 PM, Chris Wolf wrote:
>> On Mon, Mar 18, 2013 at 4:57 PM, Pontus Ullgren wrote:
>>> Hello Chris,
>>>
>>> On Mon, Mar 18, 2013 at 8:54 PM, Chris Wolf wrote:
>>>> Claus,
>>>>
>>>> I have a few further questions about CronScheduledRoutePolicy. I
>>>> noticed that it has setters such as setRouteStartTime,
>>>> setRouteStopTime, each which takes a cron expression string. What I'm
>>>> looking for is to be able to use a cron expression for the start, but
>>>> a relative time length for stop. Otherwise, I need to write code to
>>>> parse the start time expression, then calculate a stop time cron
>>>> expression. Any ideas?
>>>>
>>> Depending on your needs you could enable "sendEmptyMessageWhenIdle" on
>>> the endpoint and then suspend the route when you receive a empty
>>> message. Which means that there is no more files to poll at the
>>> moment.
>>> You can use the content based route EIP for this.
>>
>> That is interesting to know, thanks. In my case, the files at the
>> remote end are themselves deposited at an irregular rate, but within a
>> defined time window, so during that time window, there will be
>> intermittent idleness...
>>>
>>> Another solution would be to write your own RoutePolicy to take care
>>> of your needs.
>>
>> Yes, this sounds like the best approach...
>>
>>
>>>
>>> I just started to wonder if it might be possible to combine the
>>> CronScheduledRoutePolicy with a SimpleScheduledRoutePolicy.
>>> I have _not_ tested this so I'm not sure if it works. It might be that
>>> there is a collision in the way they work with Quartz.
>>>
>>>> Also I see that CronScheduledRoutePolicy has setRouteResumeTime,
>>>> setRouteSuspendTime such that for my FTP poll window, I could either
>>>> do start/stop or resume/suspend - which is recommended?
>>>>
>>> I would highly recommend resume/suspend.
>>> I've had some thread leak problem with the file component when it was
>>> repetitively started/stopped.
>>
>> Ok, but I guess the first policy callback with be onStart since the
>> route will be
>> configured with noAutoStartup(), so upon that first onStart, I'll
>> suspend then toggle
>> between onSuspend/onResume...
>>
> Yes this is what I do. We have a route that should start 06:30 each
> day and then poll all files that are in the folder at that time.
> After that it should suspend.
>
> Here is some pseudo code.
> SuspendRouteProcessor is a processor that suspends the route based on route
> id.
> ---
> String cronStr = "* 30 6 * * * ?";
> String input =
> "ftp://user@remotehost/inbox?sendEmptyMessageWhenIdle=true&password=secret";;
> CronScheduledRoutePolicy scheduledRP = new CronScheduledRoutePolicy();
> scheduledRoutePolicy.setRouteStartTime(cronStr);
> scheduledRoutePolicy.setRouteResumeTime(cronStr);
>
> from(input)
> .routeId("input1")
> .routePolicy(versionPolicy, scheduledRoutePolicy)
> .noAutoStartup()
> .choice()
> .when(body().isNotNull())
>.to("direct:processFiles")
> .end()
> .log(LoggingLevel.DEBUG, "All files processed, suspend route")
> .process(new SuspendRouteProcessor("input1"))
> ;
> --
>
> The only downside with this is that after the initial start we get a
> WARN log message that the route can not be started since it is in
> suspend state.
> But as long as you can live with the WARN log it works.
>
>>>
>>> // Pontus
>>>
>>>> Thanks,
>>>>
>>>> Chris
>>>>
>>>> On Sat, Mar 2, 2013 at 1:43 AM, Claus Ibsen wrote:
>>>>> Hi
>>>>>
>>>>> See about route policy
>>>>> http://camel.apache.org/routepolicy
>>>>>
>>>>> And the schedul
How can I perform immediate shutdown of a context and all it's routes and services, etc.?
I am implementing some unit tests and if things go wrong I just want
to shutdown ASAP without regard for inconsistent
states, etc. There's no easy hook in DefaultShutDownStrategy to do
that because you need to know the route
startup order, so I ended up with this convoluted code (that I kick
off in a separate thread). It doesn't work, BTW.
DefaultRouteStartupOrder rsuo = null;
int startOrder = 0;
List suo = new
ArrayList();
List routes = context.getRoutes();
for (Route route : routes) {
List services = route.getServices();
for (Service service : services) {
if (service instanceof RouteService) {
rsuo = new
DefaultRouteStartupOrder(startOrder, route, (RouteService) service);
suo.add(rsuo);
}
}
startOrder++;
}
ShutdownStrategy sds = context.getShutdownStrategy();
sds.shutdownForced(context, suo);
I know there must be an easier way, but I haven't found such. Any ideas?
Thanks,
Chris
Re: How to schedule FTP with quartz?
On Mon, Mar 18, 2013 at 4:57 PM, Pontus Ullgren wrote: > Hello Chris, > > On Mon, Mar 18, 2013 at 8:54 PM, Chris Wolf wrote: >> Claus, >> >> I have a few further questions about CronScheduledRoutePolicy. I >> noticed that it has setters such as setRouteStartTime, >> setRouteStopTime, each which takes a cron expression string. What I'm >> looking for is to be able to use a cron expression for the start, but >> a relative time length for stop. Otherwise, I need to write code to >> parse the start time expression, then calculate a stop time cron >> expression. Any ideas? >> > Depending on your needs you could enable "sendEmptyMessageWhenIdle" on > the endpoint and then suspend the route when you receive a empty > message. Which means that there is no more files to poll at the > moment. > You can use the content based route EIP for this. That is interesting to know, thanks. In my case, the files at the remote end are themselves deposited at an irregular rate, but within a defined time window, so during that time window, there will be intermittent idleness... > > Another solution would be to write your own RoutePolicy to take care > of your needs. Yes, this sounds like the best approach... > > I just started to wonder if it might be possible to combine the > CronScheduledRoutePolicy with a SimpleScheduledRoutePolicy. > I have _not_ tested this so I'm not sure if it works. It might be that > there is a collision in the way they work with Quartz. > >> Also I see that CronScheduledRoutePolicy has setRouteResumeTime, >> setRouteSuspendTime such that for my FTP poll window, I could either >> do start/stop or resume/suspend - which is recommended? >> > I would highly recommend resume/suspend. > I've had some thread leak problem with the file component when it was > repetitively started/stopped. Ok, but I guess the first policy callback with be onStart since the route will be configured with noAutoStartup(), so upon that first onStart, I'll suspend then toggle between onSuspend/onResume... > > // Pontus > >> Thanks, >> >> Chris >> >> On Sat, Mar 2, 2013 at 1:43 AM, Claus Ibsen wrote: >>> Hi >>> >>> See about route policy >>> http://camel.apache.org/routepolicy >>> >>> And the scheduled route policy >>> http://camel.apache.org/scheduledroutepolicy.html >>> >>> On Sat, Mar 2, 2013 at 12:15 AM, Chris Wolf wrote: >>>> I have a requirement to download files via FTP during a certain time >>>> window and according to a schedule. e.g. Only on trading days between >>>> 6:30AM and 7:00AM. The FTP component, alone, seems to just do >>>> indefinite polling according to delay/initialDelay. >>>> >>>> From the "Camel In Action" book, chapter 7, I see some examples of >>>> sending a text message with the Timer and Quartz components, but I >>>> can't quite see how to put that together to implement "kicking off >>>> routes at specified intervals", mentioned in the best practices list >>>> at the end of that chapter. How would I use quartz to stop/start the >>>> FTP component, or the route that it's in? >>>> >>>> Thanks, >>>> >>>> Chris >>> >>> >>> >>> -- >>> Claus Ibsen >>> - >>> Red Hat, Inc. >>> FuseSource is now part of Red Hat >>> Email: cib...@redhat.com >>> Web: http://fusesource.com >>> Twitter: davsclaus >>> Blog: http://davsclaus.com >>> Author of Camel in Action: http://www.manning.com/ibsen
Re: How to schedule FTP with quartz?
Claus, I have a few further questions about CronScheduledRoutePolicy. I noticed that it has setters such as setRouteStartTime, setRouteStopTime, each which takes a cron expression string. What I'm looking for is to be able to use a cron expression for the start, but a relative time length for stop. Otherwise, I need to write code to parse the start time expression, then calculate a stop time cron expression. Any ideas? Also I see that CronScheduledRoutePolicy has setRouteResumeTime, setRouteSuspendTime such that for my FTP poll window, I could either do start/stop or resume/suspend - which is recommended? Thanks, Chris On Sat, Mar 2, 2013 at 1:43 AM, Claus Ibsen wrote: > Hi > > See about route policy > http://camel.apache.org/routepolicy > > And the scheduled route policy > http://camel.apache.org/scheduledroutepolicy.html > > On Sat, Mar 2, 2013 at 12:15 AM, Chris Wolf wrote: >> I have a requirement to download files via FTP during a certain time >> window and according to a schedule. e.g. Only on trading days between >> 6:30AM and 7:00AM. The FTP component, alone, seems to just do >> indefinite polling according to delay/initialDelay. >> >> From the "Camel In Action" book, chapter 7, I see some examples of >> sending a text message with the Timer and Quartz components, but I >> can't quite see how to put that together to implement "kicking off >> routes at specified intervals", mentioned in the best practices list >> at the end of that chapter. How would I use quartz to stop/start the >> FTP component, or the route that it's in? >> >> Thanks, >> >> Chris > > > > -- > Claus Ibsen > - > Red Hat, Inc. > FuseSource is now part of Red Hat > Email: cib...@redhat.com > Web: http://fusesource.com > Twitter: davsclaus > Blog: http://davsclaus.com > Author of Camel in Action: http://www.manning.com/ibsen
Re: Programatically adding beans to a registry in a RouteBuilder
Are you running this code in web container? If so, which? Tomcat,
Jetty, JBoss?
If you are just running as a standalone Java app, you can just use
"SimpleRegistry", which is basically a Map.
CamelContext context = new DefaultCamelContext(new SimpleRegistry());
Registry registry = context.getRegistry();
if (registry instanceof PropertyPlaceholderDelegateRegistry)
registry =
((PropertyPlaceholderDelegateRegistry)registry).getRegistry();
Then, instead of JndiRegistry.bind(...), just use Map's put(..) method:
((SimpleRegistry)registry).put("bean-name", new SomeBean());
On Mon, Mar 18, 2013 at 2:49 PM, Gert Villemos wrote:
> I meant that I in the RouteBuilder::configure have;
>
> JndiRegistry registry = (JndiRegistry) getContext().getRegistry(); // DO NOT
> WORK!
>
>
> ---
>
> Thanks for the suggestion. The code
>
> PropertyPlaceholderDelegateRegistry registry =
> (PropertyPlaceholderDelegateRegistry) getContext().getRegistry();
> JndiRegistry jndiRegistry = (JndiRegistry) registry.getRegistry();
>
> Gives me a reference to the JndiRegistry, but on first bind() I get an
> exception;
>
> javax.naming.NoInitialContextException: Need to specify class name in
> environment or system property, or as an applet parameter, or in an
> application resource file: java.naming.factory.initial
>
> If I need to manually initialize the JNDI context, then this smells like Im
> doing something I should not be doing, i.e. bypassing the 'right' way of
> doing things...
>
>
>
> --
> View this message in context:
> http://camel.465427.n5.nabble.com/Programatically-adding-beans-to-a-registry-in-a-RouteBuilder-tp5729358p5729370.html
> Sent from the Camel - Users mailing list archive at Nabble.com.
Re: Programatically adding beans to a registry in a RouteBuilder
It may, or may not be wrapped in PropertyPlaceholderDelegateRegistry, in that case, I would try this: Registry registry = context.getRegistry(); if (registry instanceof PropertyPlaceholderDelegateRegistry) registry = ((PropertyPlaceholderDelegateRegistry)registry).getRegistry(); Then cast to implementation-specific Registry type to access bind() (or put) method. (Pretty much what Donald was saying...) On Mon, Mar 18, 2013 at 2:14 PM, Donald Whytock wrote: > On Mon, Mar 18, 2013 at 2:02 PM, Gert Villemos wrote: >> Hmmm... tried that but doesnt work. >> >> getContext() returns a >> org.apache.camel.impl.PropertyPlaceholderDelegateRegistry object. Which cant >> be cast to JndiRegistry. >> >> My setup is the following; In a Spring based route I have bean A. Bean As >> @Handler will create an instance of bean B, which is a RouteBuilder, and add >> bean B's routes to the context. Bean A thus 'starts' bean B. > > Apologies...I was looking at the DefaultCamelContext source and seeing > that by default it creates a JndiRegistry. > > I'm assuming you meant getRegistry() above instead of getContext()? > Such that camelContext.getRegistry() returns the > PropertyPlaceholderDelegateRegistry? > > According to the current javadoc, PropertyPlaceholderDelegateRegistry > is "A Registry which delegates to the real registry." The object has > its own getRegistry() method, which returns a Registry. > > So...I'm sorry to say this, but...have you tried > > JndiRegistry registry = (JndiRegistry) > camelContext.getRegistry().getRegistry(); > > ?
Re: How to schedule FTP with quartz?
Ok, that's what I was looking for - specifically the Cron version: http://camel.apache.org/cronscheduledroutepolicy.html Thanks for the help, Chris On Sat, Mar 2, 2013 at 1:43 AM, Claus Ibsen wrote: > Hi > > See about route policy > http://camel.apache.org/routepolicy > > And the scheduled route policy > http://camel.apache.org/scheduledroutepolicy.html > > On Sat, Mar 2, 2013 at 12:15 AM, Chris Wolf wrote: >> I have a requirement to download files via FTP during a certain time >> window and according to a schedule. e.g. Only on trading days between >> 6:30AM and 7:00AM. The FTP component, alone, seems to just do >> indefinite polling according to delay/initialDelay. >> >> From the "Camel In Action" book, chapter 7, I see some examples of >> sending a text message with the Timer and Quartz components, but I >> can't quite see how to put that together to implement "kicking off >> routes at specified intervals", mentioned in the best practices list >> at the end of that chapter. How would I use quartz to stop/start the >> FTP component, or the route that it's in? >> >> Thanks, >> >> Chris > > > > -- > Claus Ibsen > - > Red Hat, Inc. > FuseSource is now part of Red Hat > Email: cib...@redhat.com > Web: http://fusesource.com > Twitter: davsclaus > Blog: http://davsclaus.com > Author of Camel in Action: http://www.manning.com/ibsen
