venkat-oss opened a new issue #1200:
URL: https://github.com/apache/camel-kafka-connector/issues/1200
Hi @oscerd I'm unable to use the simple language expression to get the kafka
headers in the sink configuration.
my sink configuration is like this:
{
"connector.class":
"org.apache.camel.kafkaconnector.aws2s3.CamelAws2s3SinkConnector",
"camel.component.aws2-s3.region": "us-east-1",
"camel.sink.endpoint.keyName":
"${date:now:yyyyMMdd-HHmmssSSS}-${exchangeId}-${header.kafka.TOPIC}",
"topics": "s3.source",
"camel.sink.path.bucketNameOrArn": "bucket-to-hold-more-data-auto",
"camel.beans.aggregate":
"#class:org.apache.camel.kafkaconnector.aggregator.StringAggregator",
"camel.aggregation.size": "1",
"camel.sink.endpoint.useDefaultCredentialsProvider": "true",
"name": "source_kafka_dest_s3_connector",
"value.converter": "org.apache.kafka.connect.storage.StringConverter",
"key.converter": "org.apache.kafka.connect.storage.StringConverter",
"camel.aggregation.timeout": "1000"
}
If I takeout the ${header.kafka.TOPIC} part it works and populates the date
and exchangeId., If I add it, then the connector fails with the simple lang
exception. I tried using ${headers[kafka.TOPIC]} as well, but it fails with the
same exception. Couldn't get down to what went wrong.
"trace": "org.apache.kafka.connect.errors.ConnectException: Failed to create
and start Camel context\n\tat
org.apache.camel.kafkaconnector.CamelSinkTask.start(CamelSinkTask.java:152)\n\tat
org.apache.kafka.connect.runtime.WorkerSinkTask.initializeAndStart(WorkerSinkTask.java:308)\n\tat
org.apache.kafka.connect.runtime.WorkerSinkTask.execute(WorkerSinkTask.java:196)\n\tat
org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:189)\n\tat
org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:238)\n\tat
java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)\n\tat
java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)\n\tat
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)\n\tat
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)\n\tat
java.base/java.lang.Thread.run(Thread.java:829)\nCaused by:
org.apache.camel.FailedToCreateRouteException: Failed to
create route route26 at: >>>
Aggregate[org.apache.camel.builder.ExpressionClause@11734ac4 ->
[DynamicTo[aws2-s3://bucket-to-hold-more-data-auto?keyName=${date:now:yyyyMMdd-HHmmssSSS}-${exchangeId}-${header.kafka.TOPIC}&useDefaultCredentialsProvider=true]]]
<<< in route: Route(route26)[From[direct:start] -> [Aggregate[org.apache.c...
because of No language could be found for: bean\n\tat
org.apache.camel.reifier.RouteReifier.doCreateRoute(RouteReifier.java:240)\n\tat
org.apache.camel.reifier.RouteReifier.createRoute(RouteReifier.java:74)\n\tat
org.apache.camel.impl.DefaultModelReifierFactory.createRoute(DefaultModelReifierFactory.java:49)\n\tat
org.apache.camel.impl.DefaultCamelContext.startRouteDefinitions(DefaultCamelContext.java:826)\n\tat
org.apache.camel.impl.DefaultCamelContext.startRouteDefinitions(DefaultCamelContext.java:716)\n\tat
org.apache.camel.impl.engine.AbstractCamelContext.doInit(AbstractCamelContext.java:2756)\n\tat
org.apache.camel.support.service.BaseService.init(
BaseService.java:83)\n\tat
org.apache.camel.impl.engine.AbstractCamelContext.init(AbstractCamelContext.java:2475)\n\tat
org.apache.camel.support.service.BaseService.start(BaseService.java:111)\n\tat
org.apache.camel.impl.engine.AbstractCamelContext.start(AbstractCamelContext.java:2494)\n\tat
org.apache.camel.impl.DefaultCamelContext.start(DefaultCamelContext.java:245)\n\tat
org.apache.camel.main.SimpleMain.doStart(SimpleMain.java:43)\n\tat
org.apache.camel.support.service.BaseService.start(BaseService.java:119)\n\tat
org.apache.camel.kafkaconnector.CamelSinkTask.start(CamelSinkTask.java:145)\n\t...
9 more\nCaused by:
org.apache.camel.language.simple.types.SimpleIllegalSyntaxException: No
language could be found for: bean\n\tat
org.apache.camel.language.simple.SimpleExpressionParser.parseExpression(SimpleExpressionParser.java:62)\n\tat
org.apache.camel.language.simple.SimpleLanguage.createExpression(SimpleLanguage.java:199)\n\tat
org.apache.camel.reifier.ToDynamicReifier.createExpres
sion(ToDynamicReifier.java:80)\n\tat
org.apache.camel.reifier.ToDynamicReifier.createProcessor(ToDynamicReifier.java:45)\n\tat
org.apache.camel.reifier.ProcessorReifier.createProcessor(ProcessorReifier.java:815)\n\tat
org.apache.camel.reifier.ProcessorReifier.createOutputsProcessor(ProcessorReifier.java:770)\n\tat
org.apache.camel.reifier.ProcessorReifier.createOutputsProcessor(ProcessorReifier.java:548)\n\tat
org.apache.camel.reifier.ProcessorReifier.createChildProcessor(ProcessorReifier.java:569)\n\tat
org.apache.camel.reifier.AggregateReifier.createAggregator(AggregateReifier.java:56)\n\tat
org.apache.camel.reifier.AggregateReifier.createProcessor(AggregateReifier.java:52)\n\tat
org.apache.camel.reifier.ProcessorReifier.makeProcessor(ProcessorReifier.java:838)\n\tat
org.apache.camel.reifier.ProcessorReifier.addRoutes(ProcessorReifier.java:579)\n\tat
org.apache.camel.reifier.RouteReifier.doCreateRoute(RouteReifier.java:236)\n\t...
22 more\nCaused by: org.apache.camel.NoSuchLanguag
eException: No language could be found for: bean\n\tat
org.apache.camel.impl.engine.DefaultLanguageResolver.noSpecificLanguageFound(DefaultLanguageResolver.java:89)\n\tat
org.apache.camel.impl.engine.DefaultLanguageResolver.resolveLanguage(DefaultLanguageResolver.java:63)\n\tat
org.apache.camel.impl.engine.AbstractCamelContext$4.apply(AbstractCamelContext.java:1722)\n\tat
org.apache.camel.impl.engine.AbstractCamelContext$4.apply(AbstractCamelContext.java:1705)\n\tat
java.base/java.util.concurrent.ConcurrentHashMap.computeIfAbsent(ConcurrentHashMap.java:1705)\n\tat
org.apache.camel.impl.engine.AbstractCamelContext.resolveLanguage(AbstractCamelContext.java:1705)\n\tat
org.apache.camel.language.simple.SimpleExpressionBuilder$KeyedOgnlExpressionAdapter.init(SimpleExpressionBuilder.java:939)\n\tat
org.apache.camel.language.simple.ast.SimpleFunctionExpression.createExpression(SimpleFunctionExpression.java:63)\n\tat
org.apache.camel.language.simple.ast.SimpleFunctionStart.doCreateLiteralEx
pression(SimpleFunctionStart.java:74)\n\tat
org.apache.camel.language.simple.ast.SimpleFunctionStart.createExpression(SimpleFunctionStart.java:64)\n\tat
org.apache.camel.language.simple.SimpleExpressionParser.createExpressions(SimpleExpressionParser.java:193)\n\tat
org.apache.camel.language.simple.SimpleExpressionParser.doParseExpression(SimpleExpressionParser.java:116)\n\tat
org.apache.camel.language.simple.SimpleExpressionParser.parseExpression(SimpleExpressionParser.java:56)\n\t...
34 more\n"
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
