[
https://issues.apache.org/jira/browse/CAMEL-12596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16530174#comment-16530174
]
Lizuca Mihaescu commented on CAMEL-12596:
-----------------------------------------
ActiveMQ shuts down immediately after starting. There is no error into the log
during shutdown:
{code:java}
acks = 1
batch.size = 16384
bootstrap.servers = [10.148.70.74:9092]
buffer.memory = 33554432
client.id =
compression.type = none
connections.max.idle.ms = 540000
enable.idempotence = false
interceptor.classes = []
key.serializer = class
org.apache.kafka.common.serialization.ByteArraySerializer linger.ms = 0
max.block.ms = 60000
max.in.flight.requests.per.connection = 5
max.request.size = 1048576
metadata.max.age.ms = 300000
metric.reporters = []
metrics.num.samples = 2
metrics.recording.level = INFO
metrics.sample.window.ms = 30000
partitioner.class = class
org.apache.kafka.clients.producer.internals.DefaultPartitioner
receive.buffer.bytes = 65536
reconnect.backoff.max.ms = 1000
reconnect.backoff.ms = 50
request.timeout.ms = 305000
retries = 3
retry.backoff.ms = 100
sasl.jaas.config = [hidden]
sasl.kerberos.kinit.cmd = /usr/bin/kinit
sasl.kerberos.min.time.before.relogin = 60000
sasl.kerberos.service.name = kafka
sasl.kerberos.ticket.renew.jitter = 0.05
sasl.kerberos.ticket.renew.window.factor = 0.8
sasl.mechanism = GSSAPI
security.protocol = SASL_PLAINTEXT
send.buffer.bytes = 131072
ssl.cipher.suites = null
ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1]
ssl.endpoint.identification.algorithm = null
ssl.key.password = null
ssl.keymanager.algorithm = SunX509
ssl.keystore.location = null
ssl.keystore.password = null
ssl.keystore.type = JKS
ssl.protocol = TLS
ssl.provider = null
ssl.secure.random.implementation = null
ssl.trustmanager.algorithm = PKIX
ssl.truststore.location = null
ssl.truststore.password = null
ssl.truststore.type = JKS
transaction.timeout.ms = 60000
transactional.id = null
value.serializer = class
org.apache.kafka.common.serialization.ByteArraySerializer{code}
{code:java}
2018-07-02 18:27:16,382 | INFO | [Producer clientId=producer-1] Closing the
Kafka producer with timeoutMillis = 0 ms. |
org.apache.kafka.clients.producer.KafkaProducer | main
2018-07-02 18:27:16,384 | INFO | Apache Camel 2.21.0 (CamelContext: camel) is
shutting down | org.apache.camel.spring.SpringCamelContext | main
2018-07-02 18:27:16,388 | DEBUG | Shutting down with no inflight threads. |
org.apache.camel.impl.DefaultAsyncProcessorAwaitManager | main
2018-07-02 18:27:16,399 | DEBUG | Clearing simple language predicate
cache[size=0, hits=0, misses=0, evicted=0] |
org.apache.camel.language.simple.SimpleLanguage | main
2018-07-02 18:27:16,404 | DEBUG | Clearing simple language expression
cache[size=1, hits=0, misses=1, evicted=0] |
org.apache.camel.language.simple.SimpleLanguage | main
2018-07-02 18:27:16,407 | DEBUG | Unregistered MBean with ObjectName:
org.apache.camel:context=camel,type=routecontrollers,name="camel" |
org.apache.camel.management.DefaultManagementAgent | main
2018-07-02 18:27:16,410 | DEBUG | Unregistered MBean with ObjectName:
org.apache.camel:context=camel,type=health,name="camel" |
org.apache.camel.management.DefaultManagementAgent | main
2018-07-02 18:27:16,413 | DEBUG | Removed TimerListener:
org.apache.camel.management.mbean.ManagedCamelContext@541179e7 |
org.apache.camel.support.TimerListenerManager | main
2018-07-02 18:27:16,416 | DEBUG | Unregistered MBean with ObjectName:
org.apache.camel:context=camel,type=context,name="camel" |
org.apache.camel.management.DefaultManagementAgent | main
2018-07-02 18:27:16,419 | DEBUG | Shutting down with no inflight exchanges. |
org.apache.camel.impl.DefaultInflightRepository | main
2018-07-02 18:27:16,422 | DEBUG | Stopping service pool:
org.apache.camel.impl.SharedPollingConsumerServicePool@16e7b402 |
org.apache.camel.impl.SharedPollingConsumerServicePool | main
2018-07-02 18:27:16,425 | DEBUG | Stopping service pool:
org.apache.camel.impl.SharedProducerServicePool@2f00f851 |
org.apache.camel.impl.SharedProducerServicePool | main
2018-07-02 18:27:16,428 | DEBUG | Giving time for 1 ExecutorService's to
shutdown properly (acting as fail-safe) |
org.apache.camel.impl.DefaultExecutorServiceManager | main
2018-07-02 18:27:16,434 | DEBUG | Shutdown of ExecutorService:
java.util.concurrent.ThreadPoolExecutor@8bd86c8[Terminated, pool size = 0,
active threads = 0, queued tasks = 0, completed tasks = 0] is shutdown: true
and terminated: true took: 0.000 seconds. |
org.apache.camel.impl.DefaultExecutorServiceManager | main
2018-07-02 18:27:16,437 | DEBUG | Unregistered MBean with ObjectName:
org.apache.camel:context=camel,type=threadpools,name="JmsConsumer(0x885e7ff)" |
org.apache.camel.management.DefaultManagementAgent | main
2018-07-02 18:27:16,440 | DEBUG | Unregistered MBean with ObjectName:
org.apache.camel:context=camel,type=services,name=DefaultInflightRepository |
org.apache.camel.management.DefaultManagementAgent | main
2018-07-02 18:27:16,444 | DEBUG | Unregistered MBean with ObjectName:
org.apache.camel:context=camel,type=services,name=DefaultShutdownStrategy |
org.apache.camel.management.DefaultManagementAgent | main
2018-07-02 18:27:16,447 | DEBUG | Unregistered MBean with ObjectName:
org.apache.camel:context=camel,type=processors,name="setHeader1" |
org.apache.camel.management.DefaultManagementAgent | main
2018-07-02 18:27:16,450 | DEBUG | Unregistered MBean with ObjectName:
org.apache.camel:context=camel,type=components,name="kafka" |
org.apache.camel.management.DefaultManagementAgent | main
2018-07-02 18:27:16,453 | DEBUG | Unregistered MBean with ObjectName:
org.apache.camel:context=camel,type=processors,name="log1" |
org.apache.camel.management.DefaultManagementAgent | main
2018-07-02 18:27:16,456 | DEBUG | Unregistered MBean with ObjectName:
org.apache.camel:context=camel,type=routes,name="rtbi.kafka-producer" |
org.apache.camel.management.DefaultManagementAgent | main
2018-07-02 18:27:16,460 | DEBUG | Unregistered MBean with ObjectName:
org.apache.camel:context=camel,type=tracer,name=BacklogDebugger |
org.apache.camel.management.DefaultManagementAgent | main
2018-07-02 18:27:16,465 | DEBUG | Unregistered MBean with ObjectName:
org.apache.camel:context=camel,type=services,name=DefaultRestRegistry |
org.apache.camel.management.DefaultManagementAgent | main
2018-07-02 18:27:16,467 | DEBUG | Unregistered MBean with ObjectName:
org.apache.camel:context=camel,type=services,name=DefaultExecutorServiceManager
| org.apache.camel.management.DefaultManagementAgent | main
2018-07-02 18:27:16,471 | DEBUG | Unregistered MBean with ObjectName:
org.apache.camel:context=camel,type=processors,name="to1" |
org.apache.camel.management.DefaultManagementAgent | main
2018-07-02 18:27:16,474 | DEBUG | Unregistered MBean with ObjectName:
org.apache.camel:context=camel,type=components,name="spring-event" |
org.apache.camel.management.DefaultManagementAgent | main
2018-07-02 18:27:16,477 | DEBUG | Unregistered MBean with ObjectName:
org.apache.camel:context=camel,type=services,name=DefaultTransformerRegistry |
org.apache.camel.management.DefaultManagementAgent | main
2018-07-02 18:27:16,479 | DEBUG | Unregistered MBean with ObjectName:
org.apache.camel:context=camel,type=services,name=DefaultAsyncProcessorAwaitManager
| org.apache.camel.management.DefaultManagementAgent | main
2018-07-02 18:27:16,482 | DEBUG | Unregistered MBean with ObjectName:
org.apache.camel:context=camel,type=endpoints,name="kafka://10.148.70.74:9092\?brokers=10.148.70.74%3A9092&keySerializerClass=org.apache.kafka.common.serialization.ByteArraySerializer&requestTimeoutMs=305000&retries=3&saslJaasConfig=com.sun.security.auth.module.Krb5LoginModule+required+useKeyTab%3Dtrue+storeKey%3Dtrue+keyTab%3D%22.%2Fsvc_kafka.keytab%22+useTicketCache%3Dfalse+serviceName%3D%22kafka%22+principal%3D%22svc_kafka%40GTAT.LAN%22&saslKerberosServiceName=kafka&saslMechanism=GSSAPI&securityProtocol=SASL_PLAINTEXT&serializerClass=org.apache.kafka.common.serialization.ByteArraySerializer&topic=GameEvents.s1.v1"
| org.apache.camel.management.DefaultManagementAgent | main
2018-07-02 18:27:16,485 | DEBUG | Unregistered MBean with ObjectName:
org.apache.camel:context=camel,type=services,name=DefaultValidatorRegistry |
org.apache.camel.management.DefaultManagementAgent | main
2018-07-02 18:27:16,488 | DEBUG | Unregistered MBean with ObjectName:
org.apache.camel:context=camel,type=endpoints,name="activemq://queue:RTBI.gameEvents.site1.v1"
| org.apache.camel.management.DefaultManagementAgent | main
2018-07-02 18:27:16,491 | DEBUG | Unregistered MBean with ObjectName:
org.apache.camel:context=camel,type=services,name=DefaultTypeConverter |
org.apache.camel.management.DefaultManagementAgent | main
2018-07-02 18:27:16,494 | DEBUG | Unregistered MBean with ObjectName:
org.apache.camel:context=camel,type=errorhandlers,name="DefaultErrorHandlerBuilder(ref:CamelDefaultErrorHandlerBuilder)"
| org.apache.camel.management.DefaultManagementAgent | main
2018-07-02 18:27:16,497 | DEBUG | Unregistered MBean with ObjectName:
org.apache.camel:context=camel,type=services,name=DefaultEndpointRegistry |
org.apache.camel.management.DefaultManagementAgent | main
2018-07-02 18:27:16,500 | DEBUG | Unregistered MBean with ObjectName:
org.apache.camel:context=camel,type=tracer,name=BacklogTracer |
org.apache.camel.management.DefaultManagementAgent | main
2018-07-02 18:27:16,503 | DEBUG | Unregistered MBean with ObjectName:
org.apache.camel:context=camel,type=producers,name=KafkaProducer(0x55d58825) |
org.apache.camel.management.DefaultManagementAgent | main
2018-07-02 18:27:16,506 | DEBUG | Unregistered MBean with ObjectName:
org.apache.camel:context=camel,type=processors,name="setHeader2" |
org.apache.camel.management.DefaultManagementAgent | main
2018-07-02 18:27:16,508 | DEBUG | Unregistered MBean with ObjectName:
org.apache.camel:context=camel,type=services,name=DefaultRuntimeCamelCatalog |
org.apache.camel.management.DefaultManagementAgent | main
2018-07-02 18:27:16,511 | DEBUG | Unregistered MBean with ObjectName:
org.apache.camel:context=camel,type=components,name="activemq" |
org.apache.camel.management.DefaultManagementAgent | main
2018-07-02 18:27:16,514 | DEBUG | Clearing cache[size=15, hits=4, misses=26,
evicted=11] | org.apache.camel.management.MBeanInfoAssembler | main
2018-07-02 18:27:16,520 | DEBUG | Clearing cache[size=62, hits=105, misses=92,
evicted=30] | org.apache.camel.util.IntrospectionSupport | main
2018-07-02 18:27:16,524 | INFO | Apache Camel 2.21.0 (CamelContext: camel)
uptime 0.916 seconds | org.apache.camel.spring.SpringCamelContext | main
2018-07-02 18:27:16,527 | INFO | Apache Camel 2.21.0 (CamelContext: camel) is
shutdown in 0.143 seconds | org.apache.camel.spring.SpringCamelContext | main
2018-07-02 18:27:16,533 | INFO | Apache ActiveMQ 5.15.4 (localhost,
ID:atix-bi-amq1-44600-1530548833663-0:1) is shutting down |
org.apache.activemq.broker.BrokerService | ActiveMQ ShutdownHook
2018-07-02 18:27:16,535 | INFO | Connector openwire stopped |
org.apache.activemq.broker.TransportConnector | ActiveMQ ShutdownHook
2018-07-02 18:27:16,536 | INFO | socketQueue interrupted - stopping |
org.apache.activemq.transport.tcp.TcpTransportServer | ActiveMQ Transport
Server Thread Handler:
tcp://0.0.0.0:61616?maximumConnections=1000&wireFormat.maxFrameSize=104857600
2018-07-02 18:27:16,537 | INFO | Could not accept connection during shutdown
: {} | org.apache.activemq.broker.TransportConnector | ActiveMQ Transport
Server Thread Handler:
tcp://0.0.0.0:61616?maximumConnections=1000&wireFormat.maxFrameSize=104857600
java.lang.InterruptedException
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014)[:1.8.0_171]
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088)[:1.8.0_171]
at
java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)[:1.8.0_171]
at
org.apache.activemq.transport.tcp.TcpTransportServer$1.run(TcpTransportServer.java:479)[activemq-client-5.15.4.jar:5.15.4]
at java.lang.Thread.run(Thread.java:748)[:1.8.0_171]
2018-07-02 18:27:16,538 | INFO | Connector amqp stopped |
org.apache.activemq.broker.TransportConnector | ActiveMQ ShutdownHook
2018-07-02 18:27:16,540 | INFO | Connector stomp stopped |
org.apache.activemq.broker.TransportConnector | ActiveMQ ShutdownHook
2018-07-02 18:27:16,541 | INFO | Connector mqtt stopped |
org.apache.activemq.broker.TransportConnector | ActiveMQ ShutdownHook
2018-07-02 18:27:16,557 | INFO | Connector ws stopped |
org.apache.activemq.broker.TransportConnector | ActiveMQ ShutdownHook
2018-07-02 18:27:16,560 | INFO |
PListStore:[/opt/apache-activemq-5.15.4/data/localhost/tmp_storage] stopped |
org.apache.activemq.store.kahadb.plist.PListStoreImpl | ActiveMQ ShutdownHook
2018-07-02 18:27:16,561 | INFO | Stopping async queue tasks |
org.apache.activemq.store.kahadb.KahaDBStore | ActiveMQ ShutdownHook
2018-07-02 18:27:16,562 | INFO | Stopping async topic tasks |
org.apache.activemq.store.kahadb.KahaDBStore | ActiveMQ ShutdownHook
2018-07-02 18:27:16,563 | INFO | Stopped KahaDB |
org.apache.activemq.store.kahadb.KahaDBStore | ActiveMQ ShutdownHook
2018-07-02 18:27:16,597 | INFO | Apache ActiveMQ 5.15.4 (localhost,
ID:atix-bi-amq1-44600-1530548833663-0:1) uptime 3.061 seconds |
org.apache.activemq.broker.BrokerService | ActiveMQ ShutdownHook
2018-07-02 18:27:16,598 | INFO | Apache ActiveMQ 5.15.4 (localhost,
ID:atix-bi-amq1-44600-1530548833663-0:1) is shutdown |
org.apache.activemq.broker.BrokerService | ActiveMQ ShutdownHook
2018-07-02 18:27:16,599 | INFO | Closing
org.apache.activemq.xbean.XBeanBrokerFactory$1@5bcab519: startup date [Mon Jul
02 18:27:11 CEST 2018]; root of context hierarchy |
org.apache.activemq.xbean.XBeanBrokerFactory$1 | ActiveMQ ShutdownHook
2018-07-02 18:27:16,600 | DEBUG | onApplicationEvent:
org.springframework.context.event.ContextClosedEvent[source=org.apache.activemq.xbean.XBeanBrokerFactory$1@5bcab519:
startup date [Mon Jul 02 18:27:11 CEST 2018]; root of context hierarchy] |
org.apache.camel.spring.SpringCamelContext | ActiveMQ ShutdownHook
2018-07-02 18:27:16,602 | INFO | Stopping beans in phase 2147483646 |
org.springframework.context.support.DefaultLifecycleProcessor | ActiveMQ
ShutdownHook
2018-07-02 18:27:16,624 | INFO | Destroying Spring FrameworkServlet
'dispatcher' | /admin | ActiveMQ ShutdownHook
2018-07-02 18:27:16,627 | INFO | Closing WebApplicationContext for namespace
'dispatcher-servlet': startup date [Mon Jul 02 18:27:14 CEST 2018]; parent:
Root WebApplicationContext |
org.springframework.web.context.support.XmlWebApplicationContext | ActiveMQ
ShutdownHook
2018-07-02 18:27:16,629 | INFO | Closing Root WebApplicationContext: startup
date [Mon Jul 02 18:27:14 CEST 2018]; root of context hierarchy |
org.springframework.web.context.support.XmlWebApplicationContext | ActiveMQ
ShutdownHook{code}
> Camel-Kafka security protocol SASL_PLAINTEXT not supported
> ----------------------------------------------------------
>
> Key: CAMEL-12596
> URL: https://issues.apache.org/jira/browse/CAMEL-12596
> Project: Camel
> Issue Type: Improvement
> Components: camel-kafka
> Affects Versions: 2.21.1
> Environment: * ActiveMQ v5.15.4
> * Camel:2.21.1
> * Kafka Clients: 1.1.0
> * Server Version: Apache/2.4.6(CentOS)
> Reporter: Lizuca Mihaescu
> Priority: Major
>
> I need to route ActiveMQ messages to Kafka(Cloudera) through Camel using
> authentication protocol Kerberos.
>
> Kafka Security documentation states that it only supports *SASL_PLAINTEXT*
> and *SASL_SSL* for Kerberos:
> [https://www.cloudera.com/documentation/kafka/2-0-x/topics/kafka_security.html]
>
> | ** |*SSL*|*Kerberos*|
> |PLAINTEXT|No|No|
> |SSL|Yes|No|
> |SASL_PLAINTEXT|No|Yes|
> |SASL_SSL|Yes|Yes|
>
>
>
> On the other hand when I try to use *SASL_PLAINTEXT* for security protocol in
> Camel I am getting an error during the ActiveMQ starting. As a result
> ActiveMQ will not start.
>
> I took the latest Camel code from: [https://github.com/apache/camel.git] and
> it states that it only supports *SSL* and *PLAINTEXT* as security protocols
> values.
>
> | *securityProtocol* (security) | Protocol used to communicate with brokers.
> Currently only PLAINTEXT and SSL are supported. | PLAINTEXT | String
>
>
> I did find this solved issue: [https://access.redhat.com/solutions/3364871]
> but I did not find any evidence that this is working in the latest Camel
> version.
>
> My Camel setup fragment is:
> {code:java}
> <log message="Started The Producer Route" /><to
> uri="kafka://10.100.70.00:9092?topic=MyEvents.s1.v1&brokers=10.100.70.00:9092&requestTimeoutMs=305000&retries=3&keySerializerClass=org.apache.kafka.common.serialization.ByteArraySerializer&saslMechanism=GSSAPI&serializerClass=org.apache.kafka.common.serialization.ByteArraySerializer&securityProtocol=SASL_PLAINTEXT&saslKerberosServiceName=kafka"/>{code}
>
> I am using an external Jaas configuration file:
> {code:java}
> KafkaClient {
> com.sun.security.auth.module.Krb5LoginModule required
> useKeyTab=true
> storeKey=true
> keyTab="./user.keytab"
> useTicketCache=false
> serviceName="kafka"
> principal=" Group/[email protected]";
> };{code}
> Why Camel does not support *SASL_PLAINTEXT* *and* *SASL_SSL*?
>
> Please help me this is *VERY IMPORTANT* for the project I am working on and
> this issue is considered a blocker. I am also an experienced Java programmer
> and I am willing to contribute if necessary to the open source code for such
> implementation if the need may be.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
