Hi, I have identified the problem more precisely. The issue occurs if feature URLs point to two different versions of the same wrapped thirdparties dependency (like Hystrix). After fix features in way that they points on the same version, issue disappears. I will try to distil the issue in simple example based on vanilla Karaf, anyway it would be nice to investigate and fix it (at least to produce clear log error messages). Otherwise the problem is really weird and hard to investigate.
Regards, Andrei. > -----Original Message----- > From: Andrei Shakirin [mailto:ashaki...@talend.com] > Sent: Dienstag, 19. Juni 2018 09:54 > To: user@karaf.apache.org > Cc: j...@nanthrax.net > Subject: RE: Karaf hangs on startup (4.0.7) > > Hi JB, > > JVM: 1.8.0_151 > OS: Linux #16-Ubuntu. > > Yes, it is custom Karaf distribution. Will try to reproduce it on clean Karaf. > > I took thread dumps from hanging Karaf (attached). Can you see anything > suspicious there? > > Regards, > Andrei. > > > > -----Original Message----- > > From: Jean-Baptiste Onofré [mailto:j...@nanthrax.net] > > Sent: Montag, 18. Juni 2018 13:32 > > To: user@karaf.apache.org > > Subject: Re: Karaf hangs on startup (4.0.7) > > > > Hi Andrei, > > > > can you provide some details about the environment (OS, JVM, ...) ? > > > > I guess it's a custom Karaf distribution ? Are you able to reproduce > > with Karaf vanilla ? > > > > Regards > > JB > > > > On 18/06/2018 13:02, Andrei Shakirin wrote: > > > Hi, > > > > > > I have the following issue with Karaf (4.0.7) startup: > > > The startup process completely hangs after starting Jetty Server instance: > > > > > > ... > > > 2018-06-17 04:00:42,326INFO > > [{{bundle.name,org.apache.karaf.features.core}{bundle.version,4.0.7}{b > > undle.id > > > ,9}}][null]org.apache.karaf.features.internal.service.FeaturesServiceImplDone. > > > 2018-06-17 04:00:42,360INFO > > > [{{bundle.name,org.apache.karaf.features.core}{bundle.version,4.0.7} > > > {b > > > undle.id,9}}][null]org.apache.karaf.features.internal.service.Featur > > > es ServiceImplAdding features: spring-dm/[1.2.1,1.2.1], > > > cxf-abdera/[3.1.8,3.1.8], cxf/[3.1.8,3.1.8], > > > cxf-commands/[3.1.8,3.1.8], activemq-client/[5.14.5,5.14.5], > > > camel/[2.17.3,2.17.3], camel-cxf/[2.17.3,2.17.3], > > > camel-jms/[2.17.3,2.17.3], > > > basit-server-availability/[3.23.2,3.23.2], > > > basit-address-service/[3.34.1,3.34.1], > > > basit-administration-service/[1.25.0,1.25.0], > > > basit-article-domain/[7.26.0,7.26.0], > > > basit-article-service/[4.28.0,4.28.0], > > > basit-connector-atp-engine/[2.29.2,2.29.2], > > > basit-cart-service/[6.21.0,6.21.0], > > > basit-checkout-service/[9.2.0,9.2.0], > > > basit-communication-engine/[1.24.0,1.24.0], > > > basit-core-domain/[10.19.1,10.19.1], > > > basit-customer-domain/[13.3.0,13.3.0], > > > basit-datasource-ecom-pg/[9.11.0,9.11.0], > > > basit-connector-ecom/[9.11.0,9.11.0], > > > basit-datasource-hybris/[2.39.0,2.39.0], > > > basit-connector-hybris/[2.39.0,2.39.0], > > > basit-datasource-talendmd-pg/[3.34.0,3.34.0], > > > basit-connector-talendmd/[3.34.0,3.34.0], > > > basit-ebay-gateway/[1.28.0,1.28.0], > > > basit-exclusion-engine/[1.14.0,1.14.0], > > > basit-giftcard-service/[0,0.0.0], > > > basit-connector-jms/[1.37.0,1.37.0], > > > basit-messaging-service/[1.27.0,1.27.0], > > > basit-newsletter-service/[2.8.3,2.8.3], > > > basit-offer-service/[3.27.1,3.27.1], basit-order-service/[0,0.0.0], > > > basit-payment-service/[1.33.0,1.33.0], > > > basit-connector-sap/[4.16.0,4.16.0], > > > basit-user-service/[11.11.1,11.11.1] > > > 2018-06-17 04:00:42,384INFO > > > [{{bundle.name,org.ops4j.pax.web.pax-web-jetty}{bundle.version,4.3.0 > > > }{ > > > bundle.id,94}}][null]org.ops4j.pax.web.service.jetty.internal.JettyF > > > ac toryImplSPDY not available, creating standard ServerConnector for > > > Http > > > 2018-06-17 04:00:42,398INFO > > > [{{bundle.name,org.ops4j.pax.web.pax-web-jetty}{bundle.version,4.3.0 > > > }{ > > > bundle.id,94}}][null]org.ops4j.pax.web.service.jetty.internal.JettyS > > > er verImplPax Web available at [0.0.0.0]:[8040] > > > 2018-06-17 04:00:42,418INFO > > > [{{bundle.name,org.ops4j.pax.web.pax-web-jetty}{bundle.version,4.3.0 > > > }{ > > > bundle.id,94}}][null]org.ops4j.pax.web.service.jetty.internal.JettyF > > > ac > > > toryImplNo ALPN class available > > > 2018-06-17 04:00:42,418INFO > > > [{{bundle.name,org.ops4j.pax.web.pax-web-jetty}{bundle.version,4.3.0 > > > }{ > > > bundle.id,94}}][null]org.ops4j.pax.web.service.jetty.internal.JettyF > > > ac toryImplSPDY not available, creating standard ServerConnector for > > > Https > > > 2018-06-17 04:00:42,420INFO > > > [{{bundle.name,org.ops4j.pax.web.pax-web-jetty}{bundle.version,4.3.0 > > > }{ > > > bundle.id,94}}][null]org.ops4j.pax.web.service.jetty.internal.JettyS > > > er verImplPax Web available at [0.0.0.0]:[8041] > > > 2018-06-17 04:00:42,431INFO > > > [{{bundle.name,org.ops4j.pax.web.pax-web-runtime}{bundle.version,4.3 > > > .0 > > > }{bundle.id,95}}][null]org.ops4j.pax.web.service.internal.HttpServic > > > eF actoryImplBinding bundle: > > > [org.apache.karaf.webconsole.console_4.0.7 > > > [56]] to http service > > > 2018-06-17 04:00:42,469INFO > > > [{{bundle.name,org.ops4j.pax.web.pax-web-jetty}{bundle.version,4.3.0 > > > }{ > > > bundle.id,94}}][null]org.ops4j.pax.web.service.jetty.internal.JettyS > > > er > > > verWrapperwill add > > > org.eclipse.jetty.websocket.jsr356.server.deploy.WebSocketServerCont > > > ai nerInitializer to ServletContainerInitializers > > > 2018-06-17 04:00:42,747INFO > > > [{{bundle.name,org.ops4j.pax.web.pax-web-jetty}{bundle.version,4.3.0 > > > }{ > > > bundle.id,94}}][null]org.ops4j.pax.web.service.jetty.internal.JettyS > > > er verWrapperadded ServletContainerInitializer: > > > org.eclipse.jetty.websocket.jsr356.server.deploy.WebSocketServerCont > > > ai > > > nerInitializer > > > 2018-06-17 04:00:42,781INFO > > > [{{bundle.name,org.ops4j.pax.web.pax-web- > > jetty}{bundle.version,4.3.0}{bundle.id,94}}][null]org.ops4j.pax.web.se > > rvice.jetty.i nternal.HttpServiceContextregistering context > > org.apache.felix.webconsole.internal.servlet.OsgiManagerHttpContext@36 > > e9b > > 33f, with context-name: > > > 2018-06-17 04:00:42,827INFO > > > [{{bundle.name,org.eclipse.jetty.util}{bundle.version,9.2.19.v201609 > > > 08 > > > }{bundle.id,79}}][null]org.eclipse.jetty.server.handler.ContextHandl > > > er > > > Started > > > HttpServiceContext{httpContext=org.apache.felix.webconsole.internal. > > > se rvlet.OsgiManagerHttpContext@36e9b33f} > > > 2018-06-17 04:00:42,830INFO > > > [{{bundle.name,org.eclipse.jetty.util}{bundle.version,9.2.19.v201609 > > > 08 > > > }{bundle.id,79}}][null]org.eclipse.jetty.server.Serverjetty-9.2.19.v > > > 20 > > > 160908 > > > 2018-06-17 04:00:42,928INFO > > > [{{bundle.name,org.eclipse.jetty.util}{bundle.version,9.2.19.v201609 > > > 08 > > > }{bundle.id,79}}][null]org.eclipse.jetty.server.ServerConnectorStart > > > ed default@3616b12b{HTTP/1.1}{0.0.0.0:8040} > > > 2018-06-17 04:00:42,959INFO > > > [{{bundle.name,org.eclipse.jetty.util}{bundle.version,9.2.19.v201609 > > > 08 > > > }{bundle.id,79}}][null]org.eclipse.jetty.server.ServerConnectorStart > > > ed secureDefault@4b972cf2{SSL-http/1.1}{0.0.0.0:8041} > > > 2018-06-17 04:00:42,960INFO > > > [{{bundle.name,org.eclipse.jetty.util}{bundle.version,9.2.19.v201609 > > > 08 }{bundle.id,79}}][null]org.eclipse.jetty.server.ServerStarted > > > @5804ms > > > ---------------------------------------------------------- > > > After that just nothing happens. > > > > > > In normal case Karaf starts FeaturesServiceImpl with "Changes to perform:" > > message after jetty: > > > > > > .... > > > 2018-06-17 05:00:35,815INFO > > > [{{bundle.name,org.ops4j.pax.web.pax-web- > > jetty}{bundle.version,4.3.0}{bundle.id,94}}][null]org.ops4j.pax.web.se > > rvice.jetty.i nternal.HttpServiceContextregistering context > > org.apache.felix.webconsole.internal.servlet.OsgiManagerHttpContext@77 > > ca9 > > 71, with context-name: > > > 2018-06-17 05:00:35,849INFO > > > [{{bundle.name,org.eclipse.jetty.util}{bundle.version,9.2.19.v201609 > > > 08 > > > }{bundle.id,79}}][null]org.eclipse.jetty.server.handler.ContextHandl > > > er > > > Started > > > HttpServiceContext{httpContext=org.apache.felix.webconsole.internal. > > > se rvlet.OsgiManagerHttpContext@77ca971} > > > 2018-06-17 05:00:35,852INFO > > > [{{bundle.name,org.eclipse.jetty.util}{bundle.version,9.2.19.v201609 > > > 08 > > > }{bundle.id,79}}][null]org.eclipse.jetty.server.Serverjetty-9.2.19.v > > > 20 > > > 160908 > > > 2018-06-17 05:00:35,929INFO > > > [{{bundle.name,org.eclipse.jetty.util}{bundle.version,9.2.19.v201609 > > > 08 > > > }{bundle.id,79}}][null]org.eclipse.jetty.server.ServerConnectorStart > > > ed default@2e0e40ef{HTTP/1.1}{0.0.0.0:8040} > > > 2018-06-17 05:00:35,957INFO > > > [{{bundle.name,org.eclipse.jetty.util}{bundle.version,9.2.19.v201609 > > > 08 > > > }{bundle.id,79}}][null]org.eclipse.jetty.server.ServerConnectorStart > > > ed secureDefault@645d3768{SSL-http/1.1}{0.0.0.0:8041} > > > 2018-06-17 05:00:35,958INFO > > > [{{bundle.name,org.eclipse.jetty.util}{bundle.version,9.2.19.v201609 > > > 08 }{bundle.id,79}}][null]org.eclipse.jetty.server.ServerStarted > > > @7463ms > > > 2018-06-17 05:00:48,501INFO > > [{{bundle.name,org.apache.karaf.features.core}{bundle.version,4.0.7}{b > > undle.id ,9}}][null] 2018-06-17 05:00:48,501INFO > > [{{bundle.name,org.apache.karaf.features.core}{bundle.version,4.0.7}{b > > undle.id > > ,9}}][null]org.apache.karaf.features.internal.service.FeaturesServiceI > > mplChang > > es to perform: > > > 2018-06-17 05:00:48,502INFO > > [{{bundle.name,org.apache.karaf.features.core}{bundle.version,4.0.7}{b > > undle.id > > ,9}}][null]org.apache.karaf.features.internal.service.FeaturesServiceI > > mpl > > Region: root > > > 2018-06-17 05:00:48,502INFO > > [{{bundle.name,org.apache.karaf.features.core}{bundle.version,4.0.7}{b > > undle.id > > ,9}}][null]org.apache.karaf.features.internal.service.FeaturesServiceI > > mpl > > Bundles to uninstall: > > > ... > > > > > > The problem happens not always - only sometimes, but quite often. > > > > > > The full stacktrace and jetty configuration are attached (in > > > stacktrace you can > > see that nothing happens after "2018-06-17 04:00:42,960INFO"). > > > > > > Any clue why it could happens and how to repair the issue? > > > > > > Regards, > > > Andrei. > > > > > > As a recipient of an email from Talend, your contact personal data > > > will be on our systems. Please see our contacts privacy notice at > > > Talend, Inc. <https://www.talend.com/contacts-privacy-policy/> > > > > > > > > > > -- > > Jean-Baptiste Onofré > > jbono...@apache.org > > https://urldefense.proofpoint.com/v2/url?u=http- > > 3A__blog.nanthrax.net&d=DwIG- > > g&c=2w5q_42kFG40MI2alLPgJw&r=bWOqkHjIZE0sZtdpFMIhm- > > > lcbhtB3cv08OlIr0lkKR4&m=LRcCRwvQdL0VBDlLPAYjd2DNfbeMm3wRTun9cjUP > > p8c&s=Wxx3gb1-rmuYShLTll-DDQmjIOgIMGtYB7cpZLoSkcs&e= > > Talend - http://www.talend.com
