huijunwu commented on pull request #3571:
URL: https://github.com/apache/incubator-heron/pull/3571#issuecomment-660425049
ubuntu 20.04 minikube
looks like some config is missing for bookeeper `Exception in thread "main"
org.apache.commons.configuration.ConversionException: 'httpServerPort' doesn't
map to an Integer object`
```
$ kubectl logs bookie-9hbmp
......
2020-07-18 04:34:17,715 - INFO -
[main-SendThread(zookeeper:2181):ClientCnxn$SendThread@1394] - Session
establishment complete on server zookeeper/172.18.0.3:2181, sessionid =
0x1002a08191e0009, negotiated timeout = 10000
2020-07-18 04:34:17,716 - INFO -
[main-EventThread:ZooKeeperWatcherBase@130] - ZooKeeper client is connected now.
2020-07-18 04:34:17,807 - ERROR -
[main:RackawareEnsemblePlacementPolicyImpl@267] - Failed to initialize DNS
Resolver org.apache.bookkeeper.net.ScriptBasedMapping, used default subnet
resolver : java.lang.RuntimeException: No network topology script is found when
using script based DNS resolver.
2020-07-18 04:34:17,832 - INFO -
[main:RackawareEnsemblePlacementPolicyImpl@214] - Initialize rackaware ensemble
placement policy @ <Bookie:172.18.0.4:0> @ /default-rack :
org.apache.bookkeeper.client.TopologyAwareEnsemblePlacementPolicy$DefaultResolver.
2020-07-18 04:34:17,832 - INFO -
[main:RackawareEnsemblePlacementPolicyImpl@224] - Not weighted
2020-07-18 04:34:17,840 - INFO - [main:BookKeeper@509] - Weighted ledger
placement is not enabled
Jul 18, 2020 4:34:18 AM io.vertx.core.spi.resolver.ResolverProvider
INFO: Using the default address resolver as the dns resolver could not be
loaded
2020-07-18 04:34:18,205 - INFO - [main:Main@345] - Load lifecycle component
: org.apache.bookkeeper.server.service.HttpService
Exception in thread "main"
org.apache.commons.configuration.ConversionException: 'httpServerPort' doesn't
map to an Integer object
at
org.apache.commons.configuration.AbstractConfiguration.getInteger(AbstractConfiguration.java:848)
at
org.apache.commons.configuration.AbstractConfiguration.getInt(AbstractConfiguration.java:822)
at
org.apache.bookkeeper.conf.ServerConfiguration.getHttpServerPort(ServerConfiguration.java:3118)
at
org.apache.bookkeeper.server.service.HttpService.publishInfo(HttpService.java:73)
at
org.apache.bookkeeper.common.component.LifecycleComponentStack.lambda$publishInfo$2(LifecycleComponentStack.java:130)
at
com.google.common.collect.ImmutableList.forEach(ImmutableList.java:408)
at
org.apache.bookkeeper.common.component.LifecycleComponentStack.publishInfo(LifecycleComponentStack.java:126)
at
org.apache.bookkeeper.common.component.ComponentStarter.startComponent(ComponentStarter.java:82)
at org.apache.bookkeeper.server.Main.doMain(Main.java:234)
at org.apache.bookkeeper.server.Main.main(Main.java:208)
Caused by: org.apache.commons.configuration.ConversionException: Could not
convert to java.lang.Integer
at
org.apache.commons.configuration.PropertyConverter.toNumber(PropertyConverter.java:461)
at
org.apache.commons.configuration.PropertyConverter.toInteger(PropertyConverter.java:294)
at
org.apache.commons.configuration.AbstractConfiguration.getInteger(AbstractConfiguration.java:844)
... 9 more
Caused by: java.lang.NumberFormatException: For input string: ""
at
java.lang.NumberFormatException.forInputString(NumberFormatException.java:65)
at java.lang.Integer.parseInt(Integer.java:592)
at java.lang.Integer.<init>(Integer.java:867)
at sun.reflect.GeneratedConstructorAccessor1.newInstance(Unknown
Source)
at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at
org.apache.commons.configuration.PropertyConverter.toNumber(PropertyConverter.java:457)
... 11 more
$ kubectl logs heron-apiserver-65b9f7c79f-vb5lp
.....
2020-07-18 04:37:07,986 ERROR
org.apache.heron.apiserver.resources.TopologyResource submit qtp2100961961-16
error submitting topology acking
org.apache.heron.spi.uploader.UploaderException: Encountered exceptions on
uploading the package 'acking-ubuntu-tag-0--6015305960494613991.tar.gz'
at
org.apache.heron.uploader.dlog.DLUploader.uploadPackage(DLUploader.java:167)
at
org.apache.heron.scheduler.SubmitterMain.uploadPackage(SubmitterMain.java:549)
at
org.apache.heron.scheduler.SubmitterMain.submitTopology(SubmitterMain.java:452)
at
org.apache.heron.apiserver.actions.SubmitTopologyAction.execute(SubmitTopologyAction.java:39)
at
org.apache.heron.apiserver.resources.TopologyResource.submit(TopologyResource.java:230)
at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at
org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory$1.invoke(ResourceMethodInvocationHandlerFactory.java:81)
at
org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:144)
at
org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:161)
at
org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$ResponseOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:160)
at
org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:99)
at
org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:389)
at
org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:347)
at
org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:102)
at
org.glassfish.jersey.server.ServerRuntime$2.run(ServerRuntime.java:326)
at org.glassfish.jersey.internal.Errors$1.call(Errors.java:271)
at org.glassfish.jersey.internal.Errors$1.call(Errors.java:267)
at org.glassfish.jersey.internal.Errors.process(Errors.java:315)
at org.glassfish.jersey.internal.Errors.process(Errors.java:297)
at org.glassfish.jersey.internal.Errors.process(Errors.java:267)
at
org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:317)
at
org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:305)
at
org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:1154)
at
org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:473)
at
org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:427)
at
org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:388)
at
org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:341)
at
org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:228)
at
org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:841)
at
org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:535)
at
org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:188)
at
org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1253)
at
org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:168)
at
org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473)
at
org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:166)
at
org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1155)
at
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
at
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
at org.eclipse.jetty.server.Server.handle(Server.java:564)
at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:317)
at
org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
at
org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:279)
at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:110)
at
org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:124)
at
org.eclipse.jetty.util.thread.Invocable.invokePreferred(Invocable.java:128)
at
org.eclipse.jetty.util.thread.Invocable$InvocableExecutor.invoke(Invocable.java:222)
at
org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:294)
at
org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:199)
at
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:673)
at
org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:591)
at java.base/java.lang.Thread.run(Thread.java:834)
Caused by: org.apache.distributedlog.exceptions.WriteException: Write
rejected because stream acking-ubuntu-tag-0--6015305960494613991.tar.gz has
encountered an error : writer has been closed due to error.
at
org.apache.distributedlog.BKAsyncLogWriter.doGetLogSegmentWriter(BKAsyncLogWriter.java:218)
at
org.apache.distributedlog.BKAsyncLogWriter.getLogSegmentWriter(BKAsyncLogWriter.java:208)
at
org.apache.distributedlog.BKAsyncLogWriter.getLogSegmentWriterForEndOfStream(BKAsyncLogWriter.java:237)
at
org.apache.distributedlog.BKAsyncLogWriter.markEndOfStream(BKAsyncLogWriter.java:475)
at
org.apache.distributedlog.AppendOnlyStreamWriter.markEndOfStream(AppendOnlyStreamWriter.java:82)
at org.apache.heron.dlog.DLOutputStream.close(DLOutputStream.java:74)
at
org.apache.heron.uploader.dlog.DLUploader.doUploadPackage(DLUploader.java:196)
at
org.apache.heron.uploader.dlog.DLUploader.uploadPackage(DLUploader.java:161)
... 53 more
.....
to reproduce:
./docker/scripts/build-docker.sh ubuntu20.04 0.0.0 ~/heron-release
DIR=./deploy/kubernetes/minikube
STR='s!heron/heron:latest!heron/heron:0.0.0!g'
sed ${STR} ${DIR}/zookeeper.yaml > /tmp/zookeeper.yaml
sed ${STR} ${DIR}/tools.yaml > /tmp/tools.yaml
sed ${STR} ${DIR}/apiserver.yaml > /tmp/apiserver.yaml
kubectl create -f /tmp/zookeeper.yaml
kubectl create -f ${DIR}/bookkeeper.yaml
kubectl create -f /tmp/tools.yaml
kubectl create -f /tmp/apiserver.yaml
kubectl get pods
kubectl proxy -p 8001 &
curl
http://localhost:8001/api/v1/namespaces/default/services/heron-apiserver:9000/proxy/api/v1/version
heron config kubernetes set service_url
http://localhost:8001/api/v1/namespaces/default/services/heron-apiserver:9000/proxy
heron submit kubernetes ~/.heron/examples/heron-api-examples.jar
org.apache.heron.examples.api.AckingTopology acking
[2020-07-18 04:47:56 +0000] [ERROR]: Encountered exceptions on uploading the
package 'acking-ubuntu-tag-0--2714210181101618016.tar.gz'
[2020-07-18 04:47:56 +0000] [ERROR]: Failed to launch topology 'acking'
kubectl get pods
heron submit kubernetes ~/.heron/examples/heron-api-examples.jar
org.apache.heron.examples.api.AckingTopology acking
[2020-07-18 04:47:56 +0000] [ERROR]: Encountered exceptions on uploading the
package 'acking-ubuntu-tag-0--2714210181101618016.tar.gz'
[2020-07-18 04:47:56 +0000] [ERROR]: Failed to launch topology 'acking'
kubectl describe pod heron-apiserver-65b9f7c79f-vb5lp
kubectl logs heron-apiserver-65b9f7c79f-vb5lp
kubectl get pods
kubectl logs bookie-9hbmp
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
