huijunwu commented on pull request #3571: URL: https://github.com/apache/incubator-heron/pull/3571#issuecomment-660545082
looks like we still neee bookie format init container .. ``` $ kubectl logs bookie-2rl2j ... 2020-07-18 11:05:17,827 - INFO - [main-EventThread:ZooKeeperWatcherBase@130] - ZooKeeper client is connected now. 2020-07-18 11:05:18,233 - INFO - [main:BookieNettyServer@424] - Shutting down BookieNettyServer 2020-07-18 11:05:18,268 - ERROR - [main:Main@228] - Failed to build bookie server org.apache.bookkeeper.bookie.BookieException$InvalidCookieException: instanceId 4eae15a0-4a00-44a1-849d-df5fcb9d2789 is not matching with 395e2565-3488-4e4c-b8d2-9a6795ee42ae at org.apache.bookkeeper.bookie.Cookie.verifyInternal(Cookie.java:142) at org.apache.bookkeeper.bookie.Cookie.verify(Cookie.java:147) at org.apache.bookkeeper.bookie.Bookie.verifyAndGetMissingDirs(Bookie.java:372) at org.apache.bookkeeper.bookie.Bookie.checkEnvironmentWithStorageExpansion(Bookie.java:435) at org.apache.bookkeeper.bookie.Bookie.checkEnvironment(Bookie.java:253) at org.apache.bookkeeper.bookie.Bookie.<init>(Bookie.java:699) at org.apache.bookkeeper.proto.BookieServer.newBookie(BookieServer.java:140) at org.apache.bookkeeper.proto.BookieServer.<init>(BookieServer.java:108) at org.apache.bookkeeper.server.service.BookieService.<init>(BookieService.java:52) at org.apache.bookkeeper.server.Main.buildBookieServer(Main.java:313) at org.apache.bookkeeper.server.Main.doMain(Main.java:226) at org.apache.bookkeeper.server.Main.main(Main.java:208) ``` how to reproduce: following the previous ubuntu20.04 environment, kill the old cluster and start the new cluster, then submit the job again ``` $ DIR=./deploy/kubernetes/minikube $ STR='s!heron/heron:latest!heron/heron:0.0.0!g' $ sed ${STR} ${DIR}/zookeeper.yaml > /tmp/zookeeper.yaml $ sed ${STR} ${DIR}/tools.yaml > /tmp/tools.yaml $ sed ${STR} ${DIR}/apiserver.yaml > /tmp/apiserver.yaml kubectl delete -f /tmp/zookeeper.yaml kubectl delete -f ${DIR}/bookkeeper.yaml kubectl delete -f /tmp/tools.yaml kubectl delete -f /tmp/apiserver.yaml kubectl create -f /tmp/zookeeper.yaml kubectl create -f ${DIR}/bookkeeper.yaml kubectl create -f /tmp/tools.yaml kubectl create -f /tmp/apiserver.yaml ``` ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org