Hi Daniel,
Thanks for reply. I am trying vagrant onap. When I run command
vagrant up message_router
It makes 2 containers up except the Kafka container in mr . Kafka container
exits immediately. Unable to start Kafka container.
I tried running start-kafka.sh . Getting below error.
vagrant@all-in-one:/vagrant$ sudo docker ps -a
CONTAINER ID IMAGE
COMMAND CREATED STATUS
PORTS
NAMES
2dbe339ade43 attos/dmaap
"/bin/sh -c ./star..." 11 minutes ago Up 11 minutes
0.0.0.0:3904-3905->3904-3905/tcp
dockerfiles_dmaap_1
41eef7f94bfd dockerfiles_kafka
"start-kafka.sh" 11 minutes ago Exited (1) 10
minutes ago
dockerfiles_kafka_1
c4ed041cd9ef wurstmeister/zookeeper
"/bin/sh -c '/usr/..." 11 minutes ago Up 11 minutes
22/tcp, 2888/tcp, 3888/tcp, 0.0.0.0:2181->2181/tcp
dockerfiles_zookeeper_1
vagrant@all-in-one:/vagrant$ sudo docker logs 41eef7f94bfd
waiting for kafka to be ready
[2017-06-20 11:14:59,932] INFO Verifying properties (kafka.utils.
VerifiableProperties)
[2017-06-20 11:14:59,996] INFO Property advertised.host.name is overridden
to kafka (kafka.utils.VerifiableProperties)
[2017-06-20 11:15:00,002] INFO Property advertised.port is overridden to
9092 (kafka.utils.VerifiableProperties)
[2017-06-20 11:15:00,002] INFO Property broker.id is overridden to 1
(kafka.utils.VerifiableProperties)
[2017-06-20 11:15:00,002] INFO Property log.cleaner.enable is overridden to
false (kafka.utils.VerifiableProperties)
[2017-06-20 11:15:00,003] INFO Property log.dirs is overridden to
/kafka/kafka-logs (kafka.utils.VerifiableProperties)
[2017-06-20 11:15:00,008] INFO Property log.retention.check.interval.ms is
overridden to 60000 (kafka.utils.VerifiableProperties)
[2017-06-20 11:15:00,008] INFO Property log.retention.hours is overridden
to 168 (kafka.utils.VerifiableProperties)
[2017-06-20 11:15:00,008] INFO Property log.segment.bytes is overridden to
536870912 (kafka.utils.VerifiableProperties)
[2017-06-20 11:15:00,008] INFO Property num.io.threads is overridden to 8
(kafka.utils.VerifiableProperties)
[2017-06-20 11:15:00,008] INFO Property num.network.threads is overridden
to 2 (kafka.utils.VerifiableProperties)
[2017-06-20 11:15:00,009] INFO Property num.partitions is overridden to 2
(kafka.utils.VerifiableProperties)
[2017-06-20 11:15:00,009] INFO Property port is overridden to 9092
(kafka.utils.VerifiableProperties)
[2017-06-20 11:15:00,009] INFO Property socket.receive.buffer.bytes is
overridden to 1048576 (kafka.utils.VerifiableProperties)
[2017-06-20 11:15:00,009] INFO Property socket.request.max.bytes is
overridden to 104857600 (kafka.utils.VerifiableProperties)
[2017-06-20 11:15:00,009] INFO Property socket.send.buffer.bytes is
overridden to 1048576 (kafka.utils.VerifiableProperties)
[2017-06-20 11:15:00,012] WARN Property version is not valid (kafka.utils.
VerifiableProperties)
[2017-06-20 11:15:00,012] INFO Property zookeeper.connect is overridden to
zookeeper:2181 (kafka.utils.VerifiableProperties)
[2017-06-20 11:15:00,012] INFO Property zookeeper.connection.timeout.ms is
overridden to 1000000 (kafka.utils.VerifiableProperties)
[2017-06-20 11:15:00,036] INFO [Kafka Server 1], starting
(kafka.server.KafkaServer)
[2017-06-20 11:15:00,038] INFO [Kafka Server 1], Connecting to zookeeper on
zookeeper:2181 (kafka.server.KafkaServer)
[2017-06-20 11:15:00,068] INFO Starting ZkClient event thread.
(org.I0Itec.zkclient.ZkEventThread)
[2017-06-20 11:15:00,092] INFO Client
environment:zookeeper.version=3.3.3-1203054,
built on 11/17/2011 05:47 GMT (org.apache.zookeeper.ZooKeeper)
[2017-06-20 11:15:00,092] INFO Client environment:host.name=41eef7f94bfd
(org.apache.zookeeper.ZooKeeper)
[2017-06-20 11:15:00,092] INFO Client environment:java.version=1.8.0_131
(org.apache.zookeeper.ZooKeeper)
[2017-06-20 11:15:00,092] INFO Client environment:java.vendor=Oracle
Corporation (org.apache.zookeeper.ZooKeeper)
[2017-06-20 11:15:00,092] INFO Client
environment:java.home=/opt/jdk1.8.0_131/jre
(org.apache.zookeeper.ZooKeeper)
[2017-06-20 11:15:00,092] INFO Client environment:java.class.path=:/
opt/kafka_2.9.2-0.8.1.1/bin/../core/build/dependant-libs-2.
9.2/*.jar:/opt/kafka_2.9.2-0.8.1.1/bin/../perf/build/libs//
kafka-perf_2.9.2*.jar:/opt/kafka_2.9.2-0.8.1.1/bin/../
clients/build/libs//kafka-clients*.jar:/opt/kafka_2.9.2-
0.8.1.1/bin/../examples/build/libs//kafka-examples*.jar:/
opt/kafka_2.9.2-0.8.1.1/bin/../contrib/hadoop-consumer/
build/libs//kafka-hadoop-consumer*.jar:/opt/kafka_2.9.
2-0.8.1.1/bin/../contrib/hadoop-producer/build/libs//
kafka-hadoop-producer*.jar:/opt/kafka_2.9.2-0.8.1.1/bin/..
/libs/jopt-simple-3.2.jar:/opt/kafka_2.9.2-0.8.1.1/bin/..
/libs/kafka_2.9.2-0.8.1.1-javadoc.jar:/opt/kafka_2.9.2-
0.8.1.1/bin/../libs/kafka_2.9.2-0.8.1.1-scaladoc.jar:/opt/
kafka_2.9.2-0.8.1.1/bin/../libs/kafka_2.9.2-0.8.1.1-
sources.jar:/opt/kafka_2.9.2-0.8.1.1/bin/../libs/kafka_2.9.
2-0.8.1.1.jar:/opt/kafka_2.9.2-0.8.1.1/bin/../libs/log4j-1.
2.15.jar:/opt/kafka_2.9.2-0.8.1.1/bin/../libs/metrics-core-
2.2.0.jar:/opt/kafka_2.9.2-0.8.1.1/bin/../libs/scala-
library-2.9.2.jar:/opt/kafka_2.9.2-0.8.1.1/bin/../libs/
slf4j-api-1.7.2.jar:/opt/kafka_2.9.2-0.8.1.1/bin/../
libs/snappy-java-1.0.5.jar:/opt/kafka_2.9.2-0.8.1.1/bin/..
/libs/zkclient-0.3.jar:/opt/kafka_2.9.2-0.8.1.1/bin/../
libs/zookeeper-3.3.4.jar:/opt/kafka_2.9.2-0.8.1.1/bin/../
core/build/libs/kafka_2.9.2*.jar (org.apache.zookeeper.ZooKeeper)
[2017-06-20 11:15:00,092] INFO Client environment:java.library.path=
/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
(org.apache.zookeeper.ZooKeeper)
[2017-06-20 11:15:00,093] INFO Client environment:java.io.tmpdir=/tmp
(org.apache.zookeeper.ZooKeeper)
[2017-06-20 11:15:00,093] INFO Client environment:java.compiler=<NA>
(org.apache.zookeeper.ZooKeeper)
[2017-06-20 11:15:00,093] INFO Client environment:os.name=Linux
(org.apache.zookeeper.ZooKeeper)
[2017-06-20 11:15:00,093] INFO Client environment:os.arch=amd64
(org.apache.zookeeper.ZooKeeper)
[2017-06-20 11:15:00,093] INFO Client environment:os.version=3.13.0-119-generic
(org.apache.zookeeper.ZooKeeper)
[2017-06-20 11:15:00,093] INFO Client environment:user.name=root
(org.apache.zookeeper.ZooKeeper)
[2017-06-20 11:15:00,093] INFO Client environment:user.home=/root
(org.apache.zookeeper.ZooKeeper)
[2017-06-20 11:15:00,093] INFO Client environment:user.dir=/
(org.apache.zookeeper.ZooKeeper)
[2017-06-20 11:15:00,094] INFO Initiating client connection,
connectString=zookeeper:2181 sessionTimeout=6000
watcher=org.I0Itec.zkclient.ZkClient@71623278 (org.apache.zookeeper.
ZooKeeper)
[2017-06-20 11:15:00,147] INFO Opening socket connection to server
zookeeper/172.18.0.3:2181 (org.apache.zookeeper.ClientCnxn)
[2017-06-20 11:15:00,151] WARN Session 0x0 for server null, unexpected
error, closing socket connection and attempting reconnect
(org.apache.zookeeper.ClientCnxn)
java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1146)
[2017-06-20 11:15:02,167] INFO Opening socket connection to server
zookeeper/172.18.0.3:2181 (org.apache.zookeeper.ClientCnxn)
[2017-06-20 11:15:02,168] INFO Socket connection established to zookeeper/
172.18.0.3:2181, initiating session (org.apache.zookeeper.ClientCnxn)
[2017-06-20 11:15:03,619] INFO Session establishment complete on server
zookeeper/172.18.0.3:2181, sessionid = 0x15cc5367a6f0000, negotiated
timeout = 6000 (org.apache.zookeeper.ClientCnxn)
[2017-06-20 11:15:03,620] INFO zookeeper state changed (SyncConnected)
(org.I0Itec.zkclient.ZkClient)
[2017-06-20 11:15:04,195] INFO Found clean shutdown file. Skipping recovery
for all logs in data directory '/kafka/kafka-logs' (kafka.log.LogManager)
[2017-06-20 11:15:04,197] INFO Loading log 'APPC-TEST2-0'
(kafka.log.LogManager)
[2017-06-20 11:15:04,341] FATAL Fatal error during KafkaServerStable
startup. Prepare to shutdown (kafka.server.KafkaServerStartable)
java.io.IOException: Invalid argument
at sun.nio.ch.FileChannelImpl.map0(Native Method)
at sun.nio.ch.FileChannelImpl.map(FileChannelImpl.java:926)
at kafka.log.OffsetIndex$$anonfun$resize$1.apply(OffsetIndex.scala:286)
at kafka.log.OffsetIndex$$anonfun$resize$1.apply(OffsetIndex.scala:276)
at kafka.utils.Utils$.inLock(Utils.scala:538)
at kafka.log.OffsetIndex.resize(OffsetIndex.scala:276)
/Pardhu
On 21-Jun-2017 7:38 pm, "ROSE, DANIEL V" <[email protected]> wrote:
> I would delete and restart the container or rebuild if you are using your
> own build, looks like it did not finish downloading or was a bad image
>
>
>
> Daniel Rose
>
> ECOMP / ONAP
>
> com.att.ecomp
>
> 732-420-7308 <(732)%20420-7308>
>
>
>
> *From:* [email protected] [mailto:onap-discuss-bounces@
> lists.onap.org] *On Behalf Of *parthiva krishna
> *Sent:* Wednesday, June 21, 2017 6:03 AM
> *To:* [email protected]
> *Subject:* [onap-discuss] message_router is failing with kafka error
>
>
>
> Hi
>
>
>
> When I am configuring the message_router only 2 containers are up and the
> kafka container is exited. I manually tried starting kafka by running
> start_kafka.sh. Getting below error. Can you please help in resolving this
> issue.
>
>
>
> --------------------------------
>
> [2017-06-21 09:51:11,601] INFO Client environment:java.library.path=
> /usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
> (org.apache.zookeeper.ZooKeeper)
>
> [2017-06-21 09:51:11,601] INFO Client environment:java.io.tmpdir=/tmp
> (org.apache.zookeeper.ZooKeeper)
>
> [2017-06-21 09:51:11,601] INFO Client environment:java.compiler=<NA>
> (org.apache.zookeeper.ZooKeeper)
>
> [2017-06-21 09:51:11,602] INFO Client environment:os.name
> <https://urldefense.proofpoint.com/v2/url?u=http-3A__os.name&d=DwMFaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=2wwdGZ3YcpSivQ2Kio028A&m=P-F7TepGcbCBlBX3eeaHcNwZ8-CiKk2q4LmSl8xFWjE&s=JvOZjYHWTi_wYT7Qq50dIE7Av_16nM9124EXwc6CamU&e=>=Linux
> (org.apache.zookeeper.ZooKeeper)
>
> [2017-06-21 09:51:11,602] INFO Client environment:os.arch=amd64
> (org.apache.zookeeper.ZooKeeper)
>
> [2017-06-21 09:51:11,602] INFO Client
> environment:os.version=3.13.0-119-generic
> (org.apache.zookeeper.ZooKeeper)
>
> [2017-06-21 09:51:11,602] INFO Client environment:user.name
> <https://urldefense.proofpoint.com/v2/url?u=http-3A__user.name&d=DwMFaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=2wwdGZ3YcpSivQ2Kio028A&m=P-F7TepGcbCBlBX3eeaHcNwZ8-CiKk2q4LmSl8xFWjE&s=LEgOHXdAHm3ULLULC4nnfv0_FuefmuCQnFBbp3kv-QU&e=>=root
> (org.apache.zookeeper.ZooKeeper)
>
> [2017-06-21 09:51:11,602] INFO Client environment:user.home=/root
> (org.apache.zookeeper.ZooKeeper)
>
> [2017-06-21 09:51:11,602] INFO Client environment:user.dir=/
> (org.apache.zookeeper.ZooKeeper)
>
> [2017-06-21 09:51:11,603] INFO Initiating client connection,
> connectString=zookeeper:2181 sessionTimeout=6000
> watcher=org.I0Itec.zkclient.ZkClient@71623278 (org.apache.zookeeper.
> ZooKeeper)
>
> [2017-06-21 09:51:11,615] INFO Opening socket connection to server
> zookeeper/172.18.0.3:2181
> <https://urldefense.proofpoint.com/v2/url?u=http-3A__172.18.0.3-3A2181&d=DwMFaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=2wwdGZ3YcpSivQ2Kio028A&m=P-F7TepGcbCBlBX3eeaHcNwZ8-CiKk2q4LmSl8xFWjE&s=tkiDO7eDaRi7Ir9gHHaRHMlCaIk5n5thhKARlwWxr-k&e=>
> (org.apache.zookeeper.ClientCnxn)
>
> [2017-06-21 09:51:11,621] INFO Socket connection established to zookeeper/
> 172.18.0.3:2181
> <https://urldefense.proofpoint.com/v2/url?u=http-3A__172.18.0.3-3A2181&d=DwMFaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=2wwdGZ3YcpSivQ2Kio028A&m=P-F7TepGcbCBlBX3eeaHcNwZ8-CiKk2q4LmSl8xFWjE&s=tkiDO7eDaRi7Ir9gHHaRHMlCaIk5n5thhKARlwWxr-k&e=>,
> initiating session (org.apache.zookeeper.ClientCnxn)
>
> [2017-06-21 09:51:11,715] INFO Session establishment complete on server
> zookeeper/172.18.0.3:2181
> <https://urldefense.proofpoint.com/v2/url?u=http-3A__172.18.0.3-3A2181&d=DwMFaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=2wwdGZ3YcpSivQ2Kio028A&m=P-F7TepGcbCBlBX3eeaHcNwZ8-CiKk2q4LmSl8xFWjE&s=tkiDO7eDaRi7Ir9gHHaRHMlCaIk5n5thhKARlwWxr-k&e=>,
> sessionid = 0x15cc9fe65e50009, negotiated timeout = 6000
> (org.apache.zookeeper.ClientCnxn)
>
> [2017-06-21 09:51:11,718] INFO zookeeper state changed (SyncConnected)
> (org.I0Itec.zkclient.ZkClient)
>
> [2017-06-21 09:51:12,147] INFO Found clean shutdown file. Skipping
> recovery for all logs in data directory '/kafka/kafka-logs'
> (kafka.log.LogManager)
>
> [2017-06-21 09:51:12,150] INFO Loading log 'APPC-TEST2-0'
> (kafka.log.LogManager)
>
> [2017-06-21 09:51:12,225] FATAL Fatal error during KafkaServerStable
> startup. Prepare to shutdown (kafka.server.KafkaServerStartable)
>
> java.io.IOException: Invalid argument
>
> at sun.nio.ch.FileChannelImpl.map0(Native Method)
>
> at sun.nio.ch.FileChannelImpl.map(FileChannelImpl.java:926)
>
> at kafka.log.OffsetIndex.liftedTree1$1(OffsetIndex.scala:74)
>
> at kafka.log.OffsetIndex.<init>(OffsetIndex.scala:64)
>
> at kafka.log.LogSegment.<init>(LogSegment.scala:53)
>
> at kafka.log.Log$$anonfun$loadSegments$4.apply(Log.scala:134)
>
> at kafka.log.Log$$anonfun$loadSegments$4.apply(Log.scala:121)
>
> at scala.collection.TraversableLike$WithFilter$$
> anonfun$foreach$1.apply(TraversableLike.scala:743)
>
> at scala.collection.IndexedSeqOptimized$class.
> foreach(IndexedSeqOptimized.scala:34)
>
> at scala.collection.mutable.ArrayOps.foreach(ArrayOps.
> scala:38)
>
> at scala.collection.TraversableLike$WithFilter.
> foreach(TraversableLike.scala:742)
>
> at kafka.log.Log.loadSegments(Log.scala:121)
>
> at kafka.log.Log.<init>(Log.scala:64)
>
> at kafka.log.LogManager$$anonfun$loadLogs$1$$anonfun$apply$4.
> apply(LogManager.scala:118)
>
> at kafka.log.LogManager$$anonfun$loadLogs$1$$anonfun$apply$4.
> apply(LogManager.scala:113)
>
> at scala.collection.IndexedSeqOptimized$class.
> foreach(IndexedSeqOptimized.scala:34)
>
> at scala.collection.mutable.ArrayOps.foreach(ArrayOps.
> scala:38)
>
> at kafka.log.LogManager$$anonfun$loadLogs$1.apply(LogManager.
> scala:113)
>
> at kafka.log.LogManager$$anonfun$loadLogs$1.apply(LogManager.
> scala:105)
>
> at scala.collection.IndexedSeqOptimized$class.
> foreach(IndexedSeqOptimized.scala:34)
>
> at scala.collection.mutable.WrappedArray.foreach(
> WrappedArray.scala:33)
>
> at kafka.log.LogManager.loadLogs(LogManager.scala:105)
>
> at kafka.log.LogManager.<init>(LogManager.scala:57)
>
> at kafka.server.KafkaServer.createLogManager(KafkaServer.
> scala:275)
>
> at kafka.server.KafkaServer.startup(KafkaServer.scala:72)
>
> at kafka.server.KafkaServerStartable.startup(
> KafkaServerStartable.scala:34)
>
> at kafka.Kafka$.main(Kafka.scala:46)
>
> at kafka.Kafka.main(Kafka.scala)
>
> [2017-06-21 09:51:12,237] INFO [Kafka Server 1], shutting down
> (kafka.server.KafkaServer)
>
> [2017-06-21 09:51:12,239] INFO Terminate ZkClient event thread.
> (org.I0Itec.zkclient.ZkEventThread)
>
> [2017-06-21 09:51:12,242] INFO EventThread shut down (org.apache.zookeeper.
> ClientCnxn)
>
> [2017-06-21 09:51:12,242] INFO Session: 0x15cc9fe65e50009 closed
> (org.apache.zookeeper.ZooKeeper)
>
> [2017-06-21 09:51:12,243] INFO [Kafka Server 1], shut down completed
> (kafka.server.KafkaServer)
>
> [2017-06-21 09:51:12,244] INFO [Kafka Server 1], shutting down
> (kafka.server.KafkaServer)
>
> ------------------------------------------------------------
> --------------------
>
>
>
>
>
> --
>
> */Pardhu*
>
_______________________________________________
onap-discuss mailing list
[email protected]
https://lists.onap.org/mailman/listinfo/onap-discuss
