[jira] [Resolved] (MESOS-1726) docker containerizer fails when container exits quickly
[ https://issues.apache.org/jira/browse/MESOS-1726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Buffington resolved MESOS-1726. --- Resolution: Invalid docker containerizer fails when container exits quickly --- Key: MESOS-1726 URL: https://issues.apache.org/jira/browse/MESOS-1726 Project: Mesos Issue Type: Bug Components: containerization Reporter: Jay Buffington Assignee: Timothy Chen Labels: docker There is a race condition in the docker containerizer code that can usually be reproduced by running a command that exits quickly (for example, true) inside of a docker container. You will see the error Unable to get executor pid after launch” in the logs and the master will get a {{TASK_LOST}}. This race is between docker inspect” and the process running inside the container. When the processes inside the container exits (successful or not) before docker inspect runs docker inspect will return a Pid of 0. When the pid is zero the {{Docker::Container::create}} method will set the pid to an empty {{Optionpid_t}}. This will cause the {{launch}} method to return a {{Failure()}}. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Created] (MESOS-1728) Libprocess: report bind parameters on failure
Nikita Vetoshkin created MESOS-1728: --- Summary: Libprocess: report bind parameters on failure Key: MESOS-1728 URL: https://issues.apache.org/jira/browse/MESOS-1728 Project: Mesos Issue Type: Improvement Components: libprocess Reporter: Nikita Vetoshkin Assignee: Nikita Vetoshkin Priority: Trivial When you attempt to start slave or master and there's another one already running there, it is nice to report what are the actual parameters to {{bind}} call that failed. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Created] (MESOS-1729) LogZooKeeperTest.WriteRead fails on OSX
Till Toenshoff created MESOS-1729: - Summary: LogZooKeeperTest.WriteRead fails on OSX Key: MESOS-1729 URL: https://issues.apache.org/jira/browse/MESOS-1729 Project: Mesos Issue Type: Bug Components: build, test Affects Versions: 0.21.0 Environment: OSX 10.9.4, clang 3.4 Reporter: Till Toenshoff The following is reported and 100% reproducible when running {{make check}} on my OSX box. {noformat} [ RUN ] LogZooKeeperTest.WriteRead W0821 12:36:35.715975 1914815248 glog.hpp:52] RAW: Received signal SIGPIPE; escalating to SIGABRT *** Aborted at 1408617395 (unix time) try date -d @1408617395 if you are using GNU date *** PC: @ 0x7fff8523b292 __kill *** SIGABRT (@0x7fff8523b292) received by PID 90142 (TID 0x7fff7221c310) stack trace: *** @ 0x7fff8a2905aa _sigtramp @ 0x7fff7276f338 usual @0x10e35737d os::Bsd::chained_handler() @0x10e35b166 JVM_handle_bsd_signal @ 0x7fff8a2905aa _sigtramp @0x0 (unknown) @0x10bbec97b process::ProcessManager::wait() @0x10bbee96b process::wait() @0x10baf062a mesos::internal::log::Log::~Log() @0x10a63857a LogZooKeeperTest_WriteRead_Test::TestBody() @0x10a9bff8c testing::internal::HandleExceptionsInMethodIfSupported() @0x10a9ab90a testing::Test::Run() @0x10a9ac592 testing::TestInfo::Run() @0x10a9acbd0 testing::TestCase::Run() @0x10a9b2425 testing::internal::UnitTestImpl::RunAllTests() @0x10a9c0754 testing::internal::HandleExceptionsInMethodIfSupported() @0x10a9b2159 testing::UnitTest::Run() @0x10a66ea33 main @ 0x7fff8c1c65fd start @0x1 (unknown) make[3]: *** [check-local] Abort trap: 6 make[2]: *** [check-am] Error 2 make[1]: *** [check] Error 2 make: *** [check-recursive] Error 1 {noformat} -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (MESOS-1729) LogZooKeeperTest.WriteRead fails on OSX
[ https://issues.apache.org/jira/browse/MESOS-1729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105918#comment-14105918 ] Jie Yu commented on MESOS-1729: --- I saw that as well. That's after we turned on the glog signal handler for our tests. It appears that we receive a SIGPIPE when we try to shutdown the zk test server. This happens for other zk tests as well. Only happens on Mac. LogZooKeeperTest.WriteRead fails on OSX --- Key: MESOS-1729 URL: https://issues.apache.org/jira/browse/MESOS-1729 Project: Mesos Issue Type: Bug Components: build, test Affects Versions: 0.21.0 Environment: OSX 10.9.4, clang 3.4 Reporter: Till Toenshoff Labels: test The following is reported and 100% reproducible when running {{make check}} on my OSX box. {noformat} [ RUN ] LogZooKeeperTest.WriteRead W0821 12:36:35.715975 1914815248 glog.hpp:52] RAW: Received signal SIGPIPE; escalating to SIGABRT *** Aborted at 1408617395 (unix time) try date -d @1408617395 if you are using GNU date *** PC: @ 0x7fff8523b292 __kill *** SIGABRT (@0x7fff8523b292) received by PID 90142 (TID 0x7fff7221c310) stack trace: *** @ 0x7fff8a2905aa _sigtramp @ 0x7fff7276f338 usual @0x10e35737d os::Bsd::chained_handler() @0x10e35b166 JVM_handle_bsd_signal @ 0x7fff8a2905aa _sigtramp @0x0 (unknown) @0x10bbec97b process::ProcessManager::wait() @0x10bbee96b process::wait() @0x10baf062a mesos::internal::log::Log::~Log() @0x10a63857a LogZooKeeperTest_WriteRead_Test::TestBody() @0x10a9bff8c testing::internal::HandleExceptionsInMethodIfSupported() @0x10a9ab90a testing::Test::Run() @0x10a9ac592 testing::TestInfo::Run() @0x10a9acbd0 testing::TestCase::Run() @0x10a9b2425 testing::internal::UnitTestImpl::RunAllTests() @0x10a9c0754 testing::internal::HandleExceptionsInMethodIfSupported() @0x10a9b2159 testing::UnitTest::Run() @0x10a66ea33 main @ 0x7fff8c1c65fd start @0x1 (unknown) make[3]: *** [check-local] Abort trap: 6 make[2]: *** [check-am] Error 2 make[1]: *** [check] Error 2 make: *** [check-recursive] Error 1 {noformat} -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (MESOS-1729) LogZooKeeperTest.WriteRead fails on OSX
[ https://issues.apache.org/jira/browse/MESOS-1729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105987#comment-14105987 ] Till Toenshoff commented on MESOS-1729: --- I am wildly guessing here, without proper testing... Could we possibly have hit an upstream issue in Zookeeper due to their usage of MSG_NOSIGNAL, which isn't functional on OSX (see [this lesson learned|https://issues.apache.org/jira/browse/MESOS-912?focusedCommentId=13899069page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13899069] in our libprocess past)? LogZooKeeperTest.WriteRead fails on OSX --- Key: MESOS-1729 URL: https://issues.apache.org/jira/browse/MESOS-1729 Project: Mesos Issue Type: Bug Components: build, test Affects Versions: 0.21.0 Environment: OSX 10.9.4, clang 3.4 Reporter: Till Toenshoff Labels: test The following is reported and 100% reproducible when running {{make check}} on my OSX box. {noformat} [ RUN ] LogZooKeeperTest.WriteRead I0821 21:18:34.960811 2078368528 jvm.cpp:572] Looking up method init(Ljava/lang/String;)V I0821 21:18:34.960934 2078368528 jvm.cpp:572] Looking up method deleteOnExit()V I0821 21:18:34.961335 2078368528 jvm.cpp:572] Looking up method init(Ljava/io/File;Ljava/io/File;)V log4j:WARN No appenders could be found for logger (org.apache.zookeeper.server.persistence.FileTxnSnapLog). log4j:WARN Please initialize the log4j system properly. I0821 21:18:35.004449 2078368528 jvm.cpp:572] Looking up method init()V I0821 21:18:35.005053 2078368528 jvm.cpp:572] Looking up method init(Lorg/apache/zookeeper/server/persistence/FileTxnSnapLog;Lorg/apache/zookeeper/server/ZooKeeperServer$DataTreeBuilder;)V I0821 21:18:35.025753 2078368528 jvm.cpp:572] Looking up method init()V I0821 21:18:35.032670 2078368528 jvm.cpp:572] Looking up method init(I)V I0821 21:18:35.032873 2078368528 jvm.cpp:572] Looking up method configure(Ljava/net/InetSocketAddress;I)V I0821 21:18:35.038020 2078368528 jvm.cpp:572] Looking up method startup(Lorg/apache/zookeeper/server/ZooKeeperServer;)V I0821 21:18:35.093870 2078368528 jvm.cpp:572] Looking up method getClientPort()I I0821 21:18:35.093925 2078368528 zookeeper_test_server.cpp:158] Started ZooKeeperTestServer on port 52772 I0821 21:18:35.094081 2078368528 log_tests.cpp:1945] Using temporary directory '/tmp/LogZooKeeperTest_WriteRead_F8UzYv' I0821 21:18:35.095954 2078368528 leveldb.cpp:176] Opened db in 1815us I0821 21:18:35.096392 2078368528 leveldb.cpp:183] Compacted db in 428us I0821 21:18:35.096420 2078368528 leveldb.cpp:198] Created db iterator in 7us I0821 21:18:35.096432 2078368528 leveldb.cpp:204] Seeked to beginning of db in 8us I0821 21:18:35.096442 2078368528 leveldb.cpp:273] Iterated through 0 keys in the db in 8us I0821 21:18:35.096462 2078368528 replica.cpp:741] Replica recovered with log positions 0 - 0 with 1 holes and 0 unlearned I0821 21:18:35.097043 107220992 leveldb.cpp:306] Persisting metadata (8 bytes) to leveldb took 184us I0821 21:18:35.097075 107220992 replica.cpp:320] Persisted replica status to VOTING I0821 21:18:35.099768 2078368528 leveldb.cpp:176] Opened db in 1673us I0821 21:18:35.100049 2078368528 leveldb.cpp:183] Compacted db in 270us I0821 21:18:35.100070 2078368528 leveldb.cpp:198] Created db iterator in 6us I0821 21:18:35.100080 2078368528 leveldb.cpp:204] Seeked to beginning of db in 5us I0821 21:18:35.100088 2078368528 leveldb.cpp:273] Iterated through 0 keys in the db in 5us I0821 21:18:35.100097 2078368528 replica.cpp:741] Replica recovered with log positions 0 - 0 with 1 holes and 0 unlearned I0821 21:18:35.100411 108294144 leveldb.cpp:306] Persisting metadata (8 bytes) to leveldb took 159us I0821 21:18:35.100435 108294144 replica.cpp:320] Persisted replica status to VOTING I0821 21:18:35.101984 2078368528 leveldb.cpp:176] Opened db in 1224us I0821 21:18:35.102934 2078368528 leveldb.cpp:183] Compacted db in 942us I0821 21:18:35.102958 2078368528 leveldb.cpp:198] Created db iterator in 8us I0821 21:18:35.102972 2078368528 leveldb.cpp:204] Seeked to beginning of db in 8us I0821 21:18:35.102984 2078368528 leveldb.cpp:273] Iterated through 1 keys in the db in 9us I0821 21:18:35.102994 2078368528 replica.cpp:741] Replica recovered with log positions 0 - 0 with 1 holes and 0 unlearned 2014-08-21 21:18:35,103:6420(0x106641000):ZOO_INFO@log_env@712: Client environment:zookeeper.version=zookeeper C client 3.4.5 2014-08-21 21:18:35,103:6420(0x106641000):ZOO_INFO@log_env@716: Client environment:host.name=lobomacpro2.fritz.box 2014-08-21 21:18:35,103:6420(0x106641000):ZOO_INFO@log_env@723: Client environment:os.name=Darwin 2014-08-21 21:18:35,103:6420(0x106641000):ZOO_INFO@log_env@724: Client
[jira] [Commented] (MESOS-1729) LogZooKeeperTest.WriteRead fails on OSX
[ https://issues.apache.org/jira/browse/MESOS-1729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105992#comment-14105992 ] Jie Yu commented on MESOS-1729: --- [~tillt] Very likely! LogZooKeeperTest.WriteRead fails on OSX --- Key: MESOS-1729 URL: https://issues.apache.org/jira/browse/MESOS-1729 Project: Mesos Issue Type: Bug Components: build, test Affects Versions: 0.21.0 Environment: OSX 10.9.4, clang 3.4 Reporter: Till Toenshoff Labels: test The following is reported and 100% reproducible when running {{make check}} on my OSX box. {noformat} [ RUN ] LogZooKeeperTest.WriteRead I0821 21:18:34.960811 2078368528 jvm.cpp:572] Looking up method init(Ljava/lang/String;)V I0821 21:18:34.960934 2078368528 jvm.cpp:572] Looking up method deleteOnExit()V I0821 21:18:34.961335 2078368528 jvm.cpp:572] Looking up method init(Ljava/io/File;Ljava/io/File;)V log4j:WARN No appenders could be found for logger (org.apache.zookeeper.server.persistence.FileTxnSnapLog). log4j:WARN Please initialize the log4j system properly. I0821 21:18:35.004449 2078368528 jvm.cpp:572] Looking up method init()V I0821 21:18:35.005053 2078368528 jvm.cpp:572] Looking up method init(Lorg/apache/zookeeper/server/persistence/FileTxnSnapLog;Lorg/apache/zookeeper/server/ZooKeeperServer$DataTreeBuilder;)V I0821 21:18:35.025753 2078368528 jvm.cpp:572] Looking up method init()V I0821 21:18:35.032670 2078368528 jvm.cpp:572] Looking up method init(I)V I0821 21:18:35.032873 2078368528 jvm.cpp:572] Looking up method configure(Ljava/net/InetSocketAddress;I)V I0821 21:18:35.038020 2078368528 jvm.cpp:572] Looking up method startup(Lorg/apache/zookeeper/server/ZooKeeperServer;)V I0821 21:18:35.093870 2078368528 jvm.cpp:572] Looking up method getClientPort()I I0821 21:18:35.093925 2078368528 zookeeper_test_server.cpp:158] Started ZooKeeperTestServer on port 52772 I0821 21:18:35.094081 2078368528 log_tests.cpp:1945] Using temporary directory '/tmp/LogZooKeeperTest_WriteRead_F8UzYv' I0821 21:18:35.095954 2078368528 leveldb.cpp:176] Opened db in 1815us I0821 21:18:35.096392 2078368528 leveldb.cpp:183] Compacted db in 428us I0821 21:18:35.096420 2078368528 leveldb.cpp:198] Created db iterator in 7us I0821 21:18:35.096432 2078368528 leveldb.cpp:204] Seeked to beginning of db in 8us I0821 21:18:35.096442 2078368528 leveldb.cpp:273] Iterated through 0 keys in the db in 8us I0821 21:18:35.096462 2078368528 replica.cpp:741] Replica recovered with log positions 0 - 0 with 1 holes and 0 unlearned I0821 21:18:35.097043 107220992 leveldb.cpp:306] Persisting metadata (8 bytes) to leveldb took 184us I0821 21:18:35.097075 107220992 replica.cpp:320] Persisted replica status to VOTING I0821 21:18:35.099768 2078368528 leveldb.cpp:176] Opened db in 1673us I0821 21:18:35.100049 2078368528 leveldb.cpp:183] Compacted db in 270us I0821 21:18:35.100070 2078368528 leveldb.cpp:198] Created db iterator in 6us I0821 21:18:35.100080 2078368528 leveldb.cpp:204] Seeked to beginning of db in 5us I0821 21:18:35.100088 2078368528 leveldb.cpp:273] Iterated through 0 keys in the db in 5us I0821 21:18:35.100097 2078368528 replica.cpp:741] Replica recovered with log positions 0 - 0 with 1 holes and 0 unlearned I0821 21:18:35.100411 108294144 leveldb.cpp:306] Persisting metadata (8 bytes) to leveldb took 159us I0821 21:18:35.100435 108294144 replica.cpp:320] Persisted replica status to VOTING I0821 21:18:35.101984 2078368528 leveldb.cpp:176] Opened db in 1224us I0821 21:18:35.102934 2078368528 leveldb.cpp:183] Compacted db in 942us I0821 21:18:35.102958 2078368528 leveldb.cpp:198] Created db iterator in 8us I0821 21:18:35.102972 2078368528 leveldb.cpp:204] Seeked to beginning of db in 8us I0821 21:18:35.102984 2078368528 leveldb.cpp:273] Iterated through 1 keys in the db in 9us I0821 21:18:35.102994 2078368528 replica.cpp:741] Replica recovered with log positions 0 - 0 with 1 holes and 0 unlearned 2014-08-21 21:18:35,103:6420(0x106641000):ZOO_INFO@log_env@712: Client environment:zookeeper.version=zookeeper C client 3.4.5 2014-08-21 21:18:35,103:6420(0x106641000):ZOO_INFO@log_env@716: Client environment:host.name=lobomacpro2.fritz.box 2014-08-21 21:18:35,103:6420(0x106641000):ZOO_INFO@log_env@723: Client environment:os.name=Darwin 2014-08-21 21:18:35,103:6420(0x106641000):ZOO_INFO@log_env@724: Client environment:os.arch=13.3.0 2014-08-21 21:18:35,103:6420(0x106641000):ZOO_INFO@log_env@725: Client environment:os.version=Darwin Kernel Version 13.3.0: Tue Jun 3 21:27:35 PDT 2014; root:xnu-2422.110.17~1/RELEASE_X86_64 2014-08-21 21:18:35,103:6420(0x106641000):ZOO_INFO@log_env@733: Client environment:user.name=till 2014-08-21
[jira] [Assigned] (MESOS-1661) socket errors should show IP address
[ https://issues.apache.org/jira/browse/MESOS-1661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ken Sipe reassigned MESOS-1661: --- Assignee: Ken Sipe socket errors should show IP address Key: MESOS-1661 URL: https://issues.apache.org/jira/browse/MESOS-1661 Project: Mesos Issue Type: Task Components: libprocess Reporter: David Robinson Assignee: Ken Sipe Priority: Minor Labels: newbie [Log messages that show socket errors|https://github.com/apache/mesos/blob/master/3rdparty/libprocess/src/process.cpp#L1035] (Connection refused, Broken pipe etc) should also show the remote IP address. It's difficult to troubleshoot why a connection is being refused when you don't know where it's trying to connect. {noformat:title=sample log snippet} I0801 23:15:57.315096 20305 log.cpp:656] Attempting to start the writer I0801 23:15:57.315913 20313 replica.cpp:474] Replica received implicit promise request with proposal 865 I0801 23:15:57.316473 20326 process.cpp:1096] Socket error while receiving: Connection refused I0801 23:15:57.316499 20326 process.cpp:1140] Socket error while sending: Broken pipe {noformat} -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (MESOS-1729) LogZooKeeperTest.WriteRead fails on OSX
[ https://issues.apache.org/jira/browse/MESOS-1729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14106351#comment-14106351 ] Jessica Hartog commented on MESOS-1729: --- I cannot reproduce this on OSX Version 10.9.4 $ clang --version Apple LLVM version 5.1 (clang-503.0.40) (based on LLVM 3.4svn) Target: x86_64-apple-darwin13.3.0 Thread model: posix Relevant output from `make check`: [--] 2 tests from LogZooKeeperTest [ RUN ] LogZooKeeperTest.WriteRead [ OK ] LogZooKeeperTest.WriteRead (259 ms) LogZooKeeperTest.WriteRead fails on OSX --- Key: MESOS-1729 URL: https://issues.apache.org/jira/browse/MESOS-1729 Project: Mesos Issue Type: Bug Components: build, test Affects Versions: 0.21.0 Environment: OSX 10.9.4, clang 3.4 Reporter: Till Toenshoff Labels: test The following is reported and 100% reproducible when running {{make check}} on my OSX box. {noformat} [ RUN ] LogZooKeeperTest.WriteRead I0821 21:18:34.960811 2078368528 jvm.cpp:572] Looking up method init(Ljava/lang/String;)V I0821 21:18:34.960934 2078368528 jvm.cpp:572] Looking up method deleteOnExit()V I0821 21:18:34.961335 2078368528 jvm.cpp:572] Looking up method init(Ljava/io/File;Ljava/io/File;)V log4j:WARN No appenders could be found for logger (org.apache.zookeeper.server.persistence.FileTxnSnapLog). log4j:WARN Please initialize the log4j system properly. I0821 21:18:35.004449 2078368528 jvm.cpp:572] Looking up method init()V I0821 21:18:35.005053 2078368528 jvm.cpp:572] Looking up method init(Lorg/apache/zookeeper/server/persistence/FileTxnSnapLog;Lorg/apache/zookeeper/server/ZooKeeperServer$DataTreeBuilder;)V I0821 21:18:35.025753 2078368528 jvm.cpp:572] Looking up method init()V I0821 21:18:35.032670 2078368528 jvm.cpp:572] Looking up method init(I)V I0821 21:18:35.032873 2078368528 jvm.cpp:572] Looking up method configure(Ljava/net/InetSocketAddress;I)V I0821 21:18:35.038020 2078368528 jvm.cpp:572] Looking up method startup(Lorg/apache/zookeeper/server/ZooKeeperServer;)V I0821 21:18:35.093870 2078368528 jvm.cpp:572] Looking up method getClientPort()I I0821 21:18:35.093925 2078368528 zookeeper_test_server.cpp:158] Started ZooKeeperTestServer on port 52772 I0821 21:18:35.094081 2078368528 log_tests.cpp:1945] Using temporary directory '/tmp/LogZooKeeperTest_WriteRead_F8UzYv' I0821 21:18:35.095954 2078368528 leveldb.cpp:176] Opened db in 1815us I0821 21:18:35.096392 2078368528 leveldb.cpp:183] Compacted db in 428us I0821 21:18:35.096420 2078368528 leveldb.cpp:198] Created db iterator in 7us I0821 21:18:35.096432 2078368528 leveldb.cpp:204] Seeked to beginning of db in 8us I0821 21:18:35.096442 2078368528 leveldb.cpp:273] Iterated through 0 keys in the db in 8us I0821 21:18:35.096462 2078368528 replica.cpp:741] Replica recovered with log positions 0 - 0 with 1 holes and 0 unlearned I0821 21:18:35.097043 107220992 leveldb.cpp:306] Persisting metadata (8 bytes) to leveldb took 184us I0821 21:18:35.097075 107220992 replica.cpp:320] Persisted replica status to VOTING I0821 21:18:35.099768 2078368528 leveldb.cpp:176] Opened db in 1673us I0821 21:18:35.100049 2078368528 leveldb.cpp:183] Compacted db in 270us I0821 21:18:35.100070 2078368528 leveldb.cpp:198] Created db iterator in 6us I0821 21:18:35.100080 2078368528 leveldb.cpp:204] Seeked to beginning of db in 5us I0821 21:18:35.100088 2078368528 leveldb.cpp:273] Iterated through 0 keys in the db in 5us I0821 21:18:35.100097 2078368528 replica.cpp:741] Replica recovered with log positions 0 - 0 with 1 holes and 0 unlearned I0821 21:18:35.100411 108294144 leveldb.cpp:306] Persisting metadata (8 bytes) to leveldb took 159us I0821 21:18:35.100435 108294144 replica.cpp:320] Persisted replica status to VOTING I0821 21:18:35.101984 2078368528 leveldb.cpp:176] Opened db in 1224us I0821 21:18:35.102934 2078368528 leveldb.cpp:183] Compacted db in 942us I0821 21:18:35.102958 2078368528 leveldb.cpp:198] Created db iterator in 8us I0821 21:18:35.102972 2078368528 leveldb.cpp:204] Seeked to beginning of db in 8us I0821 21:18:35.102984 2078368528 leveldb.cpp:273] Iterated through 1 keys in the db in 9us I0821 21:18:35.102994 2078368528 replica.cpp:741] Replica recovered with log positions 0 - 0 with 1 holes and 0 unlearned 2014-08-21 21:18:35,103:6420(0x106641000):ZOO_INFO@log_env@712: Client environment:zookeeper.version=zookeeper C client 3.4.5 2014-08-21 21:18:35,103:6420(0x106641000):ZOO_INFO@log_env@716: Client environment:host.name=lobomacpro2.fritz.box 2014-08-21 21:18:35,103:6420(0x106641000):ZOO_INFO@log_env@723: Client environment:os.name=Darwin 2014-08-21 21:18:35,103:6420(0x106641000):ZOO_INFO@log_env@724: Client environment:os.arch=13.3.0 2014-08-21