[ https://issues.apache.org/jira/browse/KUDU-1123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mike Percy resolved KUDU-1123. ------------------------------ Resolution: Fixed Fix Version/s: 1.5.0 Target Version/s: (was: 1.4.0) Fixed in https://github.com/apache/kudu/commit/e6758739a90adeb2e4d0c6cf76185cf90cc7d2b0 > MiniCluster should use GetBindIpForTabletServer() > ------------------------------------------------- > > Key: KUDU-1123 > URL: https://issues.apache.org/jira/browse/KUDU-1123 > Project: Kudu > Issue Type: Bug > Components: test, tserver > Affects Versions: Feature Complete > Reporter: Mike Percy > Assignee: Mike Percy > Priority: Minor > Fix For: 1.5.0 > > > MiniCluster can have a port conflict with ExternalMiniCluster because > MiniCluster doesn't currently use the GetBindIpForTabletServer() > functionality which is currently a part of ExternalMiniCluster. > One example of ts_recovery- itest having a port conflict with > create-table-stress-test: > {noformat} > I0908 14:40:41.945065 5400 tablet_server_main.cc:37] Initializing tablet > server... > I0908 14:40:41.978004 5400 fs_manager.cc:224] Opened local filesystem: > /data1/test-tmp/ts_recovery-itest.TsRecoveryITest.TestCrashDuringLogReplay.1441748428064234-3293/minicluster-data/ts-0 > uuid: "eb0e3a789538467096cb3ce488b930aa" > format_stamp: "Formatted at 2015-09-08 21:40:38 on > boost-static-burst-slave-1d1d.vpc.cloudera.com" > W0908 14:40:42.046265 5400 net_util.cc:239] Failed to bind to > 127.12.221.0:42699. Trying to use lsof to find any processes listening on the > same port: > I0908 14:40:42.046599 5400 net_util.cc:242] $ export PATH=$PATH:/usr/sbin ; > lsof -n -i 'TCP:42699' -sTCP:LISTEN ; for pid in $(lsof -F p -n -i > 'TCP:42699' -sTCP:LISTEN | cut -f 2 -dp) ; do while [ $pid -gt 1 ] ; do > ps h -fp $pid ; stat=($(</proc/$pid/stat)) ; pid=${stat[3]} ; done ; > done > W0908 14:40:42.969758 5400 net_util.cc:283] COMMAND PID USER FD > TYPE DEVICE SIZE/OFF NODE NAME > create-ta 4902 jenkins 50u IPv4 133884 0t0 TCP *:42699 (LISTEN) > jenkins 4902 4853 73 14:40 ? Rl 0:02 > /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/ASAN/label/kudu-gerrit-slaves/build/fastdebug/create-table-stress-test > --test_timeout_after 900 > jenkins 4853 10062 0 14:40 ? S 0:00 /bin/bash > /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/ASAN/label/kudu-gerrit-slaves/build-support/run-test.sh > > /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/ASAN/label/kudu-gerrit-slaves/build/fastdebug//create-table-stress-test > jenkins 10062 3432 0 14:36 ? S 0:00 ctest -j8 > jenkins 3432 3233 0 14:12 ? S 0:00 /bin/bash > build-support/jenkins/build-and-test.sh > jenkins 3233 3119 0 14:09 ? S 0:00 /bin/bash > /tmp/hudson6781203206259695432.sh > jenkins 3119 3106 0 14:09 ? Sl 0:12 > /var/lib/jenkins/jdk/bin/java -Xmx1g -Xms256m -XX:MaxPermSize=512m -jar > slave.jar > jenkins 3106 2999 0 14:09 ? Ss 0:00 bash -c cd > "/var/lib/jenkins" && /var/lib/jenkins/jdk/bin/java -Xmx1g -Xms256m > -XX:MaxPermSize=512m -jar slave.jar > jenkins 2999 2997 0 14:08 ? S 0:09 sshd: jenkins@notty > root 2997 1943 0 14:08 ? Ss 0:00 sshd: jenkins [priv] > root 1943 1 0 14:07 ? Ss 0:00 /usr/sbin/sshd > F0908 14:40:42.970139 5400 tablet_server_main.cc:38] Check failed: _s.ok() > Bad status: Network error: error binding socket to 127.12.221.0:42699: > Address already in use (error 98) > *** Check failure stack trace: *** > @ 0x7f12a04dabcd google::LogMessage::Fail() at ??:0 > @ 0x7f12a04df0ad google::LogMessage::SendToLog() at ??:0 > @ 0x7f12a04dcf1b google::LogMessage::Flush() at ??:0 > @ 0x7f12a04dd241 google::LogMessageFatal::~LogMessageFatal() at ??:0 > @ 0x4e2447 kudu::tserver::TabletServerMain() at > /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/ASAN/label/kudu-gerrit-slaves/src/kudu/integration-tests/ts_recovery-itest.cc:0 > @ 0x4e1ca5 main at > /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/ASAN/label/kudu-gerrit-slaves/src/kudu/integration-tests/ts_recovery-itest.cc:0 > @ 0x7f129ea64cdd __libc_start_main at ??:0 > @ 0x41e319 (unknown) at ??:0 > /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/ASAN/label/kudu-gerrit-slaves/src/kudu/integration-tests/ts_recovery-itest.cc:117: > Failure > Failed > Bad status: Runtime error: Process exited with rc=6: > /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/ASAN/label/kudu-gerrit-slaves/build/fastdebug/kudu-tserver > I0908 14:40:42.997918 3293 external_mini_cluster.cc:614] Killing > /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/ASAN/label/kudu-gerrit-slaves/build/fastdebug/kudu-master > with pid 4625 > I0908 14:40:43.040345 3293 test_util.cc:56] > ----------------------------------------------- > I0908 14:40:43.040518 3293 test_util.cc:57] Had fatal failures, leaving test > files at /data1/test-tmp/ts_recovery- > itest.TsRecoveryITest.TestCrashDuringLogReplay.1441748428064234-3293 > [ FAILED ] TsRecoveryITest.TestCrashDuringLogReplay (7128 ms) > {noformat} -- This message was sent by Atlassian JIRA (v6.4.14#64029)