Will Berkeley created KUDU-2634:
-----------------------------------
Summary: token_signer-itest can get stuck when the cluster is
shutting down while the leader master generates a new TSK
Key: KUDU-2634
URL: https://issues.apache.org/jira/browse/KUDU-2634
Project: Kudu
Issue Type: Bug
Affects Versions: 1.8.0
Reporter: Will Berkeley
Attachments: token_signer-itest.log
I saw the following thing happen in token_signer-itest:
1. The test body finishes. The InternalMiniCluster is being shut down as part
of cleaning up the test.
2. The follower masters shut down.
3. The leader master starts shutting down (Master::Shutdown()). The catalog
manager is shutting down the background tasks
(CatalogManagerBgTasks::Shutdown(), and so is joining with the bg task thread.
4. The bg task thread is in the middle of CatalogManagerBgTasks::Run(), where,
because of the short TSK rotation times, it detects it needs to generate a new
TSK. It calls through to SysCatalogTable::SyncWrite to write the new TSK.
5. The other two masters are shut down, so SyncWrite blocks forever waiting for
the TSK write to replicate.
6. The test eventually times out because the itest thread is stuck in
CatalogManagerBgTasks::Shutdown() waiting for SysCatalogTable::SyncWrite().
Log of the failing test attached.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)