[
https://issues.apache.org/jira/browse/CASSANDRA-9953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Imri Zvik updated CASSANDRA-9953:
---------------------------------
Description:
We are seeing a lot of opened file descriptors to deleted snapshots (deleted
using nodetool clearsnapshot):
{code}
java 128657 cassandra DEL REG 253,2 569272514
/var/lib/cassandra/data/accounts/account_store_data/snapshots/feb5f790-316e-11e5-aec0-472b0d6e3fd4/accounts-account_store_data-jb-264593-Index.db
java 128657 cassandra DEL REG 253,2 1610616657
/var/lib/cassandra/data/accounts/account_store_counters/snapshots/03aa4710-316f-11e5-aec0-472b0d6e3fd4/accounts-account_store_counters-jb-635527-Index.db
java 128657 cassandra DEL REG 253,2 1610613856
/var/lib/cassandra/data/accounts/account_store_counters/snapshots/43c17170-316f-11e5-aec0-472b0d6e3fd4/accounts-account_store_counters-jb-635675-Index.db
java 128657 cassandra DEL REG 253,2 1610613052
/var/lib/cassandra/data/accounts/account_store_counters/snapshots/18e001a0-3170-11e5-aec0-472b0d6e3fd4/accounts-account_store_counters-jb-636200-Index.db
[root@cassandra002 ~]# lsof -np 128657 |grep -c DEL
56682
{code}
They are probably created by the routine repair process, but they are never
cleared (restarting the Cassandra process clears them, of course).
We are seeing these also after all repair processes finished, and no repair
process is running in the cluster.
There are no errors or fatals in the system.log.
We are using Datastax community edition 2.0.13, installed from RPMs.
was:
We are seeing a lot of opened file descriptors to deleted snapshots:
{code}
java 128657 cassandra DEL REG 253,2 569272514
/var/lib/cassandra/data/accounts/account_store_data/snapshots/feb5f790-316e-11e5-aec0-472b0d6e3fd4/accounts-account_store_data-jb-264593-Index.db
java 128657 cassandra DEL REG 253,2 1610616657
/var/lib/cassandra/data/accounts/account_store_counters/snapshots/03aa4710-316f-11e5-aec0-472b0d6e3fd4/accounts-account_store_counters-jb-635527-Index.db
java 128657 cassandra DEL REG 253,2 1610613856
/var/lib/cassandra/data/accounts/account_store_counters/snapshots/43c17170-316f-11e5-aec0-472b0d6e3fd4/accounts-account_store_counters-jb-635675-Index.db
java 128657 cassandra DEL REG 253,2 1610613052
/var/lib/cassandra/data/accounts/account_store_counters/snapshots/18e001a0-3170-11e5-aec0-472b0d6e3fd4/accounts-account_store_counters-jb-636200-Index.db
[root@cassandra002 ~]# lsof -np 128657 |grep -c DEL
56682
{code}
They are probably created by the routine repair process, but they are never
cleared (restarting the Cassandra process clears them, of course).
There are no errors or fatals in the system.log.
We are using Datastax community edition 2.0.13, installed from RPMs.
> Snapshot file handlers are not released after snapshot deleted
> --------------------------------------------------------------
>
> Key: CASSANDRA-9953
> URL: https://issues.apache.org/jira/browse/CASSANDRA-9953
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Reporter: Imri Zvik
>
> We are seeing a lot of opened file descriptors to deleted snapshots (deleted
> using nodetool clearsnapshot):
> {code}
> java 128657 cassandra DEL REG 253,2
> 569272514
> /var/lib/cassandra/data/accounts/account_store_data/snapshots/feb5f790-316e-11e5-aec0-472b0d6e3fd4/accounts-account_store_data-jb-264593-Index.db
> java 128657 cassandra DEL REG 253,2
> 1610616657
> /var/lib/cassandra/data/accounts/account_store_counters/snapshots/03aa4710-316f-11e5-aec0-472b0d6e3fd4/accounts-account_store_counters-jb-635527-Index.db
> java 128657 cassandra DEL REG 253,2
> 1610613856
> /var/lib/cassandra/data/accounts/account_store_counters/snapshots/43c17170-316f-11e5-aec0-472b0d6e3fd4/accounts-account_store_counters-jb-635675-Index.db
> java 128657 cassandra DEL REG 253,2
> 1610613052
> /var/lib/cassandra/data/accounts/account_store_counters/snapshots/18e001a0-3170-11e5-aec0-472b0d6e3fd4/accounts-account_store_counters-jb-636200-Index.db
> [root@cassandra002 ~]# lsof -np 128657 |grep -c DEL
> 56682
> {code}
> They are probably created by the routine repair process, but they are never
> cleared (restarting the Cassandra process clears them, of course).
> We are seeing these also after all repair processes finished, and no repair
> process is running in the cluster.
> There are no errors or fatals in the system.log.
> We are using Datastax community edition 2.0.13, installed from RPMs.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
