Smalyshev added a comment.
Generally since new categories are loaded before old ones are deleted, the space bump is expected - and Blazegraph allocates disk space in big chunks, so it can be noticeable. What is also expected is that when old categories namespace is removed, the space is freed up
gerritbot added a comment.
Change 448597 merged by Gehel:
[operations/puppet@production] wdqs: fix ensure of reload categories cron
https://gerrit.wikimedia.org/r/448597TASK DETAILhttps://phabricator.wikimedia.org/T200202EMAIL
gerritbot added a comment.
Change 448597 had a related patch set uploaded (by Gehel; owner: Gehel):
[operations/puppet@production] wdqs: fix ensure of reload categories cron
https://gerrit.wikimedia.org/r/448597TASK DETAILhttps://phabricator.wikimedia.org/T200202EMAIL
gerritbot added a comment.
Change 448591 merged by Gehel:
[operations/puppet@production] wdqs: disable categories reload
https://gerrit.wikimedia.org/r/448591TASK DETAILhttps://phabricator.wikimedia.org/T200202EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To:
gerritbot added a comment.
Change 448591 had a related patch set uploaded (by Gehel; owner: Gehel):
[operations/puppet@production] wdqs: disable categories reload
https://gerrit.wikimedia.org/r/448591TASK DETAILhttps://phabricator.wikimedia.org/T200202EMAIL
Gehel added a comment.
Damn, we already set minReleaseAge=1 in RWStore.properties. We need to be looking for something else.TASK DETAILhttps://phabricator.wikimedia.org/T200202EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: GehelCc: Aklapper, Smalyshev,
Smalyshev added a comment.
Yep, this looks like what we should be doing.TASK DETAILhttps://phabricator.wikimedia.org/T200202EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Aklapper, Smalyshev, Gehel, AndyTan, Davinaclare77, Qtn1293, Lahi, Gq86,
Gehel added a comment.
It looks like there is some configuration around the release of historical data. Setting com.bigdata.service.AbstractTransactionService.minReleaseAge=1 might allow to reclaim space.TASK DETAILhttps://phabricator.wikimedia.org/T200202EMAIL
Gehel added a comment.
Looking at http://localhost:/bigdata/#namespaces it seems that categories namespaces are deleted. But maybe the disk space is not recovered on deletion?TASK DETAILhttps://phabricator.wikimedia.org/T200202EMAIL
