[
https://issues.apache.org/jira/browse/KUDU-1692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15567531#comment-15567531
]
Todd Lipcon commented on KUDU-1692:
-----------------------------------
It seems the root cause here might be that CFileReaders's parent memtracker is
being set to the root tracker rather than the tablet tracker when CFileSet
opens them. [~adar] do you recall how this is supposed to work? I don't see the
tablet memtracker passed into CFileSet at all at the moment, but maybe I'm
missing something.
> Deleting large tablets causes a lot of tcmalloc contention
> ----------------------------------------------------------
>
> Key: KUDU-1692
> URL: https://issues.apache.org/jira/browse/KUDU-1692
> Project: Kudu
> Issue Type: Bug
> Components: tablet, util
> Affects Versions: 1.0.0
> Reporter: Todd Lipcon
>
> I deleted a large table which contained about 1TB of data per tablet server.
> The tablet servers then started spending a large amount of time in this stack:
> {code}
> 855e94 tcmalloc::ThreadCache::GetThreadStats(unsigned
> long*, unsigned long*)
> (/opt/cloudera/parcels/KUDU-1.0.0-1.kudu1.0.0.p0.6/lib/kudu/sbin-release/kudu-tserver)
> 84e9ba ExtractStats(TCMallocStats*, unsigned long*,
> tcmalloc::PageHeap::SmallSpanStats*, tcmalloc::PageHeap::LargeSpanStats*)
> (/opt/cloudera/parcels/KUDU-1.0.0-1.kudu1.0.0.p0.6/lib/kudu/sbin-releas
> 850f8f TCMallocImplementation::GetNumericProperty(char
> const*, unsigned long*)
> (/opt/cloudera/parcels/KUDU-1.0.0-1.kudu1.0.0.p0.6/lib/kudu/sbin-release/kudu-tserver)
> 1a18c50 kudu::GetTCMallocCurrentAllocatedBytes()
> (/opt/cloudera/parcels/KUDU-1.0.0-1.kudu1.0.0.p0.6/lib/kudu/sbin-release/kudu-tserver)
> 1a19a50 kudu::MemTracker::UpdateConsumption()
> (/opt/cloudera/parcels/KUDU-1.0.0-1.kudu1.0.0.p0.6/lib/kudu/sbin-release/kudu-tserver)
> 980f01 std::_Sp_counted_ptr<kudu::cfile::CFileReader*,
> (__gnu_cxx::_Lock_policy)2>::_M_dispose()
> (/opt/cloudera/parcels/KUDU-1.0.0-1.kudu1.0.0.p0.6/lib/kudu/sbin-release/kudu-tserver)
> 99a937 kudu::tablet::CFileSet::~CFileSet()
> (/opt/cloudera/parcels/KUDU-1.0.0-1.kudu1.0.0.p0.6/lib/kudu/sbin-release/kudu-tserver)
> 99ad61 kudu::tablet::CFileSet::~CFileSet()
> (/opt/cloudera/parcels/KUDU-1.0.0-1.kudu1.0.0.p0.6/lib/kudu/sbin-release/kudu-tserver)
> 948b42 kudu::tablet::DiskRowSet::~DiskRowSet()
> (/opt/cloudera/parcels/KUDU-1.0.0-1.kudu1.0.0.p0.6/lib/kudu/sbin-release/kudu-tserver)
> 965f35 kudu::tablet::RowSetTree::~RowSetTree()
> (/opt/cloudera/parcels/KUDU-1.0.0-1.kudu1.0.0.p0.6/lib/kudu/sbin-release/kudu-tserver)
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
