Recuisive iteration over HDFS table folder an option? The performance should be good!
On Sun, Mar 24, 2013 at 1:24 AM, Jean-Marc Spaggiari < [email protected]> wrote: > Hi Ted, > > There is no JIRA opened for that since I was not sure if it was > something required/useful/missing/etc. > > But maybe I'm going the wrong way. The idea is, for a given table, I > want to have the size of all the store files, per region. > > So far I'm using getClusterStatus so I can get all the regions for all > the tables. And then retrieve all the store files size. > > But in an environment where there is hundred tables with thousands > column, it might take a bit to long to get all the region for a > specific table. > > So the idea is to scan the META table to get all the regions for the > table I'm looking for, and from there, being able to get the HRegion > object for each of those regions... > > JM > > 2013/3/23 Ted Yu <[email protected]>: > > HRegion is used on region server side. > > Is this tracking on server side ? > > If there is JIRA, giving us the JIRA number would help. > > > > Cheers > > > > On Sat, Mar 23, 2013 at 9:01 AM, Jean-Marc Spaggiari < > > [email protected]> wrote: > > > >> Hi Ted, > >> > >> Yes, it's for 0.94 and newer. > >> > >> For a given table, and a given region, I want to get the storeFileSize. > >> > >> I want to be able to track the storeFileSize per region per table. And > >> since I already have the HRegionInfo I'm wondering if there is a way > >> to use this to get the HRegion to call getStorefileSizeMB. > >> > >> I already found few ways to get the getStorefileSizeMB for a region, > >> but none clean and easy using an HRegionInfo parameter. > >> > >> JM > >> > >> 2013/3/23 Ted Yu <[email protected]>: > >> > Can you clarify your use case ? > >> > > >> > This is for 0.94 and newer releases, I assume. > >> > > >> > On Sat, Mar 23, 2013 at 8:37 AM, Jean-Marc Spaggiari < > >> > [email protected]> wrote: > >> > > >> >> Hi, > >> >> > >> >> What's the best and cleanest way to get the HRegion object from the > >> >> HRegionInfo one? Is there any utility class doing that? > >> >> > >> >> Thanks, > >> >> > >> >> JM > >> >> > >> >
