Thanks Ted. I will surely look into it. -----Original Message----- From: Ted Yu [mailto:[email protected]] Sent: 04 September 2014 10:32 To: [email protected] Subject: Re: Writer for a hfile is rolled though it has not reached max size
See the conversation between Todd and Nicolas (on IRC) on HBASE-1861 Cheers On Wed, Sep 3, 2014 at 9:37 PM, ashish singhi <[email protected]> wrote: > Hi all. > > When a writer for a column family exceeds the hregion.max.filesize > then we are rolling writers of all the column families though the > writers of the other column family has not exceeded the max size. > Below is the code snippet from HFileOutputFormat2 class. > {code} > // If any of the HFiles for the column families has reached > // maxsize, we need to roll all the writers > if (wl != null && wl.written + length >= maxsize) { > this.rollRequested = true; > } > > // This can only happen once a row is finished though > if (rollRequested && Bytes.compareTo(this.previousRow, rowKey) > != > 0) { > rollWriters(); > } > {code} > > Is it a bug or I am missing something ? > > Regards, > Ashish Singhi >
