RE: [Help] minor compact is continuously consuming the disk space until run out of space?

2017-08-28 Thread Liu, Ming (Ming)
: [Help] minor compact is continuously consuming the disk space until run out of space? >We think minor compact is just combining files , say, if we have 10 hfiles >using 100G disk space, after minor compact, it still should be 100G, if not >less. That is partially true. The thing is whe

Re: [Help] minor compact is continuously consuming the disk space until run out of space?

2017-08-28 Thread Anoop John
0G, if not >> less. It is called compaction, isn't it? So we don't understand why it is >> using so many extra disk space? Anything wrong in our system? >> >> thanks, >> Ming >> >> -----Original Message----- >> From: Ted Yu [mailto:yuzhih...@gmail.com] >>

Re: [Help] minor compact is continuously consuming the disk space until run out of space?

2017-08-26 Thread Ted Yu
[mailto:yuzhih...@gmail.com] > Sent: Saturday, August 26, 2017 9:54 PM > To: user@hbase.apache.org > Subject: Re: [Help] minor compact is continuously consuming the disk space > until run out of space? > > bq. on each Region Server there are about 800 hfiles > > Is it possible t

RE: [Help] minor compact is continuously consuming the disk space until run out of space?

2017-08-26 Thread Liu, Ming (Ming)
understand why it is using so many extra disk space? Anything wrong in our system? thanks, Ming -Original Message- From: Ted Yu [mailto:yuzhih...@gmail.com] Sent: Saturday, August 26, 2017 9:54 PM To: user@hbase.apache.org Subject: Re: [Help] minor compact is continuously consuming the disk

Re: [Help] minor compact is continuously consuming the disk space until run out of space?

2017-08-26 Thread Ted Yu
bq. on each Region Server there are about 800 hfiles Is it possible to control the number of hfiles during each bulk load ? For this big table, are the regions evenly spread across the servers ? If so, consider increasing the capacity of your cluster. >From the doc for