Re: Could all tests run MR without MiniMapReduceCluster?

2015-10-23 Thread Heng Chen
I create an issue to do it. https://issues.apache.org/jira/browse/HBASE-14684 2015-10-23 13:35 GMT+08:00 Stack : > What Elliott said. > St.Ack > > On Thu, Oct 22, 2015 at 10:09 PM, Elliott Clark wrote: > > > On Thu, Oct 22, 2015 at 7:41 PM, Heng Chen

Could all tests run MR without MiniMapReduceCluster?

2015-10-22 Thread 陈恒
When i dig in HBASE-14659, i found in testcase TestHFileOutputFormat, some tests run MR job without MiniMRCluster and some run with it. The ones with no MiniMRCluster run much faster! Do we need to 'test' clustered MR especially in a unit test? As stack suggestion, i post this topic here

Re: Could all tests run MR without MiniMapReduceCluster?

2015-10-22 Thread Elliott Clark
Do we have any tests that test the locality feature for map task -> machine? That's the only thing I can think of that would 100% require an mr mincluster. I'd be +1 on removing most of the uses of mr minicluster. On Wed, Oct 21, 2015 at 10:01 PM, 陈恒 wrote: > When i dig in

Re: Could all tests run MR without MiniMapReduceCluster?

2015-10-22 Thread Stack
On Wed, Oct 21, 2015 at 10:01 PM, 陈恒 wrote: > When i dig in HBASE-14659, i found in testcase TestHFileOutputFormat, > some tests run MR job > without MiniMRCluster and some run with it. > > > The ones with no MiniMRCluster run much faster! > Do we need to 'test' clustered MR

Re: Could all tests run MR without MiniMapReduceCluster?

2015-10-22 Thread Elliott Clark
On Thu, Oct 22, 2015 at 7:41 PM, Heng Chen wrote: > IMO we can remove them firstly, and see what QA says. > +1

Re: Could all tests run MR without MiniMapReduceCluster?

2015-10-22 Thread Stack
What Elliott said. St.Ack On Thu, Oct 22, 2015 at 10:09 PM, Elliott Clark wrote: > On Thu, Oct 22, 2015 at 7:41 PM, Heng Chen > wrote: > > > IMO we can remove them firstly, and see what QA says. > > > > +1 >