Re: system.catalog and system.stats entries slows down bulk MR inserts by 20-25X (Phoenix 4.4)

2016-01-16 Thread Thangamani, Arun
ply-To: "user@phoenix.apache.org<mailto:user@phoenix.apache.org>" <user@phoenix.apache.org<mailto:user@phoenix.apache.org>> Date: Monday, December 7, 2015 at 2:52 PM To: "user@phoenix.apache.org<mailto:user@phoenix.apache.org>" <user@phoenix.apache.org<mailt

Re: system.catalog and system.stats entries slows down bulk MR inserts by 20-25X (Phoenix 4.4)

2015-12-31 Thread Thangamani, Arun
@phoenix.apache.org<mailto:user@phoenix.apache.org>> Date: Wednesday, December 30, 2015 at 11:05 PM To: user <user@phoenix.apache.org<mailto:user@phoenix.apache.org>> Subject: Re: system.catalog and system.stats entries slows down bulk MR inserts by 20-25X (Phoenix 4.4) Hi Arun, Yes, pleas

system.catalog and system.stats entries slows down bulk MR inserts by 20-25X (Phoenix 4.4)

2015-12-07 Thread Thangamani, Arun
Hello, I noticed an issue with bulk insert through map reduce in phoenix 4.4.0.2.3.0.0-2557, using outline of the code below Normally the inserts of about 25 million rows complete in about 5 mins, there are 5 region servers and the phoenix table has 32 buckets But sometimes (maybe after major

Re: system.catalog and system.stats entries slows down bulk MR inserts by 20-25X (Phoenix 4.4)

2015-12-07 Thread Matt Kowalczyk
lt.com> wrote: > This is on hbase-1.1.1.2.3.0.0-2557 if that would make any difference in > analysis. Thanks > > From: Arun Thangamani <than...@cobalt.com> > Date: Monday, December 7, 2015 at 12:13 AM > To: "user@phoenix.apache.org" <user@phoenix.apache.org> > Subject:

Re: system.catalog and system.stats entries slows down bulk MR inserts by 20-25X (Phoenix 4.4)

2015-12-07 Thread James Taylor
3.0.0-2557 if that would make any difference in >> analysis. Thanks >> >> From: Arun Thangamani <than...@cobalt.com> >> Date: Monday, December 7, 2015 at 12:13 AM >> To: "user@phoenix.apache.org" <user@phoenix.apache.org> >> Subject: system.cat

Re: system.catalog and system.stats entries slows down bulk MR inserts by 20-25X (Phoenix 4.4)

2015-12-07 Thread Matt Kowalczyk
M, Thangamani, Arun <than...@cobalt.com> >> wrote: >> >>> This is on hbase-1.1.1.2.3.0.0-2557 if that would make any difference in >>> analysis. Thanks >>> >>> From: Arun Thangamani <than...@cobalt.com> >>> Date: Monday, December 7, 2015

Re: system.catalog and system.stats entries slows down bulk MR inserts by 20-25X (Phoenix 4.4)

2015-12-07 Thread James Taylor
B%7D,'cvml','than...@cobalt.com');>> >>>> Date: Monday, December 7, 2015 at 12:13 AM >>>> To: "user@phoenix.apache.org >>>> <javascript:_e(%7B%7D,'cvml','user@phoenix.apache.org');>" < >>>> user@phoenix.apache.org >>&

Re: system.catalog and system.stats entries slows down bulk MR inserts by 20-25X (Phoenix 4.4)

2015-12-07 Thread Matt Kowalczyk
> to actively purge the table to regain sane query times. Would be sweet if >>>> the stats feature could be disabled. >>>> >>>> On Mon, Dec 7, 2015 at 9:53 AM, Thangamani, Arun <than...@cobalt.com> >>>> wrote: >>>> >>>>> Th

Re: system.catalog and system.stats entries slows down bulk MR inserts by 20-25X (Phoenix 4.4)

2015-12-07 Thread James Taylor
using slow queries". >>>>> >>>>> the stats table seems to be re-built during compactions and and I have >>>>> to actively purge the table to regain sane query times. Would be sweet if >>>>> the stats feature could be disabled. >>>>> &g

Re: system.catalog and system.stats entries slows down bulk MR inserts by 20-25X (Phoenix 4.4)

2015-12-07 Thread Matt Kowalczyk
>>> >>>>>> the stats table seems to be re-built during compactions and and I >>>>>> have to actively purge the table to regain sane query times. Would be >>>>>> sweet >>>>>> if the stats feature could be disabl

Re: system.catalog and system.stats entries slows down bulk MR inserts by 20-25X (Phoenix 4.4)

2015-12-07 Thread Thangamani, Arun
> Date: Monday, December 7, 2015 at 2:49 PM To: user <user@phoenix.apache.org<mailto:user@phoenix.apache.org>> Subject: Re: system.catalog and system.stats entries slows down bulk MR inserts by 20-25X (Phoenix 4.4) You need to bounce the cluster *before* major compaction or the re

Re: system.catalog and system.stats entries slows down bulk MR inserts by 20-25X (Phoenix 4.4)

2015-12-07 Thread Thangamani, Arun
t; <user@phoenix.apache.org<mailto:user@phoenix.apache.org>> Subject: system.catalog and system.stats entries slows down bulk MR inserts by 20-25X (Phoenix 4.4) Hello, I noticed an issue with bulk insert through map reduce in phoenix 4.4.0.2.3.0.0-2557, using outline of the code below