Re: Number of splits

2016-01-18 Thread Matt Kowalczyk
For splits, I've used, https://github.com/apache/phoenix/blob/master/phoenix-core/src/main/java/org/apache/phoenix/schema/PTable.java#L267 To get a reference to a PTable, https://github.com/apache/phoenix/blob/master/phoenix-core/src/main/java/org/apache/phoenix/util/PhoenixRuntime.java#L367

Re: Number of splits

2016-01-18 Thread Matt Kowalczyk
(in case you meant splits as salt size) On Mon, Jan 18, 2016 at 2:19 PM, Matt Kowalczyk <ma...@cloudability.com> wrote: > For splits, I've used, > > > https://github.com/apache/phoenix/blob/master/phoenix-core/src/main/java/org/apache/phoenix/schema/PTable.java#L267 >

Re: system.catalog and system.stats entries slows down bulk MR inserts by 20-25X (Phoenix 4.4)

2015-12-07 Thread Matt Kowalczyk
We're also encountering slow downs after bulk MR inserts. I've only measured slow downs in the query path (since our bulk inserts workloads vary in size it hasn't been clear that we see slow downs here but i'll now measure this as well). The subject of my reported issue was titled, "stats table

Re: system.catalog and system.stats entries slows down bulk MR inserts by 20-25X (Phoenix 4.4)

2015-12-07 Thread Matt Kowalczyk
GB), then > you're essentially disabling it. You could also try increasing it somewhere > in between to maybe 5 or 10GB. > > Thanks, > James > > On Mon, Dec 7, 2015 at 10:25 AM, Matt Kowalczyk <ma...@cloudability.com> > wrote: > >> We're also encountering slow down

Re: system.catalog and system.stats entries slows down bulk MR inserts by 20-25X (Phoenix 4.4)

2015-12-07 Thread Matt Kowalczyk
u'll need to > bounce your cluster after setting either of these, and stats won't be > updated until a major compaction occurs. > > > On Monday, December 7, 2015, Matt Kowalczyk <ma...@cloudability.com> > wrote: > >> I've set, phoenix.stats.guidepost.per.region

Re: system.catalog and system.stats entries slows down bulk MR inserts by 20-25X (Phoenix 4.4)

2015-12-07 Thread Matt Kowalczyk
to bounce the cluster *before* major compaction or the region > server will continue to use the old guideposts setting during compaction. > > On Mon, Dec 7, 2015 at 2:45 PM, Matt Kowalczyk <ma...@cloudability.com> > wrote: > >> bounced, just after major compaction, with the setti

stats table causing slow queries

2015-10-14 Thread Matt Kowalczyk
Hi, I have a large phoenix table with ~1800 regions. After running a compaction, I noticed degraded query performance. After purging the system.stat table, query performance returned back to normal. Surprisingly, using sqlline.py does not cause this slow down. Here are some numbers, (before and

Re: stats table causing slow queries

2015-10-14 Thread Matt Kowalczyk
Oh yeah, hbase-1.1.2 phoenix-4.5.1 Thanks! On Wed, Oct 14, 2015 at 12:29 PM, Matt Kowalczyk <ma...@cloudability.com> wrote: > Hi, > > I have a large phoenix table with ~1800 regions. After running a > compaction, I noticed degraded query performance. After purging the &