[jira] [Commented] (HBASE-8877) Reentrant row locks

2013-07-13 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13707787#comment-13707787 ] Dave Latham commented on HBASE-8877: Note the above comment is referencing the HRegion

[jira] [Updated] (HBASE-8877) Reentrant row locks

2013-07-13 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Latham updated HBASE-8877: --- Attachment: HBASE-8877-v6.patch Last patch failed on TestHeapSize. This surprised me since it had

[jira] [Commented] (HBASE-8806) Row locks are acquired repeatedly in HRegion.doMiniBatchMutation for duplicate rows.

2013-07-13 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13707917#comment-13707917 ] Dave Latham commented on HBASE-8806: [~lhofhansl] Agreed, don't see a reason it should

[jira] [Updated] (HBASE-8877) Reentrant row locks

2013-07-14 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Latham updated HBASE-8877: --- Attachment: HBASE-8877-0.94-v2.patch Thanks, Ted and Lars for the reviews. Here's a new patch,

[jira] [Updated] (HBASE-8877) Reentrant row locks

2013-07-14 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Latham updated HBASE-8877: --- Attachment: (was: HBASE-8877-0.94-v2.patch) Reentrant row locks ---

[jira] [Updated] (HBASE-8877) Reentrant row locks

2013-07-14 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Latham updated HBASE-8877: --- Attachment: HBASE-8877-0.94-v2.patch Reentrant row locks ---

[jira] [Updated] (HBASE-8806) Row locks are acquired repeatedly in HRegion.doMiniBatchMutation for duplicate rows.

2013-07-15 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Latham updated HBASE-8806: --- Attachment: (was: hbase-8806-0.94-v6-microbenchmark) Row locks are acquired repeatedly in

[jira] [Updated] (HBASE-8806) Row locks are acquired repeatedly in HRegion.doMiniBatchMutation for duplicate rows.

2013-07-15 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Latham updated HBASE-8806: --- Attachment: hbase-8806-0.94-v6-microbenchmark

[jira] [Updated] (HBASE-8806) Row locks are acquired repeatedly in HRegion.doMiniBatchMutation for duplicate rows.

2013-07-15 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Latham updated HBASE-8806: --- Attachment: hbase-8806-0.94-v6-microbenchmark.txt

[jira] [Updated] (HBASE-8806) Row locks are acquired repeatedly in HRegion.doMiniBatchMutation for duplicate rows.

2013-07-15 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Latham updated HBASE-8806: --- Attachment: (was: hbase-8806-0.94-v6-microbenchmark-no-dupe-rows) Row locks are acquired

[jira] [Updated] (HBASE-8806) Row locks are acquired repeatedly in HRegion.doMiniBatchMutation for duplicate rows.

2013-07-15 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Latham updated HBASE-8806: --- Attachment: (was: hbase-8806-0.94-v6-microbenchmark.txt) Row locks are acquired repeatedly

[jira] [Updated] (HBASE-8806) Row locks are acquired repeatedly in HRegion.doMiniBatchMutation for duplicate rows.

2013-07-15 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Latham updated HBASE-8806: --- Attachment: (was: hbase-8806-0.94-v6-microbenchmark-no-dupe-rows.txt) Row locks are

[jira] [Updated] (HBASE-8806) Row locks are acquired repeatedly in HRegion.doMiniBatchMutation for duplicate rows.

2013-07-15 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Latham updated HBASE-8806: --- Attachment: hbase-8806-0.94-microbenchmark-no-dupe-rows.txt

[jira] [Updated] (HBASE-8877) Reentrant row locks

2013-07-15 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Latham updated HBASE-8877: --- Attachment: HBASE-8877-v7.patch Thanks, Stack, for the review. Judging by your comments I believe

[jira] [Commented] (HBASE-8877) Reentrant row locks

2013-07-15 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13708660#comment-13708660 ] Dave Latham commented on HBASE-8877: 3 +1's on the dev mailing list for the removal of

[jira] [Commented] (HBASE-8877) Reentrant row locks

2013-07-15 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13708851#comment-13708851 ] Dave Latham commented on HBASE-8877: [~lhofhansl] Agreed that it's a bit fragile and

[jira] [Updated] (HBASE-8877) Reentrant row locks

2013-07-15 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Latham updated HBASE-8877: --- Attachment: HBASE-8877-refCounts.patch Alright, here's a patch with reentrant row locks and

[jira] [Updated] (HBASE-8877) Reentrant row locks

2013-07-15 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Latham updated HBASE-8877: --- Attachment: hbase-8877-refCounts-microbenchmarks.txt microbenchmark comparing latest patch

[jira] [Updated] (HBASE-8877) Reentrant row locks

2013-07-15 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Latham updated HBASE-8877: --- Attachment: HBASE-8877-refCounts.patch Reattaching refCounts patch with check to enforce that only

[jira] [Updated] (HBASE-8877) Reentrant row locks

2013-07-15 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Latham updated HBASE-8877: --- Attachment: (was: HBASE-8877-refCounts.patch) Reentrant row locks ---

[jira] [Updated] (HBASE-8877) Reentrant row locks

2013-07-15 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Latham updated HBASE-8877: --- Attachment: HBASE-8877-refCounts-v2.patch Thanks, Ted, for taking a look. Sorry for changing the

[jira] [Commented] (HBASE-8806) Row locks are acquired repeatedly in HRegion.doMiniBatchMutation for duplicate rows.

2013-07-15 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13709180#comment-13709180 ] Dave Latham commented on HBASE-8806: Sounds good to me. +1 to commit.

[jira] [Updated] (HBASE-8877) Reentrant row locks

2013-07-15 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Latham updated HBASE-8877: --- Attachment: HBASE-8877-refCounts-v3.patch One more patch, fixes a typo and moves the enforcement of

[jira] [Updated] (HBASE-8877) Reentrant row locks

2013-07-15 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Latham updated HBASE-8877: --- Attachment: HBASE-8877-refCounts-v4.patch Another try rebased off current tip of trunk.

[jira] [Commented] (HBASE-8877) Reentrant row locks

2013-07-15 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13709416#comment-13709416 ] Dave Latham commented on HBASE-8877: And here's the diff up on review board if that

[jira] [Commented] (HBASE-8877) Reentrant row locks

2013-07-15 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13709428#comment-13709428 ] Dave Latham commented on HBASE-8877: Now that it's done, I'd prefer refCounts. I

[jira] [Updated] (HBASE-8877) Reentrant row locks

2013-07-16 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Latham updated HBASE-8877: --- Attachment: HBASE-8877-refCounts-v5.patch Attaching HBASE-8877-refCounts-v5.patch This one's for all

[jira] [Commented] (HBASE-8877) Reentrant row locks

2013-07-16 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13710307#comment-13710307 ] Dave Latham commented on HBASE-8877: Looks good to commit to me. Hadoop QA says that

[jira] [Updated] (HBASE-8877) Reentrant row locks

2013-07-17 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Latham updated HBASE-8877: --- Environment: Changed the coprocessor RegionObserver methods preBatchMutate and postBatchMutate to

[jira] [Commented] (HBASE-8877) Reentrant row locks

2013-07-17 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13711260#comment-13711260 ] Dave Latham commented on HBASE-8877: Thanks everyone for your attention, help, and

[jira] [Updated] (HBASE-8877) Reentrant row locks

2013-07-17 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Latham updated HBASE-8877: --- Environment: (was: Changed the coprocessor RegionObserver methods preBatchMutate and

[jira] [Commented] (HBASE-8778) Region assigments scan table directory making them slow for huge tables

2013-07-17 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13711745#comment-13711745 ] Dave Latham commented on HBASE-8778: I would really like to see a resolution of this

[jira] [Updated] (HBASE-8778) Region assigments scan table directory making them slow for huge tables

2013-07-17 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Latham updated HBASE-8778: --- Fix Version/s: 0.95.2 0.98.0 Assignee: Dave Latham Region

[jira] [Commented] (HBASE-8778) Region assigments scan table directory making them slow for huge tables

2013-07-20 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13714446#comment-13714446 ] Dave Latham commented on HBASE-8778: Thanks, [~lhofhansl], for taking a look.

[jira] [Commented] (HBASE-8778) Region assigments scan table directory making them slow for huge tables

2013-07-20 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13714448#comment-13714448 ] Dave Latham commented on HBASE-8778: {quote}There is already some migration and

[jira] [Commented] (HBASE-8778) Region assigments scan table directory making them slow for huge tables

2013-07-21 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13714814#comment-13714814 ] Dave Latham commented on HBASE-8778: {quote}Could make is a config option. That way

[jira] [Commented] (HBASE-8778) Region assigments scan table directory making them slow for huge tables

2013-07-22 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13715608#comment-13715608 ] Dave Latham commented on HBASE-8778: I began working on a trunk/0.96 patch that would

[jira] [Commented] (HBASE-8778) Region assigments scan table directory making them slow for huge tables

2013-07-22 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13715673#comment-13715673 ] Dave Latham commented on HBASE-8778: The directory modtime check looks good to me.

[jira] [Commented] (HBASE-8778) Region assigments scan table directory making them slow for huge tables

2013-07-22 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13715790#comment-13715790 ] Dave Latham commented on HBASE-8778: Actually, one thought about the directory mod

[jira] [Updated] (HBASE-8778) Region assigments scan table directory making them slow for huge tables

2013-07-24 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Latham updated HBASE-8778: --- Attachment: HBASE-8778.patch Attached HBASE-8778.patch which is a patch for trunk. Up at

[jira] [Updated] (HBASE-8778) Region assigments scan table directory making them slow for huge tables

2013-07-25 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Latham updated HBASE-8778: --- Attachment: HBASE-8778-v2.patch Attaching HBASE-8778-v2.patch This patch addresses a couple

[jira] [Updated] (HBASE-8778) Region assigments scan table directory making them slow for huge tables

2013-07-25 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Latham updated HBASE-8778: --- Status: Patch Available (was: Open) Resubmitting to give Hadoop QA another chance now that trunk

[jira] [Updated] (HBASE-8778) Region assigments scan table directory making them slow for huge tables

2013-07-25 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Latham updated HBASE-8778: --- Status: Open (was: Patch Available) Region assigments scan table directory making them slow

[jira] [Updated] (HBASE-8778) Region assigments scan table directory making them slow for huge tables

2013-07-25 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Latham updated HBASE-8778: --- Attachment: (was: HBASE-8778-v2.patch) Region assigments scan table directory making them

[jira] [Updated] (HBASE-8778) Region assigments scan table directory making them slow for huge tables

2013-07-25 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Latham updated HBASE-8778: --- Attachment: HBASE-8778-v2.patch Reattaching since changing issue status didn't seem to trigger

[jira] [Updated] (HBASE-8778) Region assigments scan table directory making them slow for huge tables

2013-07-25 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Latham updated HBASE-8778: --- Attachment: HBASE-8778-v3.patch Attaching HBASE-8778-v3.patch. Only change from v2 is fixing one

[jira] [Commented] (HBASE-8778) Region assigments scan table directory making them slow for huge tables

2013-07-30 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13724018#comment-13724018 ] Dave Latham commented on HBASE-8778: Thanks [~jmspaggi] for taking a look. This

[jira] [Created] (HBASE-9089) HRegion.heapSize is missing many fields

2013-07-30 Thread Dave Latham (JIRA)
Dave Latham created HBASE-9089: -- Summary: HRegion.heapSize is missing many fields Key: HBASE-9089 URL: https://issues.apache.org/jira/browse/HBASE-9089 Project: HBase Issue Type: Bug

[jira] [Updated] (HBASE-8778) Region assigments scan table directory making them slow for huge tables

2013-07-30 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Latham updated HBASE-8778: --- Attachment: HBASE-8778-v4.patch HBASE-8778-v4.patch - rebased to the latest trunk. Ted, what is

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

2013-08-01 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13726428#comment-13726428 ] Dave Latham commented on HBASE-5954: Should update the recommended HDFS configuration

[jira] [Updated] (HBASE-8778) Region assigments scan table directory making them slow for huge tables

2013-08-02 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Latham updated HBASE-8778: --- Attachment: HBASE-8778-v5.patch Yes, trunk indeed moves fast. Thanks, Ted, for the review and help

[jira] [Created] (HBASE-9132) Use table dir modtime to avoid scanning table dir to check cached table descriptor

2013-08-05 Thread Dave Latham (JIRA)
Dave Latham created HBASE-9132: -- Summary: Use table dir modtime to avoid scanning table dir to check cached table descriptor Key: HBASE-9132 URL: https://issues.apache.org/jira/browse/HBASE-9132

[jira] [Created] (HBASE-9133) Use table dir modtime to avoid scanning table dir to check cached table descriptor

2013-08-05 Thread Dave Latham (JIRA)
Dave Latham created HBASE-9133: -- Summary: Use table dir modtime to avoid scanning table dir to check cached table descriptor Key: HBASE-9133 URL: https://issues.apache.org/jira/browse/HBASE-9133

[jira] [Resolved] (HBASE-9133) Use table dir modtime to avoid scanning table dir to check cached table descriptor

2013-08-05 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-9133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Latham resolved HBASE-9133. Resolution: Duplicate Use table dir modtime to avoid scanning table dir to check cached table

[jira] [Updated] (HBASE-9132) Use table dir modtime to avoid scanning table dir to check cached table descriptor in 0.94

2013-08-05 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-9132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Latham updated HBASE-9132: --- Attachment: HBASE-9132-0.94.patch Use table dir modtime to avoid scanning table dir to check

[jira] [Updated] (HBASE-9132) Use table dir modtime to avoid scanning table dir to check cached table descriptor in 0.94

2013-08-05 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-9132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Latham updated HBASE-9132: --- Summary: Use table dir modtime to avoid scanning table dir to check cached table descriptor in 0.94

[jira] [Work started] (HBASE-9132) Use table dir modtime to avoid scanning table dir to check cached table descriptor in 0.94

2013-08-05 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-9132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HBASE-9132 started by Dave Latham. Use table dir modtime to avoid scanning table dir to check cached table descriptor in 0.94

[jira] [Updated] (HBASE-9132) Use table dir modtime to avoid scanning table dir to check cached table descriptor in 0.94

2013-08-05 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-9132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Latham updated HBASE-9132: --- Status: Patch Available (was: In Progress) Use table dir modtime to avoid scanning table dir

[jira] [Commented] (HBASE-9132) Use table dir modtime to avoid scanning table dir to check cached table descriptor in 0.94

2013-08-05 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-9132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13730173#comment-13730173 ] Dave Latham commented on HBASE-9132: Here's a patch for 0.94. Table descriptor read:

[jira] [Commented] (HBASE-8778) Region assigments scan table directory making them slow for huge tables

2013-08-05 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13730177#comment-13730177 ] Dave Latham commented on HBASE-8778: Thanks, Stack. Let me know if you want me to do

[jira] [Commented] (HBASE-9132) Use table dir modtime to avoid scanning table dir to check cached table descriptor in 0.94

2013-08-05 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-9132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13730241#comment-13730241 ] Dave Latham commented on HBASE-9132: Thanks, Ted, for the comments. {quote}nit:

[jira] [Updated] (HBASE-8778) Region assigments scan table directory making them slow for huge tables

2013-08-06 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Latham updated HBASE-8778: --- Release Note: Table descriptors are now moved inside hdfs from residing directly in the table

[jira] [Updated] (HBASE-8778) Region assigments scan table directory making them slow for huge tables

2013-08-06 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Latham updated HBASE-8778: --- Release Note: Table descriptors are now moved inside hdfs from residing directly in the table

[jira] [Created] (HBASE-9208) ReplicationLogCleaner slow at large scale

2013-08-13 Thread Dave Latham (JIRA)
Dave Latham created HBASE-9208: -- Summary: ReplicationLogCleaner slow at large scale Key: HBASE-9208 URL: https://issues.apache.org/jira/browse/HBASE-9208 Project: HBase Issue Type: Improvement

[jira] [Commented] (HBASE-7709) Infinite loop possible in Master/Master replication

2013-08-13 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13738999#comment-13738999 ] Dave Latham commented on HBASE-7709: Thanks all for the great work on this. We

[jira] [Commented] (HBASE-9208) ReplicationLogCleaner slow at large scale

2013-08-13 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-9208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13739010#comment-13739010 ] Dave Latham commented on HBASE-9208: My patch is somewhat old now and not what I think

[jira] [Assigned] (HBASE-9208) ReplicationLogCleaner slow at large scale

2013-08-13 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-9208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Latham reassigned HBASE-9208: -- Assignee: Dave Latham ReplicationLogCleaner slow at large scale

[jira] [Commented] (HBASE-9208) ReplicationLogCleaner slow at large scale

2013-08-14 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-9208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13739883#comment-13739883 ] Dave Latham commented on HBASE-9208: The CleanerChore is shared code between cleaning

[jira] [Updated] (HBASE-9208) ReplicationLogCleaner slow at large scale

2013-08-15 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-9208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Latham updated HBASE-9208: --- Fix Version/s: 0.96.0 Status: Patch Available (was: Open) ReplicationLogCleaner

[jira] [Updated] (HBASE-9208) ReplicationLogCleaner slow at large scale

2013-08-15 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-9208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Latham updated HBASE-9208: --- Attachment: HBASE-9208.patch Attaching HBASE-9208.patch with the following changes: - Updated

[jira] [Commented] (HBASE-9208) ReplicationLogCleaner slow at large scale

2013-08-15 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-9208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13741529#comment-13741529 ] Dave Latham commented on HBASE-9208: Meant to add that the patch also updates

[jira] [Updated] (HBASE-9208) ReplicationLogCleaner slow at large scale

2013-08-19 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-9208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Latham updated HBASE-9208: --- Attachment: HBASE-9208-v2.patch Attaching HBASE-9208-v2.patch. It contains some minor javadoc,

[jira] [Updated] (HBASE-9208) ReplicationLogCleaner slow at large scale

2013-08-19 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-9208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Latham updated HBASE-9208: --- Attachment: HBASE-9208-0.94.patch Attaching HBASE-9208-0.94.patch Here is a backport to 0.94.

[jira] [Resolved] (HBASE-1913) Regionserver accepts connections, doesn't handle them after bad filter request

2013-08-19 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-1913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Latham resolved HBASE-1913. Resolution: Duplicate Resolved by HBASE-3939 Regionserver accepts connections,

[jira] [Commented] (HBASE-9208) ReplicationLogCleaner slow at large scale

2013-08-20 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-9208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13745252#comment-13745252 ] Dave Latham commented on HBASE-9208: {quote}For the 0.94 patch, why is this

[jira] [Commented] (HBASE-9208) ReplicationLogCleaner slow at large scale

2013-08-26 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-9208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13750666#comment-13750666 ] Dave Latham commented on HBASE-9208: Thanks for the attention Stack, and JD.

[jira] [Updated] (HBASE-9208) ReplicationLogCleaner slow at large scale

2013-08-26 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-9208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Latham updated HBASE-9208: --- Attachment: HBASE-9208-v3.patch HBASE-9208-0.94-v2.patch Attaching

[jira] [Commented] (HBASE-9208) ReplicationLogCleaner slow at large scale

2013-08-28 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-9208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13752712#comment-13752712 ] Dave Latham commented on HBASE-9208: I'm not sure that we should commit to 0.94 as is

[jira] [Updated] (HBASE-9377) Backport HBASE- 9208 ReplicationLogCleaner slow at large scale

2013-08-29 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-9377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Latham updated HBASE-9377: --- Description: For [~lhofhansl] to make a call on. See end where Dave Latham talks about issues w/

[jira] [Updated] (HBASE-9208) ReplicationLogCleaner slow at large scale

2013-08-29 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-9208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Latham updated HBASE-9208: --- Release Note: The FileCleanerDelegate interface has changed to operate on a batch of files at a

[jira] [Updated] (HBASE-9208) ReplicationLogCleaner slow at large scale

2013-08-29 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-9208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Latham updated HBASE-9208: --- Release Note: The FileCleanerDelegate interface has changed to operate on a batch of files at a

[jira] [Commented] (HBASE-9377) Backport HBASE- 9208 ReplicationLogCleaner slow at large scale

2013-09-06 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-9377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13760505#comment-13760505 ] Dave Latham commented on HBASE-9377: Sorry, been pulled on to some more urgent work at

[jira] [Commented] (HBASE-9377) Backport HBASE- 9208 ReplicationLogCleaner slow at large scale

2013-09-10 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-9377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13763169#comment-13763169 ] Dave Latham commented on HBASE-9377: Didn't notice the InterfaceAudience.private.

[jira] [Commented] (HBASE-9377) Backport HBASE- 9208 ReplicationLogCleaner slow at large scale

2013-09-10 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-9377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1376#comment-1376 ] Dave Latham commented on HBASE-9377: If you want me to choose, I'd say stick with the

[jira] [Commented] (HBASE-9377) Backport HBASE- 9208 ReplicationLogCleaner slow at large scale

2013-09-10 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-9377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13763336#comment-13763336 ] Dave Latham commented on HBASE-9377: (By initial patch, you mean

[jira] [Commented] (HBASE-9488) Improve performance for small scan

2013-09-10 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-9488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13764016#comment-13764016 ] Dave Latham commented on HBASE-9488: (Argh - that should be it would be nice if we

[jira] [Commented] (HBASE-9488) Improve performance for small scan

2013-09-10 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-9488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13764012#comment-13764012 ] Dave Latham commented on HBASE-9488: Yes - we were discussing trimming short scans on

[jira] [Commented] (HBASE-9488) Improve performance for small scan

2013-09-11 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-9488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13764485#comment-13764485 ] Dave Latham commented on HBASE-9488: Brainstorming on other approaches to do more

[jira] [Commented] (HBASE-9488) Improve performance for small scan

2013-09-13 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-9488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13766559#comment-13766559 ] Dave Latham commented on HBASE-9488: I guess I'm -0. No objections if nobody else is

[jira] [Commented] (HBASE-9606) Apply small scan to meta scan where rowLimit is low

2013-09-23 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-9606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13774697#comment-13774697 ] Dave Latham commented on HBASE-9606: Looks good to me, too. Can we get it in 0.96

[jira] [Updated] (HBASE-9865) WALEdit.heapSize() is incorrect in certain replication scenarios which may cause RegionServers to go OOM

2013-10-31 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-9865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Latham updated HBASE-9865: --- Labels: Repli (was: ) WALEdit.heapSize() is incorrect in certain replication scenarios which may

[jira] [Commented] (HBASE-9865) WALEdit.heapSize() is incorrect in certain replication scenarios which may cause RegionServers to go OOM

2013-10-31 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-9865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13810774#comment-13810774 ] Dave Latham commented on HBASE-9865: There are actually two issues at play here that

[jira] [Updated] (HBASE-9865) WALEdit.heapSize() is incorrect in certain replication scenarios which may cause RegionServers to go OOM

2013-10-31 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-9865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Latham updated HBASE-9865: --- Labels: (was: Repli) WALEdit.heapSize() is incorrect in certain replication scenarios which may

[jira] [Commented] (HBASE-9865) WALEdit.heapSize() is incorrect in certain replication scenarios which may cause RegionServers to go OOM

2013-10-31 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-9865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13810782#comment-13810782 ] Dave Latham commented on HBASE-9865: If we only recycle the kvs arrays during

[jira] [Commented] (HBASE-9865) WALEdit.heapSize() is incorrect in certain replication scenarios which may cause RegionServers to go OOM

2013-11-01 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-9865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13811426#comment-13811426 ] Dave Latham commented on HBASE-9865: [~jdcryans] Would love to hear your thoughts if

[jira] [Created] (HBASE-9888) HBase replicates edits written before the replication peer is created

2013-11-04 Thread Dave Latham (JIRA)
Dave Latham created HBASE-9888: -- Summary: HBase replicates edits written before the replication peer is created Key: HBASE-9888 URL: https://issues.apache.org/jira/browse/HBASE-9888 Project: HBase

[jira] [Commented] (HBASE-9865) WALEdit.heapSize() is incorrect in certain replication scenarios which may cause RegionServers to go OOM

2013-11-04 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-9865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13813072#comment-13813072 ] Dave Latham commented on HBASE-9865: Lars, you beat me to the punch on that read

[jira] [Commented] (HBASE-9865) WALEdit.heapSize() is incorrect in certain replication scenarios which may cause RegionServers to go OOM

2013-11-05 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-9865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13814247#comment-13814247 ] Dave Latham commented on HBASE-9865: Looks good to me. Thanks, Lars.

[jira] [Commented] (HBASE-9888) HBase replicates edits written before the replication peer is created

2013-11-06 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-9888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13815111#comment-13815111 ] Dave Latham commented on HBASE-9888: {quote} So in your case the replication was

[jira] [Commented] (HBASE-9888) HBase replicates edits written before the replication peer is created

2013-11-06 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-9888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13815337#comment-13815337 ] Dave Latham commented on HBASE-9888: {quote} Would it work to just do it in each RS

<    1   2   3   4   5   >