[jira] [Commented] (HBASE-20588) Space quota change after quota violation doesn't seem to take in effect

2018-05-20 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16482174#comment-16482174 ] Anoop Sam John commented on HBASE-20588: The data is pushed until reach the quota and then LIMIT

[jira] [Commented] (HBASE-20602) hbase.master.quota.observer.ignore property seems to be not taking effect

2018-05-20 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16482164#comment-16482164 ] Anoop Sam John commented on HBASE-20602: Once dropped the table, create the same once more and

[jira] [Commented] (HBASE-20460) Doc offheap write-path

2018-05-17 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16479395#comment-16479395 ] Anoop Sam John commented on HBASE-20460: Also will add one more line. The max off heap size in

[jira] [Commented] (HBASE-20460) Doc offheap write-path

2018-05-17 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16479352#comment-16479352 ] Anoop Sam John commented on HBASE-20460: Hi [~stack].. How abt below details? In hbase-2.0.0,

[jira] [Commented] (HBASE-20480) Multiple one-time cell objects are allocated and de-allocated when working with CCM

2018-05-11 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16472111#comment-16472111 ] Anoop Sam John commented on HBASE-20480: bq.We suggest to use and reuse the ThreadLocal variables

[jira] [Commented] (HBASE-20564) Tighter ByteBufferKeyValue Cell Comparator

2018-05-11 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16471631#comment-16471631 ] Anoop Sam John commented on HBASE-20564: I can see the changes in the Comparator and do the type

[jira] [Commented] (HBASE-20516) Offheap read-path needs more detail

2018-05-09 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16468657#comment-16468657 ] Anoop Sam John commented on HBASE-20516: bq. bc.deloy.modes -> Typo Looks good Stack. We can get

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-05-08 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16467239#comment-16467239 ] Anoop Sam John commented on HBASE-20188: [~eshcar] That is excellent observation. Ya we can

[jira] [Commented] (HBASE-20523) PE tool should support configuring client side buffering sizes

2018-05-03 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16463394#comment-16463394 ] Anoop Sam John commented on HBASE-20523: '--clientSideBufferSize' Just call it bufferSize as PE

[jira] [Commented] (HBASE-20281) [DOC] upgrade section needs an explanation of changes to Bucket Cache

2018-05-03 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16462007#comment-16462007 ] Anoop Sam John commented on HBASE-20281: The config related to combined mode is still valid for

[jira] [Commented] (HBASE-20485) Copy constructor of Scan doesn't copy the readType and replicaId

2018-04-25 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16452516#comment-16452516 ] Anoop Sam John commented on HBASE-20485: Nice.. I too thought of having a reflection based UT

[jira] [Updated] (HBASE-20485) Copy constructor of Scan doesn't copy the readType

2018-04-24 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anoop Sam John updated HBASE-20485: --- Priority: Minor (was: Trivial) > Copy constructor of Scan doesn't copy the readType >

[jira] [Commented] (HBASE-20485) Copy constructor of Scan doesn't copy the readType

2018-04-24 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16451601#comment-16451601 ] Anoop Sam John commented on HBASE-20485: We should add a UT in testScan to make sure all fields

[jira] [Commented] (HBASE-20483) [PERFORMANCE] Flushing is 2x slower in hbase2.

2018-04-24 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16451592#comment-16451592 ] Anoop Sam John commented on HBASE-20483: In 1.x we have CollectionBackedScanner scanner (very

[jira] [Commented] (HBASE-20483) [PERFORMANCE] Flushing is 2x slower in hbase2.

2018-04-24 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16451448#comment-16451448 ] Anoop Sam John commented on HBASE-20483: Assign to me boss? > [PERFORMANCE] Flushing is 2x

[jira] [Commented] (HBASE-20411) Ameliorate MutableSegment synchronize

2018-04-23 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16449306#comment-16449306 ] Anoop Sam John commented on HBASE-20411: Ya pls put the patch here. If you have an E2E patch, I

[jira] [Commented] (HBASE-20411) Ameliorate MutableSegment synchronize

2018-04-23 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16449305#comment-16449305 ] Anoop Sam John commented on HBASE-20411: Discussing with Stack offline. - The issue will be

[jira] [Commented] (HBASE-20447) Only fail cacheBlock if block collisions aren't related to next block metadata

2018-04-21 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16446906#comment-16446906 ] Anoop Sam John commented on HBASE-20447: {code} if (backingMap.containsKey(cacheKey) ||

[jira] [Comment Edited] (HBASE-20471) Recheck the design and implementation of FSYNC_WAL durability for WAL

2018-04-21 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16446714#comment-16446714 ] Anoop Sam John edited comment on HBASE-20471 at 4/21/18 9:31 AM: - Yes I

[jira] [Commented] (HBASE-20471) Recheck the design and implementation of FSYNC_WAL durability for WAL

2018-04-21 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16446714#comment-16446714 ] Anoop Sam John commented on HBASE-20471: As a 1st step, at least we should write all these known

[jira] [Commented] (HBASE-20471) Recheck the design and implementation of FSYNC_WAL durability for WAL

2018-04-21 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16446699#comment-16446699 ] Anoop Sam John commented on HBASE-20471: bq.Instead, we allow user to set the cluster-level way

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-20 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16446063#comment-16446063 ] Anoop Sam John commented on HBASE-20188: See this one Stack {code} public void

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-20 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16446035#comment-16446035 ] Anoop Sam John commented on HBASE-20188: We can have sub tasks for write perf issue and read perf

[jira] [Commented] (HBASE-19024) Configurable default durability for synchronous WAL

2018-04-20 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16446006#comment-16446006 ] Anoop Sam John commented on HBASE-19024: Good one Yu. Missed this point. Only at the batch

[jira] [Commented] (HBASE-20281) [DOC] upgrade section needs an explanation of changes to Bucket Cache

2018-04-20 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16445362#comment-16445362 ] Anoop Sam John commented on HBASE-20281: hbase.bucketcache.ioengine changes are there. That we

[jira] [Commented] (HBASE-20059) Make sure documentation is updated for the offheap Bucket cache usage

2018-04-19 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16445287#comment-16445287 ] Anoop Sam John commented on HBASE-20059: Thanks Stack. > Make sure documentation is updated for

[jira] [Commented] (HBASE-20281) [DOC] upgrade section needs an explanation of changes to Bucket Cache

2018-04-19 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16445285#comment-16445285 ] Anoop Sam John commented on HBASE-20281: Patch in HBASE-20059 handles this. > [DOC] upgrade

[jira] [Commented] (HBASE-20457) Return immediately for a scan rpc call when we want to switch from pread to stream

2018-04-19 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16444048#comment-16444048 ] Anoop Sam John commented on HBASE-20457: Good find over in HBASE-20188. This will be an issue

[jira] [Comment Edited] (HBASE-20188) [TESTING] Performance

2018-04-18 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16440606#comment-16440606 ] Anoop Sam John edited comment on HBASE-20188 at 4/19/18 3:46 AM: - PE

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-18 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16441981#comment-16441981 ] Anoop Sam John commented on HBASE-20188: This flush change is visible in 2.0.0 not only

[jira] [Comment Edited] (HBASE-20188) [TESTING] Performance

2018-04-17 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16440606#comment-16440606 ] Anoop Sam John edited comment on HBASE-20188 at 4/17/18 8:41 AM: - PE

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-17 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16440606#comment-16440606 ] Anoop Sam John commented on HBASE-20188: PE command hbase

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-17 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16440561#comment-16440561 ] Anoop Sam John commented on HBASE-20188: With PE (batched writes) , 2.0.0 write only case is way

[jira] [Commented] (HBASE-20059) Make sure documentation is updated for the offheap Bucket cache usage

2018-04-16 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16439044#comment-16439044 ] Anoop Sam John commented on HBASE-20059: Addressed your comments Stack. The write path off

[jira] [Updated] (HBASE-20059) Make sure documentation is updated for the offheap Bucket cache usage

2018-04-16 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anoop Sam John updated HBASE-20059: --- Attachment: HBASE-20059_V2.patch > Make sure documentation is updated for the offheap Bucket

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-12 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16435998#comment-16435998 ] Anoop Sam John commented on HBASE-20188: I tried to test the write perf using PE RandomWrite

[jira] [Updated] (HBASE-20374) End point Coprocessors do not integrate with AccessController/ VisibilityController

2018-04-09 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anoop Sam John updated HBASE-20374: --- Summary: End point Coprocessors do not integrate with AccessController/ VisibilityController

[jira] [Commented] (HBASE-20182) Can not locate region after split and merge

2018-04-08 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16430024#comment-16430024 ] Anoop Sam John commented on HBASE-20182: bq.RegionOfflineException for a split parent any more,

[jira] [Commented] (HBASE-20329) Add note for operators to refguide on AsyncFSWAL

2018-04-07 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16429277#comment-16429277 ] Anoop Sam John commented on HBASE-20329: As the subject says AsyncFSWAL and you mentioned abt the

[jira] [Commented] (HBASE-20350) NullPointerException in Scanner during close()

2018-04-06 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16429192#comment-16429192 ] Anoop Sam John commented on HBASE-20350: I too thought about the iterator way of closing

[jira] [Commented] (HBASE-20059) Make sure documentation is updated for the offheap Bucket cache usage

2018-04-06 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16429190#comment-16429190 ] Anoop Sam John commented on HBASE-20059: Yes Stack. Both these jiras getting addressed with this

[jira] [Commented] (HBASE-20059) Make sure documentation is updated for the offheap Bucket cache usage

2018-04-05 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16426767#comment-16426767 ] Anoop Sam John commented on HBASE-20059: [~stack] > Make sure documentation is updated for the

[jira] [Updated] (HBASE-20059) Make sure documentation is updated for the offheap Bucket cache usage

2018-04-05 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anoop Sam John updated HBASE-20059: --- Attachment: HBASE-20059.patch > Make sure documentation is updated for the offheap Bucket

[jira] [Commented] (HBASE-20329) Add note for operators to refguide on AsyncFSWAL

2018-04-04 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16426415#comment-16426415 ] Anoop Sam John commented on HBASE-20329: passing the WAL provder -> provider written concurrentl

[jira] [Commented] (HBASE-20329) Add note for operators to refguide on AsyncFSWAL

2018-04-04 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16426413#comment-16426413 ] Anoop Sam John commented on HBASE-20329: I see the patch now.. We edit the Durability stuff also

[jira] [Commented] (HBASE-20329) Add note for operators to refguide on AsyncFSWAL

2018-04-04 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16426410#comment-16426410 ] Anoop Sam John commented on HBASE-20329: That Q was not really on the new WAL impl 'AsyncFSWAL'.

[jira] [Commented] (HBASE-20280) Fix possibility of deadlocking in refreshFileConnections when prefetch is enabled

2018-03-27 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16415937#comment-16415937 ] Anoop Sam John commented on HBASE-20280: +1 > Fix possibility of deadlocking in

[jira] [Commented] (HBASE-20280) Fix possibility of deadlocking in refreshFileConnections when prefetch is enabled

2018-03-27 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16415300#comment-16415300 ] Anoop Sam John commented on HBASE-20280: The new fix of reopen channel making the possible dead

[jira] [Commented] (HBASE-20003) WALLess HBase on Persistent Memory

2018-03-26 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16414122#comment-16414122 ] Anoop Sam John commented on HBASE-20003: bq.on WAL replay , if the data come back, the data will

[jira] [Commented] (HBASE-20003) WALLess HBase on Persistent Memory

2018-03-26 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16414120#comment-16414120 ] Anoop Sam John commented on HBASE-20003: bq.What is the advantage to still use HDFS here? Sorry I

[jira] [Commented] (HBASE-20003) WALLess HBase on Persistent Memory

2018-03-26 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16413621#comment-16413621 ] Anoop Sam John commented on HBASE-20003: [~chancelq] Yes in the case you mentioned the 2

[jira] [Commented] (HBASE-20281) [DOC] upgrade section needs an explanation of changes to Bucket Cache

2018-03-25 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16412989#comment-16412989 ] Anoop Sam John commented on HBASE-20281: As part of another issue under HBASE-11425 am changing

[jira] [Updated] (HBASE-20284) BucketCache reduce heap overhead : Investigate removal of NavigableSet 'blocksByHFile'

2018-03-25 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anoop Sam John updated HBASE-20284: --- Summary: BucketCache reduce heap overhead : Investigate removal of NavigableSet

[jira] [Created] (HBASE-20284) Reduce heap overhead : Investigate removal of NavigableSet 'blocksByHFile'

2018-03-25 Thread Anoop Sam John (JIRA)
Anoop Sam John created HBASE-20284: -- Summary: Reduce heap overhead : Investigate removal of NavigableSet 'blocksByHFile' Key: HBASE-20284 URL: https://issues.apache.org/jira/browse/HBASE-20284

[jira] [Updated] (HBASE-17819) Reduce the heap overhead for BucketCache

2018-03-25 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anoop Sam John updated HBASE-17819: --- Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch

[jira] [Commented] (HBASE-17819) Reduce the heap overhead for BucketCache

2018-03-23 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16411789#comment-16411789 ] Anoop Sam John commented on HBASE-17819: Thanks Stack.. Will commit after the QA for the latest

[jira] [Updated] (HBASE-17819) Reduce the heap overhead for BucketCache

2018-03-23 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anoop Sam John updated HBASE-17819: --- Attachment: HBASE-17819_new_V2.patch > Reduce the heap overhead for BucketCache >

[jira] [Commented] (HBASE-20003) WALLess HBase on Persistent Memory

2018-03-23 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16410883#comment-16410883 ] Anoop Sam John commented on HBASE-20003: Added a link to the google doc where we explain the high

[jira] [Commented] (HBASE-17819) Reduce the heap overhead for BucketCache

2018-03-22 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16410827#comment-16410827 ] Anoop Sam John commented on HBASE-17819: Stack, I tested it in my 64 bit JVM in linux box using

[jira] [Commented] (HBASE-17819) Reduce the heap overhead for BucketCache

2018-03-22 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16410828#comment-16410828 ] Anoop Sam John commented on HBASE-17819: bq.Since the incrementRefCount method returns the new

[jira] [Commented] (HBASE-20204) Add locking to RefreshFileConnections in BucketCache

2018-03-22 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16410726#comment-16410726 ] Anoop Sam John commented on HBASE-20204: +1. And +1 for branch-2.0 also. Better to have a

[jira] [Resolved] (HBASE-17383) Improve log msg when offheap memstore breaches higher water mark

2018-03-22 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anoop Sam John resolved HBASE-17383. Resolution: Cannot Reproduce Assignee: (was: ramkrishna.s.vasudevan) No longer

[jira] [Commented] (HBASE-20234) Expose in-memory compaction metrics

2018-03-20 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16407478#comment-16407478 ] Anoop Sam John commented on HBASE-20234: It will be good to see info abt Compacting Memstore like

[jira] [Commented] (HBASE-19024) Configurable default durability for synchronous WAL

2018-03-20 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16407440#comment-16407440 ] Anoop Sam John commented on HBASE-19024: Raise an issue for the asyncwal [~apurtell] ,

[jira] [Updated] (HBASE-20229) ConnectionImplementation.locateRegions() doesn't work correctly when region replication is on

2018-03-20 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anoop Sam John updated HBASE-20229: --- Fix Version/s: 2.0.0 > ConnectionImplementation.locateRegions() doesn't work correctly when

[jira] [Commented] (HBASE-20229) ConnectionImplementation.locateRegions() doesn't work correctly when region replication is on

2018-03-20 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16407434#comment-16407434 ] Anoop Sam John commented on HBASE-20229: So the issue is duplicated entries in the List been

[jira] [Commented] (HBASE-20229) ConnectionImplementation.locateRegions() doesn't work correctly when region replication is on

2018-03-20 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16406752#comment-16406752 ] Anoop Sam John commented on HBASE-20229: What is the issue you are facing? Any chance for a test

[jira] [Commented] (HBASE-19639) ITBLL can't go big because RegionTooBusyException... Above memstore limit

2018-03-20 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16406740#comment-16406740 ] Anoop Sam John commented on HBASE-19639: For us the default memstore global size is 40% and BC is

[jira] [Comment Edited] (HBASE-19639) ITBLL can't go big because RegionTooBusyException... Above memstore limit

2018-03-20 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16406149#comment-16406149 ] Anoop Sam John edited comment on HBASE-19639 at 3/20/18 11:14 AM: -- Ya

[jira] [Commented] (HBASE-19639) ITBLL can't go big because RegionTooBusyException... Above memstore limit

2018-03-20 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16406149#comment-16406149 ] Anoop Sam John commented on HBASE-19639: Ya seems pool is there and the log formatting having an

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-03-20 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16406107#comment-16406107 ] Anoop Sam John commented on HBASE-20188: Yes MSLAB is ON by default from years. The pool is also

[jira] [Commented] (HBASE-19639) ITBLL can't go big because RegionTooBusyException... Above memstore limit

2018-03-20 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16406071#comment-16406071 ] Anoop Sam John commented on HBASE-19639: MSLAB with 100% pool is the default for 2.0. > ITBLL

[jira] [Commented] (HBASE-17819) Reduce the heap overhead for BucketCache

2018-03-19 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16405769#comment-16405769 ] Anoop Sam John commented on HBASE-17819: It is now 1.64 GB. This patch as such reduces only 16

[jira] [Updated] (HBASE-17819) Reduce the heap overhead for BucketCache

2018-03-19 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anoop Sam John updated HBASE-17819: --- Attachment: HBASE-17819_new_V1.patch > Reduce the heap overhead for BucketCache >

[jira] [Commented] (HBASE-19639) ITBLL can't go big because RegionTooBusyException... Above memstore limit

2018-03-19 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16405105#comment-16405105 ] Anoop Sam John commented on HBASE-19639: bq.I don't follow. 4x is the default. You suggesting we

[jira] [Commented] (HBASE-19639) ITBLL can't go big because RegionTooBusyException... Above memstore limit

2018-03-19 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16404679#comment-16404679 ] Anoop Sam John commented on HBASE-19639: I some how ended up adding below comment into

[jira] [Commented] (HBASE-20151) Bug with SingleColumnValueFilter and FamilyFilter

2018-03-19 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16404603#comment-16404603 ] Anoop Sam John commented on HBASE-20151: Yes that was mentioned in my first comment. Thought we

[jira] [Updated] (HBASE-17819) Reduce the heap overhead for BucketCache

2018-03-19 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anoop Sam John updated HBASE-17819: --- Status: Patch Available (was: In Progress) > Reduce the heap overhead for BucketCache >

[jira] [Commented] (HBASE-17819) Reduce the heap overhead for BucketCache

2018-03-19 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16404562#comment-16404562 ] Anoop Sam John commented on HBASE-17819: Latest patch attached. This does not try to remove the

[jira] [Updated] (HBASE-17819) Reduce the heap overhead for BucketCache

2018-03-19 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anoop Sam John updated HBASE-17819: --- Attachment: HBASE-17819_new_V1.patch > Reduce the heap overhead for BucketCache >

[jira] [Updated] (HBASE-17819) Reduce the heap overhead for BucketCache

2018-03-19 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anoop Sam John updated HBASE-17819: --- Description: We keep Bucket entry map in BucketCache. Below is the math for heapSize for

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-03-19 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16404443#comment-16404443 ] Anoop Sam John commented on HBASE-20188: Oh I think I have done a mistake here. This issue was

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-03-19 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16404441#comment-16404441 ] Anoop Sam John commented on HBASE-20188: I see.. no worries Yu.. I was just speaking from the

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-03-19 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16404407#comment-16404407 ] Anoop Sam John commented on HBASE-20188: bq.If having CMS makes the actual flush to cost more

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-03-18 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16404379#comment-16404379 ] Anoop Sam John commented on HBASE-20188: FYI [~carp84] Off heaping is not default ON. So in

[jira] [Commented] (HBASE-20090) Properly handle Preconditions check failure in MemStoreFlusher$FlushHandler.run

2018-03-18 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16404377#comment-16404377 ] Anoop Sam John commented on HBASE-20090: +1 > Properly handle Preconditions check failure in >

[jira] [Commented] (HBASE-20196) Maintain all regions with same size in memstore flusher

2018-03-18 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16403942#comment-16403942 ] Anoop Sam John commented on HBASE-20196: +1 > Maintain all regions with same size in memstore

[jira] [Commented] (HBASE-19024) provide a configurable option to hsync WAL edits to the disk for better durability

2018-03-17 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16403838#comment-16403838 ] Anoop Sam John commented on HBASE-19024: +1 for doing asyncfswal stuff in another jira. Just can

[jira] [Comment Edited] (HBASE-20188) [TESTING] Performance

2018-03-17 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16403836#comment-16403836 ] Anoop Sam John edited comment on HBASE-20188 at 3/18/18 2:19 AM: - In

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-03-17 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16403836#comment-16403836 ] Anoop Sam John commented on HBASE-20188: In tests, we try flush to SDD or HDD boss? In writes we

[jira] [Commented] (HBASE-19024) provide a configurable option to hsync WAL edits to the disk for better durability

2018-03-17 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16403324#comment-16403324 ] Anoop Sam John commented on HBASE-19024: setForceSync - to be forceSync ? isForceSync - Not

[jira] [Commented] (HBASE-20197) Review of ByteBufferWriterOutputStream.java

2018-03-16 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16401523#comment-16401523 ] Anoop Sam John commented on HBASE-20197: +1 for patch V5. Ping [~ram_krish],

[jira] [Commented] (HBASE-20197) Review of ByteBufferWriterOutputStream.java

2018-03-15 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16400754#comment-16400754 ] Anoop Sam John commented on HBASE-20197: Good analysis and find on the issue with Unsafe#copy..

[jira] [Commented] (HBASE-20197) Review of ByteBufferWriterOutputStream.java

2018-03-15 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16400174#comment-16400174 ] Anoop Sam John commented on HBASE-20197: bq.if (len > TEMP_BUF_LENGTH) { Hmm that is bad.. We

[jira] [Comment Edited] (HBASE-20105) Allow flushes to target SSD storage

2018-03-15 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16400088#comment-16400088 ] Anoop Sam John edited comment on HBASE-20105 at 3/15/18 8:48 AM: - I see

[jira] [Comment Edited] (HBASE-20105) Allow flushes to target SSD storage

2018-03-15 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16400088#comment-16400088 ] Anoop Sam John edited comment on HBASE-20105 at 3/15/18 8:47 AM: - I see

[jira] [Comment Edited] (HBASE-20105) Allow flushes to target SSD storage

2018-03-15 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16400088#comment-16400088 ] Anoop Sam John edited comment on HBASE-20105 at 3/15/18 8:46 AM: - I see

[jira] [Commented] (HBASE-20105) Allow flushes to target SSD storage

2018-03-15 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16400088#comment-16400088 ] Anoop Sam John commented on HBASE-20105: I see that is an existing code. I was seeing how we

[jira] [Commented] (HBASE-20045) When running compaction, cache recent blocks.

2018-03-15 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1640#comment-1640 ] Anoop Sam John commented on HBASE-20045: You mean a block with ref cells to the cells in the

[jira] [Commented] (HBASE-11425) Cell/DBB end-to-end on the read-path

2018-03-14 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16398935#comment-16398935 ] Anoop Sam John commented on HBASE-11425: Nothing new very specific to the off heaping as such.

<    4   5   6   7   8   9   10   11   12   13   >