[jira] [Updated] (HBASE-7239) Verify protobuf serialization is correctly chunking upon read to avoid direct memory OOMs

2013-04-18 Thread Devaraj Das (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-7239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Devaraj Das updated HBASE-7239:
---

Resolution: Fixed
  Assignee: Devaraj Das
Status: Resolved  (was: Patch Available)

Committed to 0.95 and trunk. Thanks for reviewing, Stack.

> Verify protobuf serialization is correctly chunking upon read to avoid direct 
> memory OOMs
> -
>
> Key: HBASE-7239
> URL: https://issues.apache.org/jira/browse/HBASE-7239
> Project: HBase
>  Issue Type: Sub-task
>Reporter: Lars Hofhansl
>Assignee: Devaraj Das
>Priority: Critical
> Fix For: 0.95.1
>
> Attachments: 7239-1.patch
>
>
> Result.readFields() used to read from the input stream in 8k chunks to avoid 
> OOM issues with direct memory.
> (Reading variable sized chunks into direct memory prevent the JVM from 
> reusing the allocated direct memory and direct memory is only collected 
> during full GCs)
> This is just to verify protobufs parseFrom type methods do the right thing as 
> well so that we do not reintroduce this problem.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Updated] (HBASE-7239) Verify protobuf serialization is correctly chunking upon read to avoid direct memory OOMs

2013-04-18 Thread Devaraj Das (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-7239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Devaraj Das updated HBASE-7239:
---

Status: Patch Available  (was: Open)

Let's see what hadoopqa says.

> Verify protobuf serialization is correctly chunking upon read to avoid direct 
> memory OOMs
> -
>
> Key: HBASE-7239
> URL: https://issues.apache.org/jira/browse/HBASE-7239
> Project: HBase
>  Issue Type: Sub-task
>Reporter: Lars Hofhansl
>Priority: Critical
> Fix For: 0.95.1
>
> Attachments: 7239-1.patch
>
>
> Result.readFields() used to read from the input stream in 8k chunks to avoid 
> OOM issues with direct memory.
> (Reading variable sized chunks into direct memory prevent the JVM from 
> reusing the allocated direct memory and direct memory is only collected 
> during full GCs)
> This is just to verify protobufs parseFrom type methods do the right thing as 
> well so that we do not reintroduce this problem.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Updated] (HBASE-7239) Verify protobuf serialization is correctly chunking upon read to avoid direct memory OOMs

2013-04-17 Thread Devaraj Das (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-7239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Devaraj Das updated HBASE-7239:
---

Attachment: 7239-1.patch

Patch that mimics what was done in the 0.94 codebase for Result class.

> Verify protobuf serialization is correctly chunking upon read to avoid direct 
> memory OOMs
> -
>
> Key: HBASE-7239
> URL: https://issues.apache.org/jira/browse/HBASE-7239
> Project: HBase
>  Issue Type: Sub-task
>Reporter: Lars Hofhansl
>Priority: Critical
> Fix For: 0.95.1
>
> Attachments: 7239-1.patch
>
>
> Result.readFields() used to read from the input stream in 8k chunks to avoid 
> OOM issues with direct memory.
> (Reading variable sized chunks into direct memory prevent the JVM from 
> reusing the allocated direct memory and direct memory is only collected 
> during full GCs)
> This is just to verify protobufs parseFrom type methods do the right thing as 
> well so that we do not reintroduce this problem.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Updated] (HBASE-7239) Verify protobuf serialization is correctly chunking upon read to avoid direct memory OOMs

2012-11-29 Thread stack (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-7239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

stack updated HBASE-7239:
-

Priority: Critical  (was: Major)

> Verify protobuf serialization is correctly chunking upon read to avoid direct 
> memory OOMs
> -
>
> Key: HBASE-7239
> URL: https://issues.apache.org/jira/browse/HBASE-7239
> Project: HBase
>  Issue Type: Sub-task
>Reporter: Lars Hofhansl
>Priority: Critical
> Fix For: 0.96.0
>
>
> Result.readFields() used to read from the input stream in 8k chunks to avoid 
> OOM issues with direct memory.
> (Reading variable sized chunks into direct memory prevent the JVM from 
> reusing the allocated direct memory and direct memory is only collected 
> during full GCs)
> This is just to verify protobufs parseFrom type methods do the right thing as 
> well so that we do not reintroduce this problem.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira