[jira] [Updated] (HBASE-7239) Verify protobuf serialization is correctly chunking upon read to avoid direct memory OOMs
[ https://issues.apache.org/jira/browse/HBASE-7239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das updated HBASE-7239: --- Resolution: Fixed Assignee: Devaraj Das Status: Resolved (was: Patch Available) Committed to 0.95 and trunk. Thanks for reviewing, Stack. > Verify protobuf serialization is correctly chunking upon read to avoid direct > memory OOMs > - > > Key: HBASE-7239 > URL: https://issues.apache.org/jira/browse/HBASE-7239 > Project: HBase > Issue Type: Sub-task >Reporter: Lars Hofhansl >Assignee: Devaraj Das >Priority: Critical > Fix For: 0.95.1 > > Attachments: 7239-1.patch > > > Result.readFields() used to read from the input stream in 8k chunks to avoid > OOM issues with direct memory. > (Reading variable sized chunks into direct memory prevent the JVM from > reusing the allocated direct memory and direct memory is only collected > during full GCs) > This is just to verify protobufs parseFrom type methods do the right thing as > well so that we do not reintroduce this problem. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-7239) Verify protobuf serialization is correctly chunking upon read to avoid direct memory OOMs
[ https://issues.apache.org/jira/browse/HBASE-7239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das updated HBASE-7239: --- Status: Patch Available (was: Open) Let's see what hadoopqa says. > Verify protobuf serialization is correctly chunking upon read to avoid direct > memory OOMs > - > > Key: HBASE-7239 > URL: https://issues.apache.org/jira/browse/HBASE-7239 > Project: HBase > Issue Type: Sub-task >Reporter: Lars Hofhansl >Priority: Critical > Fix For: 0.95.1 > > Attachments: 7239-1.patch > > > Result.readFields() used to read from the input stream in 8k chunks to avoid > OOM issues with direct memory. > (Reading variable sized chunks into direct memory prevent the JVM from > reusing the allocated direct memory and direct memory is only collected > during full GCs) > This is just to verify protobufs parseFrom type methods do the right thing as > well so that we do not reintroduce this problem. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-7239) Verify protobuf serialization is correctly chunking upon read to avoid direct memory OOMs
[ https://issues.apache.org/jira/browse/HBASE-7239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das updated HBASE-7239: --- Attachment: 7239-1.patch Patch that mimics what was done in the 0.94 codebase for Result class. > Verify protobuf serialization is correctly chunking upon read to avoid direct > memory OOMs > - > > Key: HBASE-7239 > URL: https://issues.apache.org/jira/browse/HBASE-7239 > Project: HBase > Issue Type: Sub-task >Reporter: Lars Hofhansl >Priority: Critical > Fix For: 0.95.1 > > Attachments: 7239-1.patch > > > Result.readFields() used to read from the input stream in 8k chunks to avoid > OOM issues with direct memory. > (Reading variable sized chunks into direct memory prevent the JVM from > reusing the allocated direct memory and direct memory is only collected > during full GCs) > This is just to verify protobufs parseFrom type methods do the right thing as > well so that we do not reintroduce this problem. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-7239) Verify protobuf serialization is correctly chunking upon read to avoid direct memory OOMs
[ https://issues.apache.org/jira/browse/HBASE-7239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack updated HBASE-7239: - Priority: Critical (was: Major) > Verify protobuf serialization is correctly chunking upon read to avoid direct > memory OOMs > - > > Key: HBASE-7239 > URL: https://issues.apache.org/jira/browse/HBASE-7239 > Project: HBase > Issue Type: Sub-task >Reporter: Lars Hofhansl >Priority: Critical > Fix For: 0.96.0 > > > Result.readFields() used to read from the input stream in 8k chunks to avoid > OOM issues with direct memory. > (Reading variable sized chunks into direct memory prevent the JVM from > reusing the allocated direct memory and direct memory is only collected > during full GCs) > This is just to verify protobufs parseFrom type methods do the right thing as > well so that we do not reintroduce this problem. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira