[
https://issues.apache.org/jira/browse/AVRO-557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Doug Cutting updated AVRO-557:
------------------------------
Attachment: AVRO-557.patch
Here's a new version that incorporates Scott's improved benchmarks. It also
uses a ThreadLocal for the cache instead of synchronization, for better thread
scalability.
Before:
{code}
GenericReaderTest: 9267 ms, 0.4496015202175007 million entries/sec.
17.44851002390717 million bytes/sec
GenericReaderOneTimeUseReaderTest: 20250 ms, 0.2057450903019226 million
entries/sec. 7.985813094572571 million bytes/sec
GenericReaderOneTimeUseDecoderTest: 9712 ms, 0.4289618484945668 million
entries/sec. 16.649207221055114 million bytes/sec
GenericReaderOneTimeUseTest: 22072 ms, 0.18876675392721157 million entries/sec.
7.325522819121037 million bytes/sec
{code}
After:
{code}
GenericReaderTest: 1333 ms, 3.123353146179524 million entries/sec.
121.19457294433288 million bytes/sec
GenericReaderOneTimeUseReaderTest: 2132 ms, 1.9538027524398502 million
entries/sec. 75.83652675628883 million bytes/sec
GenericReaderOneTimeUseDecoderTest: 1410 ms, 2.954731932450708 million
entries/sec. 114.68139742190509 million bytes/sec
GenericReaderOneTimeUseTest: 2064 ms, 2.0183186700653284 million entries/sec.
78.33658376373683 million bytes/sec
{code}
> Speed up one-time data decoding
> -------------------------------
>
> Key: AVRO-557
> URL: https://issues.apache.org/jira/browse/AVRO-557
> Project: Avro
> Issue Type: Improvement
> Components: java
> Affects Versions: 1.3.2
> Reporter: Kevin Oliver
> Assignee: Doug Cutting
> Fix For: 1.4.0
>
> Attachments: AVRO-557-partial.patch, AVRO-557.patch, AVRO-557.patch,
> AVRO-557.patch, AVRO-557.patch, AVRO-557.patch
>
>
> There are big gains to be had in performance when using a BinaryDecoder and a
> GenericDatumReader just one time. This is due to the relatively expensive
> parsing and initialization that came with 1.3. Patch with example code and a
> Perf harness to follow.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
