[
https://issues.apache.org/jira/browse/AVRO-1760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15033676#comment-15033676
]
Zoltan Farkas commented on AVRO-1760:
-------------------------------------
Guava Cache scalability is not exactly stellar, see
https://github.com/google/guava/issues/1634 for more detail.
Try to use a backport of JDK 1.8 ConcurrentHashMap (compute* methods)
or something like:
https://github.com/zolyfarkas/spf4j/blob/master/spf4j-core/src/main/java/org/spf4j/concurrent/UnboundedLoadingCache.java
For your benchmarks use JMH (http://openjdk.java.net/projects/code-tools/jmh/)
or something similar... will increase the probability that you will make the
right choice.
> Thread scalability problem with the use of SynchronizedMap
> ----------------------------------------------------------
>
> Key: AVRO-1760
> URL: https://issues.apache.org/jira/browse/AVRO-1760
> Project: Avro
> Issue Type: Improvement
> Components: java
> Affects Versions: 1.7.4, 1.7.5, 1.7.6, 1.7.7, 1.8.0, 1.8.1, 1.9.0
> Reporter: Mulugeta Mammo
> Priority: Critical
> Labels: patch, performance
> Fix For: 1.7.4, 1.7.5, 1.7.6, 1.7.7, 1.7.8, 1.8.0, 1.8.1, 1.9.0
>
> Attachments: AVRO-1760.patch, AVRO-1760.pdf
>
>
> While running Adam Genomics (which uses Avro) on Apache Spark, we discovered
> that threads (tasks in Spark Context) block in Avro while executing the
> getDefaultValue(Field field) method in
> https://github.com/apache/avro/blob/trunk/lang/java/avro/src/main/java/org/apache/avro/generic/GenericData.java
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
