Github user dbtsai commented on the issue:
https://github.com/apache/spark/pull/21952
@cloud-fan as you suggested, I benchmarked cache read performance, and the
performance is the same. This makes sense, since it's unlikely that cache read
performance is that bad so we can see the impact on avro writing.
Spark 2.4
```
+-------+--------------------+
|summary| cacheRead|
+-------+--------------------+
| count| 100|
| mean|0.061929999999999985|
| stddev|0.002450541065795...|
| min| 0.059|
| max| 0.071|
+-------+--------------------+
```
Spark 2.3
```
+-------+-------------------+
|summary| cacheRead|
+-------+-------------------+
| count| 100|
| mean|0.06026999999999999|
| stddev|0.00201937584116449|
| min| 0.058|
| max| 0.069|
+-------+-------------------+
```
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
