Github user Fokko commented on the issue:
https://github.com/apache/spark/pull/21596
@MaxGekk I've reran the benchmarks as you asked. The first run to set the
baseline based on master:
https://github.com/apache/spark/pull/21596/commits/32ec12bdfe1fd9377c0f4037942da9e2a49e8f9a
And after switching to Jackson 2.9.6:
https://github.com/Fokko/spark/blob/8dbc310ac6a8bcd2eb9f583b0a9990f9bed2aea0/sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/json/JsonBenchmarks.scala
@gatorsmile One of the reasons is mentioned in the starting post. I have to
add exclusions to the Cosmos Spark connector because the Spark Jackson version
is lagging behind. Would be nice to keep a bit up.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
