dongjoon-hyun commented on issue #1840:
URL: https://github.com/apache/orc/issues/1840#issuecomment-1991938898
Here are my thoughts.
1. **Mismatched Versions**: Apache ORC community intentionally aligns the
dev cycles with Apache Spark. In principle, both Apache Spark and ORC community
don't recommend to use Apache ORC 1.8 with Spark 3.3 because it's beyond of the
community test coverage.
- Apache ORC 1.7.x -> Apache Spark 3.3.x
- Apache ORC 1.8.x -> Apache Spark 3.4.x
- Apache ORC 1.9.x -> Apache Spark 3.5.x
- Apache ORC 2.0.x -> Apache Spark 4.0.x
2. **End-Of-Life**: Apache Spark 3.3 is in the end of support status and I
was the release manager for that EOL release (Apache Spark 3.3.4). Apache ORC
has been supporting Apache ORC 1.7.x and will reach the EOL in six months. Only
one or two bug fixes are expected (if exists.)
- https://spark.apache.org/releases/spark-release-3-3-4.html
- https://orc.apache.org/releases/
Given that (1) and (2), I don't think that there is a way for both Apache
Spark and ORC community's next release to be able to help you officially. Since
you are on your own build currently, my recommendation is that you can
cherry-pick and try it with your own risks.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
