lidavidm commented on pull request #7702:
URL: https://github.com/apache/arrow/pull/7702#issuecomment-657099127
I built Spark 3.0 with Arrow 0.15.1 (the default)
-> Python tests pass with PyArrow 0.17.1
-> Python tests pass with PyArrow from this PR with the environment variable
set
-> Python tests pass with PyArrow from this PR *without* the environment
variable set
The only place in Arrow/Java where the metadata version gets checked is in
`MessageSerializer.deserializeMessageBatch`, which only gets used in a unit
test and isn't used in Spark, so I suppose we got lucky ("lucky") here. Still,
having the options will be useful for systems that may actually check.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
