[GitHub] [arrow] BryanCutler commented on pull request #7702: ARROW-9395: [Python] allow configuring MetadataVersion

2020-07-12 Thread GitBox
BryanCutler commented on pull request #7702: URL: https://github.com/apache/arrow/pull/7702#issuecomment-657288029 >The only place in Arrow/Java where the metadata version gets checked is in MessageSerializer.deserializeMessageBatch, which only gets used in a unit test and isn't used in Sp

[GitHub] [arrow] BryanCutler commented on pull request #7702: ARROW-9395: [Python] allow configuring MetadataVersion

2020-07-10 Thread GitBox
BryanCutler commented on pull request #7702: URL: https://github.com/apache/arrow/pull/7702#issuecomment-656949654 Thanks for doing this @lidavidm ! I believe this will be necessary for a PySpark v2.4.x or v3.0.0 user that upgrades to PyArrow 1.0.0. It would be good to setup the spark inte