askoa commented on issue #3460:
URL: https://github.com/apache/arrow-rs/issues/3460#issuecomment-1374169123
The `*.stream` files are used in Archery integration tests. Though
`1.0.0-littleendian` folder is skipped for Rust, the files that are being
tested gives insight on how non-canonical field names are handled. In Rust, a
function named `canonicalize_schema` strips away any non-canonical names from
the schemas before validation.
- One solution is to use the function `canonicalize_schema` before
comparing schemas. I checked Java and Go validations, they have custom JSON
parser which pretty much does same thing.
- Other approach is to enable Archery tests for Rust for littleendian
folder and remove the tests from the newly written integration tests.
##### 1.0.0-littleendian folder is skipped:
https://github.com/apache/arrow/blob/a580f2711750ef507cc57ce48cb431dd700a6166/dev/archery/archery/integration/runner.py#L135-L139
##### canonicalize_schema:
https://github.com/apache/arrow-rs/blob/d325ad2d0f2b39972d1b299479d06c5fd9a41d42/arrow-integration-testing/src/bin/arrow-json-integration-test.rs#L115
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
