willtemperley commented on PR #152: URL: https://github.com/apache/arrow-swift/pull/152#issuecomment-4152649988
@kou Unfortunately I believe Arrow Swift has serious architectural issues, as exemplified here, which is why I have gone ahead with an almost complete rewrite: [1] https://github.com/willtemperley/swift-arrow/ I have completely rewritten the type system, with the new version based on arrow-rs. In addition to the types supported by Arrow Swift I've added binary views and large-offset types. I've built a test harnesss that uses the Arrow-Gold files and it passes the folliowing gold tests, which includes a round-trip through pyarrow: "generated_binary", "generated_binary_no_batches", "generated_binary_view", "generated_binary_zerolength", "generated_custom_metadata", "generated_datetime", "generated_duplicate_fieldnames", "generated_nested", "generated_nested_large_offsets", "generated_recursive_nested", "generated_large_binary", "generated_map", "generated_duration", "generated_primitive", "generated_primitive_no_batches", "generated_primitive_zerolength", Also I've made the IPC zero-copy. Arrow swift currently copies all file data into in-memory buffers. Maybe we could come up with a roadmap to create an Arrow-Swift v2 using this work, but under the Apache umbrella. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
