jichen20210919 opened a new pull request, #6694: URL: https://github.com/apache/paimon/pull/6694
…etween Paimon and Arrow formats. ### Purpose paimon-arrow module has a good design for paimon-arrow field type conversions, but the top level class has the fixed type conversions, in some use cases, developers may want to customize the field type conversion process to meet the use-case. <!-- Linking this pull request to the issue --> Linked issue: open #6693 <!-- What is the purpose of the change --> We propose improving customization capabilities for data type conversion between Paimon and Arrow formats.Below is the visions of the feature: 1. Enhanced Flexibility: Users can now provide custom type conversion logic for Paimon-to-Arrow and Arrow-to-Paimon transformations Support for custom field writer factories through ArrowFieldWriterFactoryVisitor Backward compatibility maintained with default visitor implementations 2. Improved Extensibility: Modular design allowing developers to customize specific aspects of the conversion pipeline Separation of concerns through visitor pattern implementation No breaking changes to existing API usage ### Tests <!-- List UT and IT cases to verify this change --> add testCustomArrowFormatWriter. ### API and Format <!-- Does this change affect API or storage format --> No ### Documentation <!-- Does this change introduce a new feature --> No -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
