[
https://issues.apache.org/jira/browse/FLINK-10929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16815207#comment-16815207
]
Fabian Hueske commented on FLINK-10929:
---------------------------------------
Hi [~fan_li_ya],
I think Arrow is a good building block for vectorized processing of batch
queries, which is what it was designed for and what your implementation is
doing.
With all the changes that are currently done on the Table API / SQL (API,
planner, runtime), adding such a feature needs to be well coordinated.
I'm not involved in those efforts, so it would be best to start a discussion
thread on the dev mailing list to gather some input there.
Best, Fabian
> Add support for Apache Arrow
> ----------------------------
>
> Key: FLINK-10929
> URL: https://issues.apache.org/jira/browse/FLINK-10929
> Project: Flink
> Issue Type: Wish
> Components: Runtime / State Backends
> Reporter: Pedro Cardoso Silva
> Priority: Minor
> Attachments: image-2019-04-10-13-43-08-107.png
>
>
> Investigate the possibility of adding support for Apache Arrow as a
> standardized columnar, memory format for data.
> Given the activity that [https://github.com/apache/arrow] is currently
> getting and its claims objective of providing a zero-copy, standardized data
> format across platforms, I think it makes sense for Flink to look into
> supporting it.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
