Dian Fu created FLINK-14020:
-------------------------------

             Summary: User Apache Arrow as the serializer for data transmission 
between Java operator and Python harness
                 Key: FLINK-14020
                 URL: https://issues.apache.org/jira/browse/FLINK-14020
             Project: Flink
          Issue Type: Sub-task
          Components: API / Python
            Reporter: Dian Fu
             Fix For: 1.10.0


Apache Arrow is "a cross-language development platform for in-memory data. It 
specifies a standardized language-independent columnar memory format for flat 
and hierarchical data, organized for efficient analytic operations on modern 
hardware". It has been widely used in many notable projects, such as Spark, 
Parquet, Pandas, etc. We could make use of Arrow as the data serializer between 
Java operator and Python harness.



--
This message was sent by Atlassian Jira
(v8.3.2#803003)

Reply via email to