[ 
https://issues.apache.org/jira/browse/CALCITE-2173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16836862#comment-16836862
 ] 

Lai Zhou commented on CALCITE-2173:
-----------------------------------

[~masayuki038], I know what you mean. This Arrow adapter is just an adapter to 
connect the datasource in arrow format.

as you said, executing the query in parallel is a good way to improve 
performance. 

Another way is to organize the in-memory data in columnar format, enable 
vectorized expression execution.

Both of above two way need to rewrite the implementations of operators.

> Sample implementation of ArrowAdapter
> -------------------------------------
>
>                 Key: CALCITE-2173
>                 URL: https://issues.apache.org/jira/browse/CALCITE-2173
>             Project: Calcite
>          Issue Type: Improvement
>            Reporter: Masayuki Takahashi
>            Priority: Minor
>
> I try to implement Apache Arrow adaper.
> [https://github.com/masayuki038/calcite/tree/arrow2/arrow/src/main/java/org/apache/calcite/adapter/arrow]
> Issues:
> * Add ArrowJoin, ArrowUnion, etc..
> * This Arrow Adapter use org.apache.calcite.adapter.enumerable.PhysTypeImpl. 
> So I have added 'of' method on PhysType to create PhysTypeImpl instance since 
> it can't access from arrow package.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to