Qing Cai created IMPALA-10708:
---------------------------------
Summary: Expose FileReader/FileWriter Interface to allow user
define implement to improve io performance
Key: IMPALA-10708
URL: https://issues.apache.org/jira/browse/IMPALA-10708
Project: IMPALA
Issue Type: New Feature
Components: Backend
Reporter: Qing Cai
Currently, Impala only supports Hadoop FileSystem base FS and reads it via
java, if a filesystem is not HDFS, it will get bad performance because can't
use shortcircuit. to improve performance I want to implement a c++ reader and
writer.
# add a new flag to the config io plugin
# add io plugin manage, to dynamic load user lib and keep a memory mapping,
schema-> implement
# if some fs implement reader or writer, use the implement to read/writer data
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
