[ 
https://issues.apache.org/jira/browse/HUDI-410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16996460#comment-16996460
 ] 

Nishith Agarwal commented on HUDI-410:
--------------------------------------

At the moment, we can only stuff Avro inside a log block. Ideally, we want to 
get to state when we can stuff file formats like parquet and hfile - both 
useful for real-time queries and global index respectively. Once that’s 
possible, we want to be able to have semantics to read such formats out of the 
log file. A file system implementation that allows for such reading/writing to 
the log file would a good abstraction - calling that an in-line file system. 
@siva is working on this and has a WIP pr I believe 

> HFile inlining into the log file
> --------------------------------
>
>                 Key: HUDI-410
>                 URL: https://issues.apache.org/jira/browse/HUDI-410
>             Project: Apache Hudi (incubating)
>          Issue Type: Sub-task
>          Components: Index
>            Reporter: Nishith Agarwal
>            Priority: Major
>             Fix For: 0.5.2
>
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to