[
https://issues.apache.org/jira/browse/HUDI-1407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17685887#comment-17685887
]
Charlie Briggs commented on HUDI-1407:
--------------------------------------
It'd be fantastic to see this support added to remove the need to use Spark as
an intermediate job to run generic Python workloads.
It's worth noting that:
Apache Iceberg supports reading into Apache Arrow:
[https://py.iceberg.apache.org/api]
Deltalake supports reading into Apache Arrow
[https://delta-io.github.io/delta-rs/python/api_reference.html#deltalake.table.DeltaTable.to_pyarrow_table]
These both also enable easy export into other engines, such as
[DuckDB|https://duckdb.org/] (although Iceberg also supports this directly via
the pyiceberg API).
> Pandas(python) integration w/ Apache Hudi
> -----------------------------------------
>
> Key: HUDI-1407
> URL: https://issues.apache.org/jira/browse/HUDI-1407
> Project: Apache Hudi
> Issue Type: Improvement
> Components: deltastreamer
> Reporter: sivabalan narayanan
> Priority: Major
> Labels: gsoc, gsoc2021, mentor
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
