Letian Jiang created DRILL-8542:
-----------------------------------
Summary: Format plugin for Apache Paimon
Key: DRILL-8542
URL: https://issues.apache.org/jira/browse/DRILL-8542
Project: Apache Drill
Issue Type: Improvement
Components: Storage - Other
Reporter: Letian Jiang
Introduce a Paimon format plugin, enabling Drill users to query Paimon tables
directly via filesystem paths.
* support reading data from Paimon tables in Parquet and ORC formats
* support projection/filter/limit pushdown
* support snapshot read via table() with snapshotId or snapshotAsOfTime
* support metadata tables: #snapshots, #schemas, #files, #manifests
Usage examples:
* SELECT * FROM dfs.`/path/to/paimon_table`
* SELECT * FROM table(dfs.`/path/to/paimon_table`, snapshotId => 123)
* SELECT * FROM table(dfs.`/path/to/paimon_table`, snapshotAsOfTime =>
1700000000000)
* SELECT * FROM dfs.`/path/to/paimon_table#snapshots`
Reference:
* https://paimon.apache.org/docs
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
