[
https://issues.apache.org/jira/browse/KUDU-3355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
LiFu He updated KUDU-3355:
--------------------------
Description:
There is a feature in ClickHouse that allows MergeTree table to move range
partitions from local disks to remote storage(hdfs/s3).
[https://clickhouse.com/docs/en/engines/table-engines/mergetree-family/mergetree/#table_engine-mergetree-creating-a-table]
[https://clickhouse.com/docs/en/engines/table-engines/mergetree-family/mergetree/#mergetree-table-ttl]
If kudu supports this type of functionarility, maybe it will make the
combination of kudu and hdfs smoother, and even integrate into the data lake,
compete with iceburg/hudi/delta.
I have read [~granthenke]'s blog [Transparent Hierarchical Storage Management
with Apache Kudu and
Impala|https://blog.cloudera.com/transparent-hierarchical-storage-management-with-apache-kudu-and-impala/],
thanks for his detailed description, but I think this feature is another
option which release the dependence on computing engines.
What's your opinion?
was:
There is a feature in ClickHouse that allows MergeTree table to move range
partitions from local disks to remote storage(hdfs/s3).
[https://clickhouse.com/docs/en/engines/table-engines/mergetree-family/mergetree/#table_engine-mergetree-creating-a-table]
[https://clickhouse.com/docs/en/engines/table-engines/mergetree-family/mergetree/#mergetree-table-ttl]
If kudu supports this type of functionarility, maybe it will make the
combination of kudu and hdfs smoother, and even integrate into the data lake,
compete with iceburg/hudi/delta.
I have read [~granthenke]'s blog [Transparent Hierarchical Storage Management
with Apache Kudu and
Impala|https://blog.cloudera.com/transparent-hierarchical-storage-management-with-apache-kudu-and-impala/],
thanks for his detailed description, but I think this feature is another
option.
What's your opinion?
> Move outdated range partitions directly to hdfs
> -----------------------------------------------
>
> Key: KUDU-3355
> URL: https://issues.apache.org/jira/browse/KUDU-3355
> Project: Kudu
> Issue Type: New Feature
> Reporter: LiFu He
> Priority: Minor
>
> There is a feature in ClickHouse that allows MergeTree table to move range
> partitions from local disks to remote storage(hdfs/s3).
> [https://clickhouse.com/docs/en/engines/table-engines/mergetree-family/mergetree/#table_engine-mergetree-creating-a-table]
> [https://clickhouse.com/docs/en/engines/table-engines/mergetree-family/mergetree/#mergetree-table-ttl]
> If kudu supports this type of functionarility, maybe it will make the
> combination of kudu and hdfs smoother, and even integrate into the data lake,
> compete with iceburg/hudi/delta.
> I have read [~granthenke]'s blog [Transparent Hierarchical Storage Management
> with Apache Kudu and
> Impala|https://blog.cloudera.com/transparent-hierarchical-storage-management-with-apache-kudu-and-impala/],
> thanks for his detailed description, but I think this feature is another
> option which release the dependence on computing engines.
> What's your opinion?
>
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
