Quanlong Huang created IMPALA-13200:
---------------------------------------
Summary: Auto refresh on S3 tables based on S3 notification
Key: IMPALA-13200
URL: https://issues.apache.org/jira/browse/IMPALA-13200
Project: IMPALA
Issue Type: New Feature
Components: Catalog
Reporter: Quanlong Huang
S3 Event Notifications can be used to get updates on new files or file
deletions:
[https://docs.aws.amazon.com/AmazonS3/latest/userguide/EventNotifications.html]
Snowflake uses it to auto refresh external tables:
https://docs.snowflake.com/en/user-guide/tables-external-s3
Other object storages like Google Cloud Storage and Azure Blob Storage also
have the similar notification mechanism:
https://docs.snowflake.com/en/user-guide/tables-external-gcs
https://docs.snowflake.com/en/user-guide/tables-external-azure
CC [[email protected]] [~hemanth619] [~VenuReddy] [~ngangam]
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
