David Handermann created NIFI-15754:
---------------------------------------

             Summary: Add Google Cloud Storage Support for Iceberg
                 Key: NIFI-15754
                 URL: https://issues.apache.org/jira/browse/NIFI-15754
             Project: Apache NiFi
          Issue Type: New Feature
          Components: Extensions
            Reporter: David Handermann
            Assignee: David Handermann


Support for Google Cloud Support should be added the bundle of Apache Iceberg 
extension components. The {{IcebergFileIOProvider}} service interface should 
have a new implementation for GCS in a separate NAR, following the pattern of 
support for AWS S3 and Azure Data Lake Storage.

The {{iceberg-gcp}} module depends on the {{google-cloud-storage}} library, 
which dozens of direct and transitive dependencies. Instead using the 
{{GCSFileIO}} class, a new implementation should be created that supports 
authentication with vended credentials from an Apache Iceberg REST Catalog, and 
handles GCS REST API operations without additional dependencies.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to