[ 
https://issues.apache.org/jira/browse/NIFI-15754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18069721#comment-18069721
 ] 

ASF subversion and git services commented on NIFI-15754:
--------------------------------------------------------

Commit fb0beb0a3ff4ccc0adabd0a601e5f47e1095d063 in nifi's branch 
refs/heads/main from David Handermann
[ https://gitbox.apache.org/repos/asf?p=nifi.git;h=fb0beb0a3ff ]

NIFI-15754 Add Google Cloud Storage Provider for Iceberg (#11052)

* NIFI-15754 Added Google Cloud Storage Provider for Iceberg

- Added Iceberg GCS module and NAR
- Added Iceberg FileIO implementation using Java HttpClient for GCS REST 
operations
- Added retry strategy to HttpClientProvider

> Add Google Cloud Storage Support for Iceberg
> --------------------------------------------
>
>                 Key: NIFI-15754
>                 URL: https://issues.apache.org/jira/browse/NIFI-15754
>             Project: Apache NiFi
>          Issue Type: New Feature
>          Components: Extensions
>            Reporter: David Handermann
>            Assignee: David Handermann
>            Priority: Major
>          Time Spent: 1h 20m
>  Remaining Estimate: 0h
>
> Support for Google Cloud Support should be added the bundle of Apache Iceberg 
> extension components. The {{IcebergFileIOProvider}} service interface should 
> have a new implementation for GCS in a separate NAR, following the pattern of 
> support for AWS S3 and Azure Data Lake Storage.
> The {{iceberg-gcp}} module depends on the {{google-cloud-storage}} library, 
> which dozens of direct and transitive dependencies. Instead using the 
> {{GCSFileIO}} class, a new implementation should be created that supports 
> authentication with vended credentials from an Apache Iceberg REST Catalog, 
> and handles GCS REST API operations without additional dependencies.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to