David Handermann created NIFI-14328:
---------------------------------------

             Summary: Add Processor for Snowflake Snowpipe Streaming
                 Key: NIFI-14328
                 URL: https://issues.apache.org/jira/browse/NIFI-14328
             Project: Apache NiFi
          Issue Type: New Feature
          Components: Extensions
            Reporter: David Handermann
            Assignee: David Handermann


The Snowflake [Snowpipe Streaming 
API|https://docs.snowflake.com/en/user-guide/data-load-snowpipe-streaming-overview]
 supports optimized transfer of data rows into Snowflake tables. A new 
Processor should be added that integrates with the Snowpipe Streaming 
capabilities of the Snowflake Ingest SDK, supporting record-oriented transfer 
from input FlowFiles.

The new Processor should build on the latest versions of the Snowflake Ingest 
SDK and Snowflake JDBC Driver libraries, using the thin distributions to enable 
fine-grained control over dependencies and reuse of libraries shared through 
the parent {{{}nifi-standard-shared-nar{}}}. Building on version 3 of the 
Snowflake Ingest SDK also enables support for Apache Iceberg Tables in 
Snowflake.

The new Processor should support standard Snowflake account properties, 
including authentication based on Key Pairs.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to