Joey Frazee created NIFI-8449:
---------------------------------
Summary: Add support for transactional batch operations to
PutAzureCosmosDBRecord
Key: NIFI-8449
URL: https://issues.apache.org/jira/browse/NIFI-8449
Project: Apache NiFi
Issue Type: Bug
Components: Extensions
Reporter: Joey Frazee
Right now PutAzureCosmosDBRecord only batches records for processing, not for
writing data to Cosmos DB, so inserting and updating data happens serially. The
Azure Java SDK supports using transactional batch operations, however, which if
used should improve performance as well as adding more transactionality.
Unfortunately, the API for this only allows batching by partition id so this
will introduce some complexity since the processor or flow will have to
"manually" handle grouping records to create the transactional batch calls.
While not ideal it should be ok -- best case we could have 1 call for N
records, worst case we could have the status quo of N calls for N records. So
it's probably worth doing.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
