[
https://issues.apache.org/jira/browse/NIFI-13869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17891927#comment-17891927
]
ASF subversion and git services commented on NIFI-13869:
--------------------------------------------------------
Commit 35219052e13c9a2a2f3a40e125832a872067d1b1 in nifi's branch
refs/heads/main from Nicolae Puica
[ https://gitbox.apache.org/repos/asf?p=nifi.git;h=35219052e1 ]
NIFI-13869: Enhance QuerySalesforceObject Processor to Support Querying Deleted
Records
- Added a new boolean property `Include Deleted Records` to allow users to
include deleted (soft-deleted) records in Salesforce queries.
- Modified the query construction to include the `IsDeleted` field and use the
`queryAll` API endpoint when `Include Deleted Records` is enabled.
- Updated `SalesforceRestClient` to support the `queryAll` API by adding a new
`queryAll` method.
- Ensured backward compatibility by defaulting `Include Deleted Records` to
`false`, maintaining existing behavior unless explicitly enabled.
- Updated processor documentation and annotations to reflect the new
functionality.
- Adjusted state management to reset state when `Include Deleted Records`
property is modified.
Signed-off-by: Pierre Villard <[email protected]>
This closes #9434.
> Enhance QuerySalesforceObject Processor to Support Querying Deleted Records
> ---------------------------------------------------------------------------
>
> Key: NIFI-13869
> URL: https://issues.apache.org/jira/browse/NIFI-13869
> Project: Apache NiFi
> Issue Type: Improvement
> Components: Extensions
> Affects Versions: 1.25.0
> Reporter: Nicolae Puica
> Assignee: Nicolae Puica
> Priority: Major
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Currently, the {{QuerySalesforceObject}} processor in NiFi is capable of
> querying active records from Salesforce. However, it lacks the functionality
> to retrieve deleted records, which is critical for scenarios where we need to
> track changes or removals of records, especially for audit and compliance
> purposes. This improvement will add support for querying deleted records
> (soft deletes in Salesforce), leveraging the {{isDeleted}} field in
> Salesforce's SOQL queries.
> *Requirements:*
> # *New Processor Property:*
> ** Add a Boolean property: {{{}Include Deleted Records{}}}.
> ** When set to {{{}true{}}}, the processor should include records where the
> {{isDeleted}} field is {{{}true{}}}.
> # *SOQL Query Modification:*
> ** Modify the query structure to include the {{isDeleted}} field in the
> WHERE clause when querying the object. For example:
> *** {{{}SELECT Id, Name, IsDeleted FROM ContentVersion WHERE IsDeleted =
> true{}}}.
> # *Backward Compatibility:*
> ** Ensure backward compatibility by keeping the default behavior of
> excluding deleted records unless the new property is enabled.
> *Acceptance Criteria:*
> * Users should be able to enable or disable the querying of deleted records
> via a new processor property.
> * The processor should return both deleted and non-deleted records when
> appropriate.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
