[
https://issues.apache.org/jira/browse/AIRFLOW-4894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kamil Bregula resolved AIRFLOW-4894.
------------------------------------
Fix Version/s: 2.0.0
Resolution: Fixed
> Add hook and operator for GCP Data Loss Prevention API
> ------------------------------------------------------
>
> Key: AIRFLOW-4894
> URL: https://issues.apache.org/jira/browse/AIRFLOW-4894
> Project: Apache Airflow
> Issue Type: New Feature
> Components: api, gcp, hooks, operators, tests
> Affects Versions: 1.10.3
> Reporter: Zhengliang Zhu
> Assignee: Zhengliang Zhu
> Priority: Minor
> Fix For: 2.0.0
>
>
> Add a hook and operator to manipulate and use Google Cloud Data Loss
> Prevention(DLP) API. DLP API allow users to inspect or redact sensitive data
> in text contents or GCP storage locations.
> The hook includes the following APIs, implemented with Google service
> discovery API:
> * inspect/deidentify/reidentify for content:
> [https://cloud.google.com/dlp/docs/reference/rest/v2/projects.content]
> * create/delete/get/list/patch for inspectTemplates:
> [https://cloud.google.com/dlp/docs/reference/rest/v2/organizations.inspectTemplates],
>
> [https://cloud.google.com/dlp/docs/reference/rest/v2/projects.inspectTemplates]
> * create/delete/get/list/patch for storedInfoTypes:
> [https://cloud.google.com/dlp/docs/reference/rest/v2/organizations.storedInfoTypes],
>
> [https://cloud.google.com/dlp/docs/reference/rest/v2/projects.storedInfoTypes]
> * create/list/get/delete/cancel for dlpJobs:
> [https://cloud.google.com/dlp/docs/reference/rest/v2/projects.dlpJobs]
> The operator creates a long-running dlp job (for storage inspection or risk
> analysis), keeps polling its status and waits for it to be done or
> canceled/deleted.
> Apart from unit tests, also tested locally in DAG level(not included in PR).
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
