Urmi Mustafi created GOBBLIN-1584:
-------------------------------------
Summary: Add Replace Logic To Mysql Writer
Key: GOBBLIN-1584
URL: https://issues.apache.org/jira/browse/GOBBLIN-1584
Project: Apache Gobblin
Issue Type: Improvement
Components: gobblin-service
Reporter: Urmi Mustafi
Assignee: Abhishek Tiwari
We only support {{insertion}} of new values into tables, not
{{{}update/upsert{}}}. If you run an ingestion job with a record containing a
record with the same primary key the whole job will fail because of the
duplicate entry. We don't expect ingestion jobs to always contain _only new_
records, so we should handle duplicate entries, ingestion of data already in
the table or updates to old values. The insert vs. replace logic should be
configurable to the user as well.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
