On 2021-03-06 5:38 AM, Anuj Bhargava wrote:
How can I add
all the data from the data_archive database and then just add new records
that get added everyday in the data_archive database.
In a nustshell,
query="SELECT * FROM data_archive"
to import everything and
deltaImportQuery="SELECT * FROM data_archive
WHERE posting_id = '${dataimporter.delta.posting_id}'"
to import all "deltas".
To find the deltas, the docs example is
deltaQuery="SELECT posting_id FROM data_archive
WHERE last_modified > '${dataimporter.last_index_time}'"
Note the key: posting_id in the last 2 queries, and of course you must
have the last_modified column and have it populated properly for the
deltaQuery to return something useful.
Dima
