Matt Burgess created NIFI-11209:
-----------------------------------
Summary: UpdateHive3Table and UpdateDatabaseTable erase newly
created columns in output FlowFile
Key: NIFI-11209
URL: https://issues.apache.org/jira/browse/NIFI-11209
Project: Apache NiFi
Issue Type: Bug
Components: Extensions
Reporter: Matt Burgess
When using UpdateHive3Table or PutDatabaseTable with the Update Field Names
property set to "true", the output will include only those fields that already
had existing columns in the target table. This means if an incoming FlowFile
has a "new" field, the column will be created and populated in the target
database, but the output FlowFile will no longer have the "new" fields in the
outgoing records.
This is because the original database columns are used to populate the outgoing
record schema when the Update Field Names property is set to true. Instead the
database columns should be refreshed after any DDL is executed in order to get
the updated set of database column names.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)