Matt Burgess created NIFI-11209:
-----------------------------------

             Summary: UpdateHive3Table and UpdateDatabaseTable erase newly 
created columns in output FlowFile
                 Key: NIFI-11209
                 URL: https://issues.apache.org/jira/browse/NIFI-11209
             Project: Apache NiFi
          Issue Type: Bug
          Components: Extensions
            Reporter: Matt Burgess


When using UpdateHive3Table or PutDatabaseTable with the Update Field Names 
property set to "true", the output will include only those fields that already 
had existing columns in the target table. This means if an incoming FlowFile 
has a "new" field, the column will be created and populated in the target 
database, but the output FlowFile will no longer have the "new" fields in the 
outgoing records.

This is because the original database columns are used to populate the outgoing 
record schema when the Update Field Names property is set to true. Instead the 
database columns should be refreshed after any DDL is executed in order to get 
the updated set of database column names.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to