[jira] [Commented] (NIFI-6255) Allow NiFi to hash specific attributes of a record
[ https://issues.apache.org/jira/browse/NIFI-6255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118664#comment-17118664 ] ASF subversion and git services commented on NIFI-6255: --- Commit 0f4b79b55ec7e4a85334d4a0d3e7200021950d1a in nifi's branch refs/heads/MINIFI-422 from Phillip Grenier [ https://gitbox.apache.org/repos/asf?p=nifi.git;h=0f4b79b ] NIFI-6255 NIFI-6287: Hash function for expression language and record path. NIFI-6255 NIFI-6287: Rebased to match the new expression language interface NIFI-6255 NIFI-6287: Fix wildcard imports and unused imports NIFI-6255 NIFI-6287: Move to the common codec DigetUtils Update commons-codec This closes #3624 Signed-off-by: Mike Thomsen > Allow NiFi to hash specific attributes of a record > -- > > Key: NIFI-6255 > URL: https://issues.apache.org/jira/browse/NIFI-6255 > Project: Apache NiFi > Issue Type: New Feature > Components: Extensions >Reporter: Nathan Bruce >Assignee: Phillip Grenier >Priority: Trivial > Fix For: 1.12.0 > > Time Spent: 3h 10m > Remaining Estimate: 0h > > Create a processor for NiFi to read in a file of records through the Record > Reader service and hash specific keys within the record. > The processor will accept a comma delimited list of strings that would > specify the keys to be hashed, as an attribute. If the keys specified are not > present in a given record, the processor should continue without resulting in > a failure. > The processor will have a list of hashing algorithms to be applied to the > record, as well as an optional salt. > The hashed value will replace the current value stored for the given key then > passed on to the Record Writer service. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (NIFI-6255) Allow NiFi to hash specific attributes of a record
[ https://issues.apache.org/jira/browse/NIFI-6255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118666#comment-17118666 ] ASF subversion and git services commented on NIFI-6255: --- Commit 0f4b79b55ec7e4a85334d4a0d3e7200021950d1a in nifi's branch refs/heads/MINIFI-422 from Phillip Grenier [ https://gitbox.apache.org/repos/asf?p=nifi.git;h=0f4b79b ] NIFI-6255 NIFI-6287: Hash function for expression language and record path. NIFI-6255 NIFI-6287: Rebased to match the new expression language interface NIFI-6255 NIFI-6287: Fix wildcard imports and unused imports NIFI-6255 NIFI-6287: Move to the common codec DigetUtils Update commons-codec This closes #3624 Signed-off-by: Mike Thomsen > Allow NiFi to hash specific attributes of a record > -- > > Key: NIFI-6255 > URL: https://issues.apache.org/jira/browse/NIFI-6255 > Project: Apache NiFi > Issue Type: New Feature > Components: Extensions >Reporter: Nathan Bruce >Assignee: Phillip Grenier >Priority: Trivial > Fix For: 1.12.0 > > Time Spent: 3h 10m > Remaining Estimate: 0h > > Create a processor for NiFi to read in a file of records through the Record > Reader service and hash specific keys within the record. > The processor will accept a comma delimited list of strings that would > specify the keys to be hashed, as an attribute. If the keys specified are not > present in a given record, the processor should continue without resulting in > a failure. > The processor will have a list of hashing algorithms to be applied to the > record, as well as an optional salt. > The hashed value will replace the current value stored for the given key then > passed on to the Record Writer service. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (NIFI-6255) Allow NiFi to hash specific attributes of a record
[ https://issues.apache.org/jira/browse/NIFI-6255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118660#comment-17118660 ] ASF subversion and git services commented on NIFI-6255: --- Commit 0f4b79b55ec7e4a85334d4a0d3e7200021950d1a in nifi's branch refs/heads/MINIFI-422 from Phillip Grenier [ https://gitbox.apache.org/repos/asf?p=nifi.git;h=0f4b79b ] NIFI-6255 NIFI-6287: Hash function for expression language and record path. NIFI-6255 NIFI-6287: Rebased to match the new expression language interface NIFI-6255 NIFI-6287: Fix wildcard imports and unused imports NIFI-6255 NIFI-6287: Move to the common codec DigetUtils Update commons-codec This closes #3624 Signed-off-by: Mike Thomsen > Allow NiFi to hash specific attributes of a record > -- > > Key: NIFI-6255 > URL: https://issues.apache.org/jira/browse/NIFI-6255 > Project: Apache NiFi > Issue Type: New Feature > Components: Extensions >Reporter: Nathan Bruce >Assignee: Phillip Grenier >Priority: Trivial > Fix For: 1.12.0 > > Time Spent: 3h 10m > Remaining Estimate: 0h > > Create a processor for NiFi to read in a file of records through the Record > Reader service and hash specific keys within the record. > The processor will accept a comma delimited list of strings that would > specify the keys to be hashed, as an attribute. If the keys specified are not > present in a given record, the processor should continue without resulting in > a failure. > The processor will have a list of hashing algorithms to be applied to the > record, as well as an optional salt. > The hashed value will replace the current value stored for the given key then > passed on to the Record Writer service. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (NIFI-6255) Allow NiFi to hash specific attributes of a record
[ https://issues.apache.org/jira/browse/NIFI-6255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118662#comment-17118662 ] ASF subversion and git services commented on NIFI-6255: --- Commit 0f4b79b55ec7e4a85334d4a0d3e7200021950d1a in nifi's branch refs/heads/MINIFI-422 from Phillip Grenier [ https://gitbox.apache.org/repos/asf?p=nifi.git;h=0f4b79b ] NIFI-6255 NIFI-6287: Hash function for expression language and record path. NIFI-6255 NIFI-6287: Rebased to match the new expression language interface NIFI-6255 NIFI-6287: Fix wildcard imports and unused imports NIFI-6255 NIFI-6287: Move to the common codec DigetUtils Update commons-codec This closes #3624 Signed-off-by: Mike Thomsen > Allow NiFi to hash specific attributes of a record > -- > > Key: NIFI-6255 > URL: https://issues.apache.org/jira/browse/NIFI-6255 > Project: Apache NiFi > Issue Type: New Feature > Components: Extensions >Reporter: Nathan Bruce >Assignee: Phillip Grenier >Priority: Trivial > Fix For: 1.12.0 > > Time Spent: 3h 10m > Remaining Estimate: 0h > > Create a processor for NiFi to read in a file of records through the Record > Reader service and hash specific keys within the record. > The processor will accept a comma delimited list of strings that would > specify the keys to be hashed, as an attribute. If the keys specified are not > present in a given record, the processor should continue without resulting in > a failure. > The processor will have a list of hashing algorithms to be applied to the > record, as well as an optional salt. > The hashed value will replace the current value stored for the given key then > passed on to the Record Writer service. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (NIFI-6255) Allow NiFi to hash specific attributes of a record
[ https://issues.apache.org/jira/browse/NIFI-6255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115916#comment-17115916 ] ASF subversion and git services commented on NIFI-6255: --- Commit 0f4b79b55ec7e4a85334d4a0d3e7200021950d1a in nifi's branch refs/heads/master from Phillip Grenier [ https://gitbox.apache.org/repos/asf?p=nifi.git;h=0f4b79b ] NIFI-6255 NIFI-6287: Hash function for expression language and record path. NIFI-6255 NIFI-6287: Rebased to match the new expression language interface NIFI-6255 NIFI-6287: Fix wildcard imports and unused imports NIFI-6255 NIFI-6287: Move to the common codec DigetUtils Update commons-codec This closes #3624 Signed-off-by: Mike Thomsen > Allow NiFi to hash specific attributes of a record > -- > > Key: NIFI-6255 > URL: https://issues.apache.org/jira/browse/NIFI-6255 > Project: Apache NiFi > Issue Type: New Feature > Components: Extensions >Reporter: Nathan Bruce >Assignee: Phillip Grenier >Priority: Trivial > Time Spent: 2h 40m > Remaining Estimate: 0h > > Create a processor for NiFi to read in a file of records through the Record > Reader service and hash specific keys within the record. > The processor will accept a comma delimited list of strings that would > specify the keys to be hashed, as an attribute. If the keys specified are not > present in a given record, the processor should continue without resulting in > a failure. > The processor will have a list of hashing algorithms to be applied to the > record, as well as an optional salt. > The hashed value will replace the current value stored for the given key then > passed on to the Record Writer service. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (NIFI-6255) Allow NiFi to hash specific attributes of a record
[ https://issues.apache.org/jira/browse/NIFI-6255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115920#comment-17115920 ] ASF subversion and git services commented on NIFI-6255: --- Commit 0f4b79b55ec7e4a85334d4a0d3e7200021950d1a in nifi's branch refs/heads/master from Phillip Grenier [ https://gitbox.apache.org/repos/asf?p=nifi.git;h=0f4b79b ] NIFI-6255 NIFI-6287: Hash function for expression language and record path. NIFI-6255 NIFI-6287: Rebased to match the new expression language interface NIFI-6255 NIFI-6287: Fix wildcard imports and unused imports NIFI-6255 NIFI-6287: Move to the common codec DigetUtils Update commons-codec This closes #3624 Signed-off-by: Mike Thomsen > Allow NiFi to hash specific attributes of a record > -- > > Key: NIFI-6255 > URL: https://issues.apache.org/jira/browse/NIFI-6255 > Project: Apache NiFi > Issue Type: New Feature > Components: Extensions >Reporter: Nathan Bruce >Assignee: Phillip Grenier >Priority: Trivial > Time Spent: 2h 40m > Remaining Estimate: 0h > > Create a processor for NiFi to read in a file of records through the Record > Reader service and hash specific keys within the record. > The processor will accept a comma delimited list of strings that would > specify the keys to be hashed, as an attribute. If the keys specified are not > present in a given record, the processor should continue without resulting in > a failure. > The processor will have a list of hashing algorithms to be applied to the > record, as well as an optional salt. > The hashed value will replace the current value stored for the given key then > passed on to the Record Writer service. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (NIFI-6255) Allow NiFi to hash specific attributes of a record
[ https://issues.apache.org/jira/browse/NIFI-6255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115918#comment-17115918 ] ASF subversion and git services commented on NIFI-6255: --- Commit 0f4b79b55ec7e4a85334d4a0d3e7200021950d1a in nifi's branch refs/heads/master from Phillip Grenier [ https://gitbox.apache.org/repos/asf?p=nifi.git;h=0f4b79b ] NIFI-6255 NIFI-6287: Hash function for expression language and record path. NIFI-6255 NIFI-6287: Rebased to match the new expression language interface NIFI-6255 NIFI-6287: Fix wildcard imports and unused imports NIFI-6255 NIFI-6287: Move to the common codec DigetUtils Update commons-codec This closes #3624 Signed-off-by: Mike Thomsen > Allow NiFi to hash specific attributes of a record > -- > > Key: NIFI-6255 > URL: https://issues.apache.org/jira/browse/NIFI-6255 > Project: Apache NiFi > Issue Type: New Feature > Components: Extensions >Reporter: Nathan Bruce >Assignee: Phillip Grenier >Priority: Trivial > Time Spent: 2h 40m > Remaining Estimate: 0h > > Create a processor for NiFi to read in a file of records through the Record > Reader service and hash specific keys within the record. > The processor will accept a comma delimited list of strings that would > specify the keys to be hashed, as an attribute. If the keys specified are not > present in a given record, the processor should continue without resulting in > a failure. > The processor will have a list of hashing algorithms to be applied to the > record, as well as an optional salt. > The hashed value will replace the current value stored for the given key then > passed on to the Record Writer service. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (NIFI-6255) Allow NiFi to hash specific attributes of a record
[ https://issues.apache.org/jira/browse/NIFI-6255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115914#comment-17115914 ] ASF subversion and git services commented on NIFI-6255: --- Commit 0f4b79b55ec7e4a85334d4a0d3e7200021950d1a in nifi's branch refs/heads/master from Phillip Grenier [ https://gitbox.apache.org/repos/asf?p=nifi.git;h=0f4b79b ] NIFI-6255 NIFI-6287: Hash function for expression language and record path. NIFI-6255 NIFI-6287: Rebased to match the new expression language interface NIFI-6255 NIFI-6287: Fix wildcard imports and unused imports NIFI-6255 NIFI-6287: Move to the common codec DigetUtils Update commons-codec This closes #3624 Signed-off-by: Mike Thomsen > Allow NiFi to hash specific attributes of a record > -- > > Key: NIFI-6255 > URL: https://issues.apache.org/jira/browse/NIFI-6255 > Project: Apache NiFi > Issue Type: New Feature > Components: Extensions >Reporter: Nathan Bruce >Assignee: Phillip Grenier >Priority: Trivial > Time Spent: 2h 40m > Remaining Estimate: 0h > > Create a processor for NiFi to read in a file of records through the Record > Reader service and hash specific keys within the record. > The processor will accept a comma delimited list of strings that would > specify the keys to be hashed, as an attribute. If the keys specified are not > present in a given record, the processor should continue without resulting in > a failure. > The processor will have a list of hashing algorithms to be applied to the > record, as well as an optional salt. > The hashed value will replace the current value stored for the given key then > passed on to the Record Writer service. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (NIFI-6255) Allow NiFi to hash specific attributes of a record
[ https://issues.apache.org/jira/browse/NIFI-6255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16832669#comment-16832669 ] Bryan Bende commented on NIFI-6255: --- I think we should consider adding hash functions to EL and/or record-path which would eliminate the need for a new processor because then it could be done with UpdateRecord. If hashing with EL, then in UpdateRecord you could do: {code:java} /fieldA = ${hash(ALGORITHM, field.value)}{code} If hashing with record-path, then in UpdateRecord you could do: {code:java} /fieldA = hash(ALGORITH, /fieldA){code} > Allow NiFi to hash specific attributes of a record > -- > > Key: NIFI-6255 > URL: https://issues.apache.org/jira/browse/NIFI-6255 > Project: Apache NiFi > Issue Type: New Feature > Components: Extensions >Affects Versions: 2.0.0 >Reporter: Nathan Bruce >Priority: Trivial > > Create a processor for NiFi to read in a file of records through the Record > Reader service and hash specific keys within the record. > The processor will accept a comma delimited list of strings that would > specify the keys to be hashed, as an attribute. If the keys specified are not > present in a given record, the processor should continue without resulting in > a failure. > The processor will have a list of hashing algorithms to be applied to the > record, as well as an optional salt. > The hashed value will replace the current value stored for the given key then > passed on to the Record Writer service. -- This message was sent by Atlassian JIRA (v7.6.3#76005)