[jira] [Commented] (NIFI-6255) Allow NiFi to hash specific attributes of a record
[ https://issues.apache.org/jira/browse/NIFI-6255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118664#comment-17118664 ] ASF subversion and git services commented on NIFI-6255: --- Commit 0f4b79b55ec7e4a85334d4a0d3e7200021950d1a in nifi's branch refs/heads/MINIFI-422 from Phillip Grenier [ https://gitbox.apache.org/repos/asf?p=nifi.git;h=0f4b79b ] NIFI-6255 NIFI-6287: Hash function for expression language and record path. NIFI-6255 NIFI-6287: Rebased to match the new expression language interface NIFI-6255 NIFI-6287: Fix wildcard imports and unused imports NIFI-6255 NIFI-6287: Move to the common codec DigetUtils Update commons-codec This closes #3624 Signed-off-by: Mike Thomsen > Allow NiFi to hash specific attributes of a record > -- > > Key: NIFI-6255 > URL: https://issues.apache.org/jira/browse/NIFI-6255 > Project: Apache NiFi > Issue Type: New Feature > Components: Extensions >Reporter: Nathan Bruce >Assignee: Phillip Grenier >Priority: Trivial > Fix For: 1.12.0 > > Time Spent: 3h 10m > Remaining Estimate: 0h > > Create a processor for NiFi to read in a file of records through the Record > Reader service and hash specific keys within the record. > The processor will accept a comma delimited list of strings that would > specify the keys to be hashed, as an attribute. If the keys specified are not > present in a given record, the processor should continue without resulting in > a failure. > The processor will have a list of hashing algorithms to be applied to the > record, as well as an optional salt. > The hashed value will replace the current value stored for the given key then > passed on to the Record Writer service. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (NIFI-6255) Allow NiFi to hash specific attributes of a record
[ https://issues.apache.org/jira/browse/NIFI-6255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118666#comment-17118666 ] ASF subversion and git services commented on NIFI-6255: --- Commit 0f4b79b55ec7e4a85334d4a0d3e7200021950d1a in nifi's branch refs/heads/MINIFI-422 from Phillip Grenier [ https://gitbox.apache.org/repos/asf?p=nifi.git;h=0f4b79b ] NIFI-6255 NIFI-6287: Hash function for expression language and record path. NIFI-6255 NIFI-6287: Rebased to match the new expression language interface NIFI-6255 NIFI-6287: Fix wildcard imports and unused imports NIFI-6255 NIFI-6287: Move to the common codec DigetUtils Update commons-codec This closes #3624 Signed-off-by: Mike Thomsen > Allow NiFi to hash specific attributes of a record > -- > > Key: NIFI-6255 > URL: https://issues.apache.org/jira/browse/NIFI-6255 > Project: Apache NiFi > Issue Type: New Feature > Components: Extensions >Reporter: Nathan Bruce >Assignee: Phillip Grenier >Priority: Trivial > Fix For: 1.12.0 > > Time Spent: 3h 10m > Remaining Estimate: 0h > > Create a processor for NiFi to read in a file of records through the Record > Reader service and hash specific keys within the record. > The processor will accept a comma delimited list of strings that would > specify the keys to be hashed, as an attribute. If the keys specified are not > present in a given record, the processor should continue without resulting in > a failure. > The processor will have a list of hashing algorithms to be applied to the > record, as well as an optional salt. > The hashed value will replace the current value stored for the given key then > passed on to the Record Writer service. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (NIFI-6255) Allow NiFi to hash specific attributes of a record
[ https://issues.apache.org/jira/browse/NIFI-6255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118660#comment-17118660 ] ASF subversion and git services commented on NIFI-6255: --- Commit 0f4b79b55ec7e4a85334d4a0d3e7200021950d1a in nifi's branch refs/heads/MINIFI-422 from Phillip Grenier [ https://gitbox.apache.org/repos/asf?p=nifi.git;h=0f4b79b ] NIFI-6255 NIFI-6287: Hash function for expression language and record path. NIFI-6255 NIFI-6287: Rebased to match the new expression language interface NIFI-6255 NIFI-6287: Fix wildcard imports and unused imports NIFI-6255 NIFI-6287: Move to the common codec DigetUtils Update commons-codec This closes #3624 Signed-off-by: Mike Thomsen > Allow NiFi to hash specific attributes of a record > -- > > Key: NIFI-6255 > URL: https://issues.apache.org/jira/browse/NIFI-6255 > Project: Apache NiFi > Issue Type: New Feature > Components: Extensions >Reporter: Nathan Bruce >Assignee: Phillip Grenier >Priority: Trivial > Fix For: 1.12.0 > > Time Spent: 3h 10m > Remaining Estimate: 0h > > Create a processor for NiFi to read in a file of records through the Record > Reader service and hash specific keys within the record. > The processor will accept a comma delimited list of strings that would > specify the keys to be hashed, as an attribute. If the keys specified are not > present in a given record, the processor should continue without resulting in > a failure. > The processor will have a list of hashing algorithms to be applied to the > record, as well as an optional salt. > The hashed value will replace the current value stored for the given key then > passed on to the Record Writer service. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (NIFI-6255) Allow NiFi to hash specific attributes of a record
[ https://issues.apache.org/jira/browse/NIFI-6255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118662#comment-17118662 ] ASF subversion and git services commented on NIFI-6255: --- Commit 0f4b79b55ec7e4a85334d4a0d3e7200021950d1a in nifi's branch refs/heads/MINIFI-422 from Phillip Grenier [ https://gitbox.apache.org/repos/asf?p=nifi.git;h=0f4b79b ] NIFI-6255 NIFI-6287: Hash function for expression language and record path. NIFI-6255 NIFI-6287: Rebased to match the new expression language interface NIFI-6255 NIFI-6287: Fix wildcard imports and unused imports NIFI-6255 NIFI-6287: Move to the common codec DigetUtils Update commons-codec This closes #3624 Signed-off-by: Mike Thomsen > Allow NiFi to hash specific attributes of a record > -- > > Key: NIFI-6255 > URL: https://issues.apache.org/jira/browse/NIFI-6255 > Project: Apache NiFi > Issue Type: New Feature > Components: Extensions >Reporter: Nathan Bruce >Assignee: Phillip Grenier >Priority: Trivial > Fix For: 1.12.0 > > Time Spent: 3h 10m > Remaining Estimate: 0h > > Create a processor for NiFi to read in a file of records through the Record > Reader service and hash specific keys within the record. > The processor will accept a comma delimited list of strings that would > specify the keys to be hashed, as an attribute. If the keys specified are not > present in a given record, the processor should continue without resulting in > a failure. > The processor will have a list of hashing algorithms to be applied to the > record, as well as an optional salt. > The hashed value will replace the current value stored for the given key then > passed on to the Record Writer service. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (NIFI-6255) Allow NiFi to hash specific attributes of a record
[ https://issues.apache.org/jira/browse/NIFI-6255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115916#comment-17115916 ] ASF subversion and git services commented on NIFI-6255: --- Commit 0f4b79b55ec7e4a85334d4a0d3e7200021950d1a in nifi's branch refs/heads/master from Phillip Grenier [ https://gitbox.apache.org/repos/asf?p=nifi.git;h=0f4b79b ] NIFI-6255 NIFI-6287: Hash function for expression language and record path. NIFI-6255 NIFI-6287: Rebased to match the new expression language interface NIFI-6255 NIFI-6287: Fix wildcard imports and unused imports NIFI-6255 NIFI-6287: Move to the common codec DigetUtils Update commons-codec This closes #3624 Signed-off-by: Mike Thomsen > Allow NiFi to hash specific attributes of a record > -- > > Key: NIFI-6255 > URL: https://issues.apache.org/jira/browse/NIFI-6255 > Project: Apache NiFi > Issue Type: New Feature > Components: Extensions >Reporter: Nathan Bruce >Assignee: Phillip Grenier >Priority: Trivial > Time Spent: 2h 40m > Remaining Estimate: 0h > > Create a processor for NiFi to read in a file of records through the Record > Reader service and hash specific keys within the record. > The processor will accept a comma delimited list of strings that would > specify the keys to be hashed, as an attribute. If the keys specified are not > present in a given record, the processor should continue without resulting in > a failure. > The processor will have a list of hashing algorithms to be applied to the > record, as well as an optional salt. > The hashed value will replace the current value stored for the given key then > passed on to the Record Writer service. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (NIFI-6255) Allow NiFi to hash specific attributes of a record
[ https://issues.apache.org/jira/browse/NIFI-6255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115920#comment-17115920 ] ASF subversion and git services commented on NIFI-6255: --- Commit 0f4b79b55ec7e4a85334d4a0d3e7200021950d1a in nifi's branch refs/heads/master from Phillip Grenier [ https://gitbox.apache.org/repos/asf?p=nifi.git;h=0f4b79b ] NIFI-6255 NIFI-6287: Hash function for expression language and record path. NIFI-6255 NIFI-6287: Rebased to match the new expression language interface NIFI-6255 NIFI-6287: Fix wildcard imports and unused imports NIFI-6255 NIFI-6287: Move to the common codec DigetUtils Update commons-codec This closes #3624 Signed-off-by: Mike Thomsen > Allow NiFi to hash specific attributes of a record > -- > > Key: NIFI-6255 > URL: https://issues.apache.org/jira/browse/NIFI-6255 > Project: Apache NiFi > Issue Type: New Feature > Components: Extensions >Reporter: Nathan Bruce >Assignee: Phillip Grenier >Priority: Trivial > Time Spent: 2h 40m > Remaining Estimate: 0h > > Create a processor for NiFi to read in a file of records through the Record > Reader service and hash specific keys within the record. > The processor will accept a comma delimited list of strings that would > specify the keys to be hashed, as an attribute. If the keys specified are not > present in a given record, the processor should continue without resulting in > a failure. > The processor will have a list of hashing algorithms to be applied to the > record, as well as an optional salt. > The hashed value will replace the current value stored for the given key then > passed on to the Record Writer service. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (NIFI-6255) Allow NiFi to hash specific attributes of a record
[ https://issues.apache.org/jira/browse/NIFI-6255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115918#comment-17115918 ] ASF subversion and git services commented on NIFI-6255: --- Commit 0f4b79b55ec7e4a85334d4a0d3e7200021950d1a in nifi's branch refs/heads/master from Phillip Grenier [ https://gitbox.apache.org/repos/asf?p=nifi.git;h=0f4b79b ] NIFI-6255 NIFI-6287: Hash function for expression language and record path. NIFI-6255 NIFI-6287: Rebased to match the new expression language interface NIFI-6255 NIFI-6287: Fix wildcard imports and unused imports NIFI-6255 NIFI-6287: Move to the common codec DigetUtils Update commons-codec This closes #3624 Signed-off-by: Mike Thomsen > Allow NiFi to hash specific attributes of a record > -- > > Key: NIFI-6255 > URL: https://issues.apache.org/jira/browse/NIFI-6255 > Project: Apache NiFi > Issue Type: New Feature > Components: Extensions >Reporter: Nathan Bruce >Assignee: Phillip Grenier >Priority: Trivial > Time Spent: 2h 40m > Remaining Estimate: 0h > > Create a processor for NiFi to read in a file of records through the Record > Reader service and hash specific keys within the record. > The processor will accept a comma delimited list of strings that would > specify the keys to be hashed, as an attribute. If the keys specified are not > present in a given record, the processor should continue without resulting in > a failure. > The processor will have a list of hashing algorithms to be applied to the > record, as well as an optional salt. > The hashed value will replace the current value stored for the given key then > passed on to the Record Writer service. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (NIFI-6255) Allow NiFi to hash specific attributes of a record
[ https://issues.apache.org/jira/browse/NIFI-6255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115914#comment-17115914 ] ASF subversion and git services commented on NIFI-6255: --- Commit 0f4b79b55ec7e4a85334d4a0d3e7200021950d1a in nifi's branch refs/heads/master from Phillip Grenier [ https://gitbox.apache.org/repos/asf?p=nifi.git;h=0f4b79b ] NIFI-6255 NIFI-6287: Hash function for expression language and record path. NIFI-6255 NIFI-6287: Rebased to match the new expression language interface NIFI-6255 NIFI-6287: Fix wildcard imports and unused imports NIFI-6255 NIFI-6287: Move to the common codec DigetUtils Update commons-codec This closes #3624 Signed-off-by: Mike Thomsen > Allow NiFi to hash specific attributes of a record > -- > > Key: NIFI-6255 > URL: https://issues.apache.org/jira/browse/NIFI-6255 > Project: Apache NiFi > Issue Type: New Feature > Components: Extensions >Reporter: Nathan Bruce >Assignee: Phillip Grenier >Priority: Trivial > Time Spent: 2h 40m > Remaining Estimate: 0h > > Create a processor for NiFi to read in a file of records through the Record > Reader service and hash specific keys within the record. > The processor will accept a comma delimited list of strings that would > specify the keys to be hashed, as an attribute. If the keys specified are not > present in a given record, the processor should continue without resulting in > a failure. > The processor will have a list of hashing algorithms to be applied to the > record, as well as an optional salt. > The hashed value will replace the current value stored for the given key then > passed on to the Record Writer service. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (NIFI-6255) Allow NiFi to hash specific attributes of a record
[
https://issues.apache.org/jira/browse/NIFI-6255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16832669#comment-16832669
]
Bryan Bende commented on NIFI-6255:
---
I think we should consider adding hash functions to EL and/or record-path which
would eliminate the need for a new processor because then it could be done with
UpdateRecord.
If hashing with EL, then in UpdateRecord you could do:
{code:java}
/fieldA = ${hash(ALGORITHM, field.value)}{code}
If hashing with record-path, then in UpdateRecord you could do:
{code:java}
/fieldA = hash(ALGORITH, /fieldA){code}
> Allow NiFi to hash specific attributes of a record
> --
>
> Key: NIFI-6255
> URL: https://issues.apache.org/jira/browse/NIFI-6255
> Project: Apache NiFi
> Issue Type: New Feature
> Components: Extensions
>Affects Versions: 2.0.0
>Reporter: Nathan Bruce
>Priority: Trivial
>
> Create a processor for NiFi to read in a file of records through the Record
> Reader service and hash specific keys within the record.
> The processor will accept a comma delimited list of strings that would
> specify the keys to be hashed, as an attribute. If the keys specified are not
> present in a given record, the processor should continue without resulting in
> a failure.
> The processor will have a list of hashing algorithms to be applied to the
> record, as well as an optional salt.
> The hashed value will replace the current value stored for the given key then
> passed on to the Record Writer service.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
