[ 
https://issues.apache.org/jira/browse/NIFI-912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14727356#comment-14727356
 ] 

Sean Busbey commented on NIFI-912:
----------------------------------

{code}
+    static final PropertyDescriptor FINGERPRINT_ALGORITHM = new 
PropertyDescriptor.Builder()
+            .name("Fingerprint Algorithm")
+            .description("The algorithm used to generate the schema 
fingerprint.")
+            .addValidator(StandardValidators.NON_EMPTY_VALIDATOR)
+            .allowableValues(CRC_64_AVRO, MD5, SHA_256)
+            .defaultValue(CRC_64_AVRO.getValue())
+            .required(true)
+            .build();
{code}

It would be nice to note that the list of allowed fingerprints come from Avro 
practices (per 
[javadoc|http://avro.apache.org/docs/1.7.7/api/java/org/apache/avro/SchemaNormalization.html#fingerprint(java.lang.String,
 byte%5B%5D)]), presuming we're intentionally limiting the set from the full 
possible (that is, anything that 
[MessageDigest.getInstance|http://docs.oracle.com/javase/6/docs/api/java/security/MessageDigest.html#getInstance(java.lang.String)]
 will return).

> Support extracting metadata from Avro file headers
> --------------------------------------------------
>
>                 Key: NIFI-912
>                 URL: https://issues.apache.org/jira/browse/NIFI-912
>             Project: Apache NiFi
>          Issue Type: Improvement
>            Reporter: Bryan Bende
>            Assignee: Bryan Bende
>            Priority: Minor
>             Fix For: 0.4.0
>
>         Attachments: NIFI-912.patch
>
>
> Extract metadata from Avro file headers to FlowFile attributes so that 
> downstream processors can make decisions, such as merging together records of 
> compatible schemas (i.e. the correlation attribute).
> Information to extract:
> - Schema definition (full, not fp)
> - Schema fingerprint
> - Schema root record name (if schema is a record)
> - Key/value metadata, like compression codec



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to