[
https://issues.apache.org/jira/browse/NIFI-8437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17324014#comment-17324014
]
Matthew Lannan commented on NIFI-8437:
--------------------------------------
Not sure it warrants a code change, it may suffice to just provide a warning in
the processor's PropertyDescriptor. e.g. Can not infer schema for records
larger than 10MB(or whatever the threshold is).
> RecordReader 'Infer Schema' for large records may throw BufferedInputStream
> error
> ---------------------------------------------------------------------------------
>
> Key: NIFI-8437
> URL: https://issues.apache.org/jira/browse/NIFI-8437
> Project: Apache NiFi
> Issue Type: Bug
> Components: Core Framework
> Affects Versions: 1.12.1
> Environment: Mac, BigSur 11.2.3, 32MB RAM, 8 Core Intel i9, 1 TB
> storage
> Reporter: Matthew Lannan
> Priority: Major
> Labels: easyfix, newbie
> Attachments: Nifi-stack-trace.txt,
> PDF_Encode_Decode_template-with-bug.xml
>
>
> In the RecordReader(s), if the Schema Access Strategy is set to Infer Schema
> and the record is a single large record(tested with record ~50MB), the
> InferSchemaAccessStrategy will error.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
