Randy Gelhausen created NIFI-4146:
-------------------------------------
Summary: SplitRecord does not gracefully convert medium sized CSV
into individual FlowFiles
Key: NIFI-4146
URL: https://issues.apache.org/jira/browse/NIFI-4146
Project: Apache NiFi
Issue Type: Bug
Components: Core Framework
Reporter: Randy Gelhausen
Attachments: flow.xml.gz, nifi-app.log, ubuntu.nifi-app.log
SplitRecord fails to split a ~= 150k line (57 Mb) CSV file into individual
FlowFiles.
This could be configuration issues, but with a build from master today, I run
into problems out of the box on macOS and Linux:
On macOS Sierra, I get a too many open files error (See attached nifi-app.log).
On Ubuntu 17.04, I get OOMs (See attached ubuntu.nifi-app.log) and the Web UI
fails.
The CSV file I'm using is available
[here|https://opendata.arcgis.com/datasets/229220ee14c147659e1049bd517c0b78_16.csv]
and I've attached the flow: [^flow.xml.gz].
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
