[
https://issues.apache.org/jira/browse/CAMEL-7080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Willem Jiang resolved CAMEL-7080.
---------------------------------
Resolution: Fixed
Fix Version/s: 2.13.0
2.12.3
Applied the patch with thanks to Daneel. I also polished the code and fixed
some CS errors.
> Add support of lazy load to csv data format
> --------------------------------------------
>
> Key: CAMEL-7080
> URL: https://issues.apache.org/jira/browse/CAMEL-7080
> Project: Camel
> Issue Type: Improvement
> Reporter: Daneel S. Yaitskov
> Assignee: Willem Jiang
> Fix For: 2.12.3, 2.13.0
>
>
> CsvDataFormat uses greedy loading from a stream. This is not applicable for
> huge files i.e. all rows cannot fit into available memory.
> I added an option to create a row iterator instead list.
> Csv format is not line oriented so split("\n") workaround doesn't work
> always. This patch adds ability to Camel to process infinite csv files with
> multiline rows.
> Pull request:
> https://github.com/yaitskov/camel/commits/csv-iterator
> P.S.
> 1) I found that Bindy does similar work related with parsing csv file into
> list of why. And I don't see any clue why it doesn't delegate this job to csv
> file format. Roughly speaking there is code duplication.
> 2) I didn't find camel-csv component on the ticket form.
--
This message was sent by Atlassian JIRA
(v6.1.5#6160)
