[ 
https://issues.apache.org/jira/browse/NIFI-11167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17791226#comment-17791226
 ] 

Daniel Stieglitz edited comment on NIFI-11167 at 11/29/23 6:08 PM:
-------------------------------------------------------------------

[~iiojj2] Could you possibly still use QueryRecord with Excel reader and not 
skip the first line (thereby you get your headers), filter out the not needed 
column(s) with a SQL query, write out the csv with the CSVRecordSetWriter but 
do not write out the column names and then read it in again with a CSVReader?


was (Author: JIRAUSER294662):
[~iiojj2] Could you possibly still use QueryRecord with Excel reader and not 
skip the first line (thereby you get your headers), filter out the not needed 
column(s), write out the csv with the CSVRecordSetWriter and not write out the 
column names and then read it in again with a CSVReader?

> Add Excel Record Reader
> -----------------------
>
>                 Key: NIFI-11167
>                 URL: https://issues.apache.org/jira/browse/NIFI-11167
>             Project: Apache NiFi
>          Issue Type: New Feature
>          Components: Extensions
>            Reporter: David Handermann
>            Assignee: Daniel Stieglitz
>            Priority: Minor
>             Fix For: 2.0.0-M1, 1.23.0
>
>         Attachments: CSVRecordSetWriter_configuration.png, 
> ExcelReaderConfiguration.png, QueryRecord_configuration.png, Test 
> ExcelReader.xlsx, image-2023-11-28-18-22-07-446.png, 
> image-2023-11-29-15-51-08-386.png, resulting.csv, screenshot-1.png
>
>          Time Spent: 10h 10m
>  Remaining Estimate: 0h
>
> A new Excel Record Reader should be implemented to support reading XSLX 
> spreadsheet rows as NiFi Records. This Reader will enable integration with 
> various record-oriented components, obviating the need for the narrowly 
> focused ConvertExcelToCSVProcessor. The initial version of the Excel Reader 
> should not support the legacy binary XLS format.
> The ExcelReader should use a library that supports reading from a stream of 
> rows to avoid consuming large amounts of heap memory during processing.
> The ExcelReader should support configurable properties to read selected 
> sheets. With Excel supporting typed field values, some amount of field type 
> mapping will be required. Additional input filtering properties should not be 
> implemented as existing Processors like QueryRecord support a wide variety of 
> filtering and projection use cases.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to