[
https://issues.apache.org/jira/browse/NIFI-11167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17791226#comment-17791226
]
Daniel Stieglitz edited comment on NIFI-11167 at 11/29/23 6:15 PM:
-------------------------------------------------------------------
[~iiojj2] Could you possibly still use QueryRecord with Excel reader (with
infer schema strategy) without skipping the first line (thereby you get your
headers), filter out the not needed column(s) with a SQL query, write out the
csv with the CSVRecordSetWriter but do not write out the column names (i.e. set
'Include Header Line' to false) and then read it in again with a CSVReader in
order to obtain the column names you want which will be on the first line?
was (Author: JIRAUSER294662):
[~iiojj2] Could you possibly still use QueryRecord with Excel reader (with
infer schema strategy) without skipping the first line (thereby you get your
headers), filter out the not needed column(s) with a SQL query, write out the
csv with the CSVRecordSetWriter but do not write out the column names and then
read it in again with a CSVReader in order to obtain the column names you want
which will be on the first line?
> Add Excel Record Reader
> -----------------------
>
> Key: NIFI-11167
> URL: https://issues.apache.org/jira/browse/NIFI-11167
> Project: Apache NiFi
> Issue Type: New Feature
> Components: Extensions
> Reporter: David Handermann
> Assignee: Daniel Stieglitz
> Priority: Minor
> Fix For: 2.0.0-M1, 1.23.0
>
> Attachments: CSVRecordSetWriter_configuration.png,
> ExcelReaderConfiguration.png, QueryRecord_configuration.png, Test
> ExcelReader.xlsx, image-2023-11-28-18-22-07-446.png,
> image-2023-11-29-15-51-08-386.png, resulting.csv, screenshot-1.png
>
> Time Spent: 10h 10m
> Remaining Estimate: 0h
>
> A new Excel Record Reader should be implemented to support reading XSLX
> spreadsheet rows as NiFi Records. This Reader will enable integration with
> various record-oriented components, obviating the need for the narrowly
> focused ConvertExcelToCSVProcessor. The initial version of the Excel Reader
> should not support the legacy binary XLS format.
> The ExcelReader should use a library that supports reading from a stream of
> rows to avoid consuming large amounts of heap memory during processing.
> The ExcelReader should support configurable properties to read selected
> sheets. With Excel supporting typed field values, some amount of field type
> mapping will be required. Additional input filtering properties should not be
> implemented as existing Processors like QueryRecord support a wide variety of
> filtering and projection use cases.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
