[
https://issues.apache.org/jira/browse/NIFI-11167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17791226#comment-17791226
]
Daniel Stieglitz edited comment on NIFI-11167 at 11/29/23 6:10 PM:
-------------------------------------------------------------------
[~iiojj2] Could you possibly still use QueryRecord with Excel reader (with
infer schema strategy) without skipping the first line (thereby you get your
headers), filter out the not needed column(s) with a SQL query, write out the
csv with the CSVRecordSetWriter but do not write out the column names and then
read it in again with a CSVReader in order to obtain the column names you want?
was (Author: JIRAUSER294662):
[~iiojj2] Could you possibly still use QueryRecord with Excel reader and not
skip the first line (thereby you get your headers), filter out the not needed
column(s) with a SQL query, write out the csv with the CSVRecordSetWriter but
do not write out the column names and then read it in again with a CSVReader?
You would then get the column names you wanted.
> Add Excel Record Reader
> -----------------------
>
> Key: NIFI-11167
> URL: https://issues.apache.org/jira/browse/NIFI-11167
> Project: Apache NiFi
> Issue Type: New Feature
> Components: Extensions
> Reporter: David Handermann
> Assignee: Daniel Stieglitz
> Priority: Minor
> Fix For: 2.0.0-M1, 1.23.0
>
> Attachments: CSVRecordSetWriter_configuration.png,
> ExcelReaderConfiguration.png, QueryRecord_configuration.png, Test
> ExcelReader.xlsx, image-2023-11-28-18-22-07-446.png,
> image-2023-11-29-15-51-08-386.png, resulting.csv, screenshot-1.png
>
> Time Spent: 10h 10m
> Remaining Estimate: 0h
>
> A new Excel Record Reader should be implemented to support reading XSLX
> spreadsheet rows as NiFi Records. This Reader will enable integration with
> various record-oriented components, obviating the need for the narrowly
> focused ConvertExcelToCSVProcessor. The initial version of the Excel Reader
> should not support the legacy binary XLS format.
> The ExcelReader should use a library that supports reading from a stream of
> rows to avoid consuming large amounts of heap memory during processing.
> The ExcelReader should support configurable properties to read selected
> sheets. With Excel supporting typed field values, some amount of field type
> mapping will be required. Additional input filtering properties should not be
> implemented as existing Processors like QueryRecord support a wide variety of
> filtering and projection use cases.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
