[
https://issues.apache.org/jira/browse/PHOENIX-5258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16837032#comment-16837032
]
Prashant Vithani commented on PHOENIX-5258:
-------------------------------------------
[[email protected]]: I believe [~elserj] is the best person to answer the first
question (about CSV being broken in multiple splits). My assumption till now
was that a single CSV would run without being split.
For the second question, I have observed that input columns are usually
converted to uppercase if not wrapped around commas. e.g. (`"Sample"` will be
case sensitive, but `Sample` will be converted to `SAMPLE`)
> Add support to parse header from the input CSV file as input columns for
> CsvBulkLoadTool
> ----------------------------------------------------------------------------------------
>
> Key: PHOENIX-5258
> URL: https://issues.apache.org/jira/browse/PHOENIX-5258
> Project: Phoenix
> Issue Type: Improvement
> Reporter: Prashant Vithani
> Assignee: Prashant Vithani
> Priority: Minor
> Fix For: 4.15.0, 5.1.0
>
> Attachments: PHOENIX-5258-4.x-HBase-1.4.patch,
> PHOENIX-5258-master.patch
>
> Time Spent: 40m
> Remaining Estimate: 0h
>
> Currently, CsvBulkLoadTool does not support reading header from the input csv
> and expects the content of the csv to match with the table schema. The
> support for the header can be added to dynamically map the schema with the
> header.
> The proposed solution is to introduce another option for the tool
> `–parse-header`. If this option is passed, the input columns list is
> constructed by reading the first line of the input CSV file.
> * If there is only one file, read the header from the first line and
> generate the `ColumnInfo` list.
> * If there are multiple files, read the header from all the files, and throw
> an error if the headers across files do not match.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
