[
https://issues.apache.org/jira/browse/HIVE-5795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shuaishuai Nie updated HIVE-5795:
---------------------------------
Release Note:
hive.file.max.footer
Default Value: 100
Max number of lines of footer user can set for a table file.
skip.header.line.count
Default Value: 0
Number of header lines for the table file.
skip.footer.line.count
Default Value: 0
Number of footer lines for the table file.
"skip.footer.line.count" and "skip.header.line.count" should be specified in
the table property during creating the table. Following example shows the usage
of these two properties:
Create external table testtable (name string, message string) row format
delimited fields terminated by '\t' lines terminated by '\n' location
'/testtable' tblproperties ("skip.header.line.count"="1",
"skip.footer.line.count"="2");
was:
hive.file.max.footer
Default Value: 100
Max number of lines of footer user can set for a table file.
skip.header.line.count
Default Value: 0
Number of header lines for the table file.
skip.footer.line.count
Default Value: 0
Number of footer lines for the table file.
"skip.footer.line.count" and "skip.header.line.count" should be specified in
the table property during creating the table. Following example shows the usage
of these two properties:
{code}
Create external table testtable (name string, message string) row format
delimited fields terminated by '\t' lines terminated by '\n' location
'/testtable' tblproperties ("skip.header.line.count"="1",
"skip.footer.line.count"="2");
{code}
> Hive should be able to skip header and footer rows when reading data file for
> a table
> -------------------------------------------------------------------------------------
>
> Key: HIVE-5795
> URL: https://issues.apache.org/jira/browse/HIVE-5795
> Project: Hive
> Issue Type: New Feature
> Reporter: Shuaishuai Nie
> Assignee: Shuaishuai Nie
> Fix For: 0.13.0
>
> Attachments: HIVE-5795.1.patch, HIVE-5795.2.patch, HIVE-5795.3.patch,
> HIVE-5795.4.patch, HIVE-5795.5.patch
>
>
> Hive should be able to skip header and footer lines when reading data file
> from table. In this way, user don't need to processing data which generated
> by other application with a header or footer and directly use the file for
> table operations.
> To implement this, the idea is adding new properties in table descriptions to
> define the number of lines in header and footer and skip them when reading
> the record from record reader. An DDL example for creating a table with
> header and footer should be like this:
> {code}
> Create external table testtable (name string, message string) row format
> delimited fields terminated by '\t' lines terminated by '\n' location
> '/testtable' tblproperties ("skip.header.line.count"="1",
> "skip.footer.line.count"="2");
> {code}
--
This message was sent by Atlassian JIRA
(v6.1.5#6160)
