Steve Loughran created HADOOP-13286:
---------------------------------------
Summary: add a scale test to do gunzip and linecount
Key: HADOOP-13286
URL: https://issues.apache.org/jira/browse/HADOOP-13286
Project: Hadoop Common
Issue Type: Sub-task
Affects Versions: 2.8.0
Reporter: Steve Loughran
Assignee: Steve Loughran
the HADOOP-13203 patch proposal showed that there were performance problems
downstream which weren't surfacing in the current scale tests.
Trying to decompress the .gz test file and then go through it with LineReader
models a basic use case: parse a .csv.gz data source.
Add this, with metric printing
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
