[
https://issues.apache.org/jira/browse/HBASE-13356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Purtell updated HBASE-13356:
-----------------------------------
Fix Version/s: 0.98.14
I picked this back to 0.98.
We can take new APIs on that branch. I use a case by case evaluation. In this
case the new API looks really useful.
There are no backwards compatibility concerns detected by the checker tool:
{noformat}
Running the Java API Compliance Checker...
using Java 1.7.0_79
reading classes 1 ...
WARNING: skip "impl" packages (use --keep-internal option to check them)
reading classes 2 ...
WARNING: skip "impl" packages
comparing classes ...
creating compatibility report ...
result: COMPATIBLE
total "Binary" compatibility problems: 0, warnings: 0
total "Source" compatibility problems: 0, warnings: 0
{noformat}
New and modified unit tests all pass:
{noformat}
Running org.apache.hadoop.hbase.mapred.TestMultiTableSnapshotInputFormat
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 221.229 sec -
in org.apache.hadoop.hbase.mapred.TestMultiTableSnapshotInputFormat
Running org.apache.hadoop.hbase.mapreduce.TestMultiTableInputFormat
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 228.301 sec -
in org.apache.hadoop.hbase.mapreduce.TestMultiTableInputFormat
Running org.apache.hadoop.hbase.mapreduce.TestMultiTableSnapshotInputFormat
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 217.837 sec -
in org.apache.hadoop.hbase.mapreduce.TestMultiTableSnapshotInputFormat
Running org.apache.hadoop.hbase.mapreduce.TestMultiTableSnapshotInputFormatImpl
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.747 sec - in
org.apache.hadoop.hbase.mapreduce.TestMultiTableSnapshotInputFormatImpl
Running org.apache.hadoop.hbase.util.TestConfigurationUtil
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.493 sec - in
org.apache.hadoop.hbase.util.TestConfigurationUtil
{noformat}
I have run all of the tests in o.a.h.h.mapred.* and o.a.h.h.mapreduce.* with
this change applied and they passed.
> HBase should provide an InputFormat supporting multiple scans in mapreduce
> jobs over snapshots
> ----------------------------------------------------------------------------------------------
>
> Key: HBASE-13356
> URL: https://issues.apache.org/jira/browse/HBASE-13356
> Project: HBase
> Issue Type: New Feature
> Components: mapreduce
> Reporter: Andrew Mains
> Assignee: Andrew Mains
> Priority: Minor
> Fix For: 2.0.0, 0.98.14, 1.2.0
>
> Attachments: HBASE-13356-0.98.patch, HBASE-13356-branch-1.patch,
> HBASE-13356.2.patch, HBASE-13356.3.patch, HBASE-13356.4.patch,
> HBASE-13356.patch
>
>
> Currently, HBase supports the pushing of multiple scans to mapreduce jobs
> over live tables (via MultiTableInputFormat) but only supports a single scan
> for mapreduce jobs over table snapshots. It would be handy to support
> multiple scans over snapshots as well, probably through another input format
> (MultiTableSnapshotInputFormat?). To mimic the functionality present in
> MultiTableInputFormat, the new input format would likely have to take in the
> names of all snapshots used in addition to the scans.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
