On Tue, May 24, 2011 at 2:26 PM, Jon Stewart <[email protected]> wrote: > I have enough control over the keys for the primary table that the map > task could write rows to the primary table in order, making it > map-side only (assuming one HFile per task). The map task could then > emit KeyValue objects for the secondary hash table and let > HFileOutpuFormat/KeyValueSortReducer do its thing. > > The question is, how do I write an HFile from a map task? > HFile.Writer? What are the gotchas? >
Nothing fancier than open on map task init, append, append, append, inside in the map, and then be sure to close it in the map close. Study HFileOutputFormat I'd say. St.Ack
