Jason Gauci created CRUNCH-347:
----------------------------------

             Summary: Allow writing of single file outputs
                 Key: CRUNCH-347
                 URL: https://issues.apache.org/jira/browse/CRUNCH-347
             Project: Crunch
          Issue Type: New Feature
          Components: IO
    Affects Versions: 0.9.0
            Reporter: Jason Gauci
            Priority: Minor


One of the outputs from our system needs to be a single file to support a 
system that is ingesting the data downstream.  We currently run the job and 
then cat the output files together to create the final output, but it would be 
nice if we could pass a flag to the write(...) function to handle this case.

Note that setting the number of reducers globally for the entire job doesn't 
work in this case because of the significant performance implications.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

Reply via email to