Take a look at the testCompression() method in AbstractFileOutputOperatorTest.java for an example.
Ram On Mon, Mar 13, 2017 at 5:25 PM, Ganelin, Ilya <ilya.gane...@capitalone.com> wrote: > What is the recommended way to write compressed data to HDFS? Should I > extend AbstractFileOutputOperator or is there existing support for this via > a config? > > > > What formats are presently supported and if extending Apex to support > Snappy or Lz4 what would that look like? > > > > Thanks in advance! > > > > - Ilya Ganelin > > [image: id:image001.png@01D1F7A4.F3D42980] > > > > ------------------------------ > > The information contained in this e-mail is confidential and/or > proprietary to Capital One and/or its affiliates and may only be used > solely in performance of work or services for Capital One. The information > transmitted herewith is intended only for use by the individual or entity > to which it is addressed. If the reader of this message is not the intended > recipient, you are hereby notified that any review, retransmission, > dissemination, distribution, copying or other use of, or taking of any > action in reliance upon this information is strictly prohibited. If you > have received this communication in error, please contact the sender and > delete the material from your computer. > -- _______________________________________________________ Munagala V. Ramanath Software Engineer E: r...@datatorrent.com | M: (408) 331-5034 | Twitter: @UnknownRam www.datatorrent.com | apex.apache.org
