Re: Avro to ORC Conversion

2020-07-16 Thread Dongjoon Hyun
with the normal ORC one); one > > > > > caveat is that it's for Apache Hive 1.2, you may need to make > changes > > > > > if you're using Hive 3 libraries for example. > > > > > > > > > > Regards, > > > > > Matt > > > >

Re: Avro to ORC Conversion

2020-07-16 Thread Ryan Schachte
Matt > > > > > > > > [1] > > > > > > > https://github.com/apache/nifi/blob/main/nifi-nar-bundles/nifi-hive-bundle/nifi-hive-processors/src/main/java/org/apache/nifi/processors/hive/ConvertAvroToORC.java > > > > > > > > On Wed, Jul 15, 2020 at 4:51 PM Ryan Schachte > > > > wrote: > > > > > > > > > > I'm writing a standalone Java process and interested in converting > > the > > > > > consumed Avro messages to ORC. I've seen a plethora of examples of > > > > writing > > > > > to ORC, but the conversion to ORC from Avro is what I can't seem to > > find > > > > a > > > > > lot of examples of. > > > > > > > > > > This is just a standard Java process running inside of a container. > > > > > > >

Re: Avro to ORC Conversion

2020-07-16 Thread Dongjoon Hyun
> [1] > > > > https://github.com/apache/nifi/blob/main/nifi-nar-bundles/nifi-hive-bundle/nifi-hive-processors/src/main/java/org/apache/nifi/processors/hive/ConvertAvroToORC.java > > > > > > On Wed, Jul 15, 2020 at 4:51 PM Ryan Schachte > > > wrote: > > &g

Re: Avro to ORC Conversion

2020-07-15 Thread Matt Burgess
oToORC.java > > > > On Wed, Jul 15, 2020 at 4:51 PM Ryan Schachte > > wrote: > > > > > > I'm writing a standalone Java process and interested in converting the > > > consumed Avro messages to ORC. I've seen a plethora of examples of > > writing &g

Re: Avro to ORC Conversion

2020-07-15 Thread Ryan Schachte
o messages to ORC. I've seen a plethora of examples of > writing > > to ORC, but the conversion to ORC from Avro is what I can't seem to find > a > > lot of examples of. > > > > This is just a standard Java process running inside of a container. >

Re: Avro to ORC Conversion

2020-07-15 Thread Matt Burgess
I've seen a plethora of examples of writing > to ORC, but the conversion to ORC from Avro is what I can't seem to find a > lot of examples of. > > This is just a standard Java process running inside of a container.

Re: Avro to ORC Conversion

2020-07-15 Thread Ryan Schachte
n Wed, Jul 15, 2020 at 1:51 PM Ryan Schachte > wrote: > > > I'm writing a standalone Java process and interested in converting the > > consumed Avro messages to ORC. I've seen a plethora of examples of > writing > > to ORC, but the conversion to ORC from Avro is what I can't seem to find > a > > lot of examples of. > > > > This is just a standard Java process running inside of a container. > > >

Re: Avro to ORC Conversion

2020-07-15 Thread Dongjoon Hyun
) will be 500MB. Bests, Dongjoon. On Wed, Jul 15, 2020 at 1:51 PM Ryan Schachte wrote: > I'm writing a standalone Java process and interested in converting the > consumed Avro messages to ORC. I've seen a plethora of examples of writing > to ORC, but the conversion to ORC from Avro

Avro to ORC Conversion

2020-07-15 Thread Ryan Schachte
I'm writing a standalone Java process and interested in converting the consumed Avro messages to ORC. I've seen a plethora of examples of writing to ORC, but the conversion to ORC from Avro is what I can't seem to find a lot of examples of. This is just a standard Java process running inside