Re: Convert Avro to ORC or JSON processor - retaining the data type

2019-03-10 Thread Koji Kawamura
Hi Ravi, How about storing those as string, and cast strings into numeric data type int/bigint when you query them? https://stackoverflow.com/questions/28867438/hive-converting-a-string-to-bigint Thanks, Koji On Sat, Mar 9, 2019 at 6:10 AM Ravi Papisetti (rpapiset) wrote: > > Thanks Koji for

Re: Convert Avro to ORC or JSON processor - retaining the data type

2019-03-08 Thread Ravi Papisetti (rpapiset)
Thanks Koji for the response. Our users want to run hiveql queries with some comparators and cannot work with string type for numeric data type. Any other options? Thanks, Ravi Papisetti On 07/03/19, 7:14 PM, "Koji Kawamura" wrote: Hi Ravi, I looked at following links, Hive

Re: Convert Avro to ORC or JSON processor - retaining the data type

2019-03-07 Thread Koji Kawamura
Hi Ravi, I looked at following links, Hive does support some logical types like timestamp-millis, but not sure if decimal is supported. https://issues.apache.org/jira/browse/HIVE-8131 https://cwiki.apache.org/confluence/display/Hive/AvroSerDe#AvroSerDe-AvrotoHivetypeconversion If treating the

Convert Avro to ORC or JSON processor - retaining the data type

2019-03-07 Thread Ravi Papisetti (rpapiset)
Hi, Nifi version 1.7 We have a dataflow that would get data from Oracle database and load into hive tables. Data flow is something like below: GenerateTableFetch -> ExecuteSQL > AvrotoJson/ORC (we tried both) > PutHDFS > ListHDFS> ReplaceTExt (to build load data query form the file) >