[ 
https://issues.apache.org/jira/browse/NIFI-5079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16661929#comment-16661929
 ] 

Bartłomiej Tartanus commented on NIFI-5079:
-------------------------------------------

Does it mean that ConvertAvroToOrc is going to be depracated? Currently putting 
records with decimal field into Hive causes this error during select query:

{{java.lang.RuntimeException: 
com.cloudera.hiveserver2.support.exceptions.GeneralException: 
[Cloudera][HiveJDBCDriver](500312) Error in fetching data rows: 
*org.apache.hive.service.cli.HiveSQLException:java.io.IOException: 
java.io.IOException: ORC does not support type conversion from file type binary 
(14) to reader type decimal(10,2) (14):25:24;}}

Currently I am using NiFi 1.6 with Avro 1.8.2 and had to add logical types 
support without updating NiFi version, so I've prepared patch that fixes this 
error. I can submit pull request if you're interested. Only NiFiOrcUtils file 
needs to be changed - avro version is still 1.7.7.

> Add support for logical types to Hive DDL creation in PutORC
> ------------------------------------------------------------
>
>                 Key: NIFI-5079
>                 URL: https://issues.apache.org/jira/browse/NIFI-5079
>             Project: Apache NiFi
>          Issue Type: Improvement
>            Reporter: Matt Burgess
>            Assignee: Matt Burgess
>            Priority: Major
>
> While other processors have been updated to support Avro logical types (such 
> as decimal, timestamp, etc.), ConvertAvroToORC does not currently support 
> them. We should update ConvertAvroToORC to handle Avro logical types, not 
> just in the conversion to ORC but also in the generated Hive DDL.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to