Re: orc question

2020-03-26 Thread Matt Burgess
I'm not aware of a published list, but they correspond to Maven profiles that are disabled by default, here's what I think is the current list of NARs that are built/published but not included with the NiFi release: nifi-ranger-nar nifi-graph-client-service-api-nar nifi-neo4j-cypher-service-nar

Re: orc question

2020-03-26 Thread Benjamin Garrett
Hi Matt, Thank you for the quick response. I was not aware of the hive3 nar. Is there a list of these NARs that are released but not included in the default distribution? A quick search didn't turn up anything. Thanks, Ben On Thu, Mar 26, 2020 at 12:36 PM Matt Burgess wrote: > Ben, > >

Re: orc question

2020-03-26 Thread Matt Burgess
Ben, NiFi doesn't currently have components that support Hive 2, although some work has been done on that front [1]. However there are Hive 3 components including a PutORC processor that is kind of a mashup between the old Hive 1-based ConvertAvroToORC and PutHDFS/PutParquet, it does the

orc question

2020-03-26 Thread Benjamin Garrett
Hi, Regarding ConvertAvroToORC, I found this link which describes incompatibilities with later version of hive. https://community.cloudera.com/t5/Support-Questions/hive-2-3-return-NULLS-using-NIFI-convertAvroToORC/td-p/175279 Are there plans to support newer versions of hive with orc output from

Nifi zookeeper state migration to different cluster

2020-03-26 Thread sanjeet rath
Hi Team, I am trying to achieve Nifi migration to a different cluster using zookeeper state migration (in case of failure of cluster) Steps i am doing. zk-migrator.sh -r -z sourceHostname:sourceClientPort/sourceRootPath/components -f /path/to/export/zk-source-data.json zk-migrator.sh -s -z