Re: PutElasticsearch error

2016-05-06 Thread Matt Burgess
Pierre is correct Sent from my iPhone > On May 6, 2016, at 5:20 PM, Pierre Villard > wrote: > > Hi Igor, > > I believe ES processor uses port 9300 (transport port) and not 9200 port > (http port) > > Pierre. > > 2016-05-06 23:16 GMT+02:00 Igor Kravzov

Re: ConvertAvroSchema locale default error

2016-05-06 Thread Aldrin Piri
Hi Conrad, Not very knowledgeable in Avro by any means, but did do a cursory glance over the code during a build. Based on your snippet of stacktrace, it appears the culprit is the incorrect use of "==" in lieu of ".equals." The lines in question are: final String localeProperty =

Re: NiFi app log

2016-05-06 Thread Simon Ball
The log rotation is controlled by the logback.xml in conf/ See http://logback.qos.ch/manual/configuration.html for instructions on how to control rotation. Simon On 6 May 2016, at 17:40, Igor Kravzov > wrote: Is there a configuration

RE: Cannot Authenticate the Azure Datalake Store

2016-05-06 Thread Kumiko Yada
HI Bryan, Here are the dependencies: org.apache.nifi nifi-api org.apache.nifi nifi-processor-utils org.apache.nifi nifi-mock test

Re: NiFi app log

2016-05-06 Thread Igor Kravzov
Great. Thank you. On May 6, 2016 1:01 PM, "James Wing" wrote: > Igor, > > The options that control log file rollover are in your NiFi's > conf/logback.xml file. Around line 24, you will find a section like the > following for the nifi-app.log: > >

Re: NiFi app log

2016-05-06 Thread James Wing
Igor, The options that control log file rollover are in your NiFi's conf/logback.xml file. Around line 24, you will find a section like the following for the nifi-app.log: ./logs/nifi-app_%d{-MM-dd_HH}.%i.log 100MB

Re: Failed to receive data from Hbase due to java net connection exception :Connection Refused in Nifi

2016-05-06 Thread Bryan Bende
Looks like it is not logging the full stacktrace by default... Can you edit NIFI_HOME/conf/logback.xml and add a line like this: Wait about 15-30 seconds and then see what is in nifi-app.log On Fri, May 6, 2016 at 10:37 AM, Venkatesh Bodapati < venkatesh.bodap...@inndata.in> wrote: > This is

Re: Failed to receive data from Hbase due to java net connection exception :Connection Refused in Nifi

2016-05-06 Thread Venkatesh Bodapati
This is whole stacktrace in nifi-app.log. 2016-05-06 20:01:33,201 INFO [pool-18-thread-1] o.a.n.c.r.WriteAheadFlowFileRepository Initiating checkpoint of FlowFile Repository 2016-05-06 20:01:33,473 INFO [pool-18-thread-1] org.wali.MinimalLockingWriteAheadLog

Re: Failed to receive data from Hbase due to java net connection exception :Connection Refused in Nifi

2016-05-06 Thread Bryan Bende
Ok, thanks for sharing that... Can you look in NIFI_HOME/logs/nifi-app.log and see if you can find that error message that says "Failed to receive data from HBase due to", and then there should be a whole stack trace that goes with that. If you could paste that whole stacktrace here that would

Re: Failed to receive data from Hbase due to java net connection exception :Connection Refused in Nifi

2016-05-06 Thread Venkatesh Bodapati
I am running NiFi, Hbase and Zookeeper in same machine. This my Hbase-site.xml : hbase.master localhost:6 hbase.rootdir hdfs://localhost:8020/hbase hbase.cluster.distributed

Re: Cannot Authenticate the Azure Datalake Store

2016-05-06 Thread Bryan Bende
Hello, It seems like maybe a wrong version of a library is being used, or maybe a JAR is missing that needs to be included in your NAR. Can you share what dependencies you have in the pom.xml of your processors project? You can check under

Re: Failed to receive data from Hbase due to java net connection exception :Connection Refused in Nifi

2016-05-06 Thread Bryan Bende
Can you describe your setup a little bit more, things like... Is NiFi running on the same machine that HBase and ZooKeeper are running on (it doesn't have to be, just want to understand the setup) ? What values do you have in hbase-site.xml for properties like... - hbase.zookeeper.quorum -

Re: Failed to receive data from Hbase due to java net connection exception :Connection Refused in Nifi

2016-05-06 Thread Venkatesh Bodapati
" Missing Row id failure, routing to failure " issue solved . Still i got the "failed to receive data from Hbase due to java net connection exception :Connection Refused" error in GetHbase Processor. I update Hbase-Site.xml and remove remaining properties like " Zookeeper Quorum Info,Zookeeper

ConvertAvroSchema locale default error

2016-05-06 Thread Conrad Crampton
Hi, I am seeing this error in my logs (may or may not be linked to upgrade to 0.6.1) java.lang.IllegalArgumentException: Invalid locale format: default at org.apache.commons.lang.LocaleUtils.toLocale(LocaleUtils.java:110) ~[na:na] at

Re: Nifi versions and upgrades

2016-05-06 Thread Conrad Crampton
Ok, will do Cheers Conrad On 06/05/2016, 13:18, "Joe Witt" wrote: >Conrad, > >Glad the upgrade is back on track. > >As for the kite/avro and locale case probably best to start another >thread as it will have a better chance of catching the eye of folks >with expertise

Re: Nifi versions and upgrades

2016-05-06 Thread Conrad Crampton
Hi Joe, Thanks for your quick response (again). You prompted me to look at every node in the cluster with ps aux | grep nifi and found that two of my nodes were still running 0.5.1. I do remember now that I was experiencing an odd thing with these in that everytime I did a service nifi stop, I

Re: Failed to receive data from Hbase due to java net connection exception :Connection Refused in Nifi

2016-05-06 Thread Venkatesh Bodapati
I fallow the above properties in EvaluateJsonPath processor , " Missing Row id failure, routing to failure " issue solved . Still i got the "failed to receive data from Hbase due to java net connection exception :Connection Refused" error in GetHbase Processor. I update Hbase-Site.xml and remove

Nifi versions and upgrades

2016-05-06 Thread Conrad Crampton
Hi, I have followed the advice on upgrade planning [1] and [2] and had success since upgrading from 0.4.1 to 0.6.1 (via .5x) or so I thought! I am using ansible to perform the upgrades to 6 node cluster but then go into each server to do a ./nifi.sh install to install new version as service.

Logstash/ Filebeat/ Lumberjack -> Nifi

2016-05-06 Thread Conrad Crampton
Hi, Some advice if possible please. Whilst I would love to wait for the MiNiFi project realise its objectives as this sounds exactly what I want from the initial suggestions I have a pressing need to shift some log files on remote servers (to my DC) to my NiFi cluster. Having a quick look at