Re: Queue Issues

2018-07-20 Thread Mark Payne
Travis, If you Configure the FetchFile processor and go to the Scheduling tab, is it Timer-Driven with a Run Schedule of "0 secs"? Can you try going to in your browser to /nifi-api/processors//diagnostics and send the JSON that it returns to the mailing list? I.e., if you go to

CaptureChangeMySQL - initial binlog filename not working?

2018-07-20 Thread Katrina Henrie
I have a flow working using the CaptureChangeMySQL processor, however, when I set the Initial Binlog Filename to the most recent binlog (bin.58 with position starting at 1), the processor still begins at bin.01 Is this a bug? Am I entering the data wrong? Any help would be appreciated!

GenerateTableFetch -> RPG -> ExecuteSQL fetching duplicate records from Netezza but the count is same.

2018-07-20 Thread Mohit
Hi all, I am fetching data from Netezza using GenerateTableFetch -> RPG -> ExecuteSQL -> PutHDFS . It is working fine for most of the time, but for some tables with more than a million rows, it fetches duplicate rows. Partition Size varies from 3 million to 30 million with respect to table

Re: docker nifi cluster not working

2018-07-20 Thread Mike Thomsen
1.8 is not released yet. You'd have to build the source from the GitHub repo with "myn install -DskipTests=true" at the root of the project and then do "mvn clean install -Pdocker" inside of the nifi-docker/dockermaven project to build it. You're welcome to try it out, but as it's not released yet

Re: docker nifi cluster not working

2018-07-20 Thread Andrew Grande
I think the idea is, if there is anything available today, it will have to be built from sources, including the new docker image. I.e. it's not a public image yet. Andrew On Fri, Jul 20, 2018, 7:20 AM Chris Herssens wrote: > Hello Mike, > > Where can I find nifi 1.8 image for docker ? > I get

Re: docker nifi cluster not working

2018-07-20 Thread Chris Herssens
Hello Mike, Where can I find nifi 1.8 image for docker ? I get Pulling nifi (apache/nifi:1.8.0-SNAPSHOT-dockermaven)... ERROR: manifest for apache/nifi:1.8.0-SNAPSHOT-dockermaven not found Regards, Chris On Fri, Jul 20, 2018 at 1:10 PM Mike Thomsen wrote: > Cluster support is only in 1.8.

Re: docker nifi cluster not working

2018-07-20 Thread Mike Thomsen
Cluster support is only in 1.8. On Fri, Jul 20, 2018 at 7:02 AM Chris Herssens wrote: > Hello All, > > I try to setup a nifi cluster with docker for windows. > For that I use the docker-compose file from the nifi repository >

docker nifi cluster not working

2018-07-20 Thread Chris Herssens
Hello All, I try to setup a nifi cluster with docker for windows. For that I use the docker-compose file from the nifi repository (https://github.com/apache/nifi/tree/master/nifi-docker/docker-compose) I launch 3 nifi instance , but the instances are not clustered. In the nifi properties files

Re: RPG S2S Error

2018-07-20 Thread Faisal Durrani
Hi Joe/Koji, I cant seem to figure out a way to reduce the back pressure or to find the root cause of the errors 1.Unable to communicate with remote instance Peer [] due to java.io.EOFException; closing connection 2.indicates that port 37e64bd0-5326-3c3f-80f4-42a828dea1d5's destination is