NiFi Versioned Process Group Status Icons

2018-03-22 Thread Peter Wicks (pwicks)
Why does NiFi show status icons for Versioned Process Group's on servers that are not configured to connect to a NiFi Registry? Thanks, Peter

Re: [VOTE] Release Apache NiFi 1.6.0

2018-03-22 Thread Andrew Lim
+1 (non-binding) -Ran full clean install on OS X (10.11.6) -Tested integration with Secure NiFi Registry (1.5.0) -Tested fine grained restricted component policies. Found two minor issues: Components are marked with the "restricted" red shield icon, but are not tagged as “restricted"

Re: [VOTE] Release Apache NiFi 1.6.0

2018-03-22 Thread Aldrin Piri
+1, binding comments: * the listed commit is the new one for 1.7.0 development, its parent 99bc762a181892aa9ac50b0c6c81e8159b052137 matches the source ( https://git-wip-us.apache.org/repos/asf?p=nifi.git;a=commit;h=99bc762a181892aa9ac50b0c6c81e8159b052137 ) * signature and hashes look good *

Re: [EXT] Re: Add interrupt option for stopped processors with active threads

2018-03-22 Thread Joe Witt
Karthik I believe there are ways to determine underlying threads being executed tied to particular linux processes in some cases. However, NiFi doesn't pin a processor to a specific/single thread. A single processor could use every thread in the thread pool during its lifetime. What would be

RE: [EXT] Re: Add interrupt option for stopped processors with active threads

2018-03-22 Thread Karthik Kothareddy (karthikk) [CONT - Type 2]
Also on the same note, is there a way to get the underlying PID (unix) for a Processor? I know we can get the PID for the NiFi itself and get the child processes for that. But is there a way we can correlate them back to actual NiFi Processors ? -Original Message- From: Matt Gilman

Apache NiFi 1.6.0 RC1 Release Helper Guide

2018-03-22 Thread Joe Witt
Hello Apache NiFi community, Please find the associated guidance to help those interested in validating/verifying the release so they can vote. # Download latest KEYS file: https://dist.apache.org/repos/dist/dev/nifi/KEYS # Import keys file: gpg --import KEYS # [optional] Clear out local maven

RE: [EXT] Re: Add interrupt option for stopped processors with active threads

2018-03-22 Thread Karthik Kothareddy (karthikk) [CONT - Type 2]
Thanks Matt, will keep an eye on it. -Original Message- From: Matt Gilman [mailto:matt.c.gil...@gmail.com] Sent: Thursday, March 22, 2018 11:46 AM To: dev@nifi.apache.org Subject: [EXT] Re: Add interrupt option for stopped processors with active threads There is a PR available for the

Re: Add interrupt option for stopped processors with active threads

2018-03-22 Thread Matt Gilman
There is a PR available for the backend work [1]. It is actively being reviewed. Following that, there is additional work to make the front-end changes [2]. It doesn't look like it's going to make it into 1.6.0. However, it should be in scope for 1.7.0 assuming sufficient review traction for both

Add interrupt option for stopped processors with active threads

2018-03-22 Thread Karthik Kothareddy (karthikk) [CONT - Type 2]
Hello, Is there an ETA on the below Improvement? Or is it in the scope for any future releases? https://issues.apache.org/jira/browse/NIFI-78 Thanks Karthik

[VOTE] Release Apache NiFi 1.6.0

2018-03-22 Thread Joe Witt
Hello, I am pleased to be calling this vote for the source release of Apache NiFi nifi-1.6.0. The source zip, including signatures, digests, etc. can be found at: https://repository.apache.org/content/repositories/orgapachenifi-1122 The Git tag is nifi-1.6.0-RC1 The Git commit ID is

Re: [ANNOUNCE] New Apache NiFi Committer Mike Thomsen

2018-03-22 Thread Joe Skora
Congrats Mike! On Wed, Mar 21, 2018 at 1:52 PM, Joe Percivall wrote: > Thank you for your prior and continued contributions Mike, and congrats! > > On Wed, Mar 21, 2018 at 12:59 PM, Marco Gaido > wrote: > > > Congrats Mike! Well deserved! > > > >

Re: Stackoverflow question: Moving data from one RDB to another through NiFi

2018-03-22 Thread Jorge Machado
That would be probably the fastest way. Jorge Machado www.jmachado.me > On 22 Mar 2018, at 08:38, Brett Ryan wrote: > > Hmmm, now I’m doubting myself. It’s possible we sqoop to hdfs then sqoop > out, will have to look, sorry if I am wrong. > > On Thu, 22 Mar 2018 at

Re: Stackoverflow question: Moving data from one RDB to another through NiFi

2018-03-22 Thread Brett Ryan
Hmmm, now I’m doubting myself. It’s possible we sqoop to hdfs then sqoop out, will have to look, sorry if I am wrong. On Thu, 22 Mar 2018 at 18:27, Jorge Machado wrote: > Hi Bryan Sure ? Database to Database ? Or with a step in between ? Can > you past the command that you use ?

Re: Stackoverflow question: Moving data from one RDB to another through NiFi

2018-03-22 Thread Brett Ryan
Sure it does, I’m using it for postgres and MariaDB (which is essentially MySQL). > On 22 Mar 2018, at 18:18, Jorge Machado wrote: > > Sqoop does not import into a mySql database. Just into Hive if you tell him > to do so. > You could use Nifi but if you have a lot of data may

Re: Stackoverflow question: Moving data from one RDB to another through NiFi

2018-03-22 Thread Jorge Machado
Sqoop does not import into a mySql database. Just into Hive if you tell him to do so. You could use Nifi but if you have a lot of data may be you should try Spark. which reads and writes in Parallel. Using Nifi would work to but you have the overhead of pumping the data over “insert” unless

Re: Stackoverflow question: Moving data from one RDB to another through NiFi

2018-03-22 Thread Brett Ryan
Could Sqoop [1] be an option? [1]: http://sqoop.apache.org/ > On 22 Mar 2018, at 16:33, Sivaprasanna wrote: > > I had a chance to attempt a question raised on stackoverflow regarding > moving data from SQL Server to MySQL using NiFi. The user is using >