Re: Nifi-1325 - Enhancing Nifi AWS S3 for cross account access - Refactoring Nifi-AWS Processor credentials to use credentials provider

2016-01-09 Thread James Wing
+1 on converting AbstractAWSProcessor to using AWSCredentialsProvider, and +1 to adding a controller service for AWS creds. I would like to help. The current AbstractAWSProcessor.onScheduled method already contains code to probe for the REGION PropertyDescriptor and modify the AWS client based

Failing Unit Test testShouldValidatePGPPublicKeyringExists

2016-01-12 Thread James Wing
I'm having trouble with a failing unit test in nifi-standard-processors, new in a recent merge. Any helpful tips would be appreciated. Failed tests: TestEncryptContent.testShouldValidatePGPPublicKeyringExists:254 ''Public Keyring File' is invalid because Invalid Public Keyring File

Re: Failing Unit Test testShouldValidatePGPPublicKeyringExists

2016-01-12 Thread James Wing
OS-dependency on the differing messages, we could just > change the inspection to `instanceof FileNotFoundException`? > > Andy LoPresto > alopresto.apa...@gmail.com > PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > > On Jan 12, 2016, at 3:11 PM, James Wing <

Using NiFi S3 Processors with S3-Compatible Services?

2016-06-20 Thread James Wing
Is anyone using NiFi's S3 processors to work with non-Amazon, S3-compatible services? Would you be willing to share which service you are using and if you have experienced compatibility issues? Are you aware of the difference between S3's API signature versions 2 and 4? NiFi's current default

Re: Using NiFi S3 Processors with S3-Compatible Services?

2016-06-23 Thread James Wing
ng to a current library requires a lot of code changes, that seems > >like it would probably be a 1.0.0 change. > > > >Regards, > >Joe > > > >On Mon, Jun 20, 2016 at 2:40 PM, Tony Kurc <trk...@gmail.com> wrote: > > > >> James, > >> I bri

Re: [VOTE] Release Apache NiFi 0.7.0 (RC1)

2016-06-25 Thread James Wing
This feels like a newbie question, but the release tag "nifi-0.7.0-RC1" points to commit c9d9485, one commit ahead of the stated release commit 56dc8ae. Is that expected as part of generating the RC? Thanks, James On Fri, Jun 24, 2016 at 12:34 PM, Joe Percivall <

Re: NIFI on Windows Server 2008 R2

2016-02-08 Thread James Wing
Did you try it with a fresh Private/Incognito window? Do you get to the "Choose a certificate" step, or just nothing? On Mon, Feb 8, 2016 at 12:49 PM, Cruz, Alexandre < alexandre_c...@xtoenergy.com> wrote: > Team, > > I wonder if someone has NIFI running on Windows Server 2008 R2. > In my

Re: Apache NiFi RC2 timeline

2016-02-09 Thread James Wing
cause it will limit the > > amount of state we return back to the client/UI. I am concerned about > > the amount of state ListFile can generate in some cases and I think > > that needs to be solved but it doesn't need to hold up the release. > > > > Also, what do you

Trouble with RPMs

2016-01-30 Thread James Wing
Is anyone successfully using NiFi RPMs? I am having trouble building RPMs that result in a working NiFi installation on a clean system. I'm not sure if I'm just doing it wrong, or if I should create a ticket and try to fix it. After building an RPM (mvn clean install -Prpm) and installing it

Re: [DISCUSS] git branching model

2016-02-25 Thread James Wing
ported only to the last minor release in the 0.x line, or to all minor > releases in the 0.x line? > > Only to the most recent minor release of any still supported major > line. However, the catch of 'case by case' determination for older > minor lines is still in play. Basically i

Re: [DISCUSS] git branching model

2016-02-25 Thread James Wing
I have some rhetorical questions for discussion of the branching model: 1.) Commits merged to master today are destined for the next minor release, currently 0.6.0, by default? 2.) Is master always open for merging new code, or are there restrictions before or after releases? 3.) How long will

Re: ControllerStatusReportingTask bug

2016-04-30 Thread James Wing
Chris, I believe there is a JIRA for this issue, NIFI-1738 ( https://issues.apache.org/jira/browse/NIFI-1738), which has a fix waiting for the next release. You may want to confirm that it does what you think it should. Thanks, James On Sat, Apr 30, 2016 at 7:58 AM, Chris Conklin

Re: [ANNOUNCE] New Apache NiFi Committer James Wing

2016-05-11 Thread James Wing
Thank you, I'm excited to be contributing to a great project, and promise to use this position for good. Mostly. On Wed, May 11, 2016 at 1:10 PM, Joe Witt <joew...@apache.org> wrote: > On behalf of the Apache NiFi PMC, I am pleased to announce that James > Wing has accepted the PMC

Re: [DISCUSS] Apache NiFi 0.7.0 and 1.0.0

2016-05-17 Thread James Wing
I'm definitely in favor of releasing 0.7.0, but I don't think we need be rigid about the schedule. If delaying 0.7.0 a few weeks (2-4?) helps pace us towards a 1.0 in mid- to late-Summer, that seems reasonable to me. Do we believe that is still a likely target? Thanks, James On Tue, May 17,

Re: [ANNOUNCE] Apache NiFi 0.6.1 release

2016-04-18 Thread James Wing
Thanks, Joe. Will the 0.6.1 git tag be published as part of the release? On Mon, Apr 18, 2016 at 5:23 AM, Joe Witt wrote: > Hello > > The Apache NiFi team would like to announce the release of Apache NiFi > 0.6.1. > > Apache NiFi is an easy to use, powerful, and reliable

Re: How can we validate a data flow.?

2016-08-12 Thread James Wing
NiFi has several features to provide monitoring and verification of your data flow: 1.) Provenance Data ( https://nifi.apache.org/docs/nifi-docs/html/user-guide.html#data-provenance) NiFi's Provenance subsystem tracks every flowfile, how it was modified, and how it exited NiFi. It is the "log of

Re: PutS3Object error

2016-07-20 Thread James Wing
Nabegh, Can you share which version of NiFi you are using? Have you tried GetS3Object? I recommend also trying GetS3Object also to separate general problems with authenticating and connecting to S3 from particular issues putting objects, putting can be more complicated. Thanks, James On

Re: PutS3Object error

2016-07-20 Thread James Wing
ListS3 processor is a great place to start. I can think of a couple of likely causes: * Credentials - you might want to double-check how you specified the credentials to make sure it is right. If you specify access key and secret key, and the secret key is not correct, I believe you will get

Re: [VOTE] Release Apache NiFi 0.7.0 (RC2)

2016-07-11 Thread James Wing
+1 (non-binding) I ran through the release helper and lightly tested the generated binary. On Sat, Jul 9, 2016 at 11:47 AM, Joe Percivall < joeperciv...@yahoo.com.invalid> wrote: > Hello Apache NiFi Community, > > I am pleased to be calling this vote for the source release of Apache NiFi, >

Re: [VOTE] Release Apache NiFi 1.0.0-BETA (RC1)

2016-08-06 Thread James Wing
+1, I think this is an appropriate Beta. I ran through the Release Helper, verified hashes and signatures, built and ran tests, and did some light testing. Thanks for putting this together, Joe. James On Fri, Aug 5, 2016 at 1:40 PM, Joe Percivall < joeperciv...@yahoo.com.invalid> wrote: >

0.x Build Breaking on nifi-kafka-pubsub-processors?

2016-08-06 Thread James Wing
It looks like the 0.x build is breaking on nifi-kafka-pubsub-processors. Is this a known issue? (see Travis build https://travis-ci.org/apache/nifi/jobs/150124534, for https://issues.apache.org/jira/browse/NIFI-2423) [INFO]

Re: Question on template handling in 1.0

2016-08-09 Thread James Wing
he current context, as an extension to the Actions toolbar or yet another floating window (yeah, I know). This might help reinforce the association and provide feedback as to where templates went. Thanks, James On Tue, Aug 9, 2016 at 10:08 AM, Joe Witt <joe.w...@gmail.com> wrote: > Jame

Re: 0.7.0 install bug centos 7

2016-06-20 Thread James Wing
Thanks for reporting this, Ryan, I see the same behavior. I created a JIRA for this issue (https://issues.apache.org/jira/browse/NIFI-2063). If you need a workaround, you can edit /etc/init.d/nifi to hard-code the path to the script directory: SCRIPT_DIR=/opt/nifi/current/bin

Re: [ANNOUNCE] New Apache NiFi Committer Jeff Storck

2017-02-21 Thread James Wing
Congratulations, Jeff! On Tue, Feb 21, 2017 at 11:41 AM, Aldrin Piri wrote: > On behalf of the Apache NiFI PMC, I am very pleased to announce that Jeff > Storck has accepted the PMC's invitation to become a committer on the > Apache NiFi project. We greatly appreciate all of

Re: [ANNOUNCE] New Apache NiFi PMC Member - James Wing

2017-02-22 Thread James Wing
Thank you all On Wed, Feb 22, 2017 at 6:58 AM, Aldrin Piri <ald...@apache.org> wrote: > Team, > > On behalf of the Apache NiFi PMC, I am pleased to announce that James Wing > has accepted the PMC's invitation to join the Apache NiFi PMC. We > greatly appreciate a

Re: [VOTE] Release Apache NiFi 1.1.2

2017-02-18 Thread James Wing
+1 (non-binding) - went through release helper. On Thu, Feb 16, 2017 at 7:37 PM, Andy LoPresto wrote: > Hello, > > I am pleased to be calling this vote for the source release of Apache NiFi > nifi-1.1.2. > > The source zip, including signatures, digests, etc. can be found

Re: [VOTE] Release Apache NiFi 0.7.2

2017-02-18 Thread James Wing
The unifying theme of 0.7.2 and 1.1.2 appears to be NIFI-3487 "Refactor user formatting". Is this urgent? https://issues.apache.org/jira/browse/NIFI-3487 https://github.com/apache/nifi/commit/bd88e4335ad151592f1310996e9a0513b7f0829a Thanks, James On Fri, Feb 17, 2017 at 9:55 AM, Joe Witt

Re: Quick question on LICENSE/NOTICE when bundling controllers and processors

2017-02-27 Thread James Wing
l but the above nar L > > considerations will still apply per L > > > > Does that help at all James? > > > > On Mon, Feb 27, 2017 at 4:31 PM, James Wing <jvw...@gmail.com> wrote: > > > Thank you both for bringing up this discussion. I have a few fo

Re: Quick question on LICENSE/NOTICE when bundling controllers and processors

2017-02-27 Thread James Wing
Thank you both for bringing up this discussion. I have a few follow-up questions: 1.) Is it true all of the NAR bundles in the NiFi source should have their own LICENSE and NOTICE files, without exception? In looking through the source, most nifi-*-nar projects have both files for binary

Re: Quick question on LICENSE/NOTICE when bundling controllers and processors

2017-02-27 Thread James Wing
per L > > Does that help at all James? > > On Mon, Feb 27, 2017 at 4:31 PM, James Wing <jvw...@gmail.com> wrote: > > Thank you both for bringing up this discussion. I have a few follow-up > > questions: > > > > 1.) Is it true all of the NAR bundles i

Re: Nifi Cross Account Download With A Profile Flag

2016-08-31 Thread James Wing
Keren, Which version of NiFi are you using? One thing I noticed in your configuration of FetchS3Object is you are setting both the Access Key and Secret Key properties with the AWS Credentials Provider. When you are using the AWS Credentials Provider Service, you should not specify keys. A

Re: Nifi Cross Account Download With A Profile Flag

2016-09-01 Thread James Wing
org.apache.nifi.processor.AbstractProcessor.onTrigger( > AbstractProcessor.jav > a:27) [nifi-api-0.6.0.1.2.0.0-91.jar:0.6.0.1.2.0.0-91] > > > If you (or anyone scanning the thread) can think of a way to do this > without upgrading that’d be awesome. Otherwise, I’ll start motivating the

Re: Nifi Cross Account Download With A Profile Flag

2016-09-01 Thread James Wing
t; property. > > Best, > Keren > > On 8/31/16, 6:24 PM, "Andrew Grande" <apere...@gmail.com> wrote: > > >Debug logging can be set in a processor itself in the UI, too. > > > >On Wed, Aug 31, 2016, 5:34 PM James Wing <jvw...@gmail.com> wrot

Re: Nifi : FetchS3 object

2016-09-14 Thread James Wing
I do not believe FetchS3Object currently supports requester-pays buckets. According to the documentation, we would have to include a header, x-amz-request-payer, to signal approval of the download charges. NiFi currently has no option to include that header.

Re: Nifi Debugging AWS PutS3 processor

2016-09-09 Thread James Wing
I'm sorry to hear you're having trouble with PutS3. A few questions: - Which version of NiFi are you using? - Have you configured the Proxy Host/Port or Endpoint Override URL settings on your PutS3 processor? - Are there larger exception stack traces in the nifi-app.log files you

Re: [ANNOUNCE] New Apache NiFi Committer Rob Moran

2016-09-19 Thread James Wing
Congratulations, Rob, and welcome! On Mon, Sep 19, 2016 at 12:08 PM, Tony Kurc wrote: > On behalf of the Apache NiFI PMC, I am very pleased to announce that Rob > Moran has accepted the PMC's invitation to become a committer on the Apache > NiFi project. We greatly appreciate

Re: [VOTE] Release Apache NiFi 1.0.0 (RC1)

2016-08-29 Thread James Wing
+1 (non-binding). I ran through the release helper, including hashes, build, tests. No showstopping issues for me. James On Fri, Aug 26, 2016 at 9:25 AM, Joe Percivall < joeperciv...@yahoo.com.invalid> wrote: > Hello Apache NiFi Community, > > I am pleased to be calling this vote for the

Re: Closing on solving NIFI-1500 - NiFi requires too much write permissions to bootstrap

2016-09-27 Thread James Wing
Andre, Is your target for NIFI-1500 the default installation permission scheme, or just that NiFi does not fail to start without the permissions in a customized scheme? Would it be acceptable to distinguish between permissions required to initialize NiFi the first time, and the permissions

Re: [VOTE] Release Apache NiFi 0.7.1 (RC1)

2016-10-18 Thread James Wing
+1, I was able to verify hashes, build with tests and checks, run NiFi and do simple testing. Thanks for putting this release together, Joe. On Sun, Oct 16, 2016 at 8:32 PM, Joe Skora wrote: > Hello, > > I am pleased to be calling this vote for the source release of Apache

Re: [DISCUSS] NiFi 1.1.0 release

2016-11-22 Thread James Wing
>>> > >>>> important > >>>> > >>>> bug fixes should come first. Getting 1.x into a state where the > >>>> > >>>> release > >>>> > >>>> notes don't say that it is geared toward de

Re: [ANNOUNCE] New Apache NiFi PMC Member - Andre Fucs de Miranda

2016-11-03 Thread James Wing
Congratulations, Andre! On Thu, Nov 3, 2016 at 7:37 PM, Joe Witt wrote: > Team, > > On behalf of the Apache NiFi PMC, I am pleased to announce that Andre > Fucs de Miranda has accepted the PMC's invitation to join the Apache > NiFi PMC. Andre's excellent contributions to

Re: ValidateCSV

2016-12-07 Thread James Wing
Shashi, The ValidateCsv processor's "Header" property allows the header to be ignored in validation, but it does not have a special feature to validate the header itself. I do not believe there is a similar feature for ignoring a footer. Can you expand a bit more on your use case and what kind

Re: how to aad a specified counter in nifi

2016-12-09 Thread James Wing
You can add a custom counter very easily using ExecuteScript: /* ECMAScript */ flowFile = session.get(); if (flowFile != null) { session.adjustCounter("SampleScriptCounter", 1, false); session.transfer(flowFile, REL_SUCCESS); } The performance may not be optimal, but you can experiment

Re: how to aad a specified counter in nifi

2016-12-09 Thread James Wing
calls > adjustCounter(). It's less confusing for what my guys want if the processor > doing this only occurs once in the flow, but this is good. We can probably > make use of this via a property they can use to name their counter. > > Great, thank you! > > Russ > > On 12/09/2016

Re: Regarding NIFI Support PLZ respond ASAP

2016-12-13 Thread James Wing
Ravi, This email list is for the Apache NiFi open source developer community, and offers no paid training or support. If you search for "nifi training" or "nifi support", you will easily find commercial service providers. Thanks, James On Tue, Dec 13, 2016 at 8:55 AM, teja ravi

Re: [VOTE] Release Apache NiFi 1.0.1 (RC1)

2016-12-17 Thread James Wing
+1 (non-binding). I ran through the release helper and did some basic testing of the built binary (Java 1.8.0_101, AWS Linux). Thanks for putting this together, Joe. James On Fri, Dec 16, 2016 at 7:28 AM, Joe Percivall < joeperciv...@yahoo.com.invalid> wrote: > I apologize for the improperly

Re: [VOTE] Release Apache NiFi 1.1.1 (RC1)

2016-12-20 Thread James Wing
+1 (non-binding). I ran through the release helper -- verified hashes, license/notice/readme files, full build, and tested the resulting binary without issues on JDK 1.8.0_101, Amazon Linux. Thanks, James On Mon, Dec 19, 2016 at 2:35 PM, Joe Percivall < joeperciv...@yahoo.com.invalid> wrote: >

Re: Legacy Authorized Users File approach not working?

2016-12-21 Thread James Wing
Russell, I would not recommend the Legacy Authorized Users approach in 1.x. It does work, but the authorizations model in 1.x is bigger than it was in 0.x, and the simple conversion will not provide all that you need. I recommend using the Initial Admin Identity, then configuring groups and

Re: FetchS3Object leak

2017-03-22 Thread James Wing
David, Can you clarify which part of the FetchS3Object code looks problematic to you? From a quick look, I found one use of S3Object in FetchS3Object.java, line ~106: try (final S3Object s3Object = client.getObject(request)) { flowFile =

Re: ConvertJSONToAvro converts only last valid JASON record from an Input file with many JSON records

2017-03-14 Thread James Wing
Anshuman, What kind of error messages are you seeing? If the input is newline-delimited JSON records, I believe ConvertJSONToAvro should transfer all valid records to the "success" relationship as a single Avro, and the entire input flowfile to the "incompatible" output if any are invalid. Does

Re: [VOTE] Release Apache NiFi nifi-nar-maven-plugin-1.2.0

2017-03-16 Thread James Wing
+1 Release this package as nifi-nar-maven-plugin-1.2.0 Went through the release helper, built NiFi with the new plugin, ran NiFi to make sure it didn't explode (it didn't). On Tue, Mar 14, 2017 at 9:21 AM, Bryan Bende wrote: > Hello, > > I am pleased to be calling this vote

Re: All Partitions have been blacklisted due to failures when attempting to update. If the Write-Ahead Log is able to perform a checkpoint, this issue may resolve itself. Otherwise, manual interventio

2017-03-16 Thread James Wing
Srini, The error message "FlowFile Repository failed to update" matches a known issue where NiFi has trouble persisting attributes larger than 64 KB ( https://issues.apache.org/jira/browse/NIFI-3389). Is it possible that your EvaluateJsonPath is creating attributes exceeding 64 KB? From your

Re: All Partitions have been blacklisted due to failures when attempting to update. If the Write-Ahead Log is able to perform a checkpoint, this issue may resolve itself. Otherwise, manual interventio

2017-03-16 Thread James Wing
Would it be possible to configure EvaluateJsonPath to place the selected JSON fragment in the flowfile content instead of an attribute? Or to break the selection across multiple attributes rather than one big one? Thanks, James On Thu, Mar 16, 2017 at 11:57 AM, srini

Re: Stalled PR clean-up

2017-04-10 Thread James Wing
+1, please close. It's worth adding that all of the above PRs were asked to provide proof-of-life back in February. On Mon, Apr 10, 2017 at 8:25 AM, Andre wrote: > dev, > > The PR queue is back at 80 contributions and unless someone suggest > otherwise I would love to be

Re: Documentation for 1.x

2017-04-12 Thread James Wing
Mark, Would you please open a JIRA ticket for known doc issues and feedback ( https://issues.apache.org/jira/browse/NIFI/)? I do not know if anyone is actively doing such a review at this minute, but the documentation is frequently updated as contributions come in. By the way, we are always

Re: AWS processor credentials question

2017-04-13 Thread James Wing
sted, since > > DefaultAWSCredentialsProviderChain.getInstance() is an > > AWSCredentialsProvider, not an AWSCredentials object. But the idea would > > be similar. > > > > On Thu, Apr 13, 2017 at 10:21 AM, Joe Gresock <jgres...@gmail.com> > wrote: > > > >

Error building RPM on master

2017-04-15 Thread James Wing
I'm having trouble building an RPM on the latest master. I used to do this with the command: mvn clean install -DskipTests -Prpm But this fails at the nifi-assembly step with an error: [ERROR] Failed to execute goal org.apache.maven.plugins:maven-assembly-plugin:2.5.2:single (make shared

Re: AWS processor credentials question

2017-04-13 Thread James Wing
the > controller service, since it relies on a file sitting on the file system > and requires you to manage rotating the keys. With EC2 instance profiles, > they manage the keys for you and it's theoretically more secure. > > > > On Thu, Apr 13, 2017 at 11:41 AM, James Wi

Re: Closing in on a NiFi 1.2.0 release?

2017-03-08 Thread James Wing
Bryan, I'm 100% in favor of you and Matt Gilman doing all the hard work. Oh, and uh... thanks! :) So the alternatives are: a.) Release 1.2.0 sooner (?), but without component versioning b.) Delay 1.2.0 (?) to incorporate component versioning Will the NAR plugin alone commit us to all of the

Re: Closing in on a NiFi 1.2.0 release?

2017-03-08 Thread James Wing
mponent versioning work if > anyone is interested. > > Thanks, > > Bryan > > > On Wed, Mar 8, 2017 at 2:43 PM, Russell Bateman <r...@windofkeltia.com> > wrote: > > +1 for component versioning in NiFi 1.2! > > > > > > On 03/08/2017 12:40 PM, James W

Re: [REMINDER] Please signoff when committing other people's changes

2017-03-02 Thread James Wing
I recommend the practice. Although the signoff may not be authoritative, it requires a positive action that suggests you purposefully merged the commit, as opposed to commits you might have accidentally merged and pushed. Thanks, James On Thu, Mar 2, 2017 at 7:49 AM, Joe Witt

Re: FW: Loading nifi server within a Java process

2017-04-05 Thread James Wing
Jamie, Sorry you didn't get a response. I'm happy to confirm that this is the correct list for your question. There is no well-beaten path for running NiFi in another process, NiFi assumes that it is deployed as it's own process. NiFi contains a number of features for classloader isolation,

Re: Dynamic attributes on repeating capture groups

2017-08-02 Thread James Wing
An exception thrown in your script and not caught will cause the process session to roll back, meaning that the flowfile will be go back to the input queue and retry. If you have the processor set to run on schedule every 0 seconds, it might retry a lot :). You are correct that routing to

Re: Dynamic attributes on repeating capture groups

2017-08-03 Thread James Wing
ExecuteScript will certainly support a clustered NiFi environment. Is the processor actually processing files on both nodes, but only failing on one? Is it possible that the cluster's flow routes files through the processor only on one node? Also, can you share your script? It sounds like you

Re: Expression Language support in AmazonS3

2017-07-17 Thread James Wing
The processors were written by different developers, at different times, with different use cases in mind. The end result is different approaches to creating storage service client objects and managing credentials. Although the current S3 processors are not designed with per-flowfile expressions

Re: Start Contributing

2017-07-12 Thread James Wing
Grant, Welcome to NiFi, and thanks for being willing to contribute! Wes is right, you can go ahead and submit a pull request (or patch) with your proposed changes. You don't need to wait for the JIRA to be reviewed. Thanks, James On Wed, Jul 12, 2017 at 8:26 PM, Wes Lawrence

Re: File Filter regular expression - GetFile

2017-06-28 Thread James Wing
The .* in your regular expression is allowing all characters. You can escape this and specify a literal dot with a backslash, like \. Try [ab]+\..* for example. On Wed, Jun 28, 2017 at 2:55 AM, shankhamajumdar < shankha.majum...@lexmark.com> wrote: > Hi, > > Just a small modification, I am

Re: RTC clarification

2017-07-06 Thread James Wing
We should definitely encourage review feedback from non-committers. Getting additional perspectives, interest, and enthusiasm from users is critical for any project, doubly so for an integrating application where committers cannot be experts in all the systems we are integrating with. I believe

Re: Dynamic attributes on repeating capture groups

2017-07-31 Thread James Wing
I think you will need to use an ExecuteScript processor to nicely format your data into attributes into the foo1=bar1 pattern. I'm assuming here that you cannot predict what the key names 'foo1', 'foo2', etc. will actually be. If you could predict those field names, an UpdateAttribute processor

Re: Apache NiFi 0.7.3 RC1 Release Helper Guide

2017-05-15 Thread James Wing
Michael, What's the plan for the PGP key distribution, or how do we get your key into the KEYS file? Thanks, James On Sun, May 14, 2017 at 5:36 PM, Michael Moser wrote: > Hello Apache NiFi community, > > Please find the associated guidance to help those interested in >

Re: [VOTE] Release Apache NiFi 0.7.3

2017-05-15 Thread James Wing
+1 - Ran through the release helper, verified hashes and signature (with provided mosermw.asc key). Full build succeeded. Ran a simple test flow. License, notice, readme all look good. Thanks for putting this release together. James On Sun, May 14, 2017 at 5:33 PM, Michael Moser

Re: Apache NiFi 0.7.3 RC1 Release Helper Guide

2017-05-15 Thread James Wing
wrote: > > > just need to update that dist key file is all. I think mike did > > > update the git entry. > > > > > > On Mon, May 15, 2017 at 3:12 PM, James Wing <jvw...@gmail.com> wrote: > > >> Michael, > > >> > > >> Wha

Re: Connecting Nifi 1.2.0 with Google Cloud Storage issue

2017-05-26 Thread James Wing
Martin, If you ran "gsutil ls" against the bucket from the instance using the service account, is it able to list the bucket? Can you describe a bit more about how the service account's access to the bucket was configured? Is it added to one of the project roles, explicitly granted on the

Re: Duplicated processors when using nifi processors dependency

2017-05-21 Thread James Wing
I created a JIRA for the nifi-aws-bundle structure, https://issues.apache.org/jira/browse/NIFI-3950. Is there a best practice for the abstract classes like Robert describes? Are they a better fit for the service API bundle or the processors bundle? Or does that become irrelevant once the NAR

Re: [VOTE] Release Apache NiFi 0.7.3

2017-05-16 Thread James Wing
+1 (binding), to be clearer On Mon, May 15, 2017 at 1:08 PM, James Wing <jvw...@gmail.com> wrote: > +1 - Ran through the release helper, verified hashes and signature (with > provided mosermw.asc key). Full build succeeded. Ran a simple test flow. > License, notice, readm

Re: [VOTE] Release Apache NiFi 0.7.4

2017-06-06 Thread James Wing
+1 (binding). Signature and hashes verified. License, notice, and readme look good. Build succeeded. Testing with a basic flow succeeded. Thanks again for the release. James On Mon, Jun 5, 2017 at 1:12 PM, Matt Gilman wrote: > Hello, > > > I am pleased to be calling

Re: [VOTE] Release Apache NiFi 1.3.0

2017-06-05 Thread James Wing
+1 (binding). I ran through the release helper -- verified signature and hashes, ran the full build, checked readme, license, and notice in source and output. I ran a simple flow and verified that it still works. Thanks for putting this release together, Matt. James On Mon, Jun 5, 2017 at

Re: [VOTE] Release Apache NiFi 1.2.0 (RC2)

2017-05-07 Thread James Wing
+1 (binding). Ran through the release helper, checked hashes, did the full build successfully. Checked the license, notice, and readme. Tested a basic flow. Thanks for putting this together, Bryan. James On Fri, May 5, 2017 at 7:07 PM, Bryan Bende wrote: > Hello, > > I

Re: [DISCUSS} Closing in on a NiFi 1.4.0 release?

2017-09-11 Thread James Wing
+1 It does seem to be about time to get a release out, and we should certainly take advantage of your offer to performing RM duties. Thank you for that. On Sun, Sep 10, 2017 at 5:45 PM, Jeff wrote: > All, > > On the dev and users lists there have been some questions about

Re: Url encoding with S3 processors

2017-09-10 Thread James Wing
Joe, The good news is that you can use expression language directly in FetchS3Object's Object Key property to decode your keys. For example, ${filename:urlDecode()} However, I'm not sure that could be done without you specifying that the key should be decoded. As I understand it, the following

Re: [VOTE] Release Apache NiFi 1.4.0 (RC2)

2017-09-28 Thread James Wing
+1 (binding). I ran through the release helper including signature, hashes, build, and testing the binary. I checked the LICENSE and NOTICE files. Everything looks good to me. One thing I noted is that Jeff's GPG key is not yet in the public KEYS file at

Re: dose nifi suport Regular Expression capturing groups text using Nifi Expression Language

2017-09-30 Thread James Wing
I believe the Replacement Value field should be set to something like this: ${'$1':jsonPath("$.data.orgcode")} We may be able to help more if you can provide some sample content and regular expression you are using. Thanks, James On Fri, Sep 29, 2017 at 7:16 PM, YuNing

Re: Re: dose nifi suport Regular Expression capturing groups text using Nifi Expression Language

2017-10-01 Thread James Wing
bout how to use a processor, as the doc on > nifi-website is very simple. > > > > Best Regards > YuNing > > From: James Wing > Date: 2017-10-01 00:18 > To: NiFi Dev List > Subject: Re: dose nifi suport Regular Expression capturing groups text > using Nifi Expression Lang

Re: [VOTE] Release Apache NiFi 1.4.0 (RC2)

2017-09-29 Thread James Wing
eload, I can > see my key at https://dist.apache.org/repos/dist/dev/nifi/KEYS. Could you > try opening the KEYS link in incognito mode and verify that my key is > there? > > Thanks, > Jeff > > On Fri, Sep 29, 2017 at 1:06 AM James Wing <jvw...@gmail.com> wrote: >

Re: [DRAFT][REPORT] Apache NiFi Board Report Oct 2017

2017-10-09 Thread James Wing
Thanks, Joe. It looks good to me, too. On Mon, Oct 9, 2017 at 7:12 AM, Joe Witt wrote: > Team, > > Please see draft board report. Am looking for feedback/edits quickly > as this needs to be submitted by Wed. I'll probably send it in > tonight though as I might not have

Re: hello

2017-11-11 Thread James Wing
A great place to start is the NiFi Development Guide ( https://nifi.apache.org/docs/nifi-docs/html/developer-guide.html). The Development Guide explains how the NiFi API works, and the extension components you may develop to customize NiFi. If you prefer to learn from examples, there are many

Re: [VOTE] Change the name Apache NiFi Fluid Design System to Apache NiFi Flow Design System

2018-05-18 Thread James Wing
+1 (binding) > On May 18, 2018, at 6:30 AM, Rob Moran wrote: > > Following positive response discussing the name change of nifi-fds [1], I'd > like to call a vote to officially change the name of the Apache NiFi Fluid > Design System to the Apache NiFi Flow Design System. > >

Re: [VOTE] Release Apache NiFi Registry 0.2.0

2018-06-18 Thread James Wing
+1 (binding). Ran through the release helper, tested with a NiFi 1.7.0-SNAPSHOT build. Thanks, Kevin! On Fri, Jun 15, 2018 at 6:26 PM Kevin Doran wrote: > Hello, > > I am pleased to call this vote for the source release of Apache NiFi > Registry 0.2.0. > > The source zip, including

Re: [VOTE] Release Apache NiFi 1.7.0

2018-06-22 Thread James Wing
+1 (binding). Ran through the release helper, tested the binary, diffed the LICENSE and NOTICE files. Looks good to me. Thanks, Andy, for putting this release together. On Wed, Jun 20, 2018 at 12:16 AM Andy LoPresto wrote: > Hello, > > I am pleased to be calling this vote for the source

Re: [DISCUSS] Tar + Gzip vs. Zip

2018-06-26 Thread James Wing
It's a great idea, Andy, I strongly support just one format. I think Zip is a good choice. On Tue, Jun 26, 2018 at 11:16 AM Otto Fowler wrote: > I end up using zip all the time. zip +1 > > > On June 26, 2018 at 13:30:33, Tony Kurc (tk...@apache.org) wrote: > > My preference is zip. > > On

Confluence Wiki Access

2017-10-26 Thread James Wing
May I please have edit access to the Confluence Wiki? Thanks, James

Re: Confluence Wiki Access

2017-10-26 Thread James Wing
Thank you, Aldrin, that seems to have worked. On Thu, Oct 26, 2017 at 9:12 PM, Aldrin Piri <aldrinp...@gmail.com> wrote: > Hi James, > > You should be good to go now. Please let me know if that is not the case. > > On Thu, Oct 26, 2017 at 11:51 PM, James Wing <jvw...@gma

Re: [VOTE] Release Apache NiFi Registry 0.1.0

2017-12-30 Thread James Wing
+1 (binding). Ran through the release helper, verified hashes, LICENSE, NOTICE, and README. Built the source and performed light testing of the resulting binary. On Thu, Dec 28, 2017 at 10:09 AM, Bryan Bende wrote: > Hello, > > I am pleased to be calling this vote for the

Re: Getting lost a bit

2018-01-07 Thread James Wing
Mike, I believe you will want to rebase your branch on the latest master before you submit your PR. First, update your master branch if you have not already done so, with commands like the following: git checkout master git fetch origin git merge origin/master Second, rebase your feature

Re: [DISCUSS] Apache NiFi distribution has grown too large

2018-01-15 Thread James Wing
I think a reduced build is a good way forward until the extension registry is ready. If we can publish the remaining processors in one or more additional artifacts, that would be ideal. The admin burden of more git repositories or separate releases does not appeal to me, especially since we do

Re: [VOTE] Release Apache NiFi 1.5.0 (RC1)

2018-01-11 Thread James Wing
+1 (binding). Ran through the release helper, checked the signature, hashes, the license/notice changes, etc. Tested the binary for a while. Great work! On Tue, Jan 9, 2018 at 2:19 AM, Joe Witt wrote: > Hello, > > I am pleased to be calling this vote for the source

Re: [DISCUSS] Addressing Lingering Pull Requests

2018-01-29 Thread James Wing
This is a great idea, Mark, thanks for proposing it. 30 days after last review comment seems like a good, enforceable standard. James On Mon, Jan 29, 2018 at 8:29 AM, Mark Payne wrote: > All, > > We do from time to time go through the backlog of PR's that need to be >

Re: 答复: Re: Is there a REST API to run a dataflow on demand?

2018-02-21 Thread James Wing
The NiFi API can be used to start and stop processors or process groups, and this might solve your use case. But NiFi does not have an API to run a processor only once, immediately, separate from its configured schedule. I have solved similar problems in the past by creating two separate

Re: Setting values as System properties

2018-06-20 Thread James Wing
I agree it is not what we would hope for. But I have not found any information to contradict you. The proxy setting we use now for Google Cloud Storage apparently does not apply to Google Cloud PubSub. What user experience would you propose? It seems reasonable that a user might be able to

Re: [VOTE] Release Apache NiFi 1.7.1

2018-07-13 Thread James Wing
+1 (binding). Ran through the release helper, checked license, notice, readme files, and tested the resulting binary. Thanks for putting this together, Andy. On Thu, Jul 12, 2018 at 2:00 PM Andy LoPresto wrote: > Hello, > > I am pleased to be calling this vote for the source release of Apache

  1   2   >