Re: Signing AWS Elasticsearch Requests?

Thanks, a few notes -- as far as not using AWS ES, we have been having issues with standard-ES, mainly the lack of encryption and authentication without the X-Pack (yes, I could proxy but that seems like a band-aid).. note that AWS VPCs are not encrypted internally, and any machine that you want

Re: Signing AWS Elasticsearch Requests?

Related, interesting take on AWS ES: https://code972.com/blog/2017/12/111-why-you-shouldnt-use-aws-elasticsearch-service I saw some other critical posts that went into detail on other issues. Considering how easy it is to stand up ES yourself, I think it would be worthwhile to strongly consider

Re: Signing AWS Elasticsearch Requests?

Sorry, just like the gateway api class, it is for managing ES not calling. On April 9, 2018 at 20:29:33, Otto Fowler (ottobackwa...@gmail.com) wrote: The aws java sdk has a purpose built ElasticSearchClient class. The way to do this and be consistent would be to add a new nifi-aws processor for

Re: Signing AWS Elasticsearch Requests?

Jon, In 1.6, we added a new client service for ES. There's only one processor that uses it for now, JsonQueryElasticSearch, but I have more under way that I hope will make it into 1.7. If you take a look at the existing version of the client service implementation that uses the official

Re: Signing AWS Elasticsearch Requests?

The aws java sdk has a purpose built ElasticSearchClient class. The way to do this and be consistent would be to add a new nifi-aws processor for the ES client, as there is for s3 and dynamoDB etc. https://github.com/apache/nifi/pull/2588 is my outstanding PR for HttpInvoke for AWS Gateway Web

Signing AWS Elasticsearch Requests?

Hi All, We are looking to use the built-in Nifi Elasticsearch Http processors with signed AWS ES requests. I tried to extend them to do so, but ran into issues with things being in-extensible (private-static-final in some cases), and was wondering if this would be something that would be

Re: Update docker tag 'latest' to nifi 1.6.0

Joe, A person would need to pull the image version: docker pull apache/nifi: Tag it as latest: docker tag apache/nifi: apache/nifi:latest and then push this tag to Docker Hub: docker push apache/nifi:latest Pushing to Docker Hub is only possible for those folks in the PMC who opted in

Re: Programmatically building a nested schema

Add a RecordField to the RecordSchema where the DataType is a RecordDataType... a RecordDataType then has a child schema. May be helpful to look at the code that converts between RecordSceham and Avro schemas:

Update docker tag 'latest' to nifi 1.6.0

Aldrin As noted in the announce thread our docker tag for latest is not updated. I see examples of how to do it but I want to make sure I dont mess it up. Do you have some instructions to share? I can put them in the release guide. Thanks

Re: [ANNOUNCE] Apache NiFi 1.6.0 release

I think the latest tag is not updated. I just switched from pull apache/nifi:latest to nifi:1.6.0 and got it. On Mon, Apr 9, 2018 at 8:15 AM, Pierre Villard wrote: > Mike, > > It's up on my side: https://hub.docker.com/r/apache/nifi/builds/ > > Pierre > > 2018-04-09

Re: [ANNOUNCE] Apache NiFi 1.6.0 release

Mike, It's up on my side: https://hub.docker.com/r/apache/nifi/builds/ Pierre 2018-04-09 12:28 GMT+02:00 Mike Thomsen : > Any word on when the Docker repository is going to be updated? > > Thanks, > > Mike > > On Sun, Apr 8, 2018 at 10:46 PM, Joe Witt

Re: Host a web service on Nifi to be able to consume by third party systems

Not really. The embedded Jetty container is meant to host NiFi web components, not third party apps. There's no real reason to deploy a WAR file there because you could just spin up Tomcat, drop the SOAP service there and have them both accessible through a reverse proxy. Thanks, Mike On Mon,

Hosting SOAP web service on NIFI

Hi, I would like to host a SOAP web service in NIFI. Is it possible to do? My third party system accepts only SOAP messages. Any help would be highly appreciated. Thanks, Kalyan -- Sent from: http://apache-nifi-developer-list.39713.n7.nabble.com/

Host a web service on Nifi to be able to consume by third party systems

Hi, I would like to host SOAP web service in NIFI. My third party system accepts only SOAP endpoints to be consumed. Is there a way to achieve? Thanks, Kalyan -- Sent from: http://apache-nifi-developer-list.39713.n7.nabble.com/

Re: [ANNOUNCE] Apache NiFi 1.6.0 release

Any word on when the Docker repository is going to be updated? Thanks, Mike On Sun, Apr 8, 2018 at 10:46 PM, Joe Witt wrote: > Hello > > The Apache NiFi team would like to announce the release of Apache NiFi > 1.6.0. > > Apache NiFi is an easy to use, powerful, and