Re: NiFi app log

The log rotation is controlled by the logback.xml in conf/ See http://logback.qos.ch/manual/configuration.html for instructions on how to control rotation. Simon On 6 May 2016, at 17:40, Igor Kravzov > wrote: Is there a configuration

Re: Sensitive values

This is a deliberate behavior to protect sensitive values being placed in templates. The chances are that if you’re using templates to move flows between instances, the instances would be configured with a different key for encrypting sensitive values, so even if you were to include the value

Re: GetMongo question

Not at present, unless you customize the query attribute yourself based on the results of the previous query, which is possible but a little fiddly. A better solution would be to add an incremental processor for Mongo, similar to QueryDatabaseTable, which uses the NiFi State storage mechanism

Re: Apache NiFi - WebHDFS

For webhdfs it could be difficult to build out with InvokeHttp, because of the slightly unusual way Hadoop uses http redirects. The principal is that you send a request without payload, get the redirect then send the request dictated by the redirect, but with the payload (redirect should be to

Re: Apache NiFi/Hive - store merged tweets in HDFS, create table in hive

For most hive JSON serdes you are going to want what some people call JSON record format. This is essentially a text file with a JSON document per line which represents a record, with reasonably consistent structure. You can achieve this by ensuring your JSON is not pretty formatted (one doc

Re: Large dataset on hbase

Hi Prabhu, Did you try increasing the heap size in conf/bootstrap.conf? By default nifi uses a very small RAM allocation (512MB). You can increase this by tweaking java.arg.2 and .3 in the bootstrap.conf file. Note that this is the java heap, so you will need more than your data size to

Re: Sqoop Support in NIFI

h is in avro or json format.but i need that data in Table Structure. And I have try QueryDatabaseTable Processor in nifi-0.6.0 It can return the Table record in avro format but i need those data in Table Structure. So anyone please help me to solve this. On Tue, Mar 29, 2016 at 3:02 PM, Sim

Re: Sqoop Support in NIFI

Another processor that may be of interest to you is the QueryDatabaseTable processor, which has just been released in 0.6.0. This provides incremental load capabilities similar to sqoop. If you’re looking for the schema type functionality, bear in mind that the ExecuteSQL (and new Query

Re: Aw: Re: central place to collect templates

There is a collection of templates for common patterns at https://github.com/hortonworks-gallery/nifi-templates Feel free to submit any interesting use cases as PRs to that GitHub. Simon On 24 Mar 2016, at 17:50, Uwe Geercken > wrote: Joe yes

Re: Deploying flows

You can do that by exporting templates, and then importing those to your prod environment and deploying them on that canvas. Note that this also means sensitive values will need to be reentered, which is usually a good thing when moving to a different environment. Simon On 11 Jan 2016, at

Re: How to extract attributes from ListenHTTP flow file?

It looks like what you have there is a JSON object inside a form encoded POST body, which is a little unusual. The header extraction won’t help you, since you’re looking to extract from the body, not the header. At the moment, nifi doesn’t handle the double encoding, but what you could do is

Re: Is it possible to to create a dynamic Processor through API call from PHP

Why not use the SSL layer provided by ListenHTTP? Simon On 2 Jan 2016, at 08:47, BOUKRAA, Kacem > wrote: Hello, I'm using a php script because the source requires an ssl connexion which is not the case with Nifi connexions. I've set up a listener