ConsumeKafka starts incorrectly

2018-04-25 Thread
Hi all, I use “ConsumeKafka” processor recently and I find a problem. When I set “Run Schedule” setting below 5 sec, the processor can run timely, but when schedule interval above 10 sec, “ConsumeKafka” doesnot run any more. The state of processor remains running all the time. Thanks!

答复: 答复: put pictures from remote server into hdfs

2018-03-23 Thread
to store a lot of images and aren't able to commit to a small file size, I would recommend looking at BLOB store like S3 or OpenStack Swift. Maybe Ceph as well. On Thu, Mar 22, 2018 at 8:59 PM, 李 磊 <lei...@ruisdata.com<mailto:lei...@ruisdata.com>> wrote: Hi Bryan: Thanks for you response.

答复: put pictures from remote server into hdfs

2018-03-22 Thread
rent filename, you can stick an UpdateAttribute before PutHDFS and change the filename attribute to whatever makes sense. -Bryan On Thu, Mar 22, 2018 at 12:18 PM, 李 磊 <lei...@ruisdata.com> wrote: > Hi all, > > > > It is my requirement that put pictures from remote serve

put pictures from remote server into hdfs

2018-03-22 Thread
Hi all, It is my requirement that put pictures from remote server(not in nifi cluster) into hdfs. First I use the GetSFTP and PutFile to get pictures to local, and then use ExecuteFlumeSource and ExecuteFlumeSink to put pictures into hdfs from local. However, there is a problem that the name

whitelisting problems with host property

2018-03-18 Thread
Hi all, I now use the NIFI-1.5.0 and I want to build a NIFI cluster and make a haproxy + keepalived ahead. It makes me confused that when I set the property “nifi.web.http.host” with an ip, I can visit NIFI UI both ip or hostname, but when I set the property with a hostname, I can only visit

issue with nifi startup performance

2018-03-14 Thread
Hi, I use KYLO with NIFI-1.3.0 now. In KYLO, I create 100 feed with data-ingest template to transform data form RDBMS to HDFS, which provided by kylo.Finally, more than 1000 processors were created and there are 29 processors in the reuseable_templates. NIFI uses 6g memory. However, when I