esto
> alopre...@apache.org
> *alopresto.apa...@gmail.com *
> PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69
>
> On Oct 13, 2016, at 5:13 PM, Matt Gilman wrote:
>
> Thanks for submitting the PR Stephane! I see that Andy has already stated
> that he's r
Investigated some more, open a JIRA issue, closed it via
https://github.com/apache/nifi/pull/1135
On Fri, Oct 14, 2016 at 9:47 AM Stéphane Maarek
wrote:
> Hi,
>
> Thanks it helps ! Good to know there is already a java client I could use.
> Nonetheless I think it would be extremely
-client-dto
1.0.0
Examples of its usage can be seen in our access control integration tests
[1].
Let me know if you have any other questions. Thanks!
Matt
[1]
https://github.com/apache/nifi/blob/master/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-web/nifi-web-api/src/test/jav
Hi,
It seems possible to create an API client for any language using this
project:
https://github.com/swagger-api/swagger-codegen
It needs the swagger.json file. I know it should be generated at build
time, but where can I find it?
Beyond that, would it be useful to extract that file, version co
Hi,
How should we proceed to promote flow from dev to test to prod?
Basically, our stakeholders are not happy with having people modifying
anything in production (so it's a read-only environment), and basically
want people to draft / edit their flow in dev, push them to test, and then
to prod
I t
Hi,
Has anyone deployed NiFi using docker? I see many images on dockerhub, but
I have a few questions regarding usage:
1) How do you handle overall configuration (java memory options, etc) ?
2) If you add a docker process, does the spun up NiFi get automatically
added to your cluster?
3) How do y
ert back to number to do the actual
> comparison though.
>
> Haven’t tested but something like…
>
> myAttr:toString():substringAfter(‘.’):toNumber():lt(1)
>
> Conrad
>
>
>
> *From: *Stéphane Maarek
> *Reply-To: *"users@nifi.apache.org"
> *Date: *
Hi,
I have a flow in which I extract an attribute from json using jsonpath.
That attribute happens to be a decimal number (0.123). I wanted to do a
simple operation such as myAttr:lt(0.1) but obviously that won't work. What
also won't work is myAttr:multiply(10):lt(1). I'm kinda stuck and I really
e alert icon is clicked or hovered, it could offer a quick description of
> the issue and how to resolve it.
>
> Andy LoPresto
> alopre...@apache.org
> *alopresto.apa...@gmail.com *
> PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69
>
> On Jul 18, 2016
full garbage collection. You are good.
>> On Jun 30, 2016 8:22 PM, "Stéphane Maarek"
>> wrote:
>>
>>> Got it thanks,
>>> So I assume none of this below if full garbage collection? This has
>>> happened in less than a day
>>>
>>>
Hi Joe,
Been using NiFi for a while and I have always been wondering why I was
capping at 10 thread. Now I have my answer :)
It would be great to have a visual cue (warning sign) next to Active thread
on the left hand side, in case the max number is reached too often. Giving
the user an idea of ho
eference#java_annotation
> [4] https://issues.apache.org/jira/browse/NIFI-2215
>
> On Sun, Jul 10, 2016 at 7:42 PM, Stéphane Maarek
> wrote:
> > Hi,
> >
> > I've been thinking about implementing a RethinkDB processor as I'm
> needing
> > one for my p
Hi,
I've been thinking about implementing a RethinkDB processor as I'm needing
one for my project. Right now, if I put my code inside of an ExecuteScript,
I basically connect to the database as many times as I'm inserting
documents, and that's rather inefficient (I believe). The best I can get is
s, would recommend at least putting prov repo on its own disk.
>
> - If you do have enough disks, you can strip the content repo and your
> prov repo across multiple disks to scale vertically, and you'll
> see much better performance this way.
>
>
> Thanks
> -Markk
>
>
e more efficient in many cases
> if it is able to provide the routing logic that you need. It also tends to
> be easier to read than regular expressions, which is nice when
> you (or someone else) goes back later to modify the flow.
>
> Please let me know if anything here does
Hi,
I have a question regarding RouteText. The processor works just fine for me
but maybe I'm missing a couple subtleties:
1) I have a regex to group data by (a pair of IDs), but what do I use the
grouping attribute for? I still get as many outputs as lines
2) My data is coming from a listenUDP.
or all of the processors, etc., etc.
>
> If you were to see "Full Garbage Collections" taking place then there may
> be some concern but minor garbage collections
> are pretty frequent and shouldn't cause concern.
>
> Thanks
> -Mark
>
>
> On Jun 30, 2016,
Heap (32.0%)
*Max* 5 GB
*Total* 4 GB
*Used* 1.62 GB
*Free* 2.38 GB
dd
I have an issue, I followed this link to "optimize" HDF
https://community.hortonworks.com/articles/7882/hdfnifi-best-practices-for-setting-up-a-high-perfo.html
Basically, I have two UDP receivers but they don't receive any dat
Hi,
I'm wondering which instance on AWS EC2 is best suited for NiFi (let's say
for a standalone). I'm wondering if it's a compute instance (c4), or
something else? and why?
Thanks for your help!
Stephane
nifi-resources/src/main/resources/conf/logback.xml
>
> Cheers
>
> On Wed, Jun 8, 2016 at 10:22 AM, Stéphane Maarek <
> stephane.maa...@gmail.com> wrote:
>
>> Hi Andrew,
>>
>> It looks like the settings don't work. only the main logs go to the
>>
Hi Andrew,
It looks like the settings don't work. only the main logs go to the
indicated folder, the other dated files still go to my internal log
folder...
ls /mnt/xvdf/logs
nifi-app.log nifi-bootstrap.log nifi-user.log
ls ~/nifi/logs/
nifi-app_2016-06-06_16.0.log nifi-app_2016-06-07_22.1.lo
Actually, it seems I only needed to change one line (versus two)
/mnt/xvdf/logs/nifi-bootstrap.log
./logs/nifi-bootstrap_%d.log
On Mon, Jun 6, 2016 at 4:20 PM Stéphane Maarek
wrote:
> Hi Andrew,
>
> After changing the file I'
ferences above in to your attached volume.
> I have marked them with bold above. In the logback config file you will see
> two other appenders as well, these same changes should be done there as
> well.
>
> Thanks,
> Andrew
>
>
> On Mon, Jun 6, 2016 at 6:56 AM, Stéphane Maarek
Hi,
I'm running NiFi on a t1.micro in AWS. I have attached a 100GB EBS volume
at /mnt/xvdf and all the NiFi databases are there. I have a problem though.
It seems that NiFi keeps an internal log and I can't change the position of
it, so it's quickly clogging my t1.micro disk. See below. How can I
Hi,
How do I construct a bson from the getMongo processor?
Basically, I want to retrieve field_1, field_2
Side note: I think your overall documentation is great, but it's missing
"example values". This will users figure out much more quickly what values
is expected from properties
Cheers
Stephan
Hi,
@Joe: you're right, it would be tedious to store the state, and probably
isn't the best route. The ingestion rate of data is one point per 0.1 sec
per device
@Thad: I really like your suggestion, it makes my life a little bit easier.
I'm going to use MongoDB and perform upserts thanks to the P
I have tried a ControlRate but it doesn't work because it seems to stop
processing once the threshold of 1 is reached, even though I set a grouping
property (I know there are two different values for my group in my queue).
Any clue?
On Thu, May 26, 2016 at 2:30 PM Stéphane Maarek
wrote:
Hi,
I need to output some data streaming from multiple devices directly into a
map (mapboxjs).
Basically, every 1 second, I want to only write the last data point for
each device to a json file. My problem resides in "how to pick the latest
data point by device"
My incoming flow file has three a
> On May 23, 2016, at 20:08, Stéphane Maarek
> wrote:
>
> An easy way to reproduce is to take the csv to json template here:
>
> https://cwiki.apache.org/confluence/download/attachments/57904847/CsvToJSON.xml?version=1&modificationDate=1442927496000&api=v2
>
>
> In the
tart it, it will likely only bring in one flow file, so
> you can react to how it works, then stop it before it empties the
> queue.
>
> I hope that makes sense, I apologize in advance if I made things more
> confusing. The good news is there is a solution to your problem, even
> i
Hi,
I'm very new to nifi and love the concept. As part of the process, I'm
learning. My biggest frustration is that I can't see the data flowing
through the system as I do development.
Maybe I missed an article or a link, but is it possible to view the data
while in the flow? I.e. Say I create a
Hi,
I think I have messed something up and I need some help
I downloaded and untar nifi on my raspberry pi.
Then I installed the service which is working (I can access nifi through my
browser)
Now something I can't do is the following:
sudo apt-get install fail2ban
How can I cleanly remove the ni
32 matches
Mail list logo
