Re: Want to contribute Jira[NIFI-4360]

[Aldrin Piri]

Hi Milan,

I have added your JIRA account as a contributor to the NIFI project. You
should be able to assign issues to yourself.  Please let us know if there
are any problems.

On Thu, Sep 14, 2017 at 6:38 AM, Milan Chandna <
milan.chan...@microsoft.com.invalid> wrote:

> Hi Andre,
>
> NIFI-4360 is about ADLS(Azure Data Lake Store) support whereas NIFI-1922
> is about WASB(Azure Blob Storage also called as Windows Azure Storage Blob)
> support.
>
> They both are different kind of repositories, meant for different purposes.
> Also the user set for both technologies might be overlapping but not same.
> So we need to support ADLS as well.
> To know more about the difference, please refer to below mentioned
> Microsoft official link.
> https://docs.microsoft.com/en-us/azure/data-lake-store/data-
> lake-store-comparison-with-blob-storage
>
> Regards,
> Milan.
>
> -Original Message-
> From: Andre [mailto:andre-li...@fucs.org]
> Sent: Thursday, September 14, 2017 10:52 AM
> To: dev@nifi.apache.org
> Subject: Re: Want to contribute Jira[NIFI-4360]
>
> Milan,
>
> Would you be able to comment on the differences between NIFI-4360 and
> NIFI-1922 ?
>
> Cheers
>
> On Thu, Sep 14, 2017 at 1:00 PM, Milan Chandna <
> milan.chan...@microsoft.com.invalid> wrote:
>
> > Hi,
> >
> > Can admins please make me a contributor so that I can assign
> > Jira[NIFI-4360] > ps%3A%2F%2Fissues.apache.org%2Fjira%2Fbrowse%2FNIFI-4360=02%7C01%
> > 7CMilan.Chandna%40microsoft.com%7C3111d807fbd242266c0008d4fb307f28%7C7
> > 2f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636409633098059764=3mo
> > 1IncHZfHyQ4YjFX70ZbvJsVczIFSHRG3NUUtEuo0%3D=0> (that I
> > raised) to myself.
> >
> > Regards,
> > Milan.
> >
>

Re: NIFI templates in template folder in sync with templates inside NIFI UI

[Matt Gilman]

Ben,

In the 0.x baseline, the templates were stored in the templates directory
that you're referring to. Starting in the 1.x baseline, the templates were
migrated to become part of the flow.xml.gz. In order to support users
upgrading from 0.x to 1.x, templates in the directory are automatically
moved to the flow.xml.gz. If you're looking to automate template
importing/removal, I would recommend using the REST API. If you open up
your browser you should be able to see these requests in action.
Additionally, you can find documentation for them here [1]. The
import/upload endpoints are under Process Groups and the removal endpoints
are under Templates.

Thanks

Matt

[1] https://nifi.apache.org/docs/nifi-docs/rest-api/index.html

On Thu, Sep 14, 2017 at 2:40 AM, 尹文才  wrote:

> Hi guys, I put all my flow template xml files inside the nifi template
> directory specified inside the nifi.properties config file so that nifi
> could read in all my templates. But sometimes I need to clear all the
> templates currently inside nifi and then place in a new template, I would
> remove all the template xml files inside the template folder and put the
> new template xml file into it. But when I restart nifi, there're 5
> templates available, which are 4 old templates and 1 new template.
>
> I know I could manually remove all templates inside nifi, but I wish to do
> this all programmatically. I also know nifi keeps the templates inside the
> flow.xml.gz file.
> So does nifi simply adds the new templates in the template folder into the
> flow.xml.gz file without removing the old ones?
>
> I have used beyond compare trying to compare the template xml file content
> with the template section inside the flow.xml extracted from flow.xml.gz,
> they're slightly differently and most content are the same, does anyone
> know the relationship between these two?
>
> What I want to achieve is to keep the templates in the template folder and
> the templates in nifi in sync without having to manually  do anything in
> nifi UI, does
> anyone know if it's possible and if so how? Thanks.
>
> /Ben
>

RE: Want to contribute Jira[NIFI-4360]

[Milan Chandna]

Hi Andre,

NIFI-4360 is about ADLS(Azure Data Lake Store) support whereas NIFI-1922 is 
about WASB(Azure Blob Storage also called as Windows Azure Storage Blob) 
support.

They both are different kind of repositories, meant for different purposes.
Also the user set for both technologies might be overlapping but not same.
So we need to support ADLS as well.
To know more about the difference, please refer to below mentioned Microsoft 
official link.
https://docs.microsoft.com/en-us/azure/data-lake-store/data-lake-store-comparison-with-blob-storage
 

Regards,
Milan.

-Original Message-
From: Andre [mailto:andre-li...@fucs.org] 
Sent: Thursday, September 14, 2017 10:52 AM
To: dev@nifi.apache.org
Subject: Re: Want to contribute Jira[NIFI-4360]

Milan,

Would you be able to comment on the differences between NIFI-4360 and
NIFI-1922 ?

Cheers

On Thu, Sep 14, 2017 at 1:00 PM, Milan Chandna < 
milan.chan...@microsoft.com.invalid> wrote:

> Hi,
>
> Can admins please make me a contributor so that I can assign 
> Jira[NIFI-4360] ps%3A%2F%2Fissues.apache.org%2Fjira%2Fbrowse%2FNIFI-4360=02%7C01%
> 7CMilan.Chandna%40microsoft.com%7C3111d807fbd242266c0008d4fb307f28%7C7
> 2f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636409633098059764=3mo
> 1IncHZfHyQ4YjFX70ZbvJsVczIFSHRG3NUUtEuo0%3D=0> (that I
> raised) to myself.
>
> Regards,
> Milan.
>

NIFI templates in template folder in sync with templates inside NIFI UI

[尹文才]

Hi guys, I put all my flow template xml files inside the nifi template
directory specified inside the nifi.properties config file so that nifi
could read in all my templates. But sometimes I need to clear all the
templates currently inside nifi and then place in a new template, I would
remove all the template xml files inside the template folder and put the
new template xml file into it. But when I restart nifi, there're 5
templates available, which are 4 old templates and 1 new template.

I know I could manually remove all templates inside nifi, but I wish to do
this all programmatically. I also know nifi keeps the templates inside the
flow.xml.gz file.
So does nifi simply adds the new templates in the template folder into the
flow.xml.gz file without removing the old ones?

I have used beyond compare trying to compare the template xml file content
with the template section inside the flow.xml extracted from flow.xml.gz,
they're slightly differently and most content are the same, does anyone
know the relationship between these two?

What I want to achieve is to keep the templates in the template folder and
the templates in nifi in sync without having to manually  do anything in
nifi UI, does
anyone know if it's possible and if so how? Thanks.

/Ben