Re: FetchFTP and ListFTP is working as expected

2019-05-31 Thread Joe Witt
Rohit

It appears you could benefit from leveraging the entity tracking feature of
ListFTP

http://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.9.2/org.apache.nifi.processors.standard.ListFTP/index.html

Thanks

On Fri, May 31, 2019 at 4:06 PM ravva  wrote:

> Hello - Here is my use case, I am using ListFTP and FetchFTP processor to
> get
> the files from source. Once the files are fetched and stored in target
> systems, there are new files that are being replaced with the same file
> names in source. Right now,  I am running a cron job every 30 mins and new
> file is added to source with same file name fore every 10 mins. When a new
> file is placed in source with same file name, how can the listftp and
> fetchftp pull the latest file.
>
>
> Thanks,
> Rohit
>
>
>
> --
> Sent from: http://apache-nifi-developer-list.39713.n7.nabble.com/
>


FetchFTP and ListFTP is working as expected

2019-05-31 Thread ravva
Hello - Here is my use case, I am using ListFTP and FetchFTP processor to get
the files from source. Once the files are fetched and stored in target
systems, there are new files that are being replaced with the same file
names in source. Right now,  I am running a cron job every 30 mins and new
file is added to source with same file name fore every 10 mins. When a new
file is placed in source with same file name, how can the listftp and
fetchftp pull the latest file. 


Thanks,
Rohit



--
Sent from: http://apache-nifi-developer-list.39713.n7.nabble.com/


Re: Need some help in creating Regex Expression

2019-05-31 Thread Endre Kovács
Hi,

Also when in doubt, you can always experiment, check and learn regex in online 
places like:

https://regex101.com/#pcre 
or
https://regexr.com/ 

where you can also specify a test string you want to match for.
Best regards,
Endre

> On 31 May 2019, at 18:47, ravva  wrote:
> 
> Hello - I have input files as below 
> 
> CanadaCST_prices.csv
> CanadaEST_prices.csv
> CanadaMST_prices.csv
> CanadaPST_prices.csv
> cst_prices.csv
> est_prices.csv
> mst_prices.csv
> pst_prices.csv
> 
> I have to write 2  regex expressions where in one of them I need to get only
> the file names that are starting with cst,est,mst,pst . In the second regex
> I need to pull the files that are starting with
> CanadaCST,CanadaEST,CanadaPST,CanadaMST. 
> 
> Can someone suggest on how to create a regex for this scenario.
> 
> Thanks,
> 
> 
> 
> 
> 
> --
> Sent from: http://apache-nifi-developer-list.39713.n7.nabble.com/



Re: Need some help in creating Regex Expression

2019-05-31 Thread Andy LoPresto
These two expressions should work:

^[cemp]st.*\.csv

^Canada[CEMP]ST.*\.csv

Andy LoPresto
alopre...@apache.org
alopresto.apa...@gmail.com
PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4  BACE 3C6E F65B 2F7D EF69

> On May 31, 2019, at 9:47 AM, ravva  wrote:
> 
> Hello - I have input files as below 
> 
> CanadaCST_prices.csv
> CanadaEST_prices.csv
> CanadaMST_prices.csv
> CanadaPST_prices.csv
> cst_prices.csv
> est_prices.csv
> mst_prices.csv
> pst_prices.csv
> 
> I have to write 2  regex expressions where in one of them I need to get only
> the file names that are starting with cst,est,mst,pst . In the second regex
> I need to pull the files that are starting with
> CanadaCST,CanadaEST,CanadaPST,CanadaMST. 
> 
> Can someone suggest on how to create a regex for this scenario.
> 
> Thanks,
> 
> 
> 
> 
> 
> --
> Sent from: http://apache-nifi-developer-list.39713.n7.nabble.com/



RE: [EXT] Re: [ANNOUNCE] New Apache NiFi PMC member Peter Wicks

2019-05-31 Thread Peter Wicks (pwicks)
Thanks everyone. Looking forward to continuing to work with the community for a 
long time to come.

-Original Message-
From: Mike Thomsen  
Sent: Friday, May 31, 2019 5:50 AM
To: dev@nifi.apache.org
Subject: [EXT] Re: [ANNOUNCE] New Apache NiFi PMC member Peter Wicks

Congratulations!

On Thu, May 30, 2019 at 11:55 PM Sivaprasanna 
wrote:

> Congratulations, Peter!
>
> On Fri, 31 May 2019 at 7:07 AM, Michael Moser  wrote:
>
> > Great work, Peter.  Congrats!
> >
> >
> > On Thu, May 30, 2019 at 8:05 PM Marc Parisi  wrote:
> >
> > > Congrats!
> > >
> > > On Thu, May 30, 2019, 2:58 PM Jeff  wrote:
> > >
> > > > Welcome to the PMC, Peter!  Congrats!
> > > >
> > > > On Thu, May 30, 2019 at 2:45 PM Tony Kurc  wrote:
> > > >
> > > > > Congratulations Peter!!
> > > > >
> > > > > On Thu, May 30, 2019 at 11:21 AM Aldrin Piri 
> > > wrote:
> > > > >
> > > > > > NiFi Community,
> > > > > >
> > > > > > On behalf of the Apache NiFi PMC, I am pleased to announce that
> > Peter
> > > > > Wicks
> > > > > > has accepted the PMC's invitation to join the Apache NiFi PMC.
> > > > > >
> > > > > > Peter's contributions have been plentiful in code, community,
> > reviews
> > > > and
> > > > > > discussion after becoming a committer in November 2017.  His
> impact
> > > > > across
> > > > > > NiFi has lead to improvements surrounding Kerberos, GetFile,
> > > ListFile,
> > > > > > Clustering, Node Offload, Recordset Writers, HDFS, and Database
> > > related
> > > > > > processors among others.
> > > > > >
> > > > > > Thank you for all your contributions and welcome to the PMC,
> Peter!
> > > > > >
> > > > > > --aldrin
> > > > > >
> > > > >
> > > >
> > >
> >
>


Re: [ANNOUNCE] New Apache NiFi PMC member Peter Wicks

2019-05-31 Thread Mike Thomsen
Congratulations!

On Thu, May 30, 2019 at 11:55 PM Sivaprasanna 
wrote:

> Congratulations, Peter!
>
> On Fri, 31 May 2019 at 7:07 AM, Michael Moser  wrote:
>
> > Great work, Peter.  Congrats!
> >
> >
> > On Thu, May 30, 2019 at 8:05 PM Marc Parisi  wrote:
> >
> > > Congrats!
> > >
> > > On Thu, May 30, 2019, 2:58 PM Jeff  wrote:
> > >
> > > > Welcome to the PMC, Peter!  Congrats!
> > > >
> > > > On Thu, May 30, 2019 at 2:45 PM Tony Kurc  wrote:
> > > >
> > > > > Congratulations Peter!!
> > > > >
> > > > > On Thu, May 30, 2019 at 11:21 AM Aldrin Piri 
> > > wrote:
> > > > >
> > > > > > NiFi Community,
> > > > > >
> > > > > > On behalf of the Apache NiFi PMC, I am pleased to announce that
> > Peter
> > > > > Wicks
> > > > > > has accepted the PMC's invitation to join the Apache NiFi PMC.
> > > > > >
> > > > > > Peter's contributions have been plentiful in code, community,
> > reviews
> > > > and
> > > > > > discussion after becoming a committer in November 2017.  His
> impact
> > > > > across
> > > > > > NiFi has lead to improvements surrounding Kerberos, GetFile,
> > > ListFile,
> > > > > > Clustering, Node Offload, Recordset Writers, HDFS, and Database
> > > related
> > > > > > processors among others.
> > > > > >
> > > > > > Thank you for all your contributions and welcome to the PMC,
> Peter!
> > > > > >
> > > > > > --aldrin
> > > > > >
> > > > >
> > > >
> > >
> >
>