Hi Federico, thanks a lot, I really like your idea. It would be great to have more data quality PEs in StreamPipes. So far, we do not have an internal list for new PEs, but I think it would be a good idea to start one. There are some issues in jira [1] regarding new PEs (Component=Pipeline Element), but I think they do not focus on data quality. I created a wiki entry [2] to collect new ideas. I also think this is a great starting point when implementing a new PE, because all the inputs and outputs must be defined first before the implementation can start.
So, feel free to copy the template and create a draft definition of a new PE. We can also discuss new functionalities on the list. What do you think? @all please feel also free to add your ideas. Philipp [1] https://issues.apache.org/jira/projects/STREAMPIPES/issues [2] https://cwiki.apache.org/confluence/display/STREAMPIPES/Processing+Elements Von: Rullo, Federico <[email protected]> Datum: Montag, 16. Mai 2022 um 14:43 An: [email protected] <[email protected]> Betreff: PE component lists Hello everyone, I am trying to implement some Data Quality PE for StreamPipes but I am having a hard time finding ideas for new ones, since SP already comes packed with useful PEs. I was wondering if you guys had a list of PEs that I can refer to for new ideas on PEs that maybe you want to implement but haven’t already. I am interested especially in Data Quality Pipeline elements. So, if you have any internal list, or ideas that you can please share with me? That would be helpful. This way I would also have a base to maybe start contributing to the project once I finish implementing them. You can send me the list or reply directly to my email in case, or just to this email. Thank you in advance for your help, Kind Regards, Federico. Federico Rullo _________________________________________________________________ GFT Italia S.r.l. Via A. Rimassa, 51/2 16129 Genova, Italy T +39 025 8158169 [email protected] www.gft.com/it<http://www.gft.com/it> https://blog.gft.com https://www.linkedin.com/company/gft-group/ www.twitter.com/gft_it <http://www.twitter.com/gft_it%20> [cid:ActoForTheFuture_GFT@1,2x_68f73108-d76e-4497-aa5c-ff8a5693ce57.png]<https://www.gft.com/it/it/about-us/Sustainability> Registered office: GFT Italia S.r.l., Via Sile 18, 20139 Milan (Italy) VAT Code and number of registration with the Companies' Register of Milan: 00819200478 Corporate capital: Euro 1,000,000 fully paid-in Company subject to the direction and coordination activity of GFT Technologies SE Ai sensi del Regolamento UE 2016/679 (GDPR) e delle Linee Guida per posta elettronica ed Internet del Garante Privacy si rende noto che le informazioni contenute nella presente comunicazione e i relativi allegati possono essere riservate e sono, comunque, destinate esclusivamente alle persone o alla Società sopraindicati. Le stesse non sono da considerarsi comunicazioni personali, quindi eventuali risposte potranno essere conosciute da persone appartenenti all’azienda. In accordance with Regulation EU 2016/679 (General Data Protection Regulation) and Guidelines Applying to the Use of E-Mails and the Internet in the Employment Context of Italian Data Protection Authority it is announced that the information in this communication (which includes any documents with it) is confidential and meant only for above-mentioned persons and/or Companies; the information is not personal therefore, It is intended for the addressee only and any replies will be known by people belonging to the company. _________________________________________________________________
