Michal - It is on track to be available within about 3 hours.
On Fri, Mar 19, 2021 at 7:35 AM Michal Tomaszewski <[email protected]> wrote: > > Thanks! > > Regards, > > Michal > > > > From: Mark Payne <[email protected]> > Sent: Friday, March 19, 2021 3:01 PM > To: [email protected] > Subject: Re: SplitText issue > > > > Michal, > > > > We are working on a 1.13.2 release currently that should address this. > > > > Thanks > > -Mark > > > > > > On Mar 19, 2021, at 9:31 AM, Michal Tomaszewski <[email protected]> > wrote: > > > > Hi, > > > > In version 13.1 and 14 there is a problem with SplitText. In 1.13.0 and 1.10 > component works as expected. So problem is in any of fixes between 1.13 and > 1.13.1, > > > > Test scenario: > > We take 1.2GB file from HDFS > We divide it into rows/lines > Due to performance limitations we use 4 splittexts one after another: divide > flowfile into 5M rows, after that into flowfiles containing 500k rows, 50k > rows and at the end 5k rows. > > > > We verified the same problem exists when using only one splittext component > and smalle input flows (e.g. ~5000 rows on input divided into flows having > 200 rows is also not working) > > > > At the end we expect flowfiles having 5k rows: > > <image001.png> > > > > > > Result: > > currently flowfiles are divided into fragments (sometimes it is even 1,5row > instead of 5k rows) and it is even sometimes dividing in the middle of row: > > > > example #1 of output flow: > > > > <image002.png> > > > > Example #2 of output flow: > > <image003.png> > > > > > > > > > > Regards, > > Michał > > ________________________________________ Uwaga: Treść niniejszej wiadomości > może być poufna i objęta zakazem jej ujawniania. Jeśli czytelnik tej > wiadomości nie jest jej zamierzonym adresatem, pracownikiem lub pośrednikiem > upoważnionym do jej przekazania adresatowi, informujemy że wszelkie > rozprowadzanie, rozpowszechnianie lub powielanie niniejszej wiadomości jest > zabronione. Jeśli otrzymałeś tę wiadomość omyłkowo, proszę bezzwłocznie > odesłać ją nadawcy, a samą wiadomość usunąć z komputera. Dziękujemy. > ________________________________ Note: The information contained in this > message may be privileged and confidential and protected from disclosure. If > the reader of this message is not the intended recipient, or an employee or > agent responsible for delivering this message to the intended recipient, you > are hereby notified that any dissemination, distribution or copying of this > communication is strictly prohibited.If you have received this communication > in error, please notify the sender immediately by replying to the message and > deleting it from your computer. Thank you. ________________________________
