Re: Apache Drill Hangout July 23rd
Perhaps next time Weijie :) In today's hangout we discussed the progress for Drill's Metastore and Hive complex type support. We also heard from 2 contributors who have gotten Drill to run on ARM processors and are going to present their findings in ApacheCon 2019. There was a question about where to find Drill's docker images. Here are the links: Doc: http://drill.apache.org/docs/running-drill-on-docker/ Images: https://hub.docker.com/r/drill/apache-drill/tags On Tue, Jul 23, 2019 at 10:50 AM weijie tong wrote: > Well, sorry about the missing time . I forgot to set the alarm and > overslept. Now I can't join the meeting, maybe it has finished. I will > issue the ParallelHashJoin PR recently. > > On Tue, Jul 23, 2019 at 10:14 AM Aman Sinha wrote: > > > Hi Drillers, > > > > We will have our bi-weekly hangout tomorrow, July 23rd, at 10 AM PST > > (link: https://meet.google.com/yki-iqdf-tai ). > > > > If there are any topics you would like to discuss during the hangout > please > > respond to this email. > > > > I believe last time Weijie mentioned he could talk about the hash join > > enhancements he is working on. Would be very interesting ! > > > > > > -Aman > > >
Re: Help needed : logfile plugin multiline parsing
Hi Vincent, The log (regex) plugin uses newlines a the delimiter between records and so it cannot currently handle newlines within a record. That is, the plugin really only works for single-line messages, or cases in which we want to ignore all but the header line (say). If you are up for a Java coding effort, you could modify the plugin to take another config parameter which is the record delimiter. (The text (CSV) plugin already does this.) You would need a unique marker that gives a context-free record split. The project would welcome such a contribution. If you made such an enhancement, you could have the plugin look for, say, double-newline as the record delimiter. Recall that Drill works with HDFS files. Each scan operator may be given a block of a file. When reading the second or later block of a file, the reader must scan forward to find the start of the next record using the record delimiter. For now, I'd suggest transforming your file to replace newlines with some other character, and replace any existing record delimiter with newline. Then you can use the log (regex) plugin. That is: [Thu May 2 00:17:50 2019]Local/ACTUAL///1/Info(1200450) External [GLOBAL] macro [@PHASE_INPUT] registered OK [Thu May 2 00:17:50 2019]Local/ACTUAL///1/Info(1019008) Reading Application Definition For [ACTUAL] Becomes: [Thu May 2 00:17:50 2019]Local/ACTUAL///1/Info(1200450)|External [GLOBAL] macro [@PHASE_INPUT] registered OK[Thu May 2 00:17:50 2019]Local/ACTUAL///1/Info(1019008)|Reading Application Definition For [ACTUAL] Maybe Charles has a better idea? Thanks, - Paul On Tuesday, July 23, 2019, 05:11:26 AM PDT, Vincent BENATIER wrote: Hi all, I was if the logfile plugin can handle multiline parsing ? When I try my regex syntax online, it works well but I seems that the "\\r\\n" are note recognized when trying to configure a logfile plugin in Apache Drill. Or perhaps I there another way to do but I could not find anything in the documentation or in the "Learning Apache Drill" book. Someone could help ? Vincent Regex syntaxes I tried -- "(\\[.+\\])(.+\\r\\n)(.+)" "(\\[.+\\])(.+)(\\r\\n.+)" "(\\[.+\\])(.+) \\r\\n (.+)" File sample -- [Thu May 2 00:17:50 2019]Local/ACTUAL///1/Info(1200450) External [GLOBAL] macro [@PHASE_INPUT] registered OK [Thu May 2 00:17:50 2019]Local/ACTUAL///1/Info(1019008) Reading Application Definition For [ACTUAL] [Thu May 2 00:17:50 2019]Local/ACTUAL///1/Info(1019009) Reading Database Definition For [Actual] [Thu May 2 00:17:50 2019]Local/ACTUAL///1/Info(1019021) Reading Database Mapping For [ACTUAL] [Thu May 2 00:17:50 2019]Local/ACTUAL///1/Info(1019010) Writing Application Definition For [ACTUAL] [Thu May 2 00:17:50 2019]Local/ACTUAL///1/Info(1019011) Writing Database Definition For [Actual]
RE: Help needed : logfile plugin multiline parsing
Hi Charles, Thank you for your quick answer and sorry if I missed something in the online doc or inside the book. (By the way, congratulations for this work because I find it very clear and very useful.) I will follow your advice and create a JIRA ticket. Thanks again. Vincent -Message d'origine- De : Charles Givre [mailto:cgi...@gmail.com] Envoyé : mardi 23 juillet 2019 18:08 À : user@drill.apache.org Objet : Re: Help needed : logfile plugin multiline parsing Hi Vincent, Thanks for your question. As written, the log reader doesn't support multiline logs. However, if you're interested, please create a JIRA ticket and if possible, attach a sample log and we'll see what we can do. -- C > On Jul 23, 2019, at 8:11 AM, Vincent BENATIER wrote: > > Hi all, > > I was if the logfile plugin can handle multiline parsing ? > > When I try my regex syntax online, it works well but I seems that the > "\\r\\n" are note recognized when trying to configure a logfile plugin > in Apache Drill. > Or perhaps I there another way to do but I could not find anything in > the documentation or in the "Learning Apache Drill" book. > > Someone could help ? > > Vincent > > Regex syntaxes I tried > -- > "(\\[.+\\])(.+\\r\\n)(.+)" > "(\\[.+\\])(.+)(\\r\\n.+)" > "(\\[.+\\])(.+) \\r\\n (.+)" > > File sample > -- > [Thu May 2 00:17:50 2019]Local/ACTUAL///1/Info(1200450) > External [GLOBAL] macro [@PHASE_INPUT] registered OK > > [Thu May 2 00:17:50 2019]Local/ACTUAL///1/Info(1019008) > Reading Application Definition For [ACTUAL] > > [Thu May 2 00:17:50 2019]Local/ACTUAL///1/Info(1019009) > Reading Database Definition For [Actual] > > [Thu May 2 00:17:50 2019]Local/ACTUAL///1/Info(1019021) > Reading Database Mapping For [ACTUAL] > > [Thu May 2 00:17:50 2019]Local/ACTUAL///1/Info(1019010) > Writing Application Definition For [ACTUAL] > > [Thu May 2 00:17:50 2019]Local/ACTUAL///1/Info(1019011) > Writing Database Definition For [Actual] >
Re: Apache Drill Hangout July 23rd
Well, sorry about the missing time . I forgot to set the alarm and overslept. Now I can't join the meeting, maybe it has finished. I will issue the ParallelHashJoin PR recently. On Tue, Jul 23, 2019 at 10:14 AM Aman Sinha wrote: > Hi Drillers, > > We will have our bi-weekly hangout tomorrow, July 23rd, at 10 AM PST > (link: https://meet.google.com/yki-iqdf-tai ). > > If there are any topics you would like to discuss during the hangout please > respond to this email. > > I believe last time Weijie mentioned he could talk about the hash join > enhancements he is working on. Would be very interesting ! > > > -Aman >
Re: [ANNOUNCE] New Committer: Igor Guzenko
Congratulations Igor. On Tue, Jul 23, 2019 at 10:43 AM weijie tong wrote: > Congratulations Igor! > > On Wed, Jul 24, 2019 at 1:23 AM Igor Guzenko > wrote: > > > Hello Drillers, > > > > Thank you all for the greetings. It is an honor for me to be part of the > > Apache Drill community. > > > > Best regards, > > Igor Guzenko > > > > On Tue, Jul 23, 2019 at 6:37 PM Charles Givre wrote: > > > > > Congrats Igor! Well deserved! > > > > > > > On Jul 23, 2019, at 11:15 AM, Kunal Khatua wrote: > > > > > > > > Congratulations, Igor! > > > > > > > > On Tue, Jul 23, 2019, 8:13 AM Aman Sinha > wrote: > > > > > > > >> Congratulations Igor and thanks for your contributions to Drill ! > > > >> > > > >> On Tue, Jul 23, 2019 at 3:33 AM Anton Gozhiy > > > wrote: > > > >> > > > >>> Congratulations Igor, well deserved! > > > >>> > > > >>> On Tue, Jul 23, 2019, 12:31 Volodymyr Vysotskyi < > > volody...@apache.org> > > > >>> wrote: > > > >>> > > > Congratulations, Ihor! Thanks for your contributions! > > > > > > Kind regards, > > > Volodymyr Vysotskyi > > > > > > > > > On Mon, Jul 22, 2019 at 5:02 PM Arina Ielchiieva < > ar...@apache.org> > > > >>> wrote: > > > > > > > The Project Management Committee (PMC) for Apache Drill has > invited > > > >>> Igor > > > > Guzenko to become a committer, and we are pleased to announce > that > > he > > > >>> has > > > > accepted. > > > > > > > > Igor has been contributing into Drill for 9 months and made a > > number > > > >> of > > > > significant contributions, including cross join syntax support, > > Hive > > > views > > > > support, as well as improving performance for Hive show schema > and > > > >> unit > > > > tests. Currently he is working on supporting Hive complex types > > > > [DRILL-3290]. He already added support for list type and working > on > > > struct > > > > and canonical map. > > > > > > > > Welcome Igor, and thank you for your contributions! > > > > > > > > - Arina > > > > (on behalf of the Apache Drill PMC) > > > > > > > > > > >>> > > > >> > > > > > > > > >
Re: [ANNOUNCE] New Committer: Igor Guzenko
Congratulations Igor! On Wed, Jul 24, 2019 at 1:23 AM Igor Guzenko wrote: > Hello Drillers, > > Thank you all for the greetings. It is an honor for me to be part of the > Apache Drill community. > > Best regards, > Igor Guzenko > > On Tue, Jul 23, 2019 at 6:37 PM Charles Givre wrote: > > > Congrats Igor! Well deserved! > > > > > On Jul 23, 2019, at 11:15 AM, Kunal Khatua wrote: > > > > > > Congratulations, Igor! > > > > > > On Tue, Jul 23, 2019, 8:13 AM Aman Sinha wrote: > > > > > >> Congratulations Igor and thanks for your contributions to Drill ! > > >> > > >> On Tue, Jul 23, 2019 at 3:33 AM Anton Gozhiy > > wrote: > > >> > > >>> Congratulations Igor, well deserved! > > >>> > > >>> On Tue, Jul 23, 2019, 12:31 Volodymyr Vysotskyi < > volody...@apache.org> > > >>> wrote: > > >>> > > Congratulations, Ihor! Thanks for your contributions! > > > > Kind regards, > > Volodymyr Vysotskyi > > > > > > On Mon, Jul 22, 2019 at 5:02 PM Arina Ielchiieva > > >>> wrote: > > > > > The Project Management Committee (PMC) for Apache Drill has invited > > >>> Igor > > > Guzenko to become a committer, and we are pleased to announce that > he > > >>> has > > > accepted. > > > > > > Igor has been contributing into Drill for 9 months and made a > number > > >> of > > > significant contributions, including cross join syntax support, > Hive > > views > > > support, as well as improving performance for Hive show schema and > > >> unit > > > tests. Currently he is working on supporting Hive complex types > > > [DRILL-3290]. He already added support for list type and working on > > struct > > > and canonical map. > > > > > > Welcome Igor, and thank you for your contributions! > > > > > > - Arina > > > (on behalf of the Apache Drill PMC) > > > > > > > >>> > > >> > > > > >
Re: [ANNOUNCE] New Committer: Bohdan Kazydub
Congratulations Bohdan! On Tue, Jul 23, 2019 at 11:15 PM Aman Sinha wrote: > Congratulations Bohdan and thanks much for your contributions ! > > On Tue, Jul 23, 2019 at 3:13 AM Igor Guzenko > wrote: > > > Congratulations, Bohdan! Great job !!! > > > > On Tue, Jul 23, 2019 at 12:33 PM Volodymyr Vysotskyi < > volody...@apache.org > > > > > wrote: > > > > > Congratulations, Bohdan! Thanks for your contributions! > > > > > > Kind regards, > > > Volodymyr Vysotskyi > > > > > > > > > On Thu, Jul 18, 2019 at 4:55 PM Kunal Khatua wrote: > > > > > > > Congratulations, Bohdan! > > > > On 7/16/2019 2:21:14 PM, Robert Hou wrote: > > > > Congratulations, Bohdan. Thanks for contributing to Drill! > > > > > > > > --Robert > > > > > > > > On Tue, Jul 16, 2019 at 11:50 AM hanu mapr wrote: > > > > > > > > > Congratulations Bohdan! > > > > > > > > > > On Tue, Jul 16, 2019 at 9:30 AM Gautam Parai wrote: > > > > > > > > > > > Congratulations Bohdan! > > > > > > > > > > > > Gautam > > > > > > > > > > > > On Mon, Jul 15, 2019 at 11:53 PM Bohdan Kazydub > > > > > bohdan.kazy...@gmail.com> > > > > > > wrote: > > > > > > > > > > > > > Thank you all for your support! > > > > > > > > > > > > > > On Tue, Jul 16, 2019 at 4:16 AM weijie tong > > > > > > > wrote: > > > > > > > > > > > > > > > Congrats Bohdan! > > > > > > > > > > > > > > > > On Tue, Jul 16, 2019 at 12:54 AM Vitalii Diravka > > > > > > > > > > > > > > wrote: > > > > > > > > > > > > > > > > > Congrats Bohdan! Well deserved! > > > > > > > > > > > > > > > > > > Kind regards > > > > > > > > > Vitalii > > > > > > > > > > > > > > > > > > > > > > > > > > > On Mon, Jul 15, 2019 at 6:48 PM Paul Rogers > > > > > > > > > > > > > > > > > > > > > > > wrote: > > > > > > > > > > > > > > > > > > > Congrats Bohdan! > > > > > > > > > > - Paul > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On Monday, July 15, 2019, 01:08:04 AM PDT, Arina > Ielchiieva > > > > > > > > > > ar...@apache.org> wrote: > > > > > > > > > > > > > > > > > > > > The Project Management Committee (PMC) for Apache Drill > has > > > > > > invited > > > > > > > > > Bohdan > > > > > > > > > > Kazydub to become a committer, and we are pleased to > > announce > > > > > that > > > > > > he > > > > > > > > has > > > > > > > > > > accepted. > > > > > > > > > > > > > > > > > > > > Bohdan has been contributing into Drill for more than a > > year. > > > > His > > > > > > > > > > contributions include > > > > > > > > > > logging and various functions handling improvements, > > planning > > > > > > > > > optimizations > > > > > > > > > > and S3 improvements / fixes. His recent work includes > > Calcite > > > > > 1.19 > > > > > > / > > > > > > > > 1.20 > > > > > > > > > > [DRILL-7200] and implementation of canonical Map > > > > > [DRILL-7096]. > > > > > > > > > > > > > > > > > > > > Welcome Bohdan, and thank you for your contributions! > > > > > > > > > > > > > > > > > > > > - Arina > > > > > > > > > > (on behalf of the Apache Drill PMC) > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > >
Re: [ANNOUNCE] New Committer: Igor Guzenko
Hello Drillers, Thank you all for the greetings. It is an honor for me to be part of the Apache Drill community. Best regards, Igor Guzenko On Tue, Jul 23, 2019 at 6:37 PM Charles Givre wrote: > Congrats Igor! Well deserved! > > > On Jul 23, 2019, at 11:15 AM, Kunal Khatua wrote: > > > > Congratulations, Igor! > > > > On Tue, Jul 23, 2019, 8:13 AM Aman Sinha wrote: > > > >> Congratulations Igor and thanks for your contributions to Drill ! > >> > >> On Tue, Jul 23, 2019 at 3:33 AM Anton Gozhiy > wrote: > >> > >>> Congratulations Igor, well deserved! > >>> > >>> On Tue, Jul 23, 2019, 12:31 Volodymyr Vysotskyi > >>> wrote: > >>> > Congratulations, Ihor! Thanks for your contributions! > > Kind regards, > Volodymyr Vysotskyi > > > On Mon, Jul 22, 2019 at 5:02 PM Arina Ielchiieva > >>> wrote: > > > The Project Management Committee (PMC) for Apache Drill has invited > >>> Igor > > Guzenko to become a committer, and we are pleased to announce that he > >>> has > > accepted. > > > > Igor has been contributing into Drill for 9 months and made a number > >> of > > significant contributions, including cross join syntax support, Hive > views > > support, as well as improving performance for Hive show schema and > >> unit > > tests. Currently he is working on supporting Hive complex types > > [DRILL-3290]. He already added support for list type and working on > struct > > and canonical map. > > > > Welcome Igor, and thank you for your contributions! > > > > - Arina > > (on behalf of the Apache Drill PMC) > > > > >>> > >> > >
Re: Help needed : logfile plugin multiline parsing
Hi Vincent, Thanks for your question. As written, the log reader doesn't support multiline logs. However, if you're interested, please create a JIRA ticket and if possible, attach a sample log and we'll see what we can do. -- C > On Jul 23, 2019, at 8:11 AM, Vincent BENATIER wrote: > > Hi all, > > I was if the logfile plugin can handle multiline parsing ? > > When I try my regex syntax online, it works well but I seems that the > "\\r\\n" are note recognized when trying to configure a logfile plugin in > Apache Drill. > Or perhaps I there another way to do but I could not find anything in the > documentation or in the "Learning Apache Drill" book. > > Someone could help ? > > Vincent > > Regex syntaxes I tried > -- > "(\\[.+\\])(.+\\r\\n)(.+)" > "(\\[.+\\])(.+)(\\r\\n.+)" > "(\\[.+\\])(.+) \\r\\n (.+)" > > File sample > -- > [Thu May 2 00:17:50 2019]Local/ACTUAL///1/Info(1200450) > External [GLOBAL] macro [@PHASE_INPUT] registered OK > > [Thu May 2 00:17:50 2019]Local/ACTUAL///1/Info(1019008) > Reading Application Definition For [ACTUAL] > > [Thu May 2 00:17:50 2019]Local/ACTUAL///1/Info(1019009) > Reading Database Definition For [Actual] > > [Thu May 2 00:17:50 2019]Local/ACTUAL///1/Info(1019021) > Reading Database Mapping For [ACTUAL] > > [Thu May 2 00:17:50 2019]Local/ACTUAL///1/Info(1019010) > Writing Application Definition For [ACTUAL] > > [Thu May 2 00:17:50 2019]Local/ACTUAL///1/Info(1019011) > Writing Database Definition For [Actual] >
Re: [ANNOUNCE] New Committer: Igor Guzenko
Congrats Igor! Well deserved! > On Jul 23, 2019, at 11:15 AM, Kunal Khatua wrote: > > Congratulations, Igor! > > On Tue, Jul 23, 2019, 8:13 AM Aman Sinha wrote: > >> Congratulations Igor and thanks for your contributions to Drill ! >> >> On Tue, Jul 23, 2019 at 3:33 AM Anton Gozhiy wrote: >> >>> Congratulations Igor, well deserved! >>> >>> On Tue, Jul 23, 2019, 12:31 Volodymyr Vysotskyi >>> wrote: >>> Congratulations, Ihor! Thanks for your contributions! Kind regards, Volodymyr Vysotskyi On Mon, Jul 22, 2019 at 5:02 PM Arina Ielchiieva >>> wrote: > The Project Management Committee (PMC) for Apache Drill has invited >>> Igor > Guzenko to become a committer, and we are pleased to announce that he >>> has > accepted. > > Igor has been contributing into Drill for 9 months and made a number >> of > significant contributions, including cross join syntax support, Hive views > support, as well as improving performance for Hive show schema and >> unit > tests. Currently he is working on supporting Hive complex types > [DRILL-3290]. He already added support for list type and working on struct > and canonical map. > > Welcome Igor, and thank you for your contributions! > > - Arina > (on behalf of the Apache Drill PMC) > >>> >>
Re: [ANNOUNCE] New Committer: Igor Guzenko
Congratulations, Igor! On Tue, Jul 23, 2019, 8:13 AM Aman Sinha wrote: > Congratulations Igor and thanks for your contributions to Drill ! > > On Tue, Jul 23, 2019 at 3:33 AM Anton Gozhiy wrote: > > > Congratulations Igor, well deserved! > > > > On Tue, Jul 23, 2019, 12:31 Volodymyr Vysotskyi > > wrote: > > > > > Congratulations, Ihor! Thanks for your contributions! > > > > > > Kind regards, > > > Volodymyr Vysotskyi > > > > > > > > > On Mon, Jul 22, 2019 at 5:02 PM Arina Ielchiieva > > wrote: > > > > > > > The Project Management Committee (PMC) for Apache Drill has invited > > Igor > > > > Guzenko to become a committer, and we are pleased to announce that he > > has > > > > accepted. > > > > > > > > Igor has been contributing into Drill for 9 months and made a number > of > > > > significant contributions, including cross join syntax support, Hive > > > views > > > > support, as well as improving performance for Hive show schema and > unit > > > > tests. Currently he is working on supporting Hive complex types > > > > [DRILL-3290]. He already added support for list type and working on > > > struct > > > > and canonical map. > > > > > > > > Welcome Igor, and thank you for your contributions! > > > > > > > > - Arina > > > > (on behalf of the Apache Drill PMC) > > > > > > > > > >
Re: [ANNOUNCE] New Committer: Bohdan Kazydub
Congratulations Bohdan and thanks much for your contributions ! On Tue, Jul 23, 2019 at 3:13 AM Igor Guzenko wrote: > Congratulations, Bohdan! Great job !!! > > On Tue, Jul 23, 2019 at 12:33 PM Volodymyr Vysotskyi > > wrote: > > > Congratulations, Bohdan! Thanks for your contributions! > > > > Kind regards, > > Volodymyr Vysotskyi > > > > > > On Thu, Jul 18, 2019 at 4:55 PM Kunal Khatua wrote: > > > > > Congratulations, Bohdan! > > > On 7/16/2019 2:21:14 PM, Robert Hou wrote: > > > Congratulations, Bohdan. Thanks for contributing to Drill! > > > > > > --Robert > > > > > > On Tue, Jul 16, 2019 at 11:50 AM hanu mapr wrote: > > > > > > > Congratulations Bohdan! > > > > > > > > On Tue, Jul 16, 2019 at 9:30 AM Gautam Parai wrote: > > > > > > > > > Congratulations Bohdan! > > > > > > > > > > Gautam > > > > > > > > > > On Mon, Jul 15, 2019 at 11:53 PM Bohdan Kazydub > > > > bohdan.kazy...@gmail.com> > > > > > wrote: > > > > > > > > > > > Thank you all for your support! > > > > > > > > > > > > On Tue, Jul 16, 2019 at 4:16 AM weijie tong > > > > > > wrote: > > > > > > > > > > > > > Congrats Bohdan! > > > > > > > > > > > > > > On Tue, Jul 16, 2019 at 12:54 AM Vitalii Diravka > > > > > > > > > > > > wrote: > > > > > > > > > > > > > > > Congrats Bohdan! Well deserved! > > > > > > > > > > > > > > > > Kind regards > > > > > > > > Vitalii > > > > > > > > > > > > > > > > > > > > > > > > On Mon, Jul 15, 2019 at 6:48 PM Paul Rogers > > > > > > > > > > > > > > > > > > > > wrote: > > > > > > > > > > > > > > > > > Congrats Bohdan! > > > > > > > > > - Paul > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On Monday, July 15, 2019, 01:08:04 AM PDT, Arina Ielchiieva > > > > > > > > > ar...@apache.org> wrote: > > > > > > > > > > > > > > > > > > The Project Management Committee (PMC) for Apache Drill has > > > > > invited > > > > > > > > Bohdan > > > > > > > > > Kazydub to become a committer, and we are pleased to > announce > > > > that > > > > > he > > > > > > > has > > > > > > > > > accepted. > > > > > > > > > > > > > > > > > > Bohdan has been contributing into Drill for more than a > year. > > > His > > > > > > > > > contributions include > > > > > > > > > logging and various functions handling improvements, > planning > > > > > > > > optimizations > > > > > > > > > and S3 improvements / fixes. His recent work includes > Calcite > > > > 1.19 > > > > > / > > > > > > > 1.20 > > > > > > > > > [DRILL-7200] and implementation of canonical Map > > > > [DRILL-7096]. > > > > > > > > > > > > > > > > > > Welcome Bohdan, and thank you for your contributions! > > > > > > > > > > > > > > > > > > - Arina > > > > > > > > > (on behalf of the Apache Drill PMC) > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > >
Re: [ANNOUNCE] New Committer: Igor Guzenko
Congratulations Igor and thanks for your contributions to Drill ! On Tue, Jul 23, 2019 at 3:33 AM Anton Gozhiy wrote: > Congratulations Igor, well deserved! > > On Tue, Jul 23, 2019, 12:31 Volodymyr Vysotskyi > wrote: > > > Congratulations, Ihor! Thanks for your contributions! > > > > Kind regards, > > Volodymyr Vysotskyi > > > > > > On Mon, Jul 22, 2019 at 5:02 PM Arina Ielchiieva > wrote: > > > > > The Project Management Committee (PMC) for Apache Drill has invited > Igor > > > Guzenko to become a committer, and we are pleased to announce that he > has > > > accepted. > > > > > > Igor has been contributing into Drill for 9 months and made a number of > > > significant contributions, including cross join syntax support, Hive > > views > > > support, as well as improving performance for Hive show schema and unit > > > tests. Currently he is working on supporting Hive complex types > > > [DRILL-3290]. He already added support for list type and working on > > struct > > > and canonical map. > > > > > > Welcome Igor, and thank you for your contributions! > > > > > > - Arina > > > (on behalf of the Apache Drill PMC) > > > > > >
R: Help needed : logfile plugin multiline parsing
Hallo to everyone...some news about: 1) Insert option into an existing table (parquet file) 2) creation of parquet file with no data.. Thanks a lot to all Alex -Messaggio originale- Da: Vincent BENATIER Inviato: martedì 23 luglio 2019 14:11 A: user@drill.apache.org Oggetto: Help needed : logfile plugin multiline parsing Hi all, I was if the logfile plugin can handle multiline parsing ? When I try my regex syntax online, it works well but I seems that the "\\r\\n" are note recognized when trying to configure a logfile plugin in Apache Drill. Or perhaps I there another way to do but I could not find anything in the documentation or in the "Learning Apache Drill" book. Someone could help ? Vincent Regex syntaxes I tried -- "(\\[.+\\])(.+\\r\\n)(.+)" "(\\[.+\\])(.+)(\\r\\n.+)" "(\\[.+\\])(.+) \\r\\n (.+)" File sample -- [Thu May 2 00:17:50 2019]Local/ACTUAL///1/Info(1200450) External [GLOBAL] macro [@PHASE_INPUT] registered OK [Thu May 2 00:17:50 2019]Local/ACTUAL///1/Info(1019008) Reading Application Definition For [ACTUAL] [Thu May 2 00:17:50 2019]Local/ACTUAL///1/Info(1019009) Reading Database Definition For [Actual] [Thu May 2 00:17:50 2019]Local/ACTUAL///1/Info(1019021) Reading Database Mapping For [ACTUAL] [Thu May 2 00:17:50 2019]Local/ACTUAL///1/Info(1019010) Writing Application Definition For [ACTUAL] [Thu May 2 00:17:50 2019]Local/ACTUAL///1/Info(1019011) Writing Database Definition For [Actual]
Help needed : logfile plugin multiline parsing
Hi all, I was if the logfile plugin can handle multiline parsing ? When I try my regex syntax online, it works well but I seems that the "\\r\\n" are note recognized when trying to configure a logfile plugin in Apache Drill. Or perhaps I there another way to do but I could not find anything in the documentation or in the "Learning Apache Drill" book. Someone could help ? Vincent Regex syntaxes I tried -- "(\\[.+\\])(.+\\r\\n)(.+)" "(\\[.+\\])(.+)(\\r\\n.+)" "(\\[.+\\])(.+) \\r\\n (.+)" File sample -- [Thu May 2 00:17:50 2019]Local/ACTUAL///1/Info(1200450) External [GLOBAL] macro [@PHASE_INPUT] registered OK [Thu May 2 00:17:50 2019]Local/ACTUAL///1/Info(1019008) Reading Application Definition For [ACTUAL] [Thu May 2 00:17:50 2019]Local/ACTUAL///1/Info(1019009) Reading Database Definition For [Actual] [Thu May 2 00:17:50 2019]Local/ACTUAL///1/Info(1019021) Reading Database Mapping For [ACTUAL] [Thu May 2 00:17:50 2019]Local/ACTUAL///1/Info(1019010) Writing Application Definition For [ACTUAL] [Thu May 2 00:17:50 2019]Local/ACTUAL///1/Info(1019011) Writing Database Definition For [Actual]
Re: [ANNOUNCE] New Committer: Igor Guzenko
Congratulations Igor, well deserved! On Tue, Jul 23, 2019, 12:31 Volodymyr Vysotskyi wrote: > Congratulations, Ihor! Thanks for your contributions! > > Kind regards, > Volodymyr Vysotskyi > > > On Mon, Jul 22, 2019 at 5:02 PM Arina Ielchiieva wrote: > > > The Project Management Committee (PMC) for Apache Drill has invited Igor > > Guzenko to become a committer, and we are pleased to announce that he has > > accepted. > > > > Igor has been contributing into Drill for 9 months and made a number of > > significant contributions, including cross join syntax support, Hive > views > > support, as well as improving performance for Hive show schema and unit > > tests. Currently he is working on supporting Hive complex types > > [DRILL-3290]. He already added support for list type and working on > struct > > and canonical map. > > > > Welcome Igor, and thank you for your contributions! > > > > - Arina > > (on behalf of the Apache Drill PMC) > > >
Re: [ANNOUNCE] New Committer: Bohdan Kazydub
Congratulations, Bohdan! Great job !!! On Tue, Jul 23, 2019 at 12:33 PM Volodymyr Vysotskyi wrote: > Congratulations, Bohdan! Thanks for your contributions! > > Kind regards, > Volodymyr Vysotskyi > > > On Thu, Jul 18, 2019 at 4:55 PM Kunal Khatua wrote: > > > Congratulations, Bohdan! > > On 7/16/2019 2:21:14 PM, Robert Hou wrote: > > Congratulations, Bohdan. Thanks for contributing to Drill! > > > > --Robert > > > > On Tue, Jul 16, 2019 at 11:50 AM hanu mapr wrote: > > > > > Congratulations Bohdan! > > > > > > On Tue, Jul 16, 2019 at 9:30 AM Gautam Parai wrote: > > > > > > > Congratulations Bohdan! > > > > > > > > Gautam > > > > > > > > On Mon, Jul 15, 2019 at 11:53 PM Bohdan Kazydub > > > bohdan.kazy...@gmail.com> > > > > wrote: > > > > > > > > > Thank you all for your support! > > > > > > > > > > On Tue, Jul 16, 2019 at 4:16 AM weijie tong > > > > > wrote: > > > > > > > > > > > Congrats Bohdan! > > > > > > > > > > > > On Tue, Jul 16, 2019 at 12:54 AM Vitalii Diravka > > > > > > > > > > wrote: > > > > > > > > > > > > > Congrats Bohdan! Well deserved! > > > > > > > > > > > > > > Kind regards > > > > > > > Vitalii > > > > > > > > > > > > > > > > > > > > > On Mon, Jul 15, 2019 at 6:48 PM Paul Rogers > > > > > > > > > > > > > > > > > wrote: > > > > > > > > > > > > > > > Congrats Bohdan! > > > > > > > > - Paul > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On Monday, July 15, 2019, 01:08:04 AM PDT, Arina Ielchiieva > > > > > > > > ar...@apache.org> wrote: > > > > > > > > > > > > > > > > The Project Management Committee (PMC) for Apache Drill has > > > > invited > > > > > > > Bohdan > > > > > > > > Kazydub to become a committer, and we are pleased to announce > > > that > > > > he > > > > > > has > > > > > > > > accepted. > > > > > > > > > > > > > > > > Bohdan has been contributing into Drill for more than a year. > > His > > > > > > > > contributions include > > > > > > > > logging and various functions handling improvements, planning > > > > > > > optimizations > > > > > > > > and S3 improvements / fixes. His recent work includes Calcite > > > 1.19 > > > > / > > > > > > 1.20 > > > > > > > > [DRILL-7200] and implementation of canonical Map > > > [DRILL-7096]. > > > > > > > > > > > > > > > > Welcome Bohdan, and thank you for your contributions! > > > > > > > > > > > > > > > > - Arina > > > > > > > > (on behalf of the Apache Drill PMC) > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > >
Re: [ANNOUNCE] New Committer: Bohdan Kazydub
Congratulations, Bohdan! Thanks for your contributions! Kind regards, Volodymyr Vysotskyi On Thu, Jul 18, 2019 at 4:55 PM Kunal Khatua wrote: > Congratulations, Bohdan! > On 7/16/2019 2:21:14 PM, Robert Hou wrote: > Congratulations, Bohdan. Thanks for contributing to Drill! > > --Robert > > On Tue, Jul 16, 2019 at 11:50 AM hanu mapr wrote: > > > Congratulations Bohdan! > > > > On Tue, Jul 16, 2019 at 9:30 AM Gautam Parai wrote: > > > > > Congratulations Bohdan! > > > > > > Gautam > > > > > > On Mon, Jul 15, 2019 at 11:53 PM Bohdan Kazydub > > bohdan.kazy...@gmail.com> > > > wrote: > > > > > > > Thank you all for your support! > > > > > > > > On Tue, Jul 16, 2019 at 4:16 AM weijie tong > > > > wrote: > > > > > > > > > Congrats Bohdan! > > > > > > > > > > On Tue, Jul 16, 2019 at 12:54 AM Vitalii Diravka > > > > > > > > wrote: > > > > > > > > > > > Congrats Bohdan! Well deserved! > > > > > > > > > > > > Kind regards > > > > > > Vitalii > > > > > > > > > > > > > > > > > > On Mon, Jul 15, 2019 at 6:48 PM Paul Rogers > > > > > > > > > > > > > > wrote: > > > > > > > > > > > > > Congrats Bohdan! > > > > > > > - Paul > > > > > > > > > > > > > > > > > > > > > > > > > > > > On Monday, July 15, 2019, 01:08:04 AM PDT, Arina Ielchiieva > > > > > > > ar...@apache.org> wrote: > > > > > > > > > > > > > > The Project Management Committee (PMC) for Apache Drill has > > > invited > > > > > > Bohdan > > > > > > > Kazydub to become a committer, and we are pleased to announce > > that > > > he > > > > > has > > > > > > > accepted. > > > > > > > > > > > > > > Bohdan has been contributing into Drill for more than a year. > His > > > > > > > contributions include > > > > > > > logging and various functions handling improvements, planning > > > > > > optimizations > > > > > > > and S3 improvements / fixes. His recent work includes Calcite > > 1.19 > > > / > > > > > 1.20 > > > > > > > [DRILL-7200] and implementation of canonical Map > > [DRILL-7096]. > > > > > > > > > > > > > > Welcome Bohdan, and thank you for your contributions! > > > > > > > > > > > > > > - Arina > > > > > > > (on behalf of the Apache Drill PMC) > > > > > > > > > > > > > > > > > > > > > > > > > > > >
Re: [ANNOUNCE] New Committer: Igor Guzenko
Congratulations, Ihor! Thanks for your contributions! Kind regards, Volodymyr Vysotskyi On Mon, Jul 22, 2019 at 5:02 PM Arina Ielchiieva wrote: > The Project Management Committee (PMC) for Apache Drill has invited Igor > Guzenko to become a committer, and we are pleased to announce that he has > accepted. > > Igor has been contributing into Drill for 9 months and made a number of > significant contributions, including cross join syntax support, Hive views > support, as well as improving performance for Hive show schema and unit > tests. Currently he is working on supporting Hive complex types > [DRILL-3290]. He already added support for list type and working on struct > and canonical map. > > Welcome Igor, and thank you for your contributions! > > - Arina > (on behalf of the Apache Drill PMC) >
Re: [ANNOUNCE] New Committer: Igor Guzenko
Congratulations Igor! On Mon, Jul 22, 2019 at 5:02 PM Arina Ielchiieva wrote: > The Project Management Committee (PMC) for Apache Drill has invited Igor > Guzenko to become a committer, and we are pleased to announce that he has > accepted. > > Igor has been contributing into Drill for 9 months and made a number of > significant contributions, including cross join syntax support, Hive views > support, as well as improving performance for Hive show schema and unit > tests. Currently he is working on supporting Hive complex types > [DRILL-3290]. He already added support for list type and working on struct > and canonical map. > > Welcome Igor, and thank you for your contributions! > > - Arina > (on behalf of the Apache Drill PMC) >
