Re: [ANNOUNCE] New Committer: Bohdan Kazydub
Congrats Bohdan! On Tue, Jul 16, 2019 at 12:54 AM Vitalii Diravka wrote: > Congrats Bohdan! Well deserved! > > Kind regards > Vitalii > > > On Mon, Jul 15, 2019 at 6:48 PM Paul Rogers > wrote: > > > Congrats Bohdan! > > - Paul > > > > > > > > On Monday, July 15, 2019, 01:08:04 AM PDT, Arina Ielchiieva < > > ar...@apache.org> wrote: > > > > The Project Management Committee (PMC) for Apache Drill has invited > Bohdan > > Kazydub to become a committer, and we are pleased to announce that he has > > accepted. > > > > Bohdan has been contributing into Drill for more than a year. His > > contributions include > > logging and various functions handling improvements, planning > optimizations > > and S3 improvements / fixes. His recent work includes Calcite 1.19 / 1.20 > > [DRILL-7200] and implementation of canonical Map [DRILL-7096]. > > > > Welcome Bohdan, and thank you for your contributions! > > > > - Arina > > (on behalf of the Apache Drill PMC) > > >
Re: show files problem
Hi, The issue you are describing was fixed in DRILL-6753 [1] which was included into 1.15.0 release. I suspect you are trying to upgrade to some 1.15.0-SNAPSHOT version rather than on 1.15.0 final version. [1] https://issues.apache.org/jira/browse/DRILL-6753 Kind regards, Arina > On Jul 15, 2019, at 9:17 PM, François Méthot wrote: > > Hi, > > We are aiming to upgrade our Drill cluster to version 1.15. On my test > environment, we found that show files operation can take close to 1+ hour > to list content of a directory with only a handful of files. > > Based on Jstack, it seems a drillbit is busy collecting permission > information. > Also I see the process "ls -ld .../subpath/files.xyz" > showing up in my ps -ef output. > > I have read about the new information_schema, I suspect it is linked to > that feature, is there a flag to enable the show files behaviour from pre > 1.15 versions? > > The folder and files I am navigating are on an NFS mount. > > Any hints or help would be appreciated > > Thanks > Francois > > ex: >> show files from wrk.base.`2019/`; > > error... you should enable list_files_recursive >> alter system set `storage.list_files_recursive`=true > >> show files from wrk.base.`2019/`; > takes hours to get result > > > wrk.base is /data/ > which contain: > /2019 > /07 > /14/~1000 files > /13/~1000 files > /12/~1000 files > ... > /2018 > ... > /07 > /14/~1000 files > ...
show files problem
Hi, We are aiming to upgrade our Drill cluster to version 1.15. On my test environment, we found that show files operation can take close to 1+ hour to list content of a directory with only a handful of files. Based on Jstack, it seems a drillbit is busy collecting permission information. Also I see the process "ls -ld .../subpath/files.xyz" showing up in my ps -ef output. I have read about the new information_schema, I suspect it is linked to that feature, is there a flag to enable the show files behaviour from pre 1.15 versions? The folder and files I am navigating are on an NFS mount. Any hints or help would be appreciated Thanks Francois ex: > show files from wrk.base.`2019/`; error... you should enable list_files_recursive >alter system set `storage.list_files_recursive`=true > show files from wrk.base.`2019/`; takes hours to get result wrk.base is /data/ which contain: /2019 /07 /14/~1000 files /13/~1000 files /12/~1000 files ... /2018 ... /07 /14/~1000 files ...
Re: [ANNOUNCE] New Committer: Bohdan Kazydub
Congrats Bohdan! Well deserved! Kind regards Vitalii On Mon, Jul 15, 2019 at 6:48 PM Paul Rogers wrote: > Congrats Bohdan! > - Paul > > > > On Monday, July 15, 2019, 01:08:04 AM PDT, Arina Ielchiieva < > ar...@apache.org> wrote: > > The Project Management Committee (PMC) for Apache Drill has invited Bohdan > Kazydub to become a committer, and we are pleased to announce that he has > accepted. > > Bohdan has been contributing into Drill for more than a year. His > contributions include > logging and various functions handling improvements, planning optimizations > and S3 improvements / fixes. His recent work includes Calcite 1.19 / 1.20 > [DRILL-7200] and implementation of canonical Map [DRILL-7096]. > > Welcome Bohdan, and thank you for your contributions! > > - Arina > (on behalf of the Apache Drill PMC) >
Re: [ANNOUNCE] New Committer: Bohdan Kazydub
Congrats Bohdan! - Paul On Monday, July 15, 2019, 01:08:04 AM PDT, Arina Ielchiieva wrote: The Project Management Committee (PMC) for Apache Drill has invited Bohdan Kazydub to become a committer, and we are pleased to announce that he has accepted. Bohdan has been contributing into Drill for more than a year. His contributions include logging and various functions handling improvements, planning optimizations and S3 improvements / fixes. His recent work includes Calcite 1.19 / 1.20 [DRILL-7200] and implementation of canonical Map [DRILL-7096]. Welcome Bohdan, and thank you for your contributions! - Arina (on behalf of the Apache Drill PMC)
Re: [ANNOUNCE] New Committer: Bohdan Kazydub
Congratulations Bodhan. Welcome On Mon, Jul 15, 2019, 3:09 PM Anton Gozhiy wrote: > Congratulations, Bohdan, well deserved! > > On Mon, Jul 15, 2019, 11:26 Ellen Friedman > wrote: > > > Congratulations Bohdan on becoming a Drill committer! > > Ellen > > > > On Mon, Jul 15, 2019 at 1:08 AM Arina Ielchiieva > wrote: > > > > > The Project Management Committee (PMC) for Apache Drill has invited > > Bohdan > > > Kazydub to become a committer, and we are pleased to announce that he > has > > > accepted. > > > > > > Bohdan has been contributing into Drill for more than a year. His > > > contributions include > > > logging and various functions handling improvements, planning > > optimizations > > > and S3 improvements / fixes. His recent work includes Calcite 1.19 / > 1.20 > > > [DRILL-7200] and implementation of canonical Map [DRILL-7096]. > > > > > > Welcome Bohdan, and thank you for your contributions! > > > > > > - Arina > > > (on behalf of the Apache Drill PMC) > > > > > >
Re: [ANNOUNCE] New Committer: Bohdan Kazydub
Congratulations, Bohdan, well deserved! On Mon, Jul 15, 2019, 11:26 Ellen Friedman wrote: > Congratulations Bohdan on becoming a Drill committer! > Ellen > > On Mon, Jul 15, 2019 at 1:08 AM Arina Ielchiieva wrote: > > > The Project Management Committee (PMC) for Apache Drill has invited > Bohdan > > Kazydub to become a committer, and we are pleased to announce that he has > > accepted. > > > > Bohdan has been contributing into Drill for more than a year. His > > contributions include > > logging and various functions handling improvements, planning > optimizations > > and S3 improvements / fixes. His recent work includes Calcite 1.19 / 1.20 > > [DRILL-7200] and implementation of canonical Map [DRILL-7096]. > > > > Welcome Bohdan, and thank you for your contributions! > > > > - Arina > > (on behalf of the Apache Drill PMC) > > >
Re: [ANNOUNCE] New Committer: Bohdan Kazydub
Congratulations Bohdan on becoming a Drill committer! Ellen On Mon, Jul 15, 2019 at 1:08 AM Arina Ielchiieva wrote: > The Project Management Committee (PMC) for Apache Drill has invited Bohdan > Kazydub to become a committer, and we are pleased to announce that he has > accepted. > > Bohdan has been contributing into Drill for more than a year. His > contributions include > logging and various functions handling improvements, planning optimizations > and S3 improvements / fixes. His recent work includes Calcite 1.19 / 1.20 > [DRILL-7200] and implementation of canonical Map [DRILL-7096]. > > Welcome Bohdan, and thank you for your contributions! > > - Arina > (on behalf of the Apache Drill PMC) >
[ANNOUNCE] New Committer: Bohdan Kazydub
The Project Management Committee (PMC) for Apache Drill has invited Bohdan Kazydub to become a committer, and we are pleased to announce that he has accepted. Bohdan has been contributing into Drill for more than a year. His contributions include logging and various functions handling improvements, planning optimizations and S3 improvements / fixes. His recent work includes Calcite 1.19 / 1.20 [DRILL-7200] and implementation of canonical Map [DRILL-7096]. Welcome Bohdan, and thank you for your contributions! - Arina (on behalf of the Apache Drill PMC)