Re: [ANNOUNCE] New Committer: Bohdan Kazydub

2019-07-15 Thread weijie tong
Congrats Bohdan!

On Tue, Jul 16, 2019 at 12:54 AM Vitalii Diravka  wrote:

> Congrats Bohdan! Well deserved!
>
> Kind regards
> Vitalii
>
>
> On Mon, Jul 15, 2019 at 6:48 PM Paul Rogers 
> wrote:
>
> > Congrats Bohdan!
> > - Paul
> >
> >
> >
> > On Monday, July 15, 2019, 01:08:04 AM PDT, Arina Ielchiieva <
> > ar...@apache.org> wrote:
> >
> >  The Project Management Committee (PMC) for Apache Drill has invited
> Bohdan
> > Kazydub to become a committer, and we are pleased to announce that he has
> > accepted.
> >
> > Bohdan has been contributing into Drill for more than a year. His
> > contributions include
> > logging and various functions handling improvements, planning
> optimizations
> > and S3 improvements / fixes. His recent work includes Calcite 1.19 / 1.20
> > [DRILL-7200] and implementation of canonical Map [DRILL-7096].
> >
> > Welcome Bohdan, and thank you for your contributions!
> >
> > - Arina
> > (on behalf of the Apache Drill PMC)
> >
>


Re: show files problem

2019-07-15 Thread Arina Yelchiyeva
Hi,

The issue you are describing was fixed in DRILL-6753 [1] which was included 
into 1.15.0 release.
I suspect you are trying to upgrade to some 1.15.0-SNAPSHOT version rather than 
on 1.15.0 final version.

[1] https://issues.apache.org/jira/browse/DRILL-6753

Kind regards,
Arina

> On Jul 15, 2019, at 9:17 PM, François Méthot  wrote:
> 
> Hi,
> 
> We are aiming to upgrade our Drill cluster to version 1.15. On my test
> environment, we found that show files operation can take close to 1+ hour
> to list content of a directory with only a handful of files.
> 
> Based on Jstack, it seems a drillbit is busy collecting permission
> information.
> Also I see the process "ls -ld .../subpath/files.xyz"
> showing up in my ps -ef output.
> 
> I have read about the new information_schema, I suspect it is linked to
> that feature, is there a flag to enable the show files behaviour from pre
> 1.15 versions?
> 
> The folder and files I am navigating are on an NFS mount.
> 
> Any hints or help would be appreciated
> 
> Thanks
> Francois
> 
> ex:
>> show files from wrk.base.`2019/`;
> 
> error... you should enable list_files_recursive
>> alter system set `storage.list_files_recursive`=true
> 
>> show files from wrk.base.`2019/`;
> takes hours to get result
> 
> 
> wrk.base is  /data/
>  which contain:
> /2019
>   /07
> /14/~1000 files
> /13/~1000 files
> /12/~1000 files
> ...
> /2018
>  ...
>   /07
>  /14/~1000 files
>  ...



show files problem

2019-07-15 Thread François Méthot
Hi,

 We are aiming to upgrade our Drill cluster to version 1.15. On my test
environment, we found that show files operation can take close to 1+ hour
to list content of a directory with only a handful of files.

Based on Jstack, it seems a drillbit is busy collecting permission
information.
Also I see the process "ls -ld .../subpath/files.xyz"
showing up in my ps -ef output.

I have read about the new information_schema, I suspect it is linked to
that feature, is there a flag to enable the show files behaviour from pre
1.15 versions?

The folder and files I am navigating are on an NFS mount.

Any hints or help would be appreciated

Thanks
Francois

ex:
> show files from wrk.base.`2019/`;

error... you should enable list_files_recursive
>alter system set `storage.list_files_recursive`=true

> show files from wrk.base.`2019/`;
takes hours to get result


wrk.base is  /data/
  which contain:
/2019
   /07
 /14/~1000 files
 /13/~1000 files
 /12/~1000 files
...
/2018
  ...
   /07
  /14/~1000 files
  ...


Re: [ANNOUNCE] New Committer: Bohdan Kazydub

2019-07-15 Thread Vitalii Diravka
Congrats Bohdan! Well deserved!

Kind regards
Vitalii


On Mon, Jul 15, 2019 at 6:48 PM Paul Rogers 
wrote:

> Congrats Bohdan!
> - Paul
>
>
>
> On Monday, July 15, 2019, 01:08:04 AM PDT, Arina Ielchiieva <
> ar...@apache.org> wrote:
>
>  The Project Management Committee (PMC) for Apache Drill has invited Bohdan
> Kazydub to become a committer, and we are pleased to announce that he has
> accepted.
>
> Bohdan has been contributing into Drill for more than a year. His
> contributions include
> logging and various functions handling improvements, planning optimizations
> and S3 improvements / fixes. His recent work includes Calcite 1.19 / 1.20
> [DRILL-7200] and implementation of canonical Map [DRILL-7096].
>
> Welcome Bohdan, and thank you for your contributions!
>
> - Arina
> (on behalf of the Apache Drill PMC)
>


Re: [ANNOUNCE] New Committer: Bohdan Kazydub

2019-07-15 Thread Paul Rogers
Congrats Bohdan!
- Paul

 

On Monday, July 15, 2019, 01:08:04 AM PDT, Arina Ielchiieva 
 wrote:  
 
 The Project Management Committee (PMC) for Apache Drill has invited Bohdan
Kazydub to become a committer, and we are pleased to announce that he has
accepted.

Bohdan has been contributing into Drill for more than a year. His
contributions include
logging and various functions handling improvements, planning optimizations
and S3 improvements / fixes. His recent work includes Calcite 1.19 / 1.20
[DRILL-7200] and implementation of canonical Map [DRILL-7096].

Welcome Bohdan, and thank you for your contributions!

- Arina
(on behalf of the Apache Drill PMC)
  

Re: [ANNOUNCE] New Committer: Bohdan Kazydub

2019-07-15 Thread CHALLA
Congratulations Bodhan. Welcome

On Mon, Jul 15, 2019, 3:09 PM Anton Gozhiy  wrote:

> Congratulations, Bohdan, well deserved!
>
> On Mon, Jul 15, 2019, 11:26 Ellen Friedman 
> wrote:
>
> > Congratulations Bohdan on becoming a Drill committer!
> > Ellen
> >
> > On Mon, Jul 15, 2019 at 1:08 AM Arina Ielchiieva 
> wrote:
> >
> > > The Project Management Committee (PMC) for Apache Drill has invited
> > Bohdan
> > > Kazydub to become a committer, and we are pleased to announce that he
> has
> > > accepted.
> > >
> > > Bohdan has been contributing into Drill for more than a year. His
> > > contributions include
> > > logging and various functions handling improvements, planning
> > optimizations
> > > and S3 improvements / fixes. His recent work includes Calcite 1.19 /
> 1.20
> > > [DRILL-7200] and implementation of canonical Map [DRILL-7096].
> > >
> > > Welcome Bohdan, and thank you for your contributions!
> > >
> > > - Arina
> > > (on behalf of the Apache Drill PMC)
> > >
> >
>


Re: [ANNOUNCE] New Committer: Bohdan Kazydub

2019-07-15 Thread Anton Gozhiy
Congratulations, Bohdan, well deserved!

On Mon, Jul 15, 2019, 11:26 Ellen Friedman 
wrote:

> Congratulations Bohdan on becoming a Drill committer!
> Ellen
>
> On Mon, Jul 15, 2019 at 1:08 AM Arina Ielchiieva  wrote:
>
> > The Project Management Committee (PMC) for Apache Drill has invited
> Bohdan
> > Kazydub to become a committer, and we are pleased to announce that he has
> > accepted.
> >
> > Bohdan has been contributing into Drill for more than a year. His
> > contributions include
> > logging and various functions handling improvements, planning
> optimizations
> > and S3 improvements / fixes. His recent work includes Calcite 1.19 / 1.20
> > [DRILL-7200] and implementation of canonical Map [DRILL-7096].
> >
> > Welcome Bohdan, and thank you for your contributions!
> >
> > - Arina
> > (on behalf of the Apache Drill PMC)
> >
>


Re: [ANNOUNCE] New Committer: Bohdan Kazydub

2019-07-15 Thread Ellen Friedman
Congratulations Bohdan on becoming a Drill committer!
Ellen

On Mon, Jul 15, 2019 at 1:08 AM Arina Ielchiieva  wrote:

> The Project Management Committee (PMC) for Apache Drill has invited Bohdan
> Kazydub to become a committer, and we are pleased to announce that he has
> accepted.
>
> Bohdan has been contributing into Drill for more than a year. His
> contributions include
> logging and various functions handling improvements, planning optimizations
> and S3 improvements / fixes. His recent work includes Calcite 1.19 / 1.20
> [DRILL-7200] and implementation of canonical Map [DRILL-7096].
>
> Welcome Bohdan, and thank you for your contributions!
>
> - Arina
> (on behalf of the Apache Drill PMC)
>


[ANNOUNCE] New Committer: Bohdan Kazydub

2019-07-15 Thread Arina Ielchiieva
The Project Management Committee (PMC) for Apache Drill has invited Bohdan
Kazydub to become a committer, and we are pleased to announce that he has
accepted.

Bohdan has been contributing into Drill for more than a year. His
contributions include
logging and various functions handling improvements, planning optimizations
and S3 improvements / fixes. His recent work includes Calcite 1.19 / 1.20
[DRILL-7200] and implementation of canonical Map [DRILL-7096].

Welcome Bohdan, and thank you for your contributions!

- Arina
(on behalf of the Apache Drill PMC)