Re: Towards Drill 2.0

2022-12-21 Thread James Turton

Sure, works for me.

On 12/22/22 00:16, Charles Givre wrote:

  James, Maksym,
I suppose you are right.  We've done A LOT of work on Drill since 1.20 to 
include several new plugins (GoogleSheets, Delta Lake, Drill on Drill, 
others?).  All the user translation work, bug fixes, much more.
In terms of pending work, Calcite is about to release 1.33 which will have some 
fixes that are relevant to Drill such as Athena support and a few others.  
Additionally, there are a few pending PRs such as the Splunk writer, a few from 
James, and some from Vova that are reasonably close to completion.

Here's what I'd propose... why don't we shoot for a Drill 1.21 in January that 
incorporates all this new work?
What do you think?
-- C






On Dec 20, 2022, at 4:19 AM, James Turton  wrote:

I tend to agree that a 1.21 before a 2.0 wouldn't do any harm considering where 
we are and that little of the stuff we've got in the master branch breaks 
things in more than a superficial way.

On 12/19/22 16:49, Максим Римар wrote:

Hi Charles,

Could you please tell me, you said that you wanted a few pieces to be
wrapped up in the next release, what are they?

And another one mind, does the Drill have some breaking changes to release
it as Drill 2.0?
Of course, Calcite update is a significant update, but it is only one of
many changes that we wanted to make for release 2.0 (
https://github.com/apache/drill/wiki/Drill-2.0-Proposal). Maybe it has
sense to release the current Drill as 1.21.0 and don't make release 2.0
until we will make structural changes (
https://github.com/apache/drill/wiki/Drill-2.0-Proposal#project-structure-packaging-and-distribution
)?

Regards,
Maksym

On 2022/12/13 14:51:56 Charles Givre wrote:

Hello all,
We've been doing a lot of really great work on Drill in the last few

months, and I wanted to thank those who have been involved with releasing
the bug fix releases throughout the year.  With all that said, there's been
enormous progress on Drill 2.0 and while it isn't quite what we had
originally discussed, IMHO, it's time to get this in people's hands.

The work that Vova did updating Drill to Calcite 1.32 and getting us off

of the fork has been a HUGE improvement in performance and stability.
Likewise the casting work that James T. did has made Drill significantly
more usable.  From my perspective, there are a few pieces that I'd like to
see wrapped up but I wanted to start the dialogue to see if we might be
able to get Drill 2.0 released either by the end of the year or early
January.  What do you think?

Best,
-- C




Re: Towards Drill 2.0

2022-12-21 Thread Charles Givre
 James, Maksym, 
I suppose you are right.  We've done A LOT of work on Drill since 1.20 to 
include several new plugins (GoogleSheets, Delta Lake, Drill on Drill, 
others?).  All the user translation work, bug fixes, much more.  
In terms of pending work, Calcite is about to release 1.33 which will have some 
fixes that are relevant to Drill such as Athena support and a few others.  
Additionally, there are a few pending PRs such as the Splunk writer, a few from 
James, and some from Vova that are reasonably close to completion.  

Here's what I'd propose... why don't we shoot for a Drill 1.21 in January that 
incorporates all this new work?
What do you think?
-- C





> On Dec 20, 2022, at 4:19 AM, James Turton  wrote:
> 
> I tend to agree that a 1.21 before a 2.0 wouldn't do any harm considering 
> where we are and that little of the stuff we've got in the master branch 
> breaks things in more than a superficial way.
> 
> On 12/19/22 16:49, Максим Римар wrote:
>> Hi Charles,
>> 
>> Could you please tell me, you said that you wanted a few pieces to be
>> wrapped up in the next release, what are they?
>> 
>> And another one mind, does the Drill have some breaking changes to release
>> it as Drill 2.0?
>> Of course, Calcite update is a significant update, but it is only one of
>> many changes that we wanted to make for release 2.0 (
>> https://github.com/apache/drill/wiki/Drill-2.0-Proposal). Maybe it has
>> sense to release the current Drill as 1.21.0 and don't make release 2.0
>> until we will make structural changes (
>> https://github.com/apache/drill/wiki/Drill-2.0-Proposal#project-structure-packaging-and-distribution
>> )?
>> 
>> Regards,
>> Maksym
>> 
>> On 2022/12/13 14:51:56 Charles Givre wrote:
>>> Hello all,
>>> We've been doing a lot of really great work on Drill in the last few
>> months, and I wanted to thank those who have been involved with releasing
>> the bug fix releases throughout the year.  With all that said, there's been
>> enormous progress on Drill 2.0 and while it isn't quite what we had
>> originally discussed, IMHO, it's time to get this in people's hands.
>>> The work that Vova did updating Drill to Calcite 1.32 and getting us off
>> of the fork has been a HUGE improvement in performance and stability.
>> Likewise the casting work that James T. did has made Drill significantly
>> more usable.  From my perspective, there are a few pieces that I'd like to
>> see wrapped up but I wanted to start the dialogue to see if we might be
>> able to get Drill 2.0 released either by the end of the year or early
>> January.  What do you think?
>>> Best,
>>> -- C
> 



Re: Towards Drill 2.0

2022-12-20 Thread James Turton
I tend to agree that a 1.21 before a 2.0 wouldn't do any harm 
considering where we are and that little of the stuff we've got in the 
master branch breaks things in more than a superficial way.


On 12/19/22 16:49, Максим Римар wrote:

Hi Charles,

Could you please tell me, you said that you wanted a few pieces to be
wrapped up in the next release, what are they?

And another one mind, does the Drill have some breaking changes to release
it as Drill 2.0?
Of course, Calcite update is a significant update, but it is only one of
many changes that we wanted to make for release 2.0 (
https://github.com/apache/drill/wiki/Drill-2.0-Proposal). Maybe it has
sense to release the current Drill as 1.21.0 and don't make release 2.0
until we will make structural changes (
https://github.com/apache/drill/wiki/Drill-2.0-Proposal#project-structure-packaging-and-distribution
)?

Regards,
Maksym

On 2022/12/13 14:51:56 Charles Givre wrote:

Hello all,
We've been doing a lot of really great work on Drill in the last few

months, and I wanted to thank those who have been involved with releasing
the bug fix releases throughout the year.  With all that said, there's been
enormous progress on Drill 2.0 and while it isn't quite what we had
originally discussed, IMHO, it's time to get this in people's hands.

The work that Vova did updating Drill to Calcite 1.32 and getting us off

of the fork has been a HUGE improvement in performance and stability.
Likewise the casting work that James T. did has made Drill significantly
more usable.  From my perspective, there are a few pieces that I'd like to
see wrapped up but I wanted to start the dialogue to see if we might be
able to get Drill 2.0 released either by the end of the year or early
January.  What do you think?

Best,
-- C




RE: Towards Drill 2.0

2022-12-19 Thread Максим Римар
Hi Charles,

Could you please tell me, you said that you wanted a few pieces to be
wrapped up in the next release, what are they?

And another one mind, does the Drill have some breaking changes to release
it as Drill 2.0?
Of course, Calcite update is a significant update, but it is only one of
many changes that we wanted to make for release 2.0 (
https://github.com/apache/drill/wiki/Drill-2.0-Proposal). Maybe it has
sense to release the current Drill as 1.21.0 and don't make release 2.0
until we will make structural changes (
https://github.com/apache/drill/wiki/Drill-2.0-Proposal#project-structure-packaging-and-distribution
)?

Regards,
Maksym

On 2022/12/13 14:51:56 Charles Givre wrote:
> Hello all,
> We've been doing a lot of really great work on Drill in the last few
months, and I wanted to thank those who have been involved with releasing
the bug fix releases throughout the year.  With all that said, there's been
enormous progress on Drill 2.0 and while it isn't quite what we had
originally discussed, IMHO, it's time to get this in people's hands.
>
> The work that Vova did updating Drill to Calcite 1.32 and getting us off
of the fork has been a HUGE improvement in performance and stability.
Likewise the casting work that James T. did has made Drill significantly
more usable.  From my perspective, there are a few pieces that I'd like to
see wrapped up but I wanted to start the dialogue to see if we might be
able to get Drill 2.0 released either by the end of the year or early
January.  What do you think?
>
> Best,
> -- C


Towards Drill 2.0

2022-12-13 Thread Charles Givre
Hello all, 
We've been doing a lot of really great work on Drill in the last few months, 
and I wanted to thank those who have been involved with releasing the bug fix 
releases throughout the year.  With all that said, there's been enormous 
progress on Drill 2.0 and while it isn't quite what we had originally 
discussed, IMHO, it's time to get this in people's hands.  

The work that Vova did updating Drill to Calcite 1.32 and getting us off of the 
fork has been a HUGE improvement in performance and stability.  Likewise the 
casting work that James T. did has made Drill significantly more usable.  From 
my perspective, there are a few pieces that I'd like to see wrapped up but I 
wanted to start the dialogue to see if we might be able to get Drill 2.0 
released either by the end of the year or early January.  What do you think?
 
Best,
-- C