According to

http://spark.apache.org/improvement-proposals.html

the shepherd should be a PMC member, not necessarily the person who
proposed the SPIP

On Tue, Jul 17, 2018 at 9:13 AM, Wenchen Fan <cloud0...@gmail.com> wrote:
> I don't know an official answer, but conventionally people who propose the
> SPIP would call the vote and "shepherd" the project. Other people can jump
> in during the development. I'm interested in the new API and like to work on
> it after the vote passes.
>
> Thanks,
> Wenchen
>
> On Fri, Jul 13, 2018 at 7:25 AM Ryan Blue <rb...@netflix.com> wrote:
>>
>> Thanks! I'm all for calling a vote on the SPIP. If I understand the
>> process correctly, the intent is for a "shepherd" to do it. I'm happy to
>> call a vote, or feel free if you'd like to play that role.
>>
>> Other comments:
>> * DeleteData API: I completely agree that we need to have a proposal for
>> it. I think the SQL side is easier because DELETE FROM is already a
>> statement. We just need to be able to identify v2 tables to use it. I'll
>> come up with something and send a proposal to the dev list.
>> * Table create/drop/alter/load API: I think we have agreement around the
>> proposed DataSourceV2 API, but we need to decide how the public API will
>> work and how this will fit in with ExternalCatalog (see the other thread for
>> discussion there). Do you think we need to get that entire SPIP approved
>> before we can start getting the API in? If so, what do you think needs to be
>> decided to get it ready?
>>
>> Thanks!
>>
>> rb
>>
>> On Wed, Jul 11, 2018 at 8:24 PM Wenchen Fan <cloud0...@gmail.com> wrote:
>>>
>>> Hi Ryan,
>>>
>>> Great job on this! Shall we call a vote for the plan standardization
>>> SPIP? I think this is a good idea and we should do it.
>>>
>>> Notes:
>>> We definitely need new user-facing APIs to produce these new logical
>>> plans like DeleteData. But we need a design doc for these new APIs after the
>>> SPIP passed.
>>> We definitely need the data source to provide the ability to
>>> create/drop/alter/lookup tables, but that belongs to the other SPIP and
>>> should be voted separately.
>>>
>>> Thanks,
>>> Wenchen
>>>
>>> On Fri, Apr 20, 2018 at 5:01 AM Ryan Blue <rb...@netflix.com.invalid>
>>> wrote:
>>>>
>>>> Hi everyone,
>>>>
>>>> A few weeks ago, I wrote up a proposal to standardize SQL logical plans
>>>> and a supporting design doc for data source catalog APIs. From the comments
>>>> on those docs, it looks like we mostly have agreement around standardizing
>>>> plans and around the data source catalog API.
>>>>
>>>> We still need to work out details, like the transactional API extension,
>>>> but I'd like to get started implementing those proposals so we have
>>>> something working for the 2.4.0 release. I'm starting this thread because I
>>>> think we're about ready to vote on the proposal and I'd like to get any
>>>> remaining discussion going or get anyone that missed this to read through
>>>> the docs.
>>>>
>>>> Thanks!
>>>>
>>>> rb
>>>>
>>>> --
>>>> Ryan Blue
>>>> Software Engineer
>>>> Netflix
>>
>>
>>
>> --
>> Ryan Blue
>> Software Engineer
>> Netflix

---------------------------------------------------------------------
To unsubscribe e-mail: dev-unsubscr...@spark.apache.org

Reply via email to