Re: [VOTE] SPIP: Structured Logging Framework for Apache Spark

2024-03-13 Thread Gengliang Wang
Thanks all for participating! The vote passed. I'll send out the result in
a separate thread.

On Wed, Mar 13, 2024 at 9:43 AM bo yang  wrote:

> +1
>
> On Wed, Mar 13, 2024 at 7:19 AM Tom Graves 
> wrote:
>
>> Similar as others,  will be interested in working out api's and details
>> but overall in favor of it.
>>
>> +1
>>
>> Tom Graves
>> On Monday, March 11, 2024 at 11:25:38 AM CDT, Mridul Muralidharan <
>> mri...@gmail.com> wrote:
>>
>>
>>
>>   I am supportive of the proposal - this is a step in the right direction
>> !
>> Additional metadata (explicit and inferred) for log records, and exposing
>> them for indexing is extremely useful.
>>
>> The specifics of the API still need some work IMO and does not need to be
>> this disruptive, but I consider that is orthogonal to this vote itself -
>> and something we need to iterate upon during PR reviews.
>>
>> +1
>>
>> Regards,
>> Mridul
>>
>>
>> On Mon, Mar 11, 2024 at 11:09 AM Mich Talebzadeh <
>> mich.talebza...@gmail.com> wrote:
>>
>> +1
>>
>> Mich Talebzadeh,
>> Dad | Technologist | Solutions Architect | Engineer
>> London
>> United Kingdom
>>
>>
>>view my Linkedin profile
>> <https://www.linkedin.com/in/mich-talebzadeh-ph-d-5205b2/>
>>
>>
>>  https://en.everybodywiki.com/Mich_Talebzadeh
>>
>>
>>
>> *Disclaimer:* The information provided is correct to the best of my
>> knowledge but of course cannot be guaranteed . It is essential to note
>> that, as with any advice, quote "one test result is worth one-thousand
>> expert opinions (Werner
>> <https://en.wikipedia.org/wiki/Wernher_von_Braun>Von Braun
>> <https://en.wikipedia.org/wiki/Wernher_von_Braun>)".
>>
>>
>> On Mon, 11 Mar 2024 at 09:27, Hyukjin Kwon  wrote:
>>
>> +1
>>
>> On Mon, 11 Mar 2024 at 18:11, yangjie01 
>> wrote:
>>
>> +1
>>
>>
>>
>> Jie Yang
>>
>>
>>
>> *发件人**: *Haejoon Lee 
>> *日期**: *2024年3月11日 星期一 17:09
>> *收件人**: *Gengliang Wang 
>> *抄送**: *dev 
>> *主题**: *Re: [VOTE] SPIP: Structured Logging Framework for Apache Spark
>>
>>
>>
>> +1
>>
>>
>>
>> On Mon, Mar 11, 2024 at 10:36 AM Gengliang Wang  wrote:
>>
>> Hi all,
>>
>> I'd like to start the vote for SPIP: Structured Logging Framework for
>> Apache Spark
>>
>>
>> References:
>>
>>- JIRA ticket
>>
>> <https://mailshield.baidu.com/check?q=godVZoGJGzagfL5fHFKDXe8FOsAuf3UaY0E7uyGx6HVUGGWsmD%2fgOW2x6J1A1XYt8pai0Y8FBhY%3d>
>>- SPIP doc
>>
>> <https://mailshield.baidu.com/check?q=qnzij19o7FucfHJ%2f4C2cBnMVM2kxjtEi9Gv4zA05b3oPw5UX986BZOwzaJ30UdGRMv%2fix31TYpjtazJC5uyypG0pZVBCfSjQGqlzkUoZozkFtgMXfpmRMSSp1%2bq83gkbLyrm1g%3d%3d>
>>- Discussion thread
>>
>> <https://mailshield.baidu.com/check?q=6PGfLtMnDpsSvIF5SlbpQ4%2bwdg53GCedx5r%2b7AOnYMjYwomNs%2fBioZOabP9Ml3b%2bE8jzqXF0xR3j607DdbjV0JOnlvU%3d>
>>
>> Please vote on the SPIP for the next 72 hours:
>>
>> [ ] +1: Accept the proposal as an official SPIP
>> [ ] +0
>> [ ] -1: I don’t think this is a good idea because …
>>
>> Thanks!
>>
>> Gengliang Wang
>>
>>


Re: [VOTE] SPIP: Structured Logging Framework for Apache Spark

2024-03-13 Thread bo yang
+1

On Wed, Mar 13, 2024 at 7:19 AM Tom Graves 
wrote:

> Similar as others,  will be interested in working out api's and details
> but overall in favor of it.
>
> +1
>
> Tom Graves
> On Monday, March 11, 2024 at 11:25:38 AM CDT, Mridul Muralidharan <
> mri...@gmail.com> wrote:
>
>
>
>   I am supportive of the proposal - this is a step in the right direction !
> Additional metadata (explicit and inferred) for log records, and exposing
> them for indexing is extremely useful.
>
> The specifics of the API still need some work IMO and does not need to be
> this disruptive, but I consider that is orthogonal to this vote itself -
> and something we need to iterate upon during PR reviews.
>
> +1
>
> Regards,
> Mridul
>
>
> On Mon, Mar 11, 2024 at 11:09 AM Mich Talebzadeh <
> mich.talebza...@gmail.com> wrote:
>
> +1
>
> Mich Talebzadeh,
> Dad | Technologist | Solutions Architect | Engineer
> London
> United Kingdom
>
>
>view my Linkedin profile
> <https://www.linkedin.com/in/mich-talebzadeh-ph-d-5205b2/>
>
>
>  https://en.everybodywiki.com/Mich_Talebzadeh
>
>
>
> *Disclaimer:* The information provided is correct to the best of my
> knowledge but of course cannot be guaranteed . It is essential to note
> that, as with any advice, quote "one test result is worth one-thousand
> expert opinions (Werner  <https://en.wikipedia.org/wiki/Wernher_von_Braun>Von
> Braun <https://en.wikipedia.org/wiki/Wernher_von_Braun>)".
>
>
> On Mon, 11 Mar 2024 at 09:27, Hyukjin Kwon  wrote:
>
> +1
>
> On Mon, 11 Mar 2024 at 18:11, yangjie01 
> wrote:
>
> +1
>
>
>
> Jie Yang
>
>
>
> *发件人**: *Haejoon Lee 
> *日期**: *2024年3月11日 星期一 17:09
> *收件人**: *Gengliang Wang 
> *抄送**: *dev 
> *主题**: *Re: [VOTE] SPIP: Structured Logging Framework for Apache Spark
>
>
>
> +1
>
>
>
> On Mon, Mar 11, 2024 at 10:36 AM Gengliang Wang  wrote:
>
> Hi all,
>
> I'd like to start the vote for SPIP: Structured Logging Framework for
> Apache Spark
>
>
> References:
>
>- JIRA ticket
>
> <https://mailshield.baidu.com/check?q=godVZoGJGzagfL5fHFKDXe8FOsAuf3UaY0E7uyGx6HVUGGWsmD%2fgOW2x6J1A1XYt8pai0Y8FBhY%3d>
>- SPIP doc
>
> <https://mailshield.baidu.com/check?q=qnzij19o7FucfHJ%2f4C2cBnMVM2kxjtEi9Gv4zA05b3oPw5UX986BZOwzaJ30UdGRMv%2fix31TYpjtazJC5uyypG0pZVBCfSjQGqlzkUoZozkFtgMXfpmRMSSp1%2bq83gkbLyrm1g%3d%3d>
>- Discussion thread
>
> <https://mailshield.baidu.com/check?q=6PGfLtMnDpsSvIF5SlbpQ4%2bwdg53GCedx5r%2b7AOnYMjYwomNs%2fBioZOabP9Ml3b%2bE8jzqXF0xR3j607DdbjV0JOnlvU%3d>
>
> Please vote on the SPIP for the next 72 hours:
>
> [ ] +1: Accept the proposal as an official SPIP
> [ ] +0
> [ ] -1: I don’t think this is a good idea because …
>
> Thanks!
>
> Gengliang Wang
>
>


Re: [VOTE] SPIP: Structured Logging Framework for Apache Spark

2024-03-13 Thread Tom Graves
 Similar as others,  will be interested in working out api's and details but 
overall in favor of it.

+1
Tom Graves
On Monday, March 11, 2024 at 11:25:38 AM CDT, Mridul Muralidharan 
 wrote:  
 
 
  I am supportive of the proposal - this is a step in the right direction 
!Additional metadata (explicit and inferred) for log records, and exposing them 
for indexing is extremely useful.
The specifics of the API still need some work IMO and does not need to be this 
disruptive, but I consider that is orthogonal to this vote itself - and 
something we need to iterate upon during PR reviews.
+1

Regards,Mridul

On Mon, Mar 11, 2024 at 11:09 AM Mich Talebzadeh  
wrote:

+1
Mich Talebzadeh,Dad | Technologist | Solutions Architect | Engineer
London
United Kingdom



   view my Linkedin profile




 https://en.everybodywiki.com/Mich_Talebzadeh

 



Disclaimer: The information provided is correct to the best of my knowledge but 
of course cannot be guaranteed . It is essential to note that, as with any 
advice, quote "one test result is worth one-thousand expert opinions (Werner 
Von Braun)".


On Mon, 11 Mar 2024 at 09:27, Hyukjin Kwon  wrote:

+1

On Mon, 11 Mar 2024 at 18:11, yangjie01  wrote:


+1

 

Jie Yang

 

发件人:Haejoon Lee 
日期:2024年3月11日星期一 17:09
收件人:Gengliang Wang 
抄送:dev 
主题:Re: [VOTE] SPIP: Structured Logging Framework for Apache Spark

 

+1

 

On Mon, Mar 11, 2024 at 10:36 AM Gengliang Wang  wrote:


Hi all,

I'd like to start the vote for SPIP: Structured Logging Framework for Apache 
Spark

 
References:
   
   - JIRA ticket
   - SPIP doc
   - Discussion thread

Please vote on the SPIP for the next 72 hours:

[ ] +1: Accept the proposal as an official SPIP
[ ] +0
[ ] -1: I don’t think this is a good idea because …

Thanks!

Gengliang Wang




  

Re: [VOTE] SPIP: Structured Logging Framework for Apache Spark

2024-03-12 Thread Ruifeng Zheng
+1

On Wed, Mar 13, 2024 at 4:32 AM John Zhuge  wrote:

> +1 (non-binding)
>
> On Tue, Mar 12, 2024 at 8:45 AM L. C. Hsieh  wrote:
>
>> +1
>>
>>
>> On Tue, Mar 12, 2024 at 8:20 AM Chao Sun  wrote:
>>
>>> +1
>>>
>>> On Tue, Mar 12, 2024 at 8:03 AM Xiao Li 
>>> wrote:
>>>
>>>> +1
>>>>
>>>> On Tue, Mar 12, 2024 at 6:09 AM Holden Karau 
>>>> wrote:
>>>>
>>>>> +1
>>>>>
>>>>> Twitter: https://twitter.com/holdenkarau
>>>>> Books (Learning Spark, High Performance Spark, etc.):
>>>>> https://amzn.to/2MaRAG9  <https://amzn.to/2MaRAG9>
>>>>> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>>>>>
>>>>
>>>>>
>>>>> On Mon, Mar 11, 2024 at 7:44 PM Reynold Xin
>>>>>  wrote:
>>>>>
>>>>>> +1
>>>>>>
>>>>>>
>>>>>> On Mon, Mar 11 2024 at 7:38 PM, Jungtaek Lim <
>>>>>> kabhwan.opensou...@gmail.com> wrote:
>>>>>>
>>>>>>> +1 (non-binding), thanks Gengliang!
>>>>>>>
>>>>>>> On Mon, Mar 11, 2024 at 5:46 PM Gengliang Wang 
>>>>>>> wrote:
>>>>>>>
>>>>>>>> Hi all,
>>>>>>>>
>>>>>>>> I'd like to start the vote for SPIP: Structured Logging Framework
>>>>>>>> for Apache Spark
>>>>>>>>
>>>>>>>> References:
>>>>>>>>
>>>>>>>>- JIRA ticket
>>>>>>>><https://issues.apache.org/jira/browse/SPARK-47240>
>>>>>>>>- SPIP doc
>>>>>>>>
>>>>>>>> <https://docs.google.com/document/d/1rATVGmFLNVLmtxSpWrEceYm7d-ocgu8ofhryVs4g3XU/edit?usp=sharing>
>>>>>>>>- Discussion thread
>>>>>>>><https://lists.apache.org/thread/gocslhbfv1r84kbcq3xt04nx827ljpxq>
>>>>>>>>
>>>>>>>> Please vote on the SPIP for the next 72 hours:
>>>>>>>>
>>>>>>>> [ ] +1: Accept the proposal as an official SPIP
>>>>>>>> [ ] +0
>>>>>>>> [ ] -1: I don’t think this is a good idea because …
>>>>>>>>
>>>>>>>> Thanks!
>>>>>>>> Gengliang Wang
>>>>>>>>
>>>>>>>
>>>>
>>>> --
>>>>
>>>>
>
> --
> John Zhuge
>


Re: [VOTE] SPIP: Structured Logging Framework for Apache Spark

2024-03-12 Thread John Zhuge
+1 (non-binding)

On Tue, Mar 12, 2024 at 8:45 AM L. C. Hsieh  wrote:

> +1
>
>
> On Tue, Mar 12, 2024 at 8:20 AM Chao Sun  wrote:
>
>> +1
>>
>> On Tue, Mar 12, 2024 at 8:03 AM Xiao Li 
>> wrote:
>>
>>> +1
>>>
>>> On Tue, Mar 12, 2024 at 6:09 AM Holden Karau 
>>> wrote:
>>>
>>>> +1
>>>>
>>>> Twitter: https://twitter.com/holdenkarau
>>>> Books (Learning Spark, High Performance Spark, etc.):
>>>> https://amzn.to/2MaRAG9  <https://amzn.to/2MaRAG9>
>>>> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>>>>
>>>
>>>>
>>>> On Mon, Mar 11, 2024 at 7:44 PM Reynold Xin 
>>>> wrote:
>>>>
>>>>> +1
>>>>>
>>>>>
>>>>> On Mon, Mar 11 2024 at 7:38 PM, Jungtaek Lim <
>>>>> kabhwan.opensou...@gmail.com> wrote:
>>>>>
>>>>>> +1 (non-binding), thanks Gengliang!
>>>>>>
>>>>>> On Mon, Mar 11, 2024 at 5:46 PM Gengliang Wang 
>>>>>> wrote:
>>>>>>
>>>>>>> Hi all,
>>>>>>>
>>>>>>> I'd like to start the vote for SPIP: Structured Logging Framework
>>>>>>> for Apache Spark
>>>>>>>
>>>>>>> References:
>>>>>>>
>>>>>>>- JIRA ticket <https://issues.apache.org/jira/browse/SPARK-47240>
>>>>>>>- SPIP doc
>>>>>>>
>>>>>>> <https://docs.google.com/document/d/1rATVGmFLNVLmtxSpWrEceYm7d-ocgu8ofhryVs4g3XU/edit?usp=sharing>
>>>>>>>- Discussion thread
>>>>>>><https://lists.apache.org/thread/gocslhbfv1r84kbcq3xt04nx827ljpxq>
>>>>>>>
>>>>>>> Please vote on the SPIP for the next 72 hours:
>>>>>>>
>>>>>>> [ ] +1: Accept the proposal as an official SPIP
>>>>>>> [ ] +0
>>>>>>> [ ] -1: I don’t think this is a good idea because …
>>>>>>>
>>>>>>> Thanks!
>>>>>>> Gengliang Wang
>>>>>>>
>>>>>>
>>>
>>> --
>>>
>>>

-- 
John Zhuge


Re: [VOTE] SPIP: Structured Logging Framework for Apache Spark

2024-03-12 Thread Robyn Nameth
+ 1

On Mon, Mar 11, 2024 at 3:46 AM Gengliang Wang  wrote:

> Hi all,
>
> I'd like to start the vote for SPIP: Structured Logging Framework for
> Apache Spark
>
> References:
>
>- JIRA ticket <https://issues.apache.org/jira/browse/SPARK-47240>
>- SPIP doc
>
> <https://docs.google.com/document/d/1rATVGmFLNVLmtxSpWrEceYm7d-ocgu8ofhryVs4g3XU/edit?usp=sharing>
>- Discussion thread
><https://lists.apache.org/thread/gocslhbfv1r84kbcq3xt04nx827ljpxq>
>
> Please vote on the SPIP for the next 72 hours:
>
> [ ] +1: Accept the proposal as an official SPIP
> [ ] +0
> [ ] -1: I don’t think this is a good idea because …
>
> Thanks!
> Gengliang Wang
>


Re: [VOTE] SPIP: Structured Logging Framework for Apache Spark

2024-03-12 Thread L. C. Hsieh
+1


On Tue, Mar 12, 2024 at 8:20 AM Chao Sun  wrote:

> +1
>
> On Tue, Mar 12, 2024 at 8:03 AM Xiao Li 
> wrote:
>
>> +1
>>
>> On Tue, Mar 12, 2024 at 6:09 AM Holden Karau 
>> wrote:
>>
>>> +1
>>>
>>> Twitter: https://twitter.com/holdenkarau
>>> Books (Learning Spark, High Performance Spark, etc.):
>>> https://amzn.to/2MaRAG9  <https://amzn.to/2MaRAG9>
>>> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>>>
>>
>>>
>>> On Mon, Mar 11, 2024 at 7:44 PM Reynold Xin 
>>> wrote:
>>>
>>>> +1
>>>>
>>>>
>>>> On Mon, Mar 11 2024 at 7:38 PM, Jungtaek Lim <
>>>> kabhwan.opensou...@gmail.com> wrote:
>>>>
>>>>> +1 (non-binding), thanks Gengliang!
>>>>>
>>>>> On Mon, Mar 11, 2024 at 5:46 PM Gengliang Wang 
>>>>> wrote:
>>>>>
>>>>>> Hi all,
>>>>>>
>>>>>> I'd like to start the vote for SPIP: Structured Logging Framework for
>>>>>> Apache Spark
>>>>>>
>>>>>> References:
>>>>>>
>>>>>>- JIRA ticket <https://issues.apache.org/jira/browse/SPARK-47240>
>>>>>>- SPIP doc
>>>>>>
>>>>>> <https://docs.google.com/document/d/1rATVGmFLNVLmtxSpWrEceYm7d-ocgu8ofhryVs4g3XU/edit?usp=sharing>
>>>>>>- Discussion thread
>>>>>><https://lists.apache.org/thread/gocslhbfv1r84kbcq3xt04nx827ljpxq>
>>>>>>
>>>>>> Please vote on the SPIP for the next 72 hours:
>>>>>>
>>>>>> [ ] +1: Accept the proposal as an official SPIP
>>>>>> [ ] +0
>>>>>> [ ] -1: I don’t think this is a good idea because …
>>>>>>
>>>>>> Thanks!
>>>>>> Gengliang Wang
>>>>>>
>>>>>
>>
>> --
>>
>>


Re: [VOTE] SPIP: Structured Logging Framework for Apache Spark

2024-03-12 Thread Chao Sun
+1

On Tue, Mar 12, 2024 at 8:03 AM Xiao Li 
wrote:

> +1
>
> On Tue, Mar 12, 2024 at 6:09 AM Holden Karau 
> wrote:
>
>> +1
>>
>> Twitter: https://twitter.com/holdenkarau
>> Books (Learning Spark, High Performance Spark, etc.):
>> https://amzn.to/2MaRAG9  <https://amzn.to/2MaRAG9>
>> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>>
>
>>
>> On Mon, Mar 11, 2024 at 7:44 PM Reynold Xin 
>> wrote:
>>
>>> +1
>>>
>>>
>>> On Mon, Mar 11 2024 at 7:38 PM, Jungtaek Lim <
>>> kabhwan.opensou...@gmail.com> wrote:
>>>
>>>> +1 (non-binding), thanks Gengliang!
>>>>
>>>> On Mon, Mar 11, 2024 at 5:46 PM Gengliang Wang 
>>>> wrote:
>>>>
>>>>> Hi all,
>>>>>
>>>>> I'd like to start the vote for SPIP: Structured Logging Framework for
>>>>> Apache Spark
>>>>>
>>>>> References:
>>>>>
>>>>>- JIRA ticket <https://issues.apache.org/jira/browse/SPARK-47240>
>>>>>- SPIP doc
>>>>>
>>>>> <https://docs.google.com/document/d/1rATVGmFLNVLmtxSpWrEceYm7d-ocgu8ofhryVs4g3XU/edit?usp=sharing>
>>>>>- Discussion thread
>>>>><https://lists.apache.org/thread/gocslhbfv1r84kbcq3xt04nx827ljpxq>
>>>>>
>>>>> Please vote on the SPIP for the next 72 hours:
>>>>>
>>>>> [ ] +1: Accept the proposal as an official SPIP
>>>>> [ ] +0
>>>>> [ ] -1: I don’t think this is a good idea because …
>>>>>
>>>>> Thanks!
>>>>> Gengliang Wang
>>>>>
>>>>
>
> --
>
>


Re: [VOTE] SPIP: Structured Logging Framework for Apache Spark

2024-03-12 Thread Xiao Li
+1

On Tue, Mar 12, 2024 at 6:09 AM Holden Karau  wrote:

> +1
>
> Twitter: https://twitter.com/holdenkarau
> Books (Learning Spark, High Performance Spark, etc.):
> https://amzn.to/2MaRAG9  <https://amzn.to/2MaRAG9>
> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>
>
> On Mon, Mar 11, 2024 at 7:44 PM Reynold Xin 
> wrote:
>
>> +1
>>
>>
>> On Mon, Mar 11 2024 at 7:38 PM, Jungtaek Lim <
>> kabhwan.opensou...@gmail.com> wrote:
>>
>>> +1 (non-binding), thanks Gengliang!
>>>
>>> On Mon, Mar 11, 2024 at 5:46 PM Gengliang Wang  wrote:
>>>
>>>> Hi all,
>>>>
>>>> I'd like to start the vote for SPIP: Structured Logging Framework for
>>>> Apache Spark
>>>>
>>>> References:
>>>>
>>>>- JIRA ticket <https://issues.apache.org/jira/browse/SPARK-47240>
>>>>- SPIP doc
>>>>
>>>> <https://docs.google.com/document/d/1rATVGmFLNVLmtxSpWrEceYm7d-ocgu8ofhryVs4g3XU/edit?usp=sharing>
>>>>- Discussion thread
>>>><https://lists.apache.org/thread/gocslhbfv1r84kbcq3xt04nx827ljpxq>
>>>>
>>>> Please vote on the SPIP for the next 72 hours:
>>>>
>>>> [ ] +1: Accept the proposal as an official SPIP
>>>> [ ] +0
>>>> [ ] -1: I don’t think this is a good idea because …
>>>>
>>>> Thanks!
>>>> Gengliang Wang
>>>>
>>>

--


Re: [VOTE] SPIP: Structured Logging Framework for Apache Spark

2024-03-12 Thread Holden Karau
+1

Twitter: https://twitter.com/holdenkarau
Books (Learning Spark, High Performance Spark, etc.):
https://amzn.to/2MaRAG9  <https://amzn.to/2MaRAG9>
YouTube Live Streams: https://www.youtube.com/user/holdenkarau


On Mon, Mar 11, 2024 at 7:44 PM Reynold Xin 
wrote:

> +1
>
>
> On Mon, Mar 11 2024 at 7:38 PM, Jungtaek Lim 
> wrote:
>
>> +1 (non-binding), thanks Gengliang!
>>
>> On Mon, Mar 11, 2024 at 5:46 PM Gengliang Wang  wrote:
>>
>>> Hi all,
>>>
>>> I'd like to start the vote for SPIP: Structured Logging Framework for
>>> Apache Spark
>>>
>>> References:
>>>
>>>- JIRA ticket <https://issues.apache.org/jira/browse/SPARK-47240>
>>>- SPIP doc
>>>
>>> <https://docs.google.com/document/d/1rATVGmFLNVLmtxSpWrEceYm7d-ocgu8ofhryVs4g3XU/edit?usp=sharing>
>>>- Discussion thread
>>><https://lists.apache.org/thread/gocslhbfv1r84kbcq3xt04nx827ljpxq>
>>>
>>> Please vote on the SPIP for the next 72 hours:
>>>
>>> [ ] +1: Accept the proposal as an official SPIP
>>> [ ] +0
>>> [ ] -1: I don’t think this is a good idea because …
>>>
>>> Thanks!
>>> Gengliang Wang
>>>
>>


Re: [VOTE] SPIP: Structured Logging Framework for Apache Spark

2024-03-11 Thread Reynold Xin
+1

On Mon, Mar 11 2024 at 7:38 PM, Jungtaek Lim < kabhwan.opensou...@gmail.com > 
wrote:

> 
> +1 (non-binding), thanks Gengliang!
> 
> 
> On Mon, Mar 11, 2024 at 5:46 PM Gengliang Wang < ltn...@gmail.com > wrote:
> 
> 
> 
>> Hi all,
>> 
>> I'd like to start the vote for SPIP: Structured Logging Framework for
>> Apache Spark
>> 
>> References:
>> 
>> 
>> * JIRA ticket ( https://issues.apache.org/jira/browse/SPARK-47240 )
>> * SPIP doc (
>> https://docs.google.com/document/d/1rATVGmFLNVLmtxSpWrEceYm7d-ocgu8ofhryVs4g3XU/edit?usp=sharing
>> )
>> * Discussion thread (
>> https://lists.apache.org/thread/gocslhbfv1r84kbcq3xt04nx827ljpxq )
>> 
>> 
>> Please vote on the SPIP for the next 72 hours:
>> 
>> [ ] +1: Accept the proposal as an official SPIP
>> [ ] +0
>> [ ] -1: I don’t think this is a good idea because …
>> 
>> Thanks!
>> 
>> Gengliang Wang
>> 
> 
>

smime.p7s
Description: S/MIME Cryptographic Signature


Re: [VOTE] SPIP: Structured Logging Framework for Apache Spark

2024-03-11 Thread Jungtaek Lim
+1 (non-binding), thanks Gengliang!

On Mon, Mar 11, 2024 at 5:46 PM Gengliang Wang  wrote:

> Hi all,
>
> I'd like to start the vote for SPIP: Structured Logging Framework for
> Apache Spark
>
> References:
>
>- JIRA ticket <https://issues.apache.org/jira/browse/SPARK-47240>
>- SPIP doc
>
> <https://docs.google.com/document/d/1rATVGmFLNVLmtxSpWrEceYm7d-ocgu8ofhryVs4g3XU/edit?usp=sharing>
>- Discussion thread
><https://lists.apache.org/thread/gocslhbfv1r84kbcq3xt04nx827ljpxq>
>
> Please vote on the SPIP for the next 72 hours:
>
> [ ] +1: Accept the proposal as an official SPIP
> [ ] +0
> [ ] -1: I don’t think this is a good idea because …
>
> Thanks!
> Gengliang Wang
>


Re: [VOTE] SPIP: Structured Logging Framework for Apache Spark

2024-03-11 Thread Scott
+1

On Mon, Mar 11, 2024 at 4:11 AM yangjie01 
wrote:

> +1
>
>
>
> Jie Yang
>
>
>
> *发件人**: *Haejoon Lee 
> *日期**: *2024年3月11日 星期一 17:09
> *收件人**: *Gengliang Wang 
> *抄送**: *dev 
> *主题**: *Re: [VOTE] SPIP: Structured Logging Framework for Apache Spark
>
>
>
> +1
>
>
>
> On Mon, Mar 11, 2024 at 10:36 AM Gengliang Wang  wrote:
>
> Hi all,
>
> I'd like to start the vote for SPIP: Structured Logging Framework for
> Apache Spark
>
>
> References:
>
>- JIRA ticket
>
> <https://mailshield.baidu.com/check?q=godVZoGJGzagfL5fHFKDXe8FOsAuf3UaY0E7uyGx6HVUGGWsmD%2fgOW2x6J1A1XYt8pai0Y8FBhY%3d>
>- SPIP doc
>
> <https://mailshield.baidu.com/check?q=qnzij19o7FucfHJ%2f4C2cBnMVM2kxjtEi9Gv4zA05b3oPw5UX986BZOwzaJ30UdGRMv%2fix31TYpjtazJC5uyypG0pZVBCfSjQGqlzkUoZozkFtgMXfpmRMSSp1%2bq83gkbLyrm1g%3d%3d>
>- Discussion thread
>
> <https://mailshield.baidu.com/check?q=6PGfLtMnDpsSvIF5SlbpQ4%2bwdg53GCedx5r%2b7AOnYMjYwomNs%2fBioZOabP9Ml3b%2bE8jzqXF0xR3j607DdbjV0JOnlvU%3d>
>
> Please vote on the SPIP for the next 72 hours:
>
> [ ] +1: Accept the proposal as an official SPIP
> [ ] +0
> [ ] -1: I don’t think this is a good idea because …
>
> Thanks!
>
> Gengliang Wang
>
>


Re: [VOTE] SPIP: Structured Logging Framework for Apache Spark

2024-03-11 Thread Xinrong Meng
+1

Thanks @Gengliang Wang !

On Mon, Mar 11, 2024 at 1:09 PM Gengliang Wang  wrote:

> Hi Steve,
>
> thanks for the suggestion in this email thread and the SPIP doc! I will
> read the Audit Log and seek your feedback through PR reviews during the
> implementation process.
>
> > So worrying about how pass and manage that at the thread level matters.
>
> We can have a specific logger for org.apache.spark and only show specific
> keys from log context (MDC).
>
> > The files get really big fast. I'd recommend considering Avro as an
> option from the outset.
>
> Agree, I have mentioned how to address this issue in section Q6. What are
> the risks?
> <https://docs.google.com/document/d/1rATVGmFLNVLmtxSpWrEceYm7d-ocgu8ofhryVs4g3XU/edit#bookmark=id.8zbyavz648i6>
>
>
> Thanks,
> Gengliang
>
> On Mon, Mar 11, 2024 at 9:30 AM huaxin gao  wrote:
>
>> +1
>>
>> On Mon, Mar 11, 2024 at 7:02 AM Wenchen Fan  wrote:
>>
>>> +1
>>>
>>> On Mon, Mar 11, 2024 at 5:26 PM Hyukjin Kwon 
>>> wrote:
>>>
>>>> +1
>>>>
>>>> On Mon, 11 Mar 2024 at 18:11, yangjie01 
>>>> wrote:
>>>>
>>>>> +1
>>>>>
>>>>>
>>>>>
>>>>> Jie Yang
>>>>>
>>>>>
>>>>>
>>>>> *发件人**: *Haejoon Lee 
>>>>> *日期**: *2024年3月11日 星期一 17:09
>>>>> *收件人**: *Gengliang Wang 
>>>>> *抄送**: *dev 
>>>>> *主题**: *Re: [VOTE] SPIP: Structured Logging Framework for Apache Spark
>>>>>
>>>>>
>>>>>
>>>>> +1
>>>>>
>>>>>
>>>>>
>>>>> On Mon, Mar 11, 2024 at 10:36 AM Gengliang Wang 
>>>>> wrote:
>>>>>
>>>>> Hi all,
>>>>>
>>>>> I'd like to start the vote for SPIP: Structured Logging Framework for
>>>>> Apache Spark
>>>>>
>>>>>
>>>>> References:
>>>>>
>>>>>- JIRA ticket
>>>>>
>>>>> <https://mailshield.baidu.com/check?q=godVZoGJGzagfL5fHFKDXe8FOsAuf3UaY0E7uyGx6HVUGGWsmD%2fgOW2x6J1A1XYt8pai0Y8FBhY%3d>
>>>>>- SPIP doc
>>>>>
>>>>> <https://mailshield.baidu.com/check?q=qnzij19o7FucfHJ%2f4C2cBnMVM2kxjtEi9Gv4zA05b3oPw5UX986BZOwzaJ30UdGRMv%2fix31TYpjtazJC5uyypG0pZVBCfSjQGqlzkUoZozkFtgMXfpmRMSSp1%2bq83gkbLyrm1g%3d%3d>
>>>>>- Discussion thread
>>>>>
>>>>> <https://mailshield.baidu.com/check?q=6PGfLtMnDpsSvIF5SlbpQ4%2bwdg53GCedx5r%2b7AOnYMjYwomNs%2fBioZOabP9Ml3b%2bE8jzqXF0xR3j607DdbjV0JOnlvU%3d>
>>>>>
>>>>> Please vote on the SPIP for the next 72 hours:
>>>>>
>>>>> [ ] +1: Accept the proposal as an official SPIP
>>>>> [ ] +0
>>>>> [ ] -1: I don’t think this is a good idea because …
>>>>>
>>>>> Thanks!
>>>>>
>>>>> Gengliang Wang
>>>>>
>>>>>


Re: [VOTE] SPIP: Structured Logging Framework for Apache Spark

2024-03-11 Thread Dongjoon Hyun
Ya, I also have a similar opinion with Mridul.

+1

Thank you, Gengliang.

Dongjoon.


On Mon, Mar 11, 2024 at 1:34 PM Mridul Muralidharan 
wrote:

>
>   I am supportive of the proposal - this is a step in the right direction !
> Additional metadata (explicit and inferred) for log records, and exposing
> them for indexing is extremely useful.
>
> The specifics of the API still need some work IMO and does not need to be
> this disruptive, but I consider that is orthogonal to this vote itself -
> and something we need to iterate upon during PR reviews.
>
> +1
>
> Regards,
> Mridul
>
>
> On Mon, Mar 11, 2024 at 11:09 AM Mich Talebzadeh <
> mich.talebza...@gmail.com> wrote:
>
>> +1
>>
>> Mich Talebzadeh,
>> Dad | Technologist | Solutions Architect | Engineer
>> London
>> United Kingdom
>>
>>
>>view my Linkedin profile
>> <https://www.linkedin.com/in/mich-talebzadeh-ph-d-5205b2/>
>>
>>
>>  https://en.everybodywiki.com/Mich_Talebzadeh
>>
>>
>>
>> *Disclaimer:* The information provided is correct to the best of my
>> knowledge but of course cannot be guaranteed . It is essential to note
>> that, as with any advice, quote "one test result is worth one-thousand
>> expert opinions (Werner
>> <https://en.wikipedia.org/wiki/Wernher_von_Braun>Von Braun
>> <https://en.wikipedia.org/wiki/Wernher_von_Braun>)".
>>
>>
>> On Mon, 11 Mar 2024 at 09:27, Hyukjin Kwon  wrote:
>>
>>> +1
>>>
>>> On Mon, 11 Mar 2024 at 18:11, yangjie01 
>>> wrote:
>>>
>>>> +1
>>>>
>>>>
>>>>
>>>> Jie Yang
>>>>
>>>>
>>>>
>>>> *发件人**: *Haejoon Lee 
>>>> *日期**: *2024年3月11日 星期一 17:09
>>>> *收件人**: *Gengliang Wang 
>>>> *抄送**: *dev 
>>>> *主题**: *Re: [VOTE] SPIP: Structured Logging Framework for Apache Spark
>>>>
>>>>
>>>>
>>>> +1
>>>>
>>>>
>>>>
>>>> On Mon, Mar 11, 2024 at 10:36 AM Gengliang Wang 
>>>> wrote:
>>>>
>>>> Hi all,
>>>>
>>>> I'd like to start the vote for SPIP: Structured Logging Framework for
>>>> Apache Spark
>>>>
>>>>
>>>> References:
>>>>
>>>>- JIRA ticket
>>>>
>>>> <https://mailshield.baidu.com/check?q=godVZoGJGzagfL5fHFKDXe8FOsAuf3UaY0E7uyGx6HVUGGWsmD%2fgOW2x6J1A1XYt8pai0Y8FBhY%3d>
>>>>- SPIP doc
>>>>
>>>> <https://mailshield.baidu.com/check?q=qnzij19o7FucfHJ%2f4C2cBnMVM2kxjtEi9Gv4zA05b3oPw5UX986BZOwzaJ30UdGRMv%2fix31TYpjtazJC5uyypG0pZVBCfSjQGqlzkUoZozkFtgMXfpmRMSSp1%2bq83gkbLyrm1g%3d%3d>
>>>>- Discussion thread
>>>>
>>>> <https://mailshield.baidu.com/check?q=6PGfLtMnDpsSvIF5SlbpQ4%2bwdg53GCedx5r%2b7AOnYMjYwomNs%2fBioZOabP9Ml3b%2bE8jzqXF0xR3j607DdbjV0JOnlvU%3d>
>>>>
>>>> Please vote on the SPIP for the next 72 hours:
>>>>
>>>> [ ] +1: Accept the proposal as an official SPIP
>>>> [ ] +0
>>>> [ ] -1: I don’t think this is a good idea because …
>>>>
>>>> Thanks!
>>>>
>>>> Gengliang Wang
>>>>
>>>>


Re: [VOTE] SPIP: Structured Logging Framework for Apache Spark

2024-03-11 Thread Gengliang Wang
Hi Steve,

thanks for the suggestion in this email thread and the SPIP doc! I will
read the Audit Log and seek your feedback through PR reviews during the
implementation process.

> So worrying about how pass and manage that at the thread level matters.

We can have a specific logger for org.apache.spark and only show specific
keys from log context (MDC).

> The files get really big fast. I'd recommend considering Avro as an
option from the outset.

Agree, I have mentioned how to address this issue in section Q6. What are
the risks?
<https://docs.google.com/document/d/1rATVGmFLNVLmtxSpWrEceYm7d-ocgu8ofhryVs4g3XU/edit#bookmark=id.8zbyavz648i6>


Thanks,
Gengliang

On Mon, Mar 11, 2024 at 9:30 AM huaxin gao  wrote:

> +1
>
> On Mon, Mar 11, 2024 at 7:02 AM Wenchen Fan  wrote:
>
>> +1
>>
>> On Mon, Mar 11, 2024 at 5:26 PM Hyukjin Kwon 
>> wrote:
>>
>>> +1
>>>
>>> On Mon, 11 Mar 2024 at 18:11, yangjie01 
>>> wrote:
>>>
>>>> +1
>>>>
>>>>
>>>>
>>>> Jie Yang
>>>>
>>>>
>>>>
>>>> *发件人**: *Haejoon Lee 
>>>> *日期**: *2024年3月11日 星期一 17:09
>>>> *收件人**: *Gengliang Wang 
>>>> *抄送**: *dev 
>>>> *主题**: *Re: [VOTE] SPIP: Structured Logging Framework for Apache Spark
>>>>
>>>>
>>>>
>>>> +1
>>>>
>>>>
>>>>
>>>> On Mon, Mar 11, 2024 at 10:36 AM Gengliang Wang 
>>>> wrote:
>>>>
>>>> Hi all,
>>>>
>>>> I'd like to start the vote for SPIP: Structured Logging Framework for
>>>> Apache Spark
>>>>
>>>>
>>>> References:
>>>>
>>>>- JIRA ticket
>>>>
>>>> <https://mailshield.baidu.com/check?q=godVZoGJGzagfL5fHFKDXe8FOsAuf3UaY0E7uyGx6HVUGGWsmD%2fgOW2x6J1A1XYt8pai0Y8FBhY%3d>
>>>>- SPIP doc
>>>>
>>>> <https://mailshield.baidu.com/check?q=qnzij19o7FucfHJ%2f4C2cBnMVM2kxjtEi9Gv4zA05b3oPw5UX986BZOwzaJ30UdGRMv%2fix31TYpjtazJC5uyypG0pZVBCfSjQGqlzkUoZozkFtgMXfpmRMSSp1%2bq83gkbLyrm1g%3d%3d>
>>>>- Discussion thread
>>>>
>>>> <https://mailshield.baidu.com/check?q=6PGfLtMnDpsSvIF5SlbpQ4%2bwdg53GCedx5r%2b7AOnYMjYwomNs%2fBioZOabP9Ml3b%2bE8jzqXF0xR3j607DdbjV0JOnlvU%3d>
>>>>
>>>> Please vote on the SPIP for the next 72 hours:
>>>>
>>>> [ ] +1: Accept the proposal as an official SPIP
>>>> [ ] +0
>>>> [ ] -1: I don’t think this is a good idea because …
>>>>
>>>> Thanks!
>>>>
>>>> Gengliang Wang
>>>>
>>>>


Re: [VOTE] SPIP: Structured Logging Framework for Apache Spark

2024-03-11 Thread huaxin gao
+1

On Mon, Mar 11, 2024 at 7:02 AM Wenchen Fan  wrote:

> +1
>
> On Mon, Mar 11, 2024 at 5:26 PM Hyukjin Kwon  wrote:
>
>> +1
>>
>> On Mon, 11 Mar 2024 at 18:11, yangjie01 
>> wrote:
>>
>>> +1
>>>
>>>
>>>
>>> Jie Yang
>>>
>>>
>>>
>>> *发件人**: *Haejoon Lee 
>>> *日期**: *2024年3月11日 星期一 17:09
>>> *收件人**: *Gengliang Wang 
>>> *抄送**: *dev 
>>> *主题**: *Re: [VOTE] SPIP: Structured Logging Framework for Apache Spark
>>>
>>>
>>>
>>> +1
>>>
>>>
>>>
>>> On Mon, Mar 11, 2024 at 10:36 AM Gengliang Wang 
>>> wrote:
>>>
>>> Hi all,
>>>
>>> I'd like to start the vote for SPIP: Structured Logging Framework for
>>> Apache Spark
>>>
>>>
>>> References:
>>>
>>>- JIRA ticket
>>>
>>> <https://mailshield.baidu.com/check?q=godVZoGJGzagfL5fHFKDXe8FOsAuf3UaY0E7uyGx6HVUGGWsmD%2fgOW2x6J1A1XYt8pai0Y8FBhY%3d>
>>>- SPIP doc
>>>
>>> <https://mailshield.baidu.com/check?q=qnzij19o7FucfHJ%2f4C2cBnMVM2kxjtEi9Gv4zA05b3oPw5UX986BZOwzaJ30UdGRMv%2fix31TYpjtazJC5uyypG0pZVBCfSjQGqlzkUoZozkFtgMXfpmRMSSp1%2bq83gkbLyrm1g%3d%3d>
>>>- Discussion thread
>>>
>>> <https://mailshield.baidu.com/check?q=6PGfLtMnDpsSvIF5SlbpQ4%2bwdg53GCedx5r%2b7AOnYMjYwomNs%2fBioZOabP9Ml3b%2bE8jzqXF0xR3j607DdbjV0JOnlvU%3d>
>>>
>>> Please vote on the SPIP for the next 72 hours:
>>>
>>> [ ] +1: Accept the proposal as an official SPIP
>>> [ ] +0
>>> [ ] -1: I don’t think this is a good idea because …
>>>
>>> Thanks!
>>>
>>> Gengliang Wang
>>>
>>>


Re: [VOTE] SPIP: Structured Logging Framework for Apache Spark

2024-03-11 Thread Mridul Muralidharan
  I am supportive of the proposal - this is a step in the right direction !
Additional metadata (explicit and inferred) for log records, and exposing
them for indexing is extremely useful.

The specifics of the API still need some work IMO and does not need to be
this disruptive, but I consider that is orthogonal to this vote itself -
and something we need to iterate upon during PR reviews.

+1

Regards,
Mridul


On Mon, Mar 11, 2024 at 11:09 AM Mich Talebzadeh 
wrote:

> +1
>
> Mich Talebzadeh,
> Dad | Technologist | Solutions Architect | Engineer
> London
> United Kingdom
>
>
>view my Linkedin profile
> <https://www.linkedin.com/in/mich-talebzadeh-ph-d-5205b2/>
>
>
>  https://en.everybodywiki.com/Mich_Talebzadeh
>
>
>
> *Disclaimer:* The information provided is correct to the best of my
> knowledge but of course cannot be guaranteed . It is essential to note
> that, as with any advice, quote "one test result is worth one-thousand
> expert opinions (Werner  <https://en.wikipedia.org/wiki/Wernher_von_Braun>Von
> Braun <https://en.wikipedia.org/wiki/Wernher_von_Braun>)".
>
>
> On Mon, 11 Mar 2024 at 09:27, Hyukjin Kwon  wrote:
>
>> +1
>>
>> On Mon, 11 Mar 2024 at 18:11, yangjie01 
>> wrote:
>>
>>> +1
>>>
>>>
>>>
>>> Jie Yang
>>>
>>>
>>>
>>> *发件人**: *Haejoon Lee 
>>> *日期**: *2024年3月11日 星期一 17:09
>>> *收件人**: *Gengliang Wang 
>>> *抄送**: *dev 
>>> *主题**: *Re: [VOTE] SPIP: Structured Logging Framework for Apache Spark
>>>
>>>
>>>
>>> +1
>>>
>>>
>>>
>>> On Mon, Mar 11, 2024 at 10:36 AM Gengliang Wang 
>>> wrote:
>>>
>>> Hi all,
>>>
>>> I'd like to start the vote for SPIP: Structured Logging Framework for
>>> Apache Spark
>>>
>>>
>>> References:
>>>
>>>- JIRA ticket
>>>
>>> <https://mailshield.baidu.com/check?q=godVZoGJGzagfL5fHFKDXe8FOsAuf3UaY0E7uyGx6HVUGGWsmD%2fgOW2x6J1A1XYt8pai0Y8FBhY%3d>
>>>- SPIP doc
>>>
>>> <https://mailshield.baidu.com/check?q=qnzij19o7FucfHJ%2f4C2cBnMVM2kxjtEi9Gv4zA05b3oPw5UX986BZOwzaJ30UdGRMv%2fix31TYpjtazJC5uyypG0pZVBCfSjQGqlzkUoZozkFtgMXfpmRMSSp1%2bq83gkbLyrm1g%3d%3d>
>>>- Discussion thread
>>>
>>> <https://mailshield.baidu.com/check?q=6PGfLtMnDpsSvIF5SlbpQ4%2bwdg53GCedx5r%2b7AOnYMjYwomNs%2fBioZOabP9Ml3b%2bE8jzqXF0xR3j607DdbjV0JOnlvU%3d>
>>>
>>> Please vote on the SPIP for the next 72 hours:
>>>
>>> [ ] +1: Accept the proposal as an official SPIP
>>> [ ] +0
>>> [ ] -1: I don’t think this is a good idea because …
>>>
>>> Thanks!
>>>
>>> Gengliang Wang
>>>
>>>


Re: [VOTE] SPIP: Structured Logging Framework for Apache Spark

2024-03-11 Thread Denny Lee
+1 (non-binding)

On Sun, Mar 10, 2024 at 23:36 Gengliang Wang  wrote:

> Hi all,
>
> I'd like to start the vote for SPIP: Structured Logging Framework for
> Apache Spark
>
> References:
>
>- JIRA ticket <https://issues.apache.org/jira/browse/SPARK-47240>
>- SPIP doc
>
> <https://docs.google.com/document/d/1rATVGmFLNVLmtxSpWrEceYm7d-ocgu8ofhryVs4g3XU/edit?usp=sharing>
>- Discussion thread
><https://lists.apache.org/thread/gocslhbfv1r84kbcq3xt04nx827ljpxq>
>
> Please vote on the SPIP for the next 72 hours:
>
> [ ] +1: Accept the proposal as an official SPIP
> [ ] +0
> [ ] -1: I don’t think this is a good idea because …
>
> Thanks!
>
> Gengliang Wang
>


Re: [VOTE] SPIP: Structured Logging Framework for Apache Spark

2024-03-11 Thread Steve Loughran
I consider the context info as more important than just logging; at hadoop
level we do it to attach things like task/jobIds, kerberos principals etc
to all store requests.
https://hadoop.apache.org/docs/stable/hadoop-aws/tools/hadoop-aws/auditing.html

So worrying about how pass and manage that at the thread level matters.
Hadoop does various things like creating audit spans propagating it and the
IOStatistics context through submitter/task pools, so as to correlate
better all activity. After all, if something deleted all the files in a
table: you want to know who and what, just as you want to understand what
is overloading your store with too many GET requests.

You also need to think about cluster-wide context info, such as the
specific SQL query triggering all the work. This is context info which the
spark driver has to generate and which is then propagated down to the work
thread across the cluster. I'd like that in the Hadoop auditing stuff too.
if you are targeting hadoop 3.3.2+ only, I can provide some guidance as
having it go further down the stack can only be advantageous.

I actually played with generating Log4j to JSON lines a long, long time ago.
https://hadoop.apache.org/docs/r2.8.2/hadoop-project-dist/hadoop-common/api/org/apache/hadoop/log/Log4Json.html
The files get really big fast. I'd recommend considering Avro as an option
from the outset. It's also really good it's still be able to use ripgrep to
scan a few GB of gzipped output *and get all messages a few seconds either
side*.

One interesting place for the structured output is actually test reports.
Everyone is a bit crippled here because they are stuck using an XML test
result format which was written purely to match our XSL understanding at
the time (2000!) rather than thinking of the need to correlate integration
test output. It might be that scalatest can support better structure here
than a simple model of "tests and stack traces" + stdout/stderr. While
rethinking test output formats is quite a radical undertaking and not one I
would recommend to people, leaving the option open would be good.

Finally, if you plan for the structured output to be stable over time,
you're going to have to have a policy in place about making those logs part
of the spark public API -because they will implicitly be this. HDFS Audit
Log is one such log; I think there may actually even be some regression
tests.

On Mon, 11 Mar 2024 at 01:36, Gengliang Wang  wrote:

> Hi all,
>
> I'd like to start the vote for SPIP: Structured Logging Framework for
> Apache Spark
>
> References:
>
>- JIRA ticket <https://issues.apache.org/jira/browse/SPARK-47240>
>- SPIP doc
>
> <https://docs.google.com/document/d/1rATVGmFLNVLmtxSpWrEceYm7d-ocgu8ofhryVs4g3XU/edit?usp=sharing>
>- Discussion thread
><https://lists.apache.org/thread/gocslhbfv1r84kbcq3xt04nx827ljpxq>
>
> Please vote on the SPIP for the next 72 hours:
>
> [ ] +1: Accept the proposal as an official SPIP
> [ ] +0
> [ ] -1: I don’t think this is a good idea because …
>
> Thanks!
> Gengliang Wang
>


Re: [VOTE] SPIP: Structured Logging Framework for Apache Spark

2024-03-11 Thread Kent Yao
+1 (non-binding)


Kent Yao

Hyukjin Kwon  于2024年3月11日周一 17:26写道:
>
> +1
>
> On Mon, 11 Mar 2024 at 18:11, yangjie01  wrote:
>>
>> +1
>>
>>
>>
>> Jie Yang
>>
>>
>>
>> 发件人: Haejoon Lee 
>> 日期: 2024年3月11日 星期一 17:09
>> 收件人: Gengliang Wang 
>> 抄送: dev 
>> 主题: Re: [VOTE] SPIP: Structured Logging Framework for Apache Spark
>>
>>
>>
>> +1
>>
>>
>>
>> On Mon, Mar 11, 2024 at 10:36 AM Gengliang Wang  wrote:
>>
>> Hi all,
>>
>> I'd like to start the vote for SPIP: Structured Logging Framework for Apache 
>> Spark
>>
>>
>> References:
>>
>> JIRA ticket
>> SPIP doc
>> Discussion thread
>>
>> Please vote on the SPIP for the next 72 hours:
>>
>> [ ] +1: Accept the proposal as an official SPIP
>> [ ] +0
>> [ ] -1: I don’t think this is a good idea because …
>>
>> Thanks!
>>
>> Gengliang Wang

-
To unsubscribe e-mail: dev-unsubscr...@spark.apache.org



Re: [VOTE] SPIP: Structured Logging Framework for Apache Spark

2024-03-11 Thread Mich Talebzadeh
+1

Mich Talebzadeh,
Dad | Technologist | Solutions Architect | Engineer
London
United Kingdom


   view my Linkedin profile
<https://www.linkedin.com/in/mich-talebzadeh-ph-d-5205b2/>


 https://en.everybodywiki.com/Mich_Talebzadeh



*Disclaimer:* The information provided is correct to the best of my
knowledge but of course cannot be guaranteed . It is essential to note
that, as with any advice, quote "one test result is worth one-thousand
expert opinions (Werner  <https://en.wikipedia.org/wiki/Wernher_von_Braun>Von
Braun <https://en.wikipedia.org/wiki/Wernher_von_Braun>)".


On Mon, 11 Mar 2024 at 09:27, Hyukjin Kwon  wrote:

> +1
>
> On Mon, 11 Mar 2024 at 18:11, yangjie01 
> wrote:
>
>> +1
>>
>>
>>
>> Jie Yang
>>
>>
>>
>> *发件人**: *Haejoon Lee 
>> *日期**: *2024年3月11日 星期一 17:09
>> *收件人**: *Gengliang Wang 
>> *抄送**: *dev 
>> *主题**: *Re: [VOTE] SPIP: Structured Logging Framework for Apache Spark
>>
>>
>>
>> +1
>>
>>
>>
>> On Mon, Mar 11, 2024 at 10:36 AM Gengliang Wang  wrote:
>>
>> Hi all,
>>
>> I'd like to start the vote for SPIP: Structured Logging Framework for
>> Apache Spark
>>
>>
>> References:
>>
>>- JIRA ticket
>>
>> <https://mailshield.baidu.com/check?q=godVZoGJGzagfL5fHFKDXe8FOsAuf3UaY0E7uyGx6HVUGGWsmD%2fgOW2x6J1A1XYt8pai0Y8FBhY%3d>
>>- SPIP doc
>>
>> <https://mailshield.baidu.com/check?q=qnzij19o7FucfHJ%2f4C2cBnMVM2kxjtEi9Gv4zA05b3oPw5UX986BZOwzaJ30UdGRMv%2fix31TYpjtazJC5uyypG0pZVBCfSjQGqlzkUoZozkFtgMXfpmRMSSp1%2bq83gkbLyrm1g%3d%3d>
>>- Discussion thread
>>
>> <https://mailshield.baidu.com/check?q=6PGfLtMnDpsSvIF5SlbpQ4%2bwdg53GCedx5r%2b7AOnYMjYwomNs%2fBioZOabP9Ml3b%2bE8jzqXF0xR3j607DdbjV0JOnlvU%3d>
>>
>> Please vote on the SPIP for the next 72 hours:
>>
>> [ ] +1: Accept the proposal as an official SPIP
>> [ ] +0
>> [ ] -1: I don’t think this is a good idea because …
>>
>> Thanks!
>>
>> Gengliang Wang
>>
>>


Re: [VOTE] SPIP: Structured Logging Framework for Apache Spark

2024-03-11 Thread Wenchen Fan
+1

On Mon, Mar 11, 2024 at 5:26 PM Hyukjin Kwon  wrote:

> +1
>
> On Mon, 11 Mar 2024 at 18:11, yangjie01 
> wrote:
>
>> +1
>>
>>
>>
>> Jie Yang
>>
>>
>>
>> *发件人**: *Haejoon Lee 
>> *日期**: *2024年3月11日 星期一 17:09
>> *收件人**: *Gengliang Wang 
>> *抄送**: *dev 
>> *主题**: *Re: [VOTE] SPIP: Structured Logging Framework for Apache Spark
>>
>>
>>
>> +1
>>
>>
>>
>> On Mon, Mar 11, 2024 at 10:36 AM Gengliang Wang  wrote:
>>
>> Hi all,
>>
>> I'd like to start the vote for SPIP: Structured Logging Framework for
>> Apache Spark
>>
>>
>> References:
>>
>>- JIRA ticket
>>
>> <https://mailshield.baidu.com/check?q=godVZoGJGzagfL5fHFKDXe8FOsAuf3UaY0E7uyGx6HVUGGWsmD%2fgOW2x6J1A1XYt8pai0Y8FBhY%3d>
>>- SPIP doc
>>
>> <https://mailshield.baidu.com/check?q=qnzij19o7FucfHJ%2f4C2cBnMVM2kxjtEi9Gv4zA05b3oPw5UX986BZOwzaJ30UdGRMv%2fix31TYpjtazJC5uyypG0pZVBCfSjQGqlzkUoZozkFtgMXfpmRMSSp1%2bq83gkbLyrm1g%3d%3d>
>>- Discussion thread
>>
>> <https://mailshield.baidu.com/check?q=6PGfLtMnDpsSvIF5SlbpQ4%2bwdg53GCedx5r%2b7AOnYMjYwomNs%2fBioZOabP9Ml3b%2bE8jzqXF0xR3j607DdbjV0JOnlvU%3d>
>>
>> Please vote on the SPIP for the next 72 hours:
>>
>> [ ] +1: Accept the proposal as an official SPIP
>> [ ] +0
>> [ ] -1: I don’t think this is a good idea because …
>>
>> Thanks!
>>
>> Gengliang Wang
>>
>>


Re: [VOTE] SPIP: Structured Logging Framework for Apache Spark

2024-03-11 Thread Hyukjin Kwon
+1

On Mon, 11 Mar 2024 at 18:11, yangjie01  wrote:

> +1
>
>
>
> Jie Yang
>
>
>
> *发件人**: *Haejoon Lee 
> *日期**: *2024年3月11日 星期一 17:09
> *收件人**: *Gengliang Wang 
> *抄送**: *dev 
> *主题**: *Re: [VOTE] SPIP: Structured Logging Framework for Apache Spark
>
>
>
> +1
>
>
>
> On Mon, Mar 11, 2024 at 10:36 AM Gengliang Wang  wrote:
>
> Hi all,
>
> I'd like to start the vote for SPIP: Structured Logging Framework for
> Apache Spark
>
>
> References:
>
>- JIRA ticket
>
> <https://mailshield.baidu.com/check?q=godVZoGJGzagfL5fHFKDXe8FOsAuf3UaY0E7uyGx6HVUGGWsmD%2fgOW2x6J1A1XYt8pai0Y8FBhY%3d>
>- SPIP doc
>
> <https://mailshield.baidu.com/check?q=qnzij19o7FucfHJ%2f4C2cBnMVM2kxjtEi9Gv4zA05b3oPw5UX986BZOwzaJ30UdGRMv%2fix31TYpjtazJC5uyypG0pZVBCfSjQGqlzkUoZozkFtgMXfpmRMSSp1%2bq83gkbLyrm1g%3d%3d>
>- Discussion thread
>
> <https://mailshield.baidu.com/check?q=6PGfLtMnDpsSvIF5SlbpQ4%2bwdg53GCedx5r%2b7AOnYMjYwomNs%2fBioZOabP9Ml3b%2bE8jzqXF0xR3j607DdbjV0JOnlvU%3d>
>
> Please vote on the SPIP for the next 72 hours:
>
> [ ] +1: Accept the proposal as an official SPIP
> [ ] +0
> [ ] -1: I don’t think this is a good idea because …
>
> Thanks!
>
> Gengliang Wang
>
>


Re: [VOTE] SPIP: Structured Logging Framework for Apache Spark

2024-03-11 Thread yangjie01
+1

Jie Yang

发件人: Haejoon Lee 
日期: 2024年3月11日 星期一 17:09
收件人: Gengliang Wang 
抄送: dev 
主题: Re: [VOTE] SPIP: Structured Logging Framework for Apache Spark

+1

On Mon, Mar 11, 2024 at 10:36 AM Gengliang Wang 
mailto:ltn...@gmail.com>> wrote:
Hi all,

I'd like to start the vote for SPIP: Structured Logging Framework for Apache 
Spark

References:

  *   JIRA 
ticket<https://mailshield.baidu.com/check?q=godVZoGJGzagfL5fHFKDXe8FOsAuf3UaY0E7uyGx6HVUGGWsmD%2fgOW2x6J1A1XYt8pai0Y8FBhY%3d>
  *   SPIP 
doc<https://mailshield.baidu.com/check?q=qnzij19o7FucfHJ%2f4C2cBnMVM2kxjtEi9Gv4zA05b3oPw5UX986BZOwzaJ30UdGRMv%2fix31TYpjtazJC5uyypG0pZVBCfSjQGqlzkUoZozkFtgMXfpmRMSSp1%2bq83gkbLyrm1g%3d%3d>
  *   Discussion 
thread<https://mailshield.baidu.com/check?q=6PGfLtMnDpsSvIF5SlbpQ4%2bwdg53GCedx5r%2b7AOnYMjYwomNs%2fBioZOabP9Ml3b%2bE8jzqXF0xR3j607DdbjV0JOnlvU%3d>
Please vote on the SPIP for the next 72 hours:

[ ] +1: Accept the proposal as an official SPIP
[ ] +0
[ ] -1: I don’t think this is a good idea because …

Thanks!
Gengliang Wang


Re: [VOTE] SPIP: Structured Logging Framework for Apache Spark

2024-03-11 Thread Haejoon Lee
+1

On Mon, Mar 11, 2024 at 10:36 AM Gengliang Wang  wrote:

> Hi all,
>
> I'd like to start the vote for SPIP: Structured Logging Framework for
> Apache Spark
>
> References:
>
>- JIRA ticket <https://issues.apache.org/jira/browse/SPARK-47240>
>- SPIP doc
>
> <https://docs.google.com/document/d/1rATVGmFLNVLmtxSpWrEceYm7d-ocgu8ofhryVs4g3XU/edit?usp=sharing>
>- Discussion thread
><https://lists.apache.org/thread/gocslhbfv1r84kbcq3xt04nx827ljpxq>
>
> Please vote on the SPIP for the next 72 hours:
>
> [ ] +1: Accept the proposal as an official SPIP
> [ ] +0
> [ ] -1: I don’t think this is a good idea because …
>
> Thanks!
> Gengliang Wang
>


[VOTE] SPIP: Structured Logging Framework for Apache Spark

2024-03-10 Thread Gengliang Wang
Hi all,

I'd like to start the vote for SPIP: Structured Logging Framework for
Apache Spark

References:

   - JIRA ticket <https://issues.apache.org/jira/browse/SPARK-47240>
   - SPIP doc
   
<https://docs.google.com/document/d/1rATVGmFLNVLmtxSpWrEceYm7d-ocgu8ofhryVs4g3XU/edit?usp=sharing>
   - Discussion thread
   <https://lists.apache.org/thread/gocslhbfv1r84kbcq3xt04nx827ljpxq>

Please vote on the SPIP for the next 72 hours:

[ ] +1: Accept the proposal as an official SPIP
[ ] +0
[ ] -1: I don’t think this is a good idea because …

Thanks!
Gengliang Wang