[DISCUSS] Deprecate legacy file naming functions in FileCommitProtocol

Hello all, FileCommitProtocol is the class to commit Spark job output (staging file & directory renaming, etc). During Spark 3.2 development,

Re: [VOTE] Release Spark 3.2.1 (RC2)

+1 On Tue, Jan 25, 2022 at 10:13 AM Ruifeng Zheng wrote: > +1 (non-binding) > > > -- 原始邮件 -- > *发件人:* "Kent Yao" ; > *发送时间:* 2022年1月25日(星期二) 上午10:09 > *收件人:* "John Zhuge"; > *抄送:* "dev"; > *主题:* Re: [VOTE] Release Spark 3.2.1 (RC2) > > +1， non-binding > > John

回复： [VOTE] Release Spark 3.2.1 (RC2)

+1 (non-binding) --原始邮件-- 发件人: "Kent Yao"

Re: [VOTE] Release Spark 3.2.1 (RC2)

+1， non-binding John Zhuge 于2022年1月25日周二 06:56写道： > +1 (non-binding) > > On Mon, Jan 24, 2022 at 2:28 PM Cheng Su wrote: > >> +1 (non-binding) >> >> >> >> Cheng Su >> >> >> >> *From: *Chao Sun >> *Date: *Monday, January 24, 2022 at 2:10 PM >> *To: *Michael Heuer >> *Cc: *dev >> *Subject:

Re: [How To] run test suites for specific module

Hi Shen You can use sbt to run a specific suite. 1. run sbt shell. $ bash build/sbt 2. specify project. sbt > project core You can get project name from properties `sbt.project.name` from pom.xml 3. Finally, you can run a specific suite sbt > testOnly

Re: [How To] run test suites for specific module

Hi, Please check the relevant section of the developer tools docs: https://spark.apache.org/developer-tools.html#running-individual-tests On 1/25/22 00:44, Fangjia Shen wrote: > Hello all, > > How do you run Spark's test suites when you want to test the correctness > of your code? Is there a

[How To] run test suites for specific module

Hello all, How do you run Spark's test suites when you want to test the correctness of your code? Is there a way to run a specific test suite for Spark? For example, running test suite XXXSuite alone, instead of every class under the test/ directories. Here's some background info about what

Re: [VOTE] Release Spark 3.2.1 (RC2)

+1 (non-binding) On Mon, Jan 24, 2022 at 2:28 PM Cheng Su wrote: > +1 (non-binding) > > > > Cheng Su > > > > *From: *Chao Sun > *Date: *Monday, January 24, 2022 at 2:10 PM > *To: *Michael Heuer > *Cc: *dev > *Subject: *Re: [VOTE] Release Spark 3.2.1 (RC2) > > +1 (non-binding) > > > > On Mon,

Re: [VOTE] Release Spark 3.2.1 (RC2)

+1 (non-binding) Cheng Su From: Chao Sun Date: Monday, January 24, 2022 at 2:10 PM To: Michael Heuer Cc: dev Subject: Re: [VOTE] Release Spark 3.2.1 (RC2) +1 (non-binding) On Mon, Jan 24, 2022 at 6:32 AM Michael Heuer mailto:heue...@gmail.com>> wrote: +1 (non-binding) michael On Jan

Re: [VOTE] Release Spark 3.2.1 (RC2)

+1 (non-binding) On Mon, Jan 24, 2022 at 6:32 AM Michael Heuer wrote: > +1 (non-binding) > >michael > > > On Jan 24, 2022, at 7:30 AM, Gengliang Wang wrote: > > +1 (non-binding) > > On Mon, Jan 24, 2022 at 6:26 PM Dongjoon Hyun > wrote: > >> +1 >> >> Dongjoon. >> >> On Sat, Jan 22, 2022

Re: [VOTE] Release Spark 3.2.1 (RC2)

+1 (non-binding) michael > On Jan 24, 2022, at 7:30 AM, Gengliang Wang wrote: > > +1 (non-binding) > > On Mon, Jan 24, 2022 at 6:26 PM Dongjoon Hyun > wrote: > +1 > > Dongjoon. > > On Sat, Jan 22, 2022 at 7:19 AM Mridul Muralidharan

Re: [VOTE] Release Spark 3.2.1 (RC2)

+1 (non-binding) On Mon, Jan 24, 2022 at 6:26 PM Dongjoon Hyun wrote: > +1 > > Dongjoon. > > On Sat, Jan 22, 2022 at 7:19 AM Mridul Muralidharan > wrote: > >> >> +1 >> >> Signatures, digests, etc check out fine. >> Checked out tag and build/tested with -Pyarn -Pmesos -Pkubernetes >> >>

Re: [VOTE] Release Spark 3.2.1 (RC2)

+1 Dongjoon. On Sat, Jan 22, 2022 at 7:19 AM Mridul Muralidharan wrote: > > +1 > > Signatures, digests, etc check out fine. > Checked out tag and build/tested with -Pyarn -Pmesos -Pkubernetes > > Regards, > Mridul > > On Fri, Jan 21, 2022 at 9:01 PM Sean Owen wrote: > >> +1 with same result