Spark on Kubernetes focused workshops

Team, is there a meetup or workshop focused on Spark on Kubernetes? If not, any interest in creating a once a month sync to exchange notes and best practices? Thanks, Janak

Re: Introducing "Pandas API on Spark" component in JIRA, and use "PS" PR title component

+1. Thanks Hyukjin. On Thu, May 19, 2022 at 10:14 AM Bryan Cutler wrote: > > +1, sounds good > > On Wed, May 18, 2022 at 9:16 PM Dongjoon Hyun wrote: >> >> +1 >> >> Thank you for the suggestion, Hyukjin. >> >> Dongjoon. >> >> On Wed, May 18, 2022 at 11:08 AM Bjørn Jørgensen >> wrote: >>> >>>

Re: Introducing "Pandas API on Spark" component in JIRA, and use "PS" PR title component

+1, sounds good On Wed, May 18, 2022 at 9:16 PM Dongjoon Hyun wrote: > +1 > > Thank you for the suggestion, Hyukjin. > > Dongjoon. > > On Wed, May 18, 2022 at 11:08 AM Bjørn Jørgensen > wrote: > >> +1 >> But can will have PR Title and PR label the same, PS >> >> ons. 18. mai 2022 kl. 18:57

Re:Re: Unable to create view due to up cast error when migrating from Hive to Spark

Thank you for the reply ! At 2022-05-18 20:27:27, "Wenchen Fan" wrote: A view is essentially a SQL query. It's fragile to share views between Spark and Hive because different systems have different SQL dialects. They may interpret the view SQL query differently and introduce unexpected

Re: [VOTE] Release Spark 3.3.0 (RC2)

Hi, When testing out Spark 3.3.0 on our production spark workload it was noticed that https://issues.apache.org/jira/browse/SPARK-38681 is actually a regression from 3.2 (I did not know this a the time of creating the ticket) seem like the bug was introduced in

Re: [VOTE] Release Spark 3.3.0 (RC2)

Thanks for the quick fix, Gengliang. BR, Kent Gengliang Wang 于2022年5月19日周四 18:25写道： > > Hi Kent and Wenchen, > > Thanks for reporting. I just created > https://github.com/apache/spark/pull/36609 to fix the issue. > > Gengliang > > On Thu, May 19, 2022 at 5:40 PM Wenchen Fan wrote: >> >> I

Re: [VOTE] Release Spark 3.3.0 (RC2)

Hi Kent and Wenchen, Thanks for reporting. I just created https://github.com/apache/spark/pull/36609 to fix the issue. Gengliang On Thu, May 19, 2022 at 5:40 PM Wenchen Fan wrote: > I think it should have been fixed by >

Final reminder: ApacheCon North America call for presentations closing soon

[Note: You're receiving this because you are subscribed to one or more Apache Software Foundation project mailing lists.] This is your final reminder that the Call for Presetations for ApacheCon North America 2022 will close at 00:01 GMT on Monday, May 23rd, 2022. Please don't wait! Get your talk

Re: [VOTE] Release Spark 3.3.0 (RC2)

I think it should have been fixed by https://github.com/apache/spark/commit/0fdb6757946e2a0991256a3b73c0c09d6e764eed . Maybe the fix is not completed... On Thu, May 19, 2022 at 2:16 PM Kent Yao wrote: > Thanks, Maxim. > > Leave my -1 for this release candidate. > > Unfortunately, I don't know

Re: [VOTE] Release Spark 3.3.0 (RC2)

Thanks, Maxim. Leave my -1 for this release candidate. Unfortunately, I don't know which PR fixed this. Does anyone happen to know? BR, Kent Yao Maxim Gekk 于2022年5月19日周四 13:42写道： > > Hi Kent, > > > Shall we backport the fix from the master to 3.3 too? > > Yes, we shall. > > Maxim Gekk > >