Re: [DISCUSS] Show Python code examples first in Spark documentation

[416161...@qq.com]

+1 LGTM




Ruifeng Zheng
ruife...@foxmail.com



 




-- Original --
From:   
 "Xinrong Meng" 
   
https://spark.apache.org/docs/latest/quick-start.html


I propose this change because Python has become more popular than the other 
languages supported in Apache Spark. There are a lot more users of Spark 
in Python than Scala today and Python attracts a broader set of new users.
For Python usage data, 
see https://www.tiobe.com/tiobe-index/ and https://insights.stackoverflow.com/trends?tags=r%2Cscala%2Cpython%2Cjava.


Also, this change aligns with Python already being the first tab on our home 
page:
https://spark.apache.org/



Anyone who wants to use another language can still just click on the other tabs.


I created a draft PR for the Spark SQL, DataFrames and Datasets Guide page as a 
first step:

https://github.com/apache/spark/pull/40087




I would appreciate it if you could share your thoughts on this proposal.




Thanks a lot,
Allan Folting

Re: Time for Spark 3.4.0 release?

[416161...@qq.com]

+1, thank you Xinrong for driving this release!




Ruifeng Zheng
ruife...@foxmail.com



 




-- Original --
From:   
 "Hyukjin Kwon" 
   
https://spark.apache.org/versioning-policy.html, but I would suggest we 
postpone one day since January 15th is a Sunday.


I would like to volunteer as the release manager for Apache Spark 3.4.0.


Thanks,


Xinrong Meng

Re: [VOTE][SPIP] Better Spark UI scalability and Driver stability for large applications

[416161...@qq.com]

+1 




Ruifeng Zheng
ruife...@foxmail.com



 




-- Original --
From:   
 "Wenchen Fan"  
  
mailto:yangji...@baidu.com>>; wrote:
 > 
 >     +1, non-binding
 > 
 >     __ __
 > 
 >     Yang Jie
 > 
 >     __ __
 > 
 >     *??**: *Mridul Muralidharan mailto:mri...@gmail.com>>;
 >     ***: *2022??11??1617:35
 >     *??**: *Kent Yao mailto:y...@apache.org>>;
 >     ***: *Gengliang Wang mailto:ltn...@gmail.com>>;, dev 
mailto:dev@spark.apache.org>>;
 >     ***: *Re: [VOTE][SPIP] Better Spark UI scalability 
and Driver
 >     stability for large applications
 > 
 >     __ __
 > 
 >     __ __
 > 
 >     +1
 > 
 >     __ __
 > 
 >     Would be great to see history server performance 
improvements and
 >     lower resource utilization at driver !
 > 
 >     __ __
 > 
 >     Regards,
 > 
 >     Mridul 
 > 
 >     __ __
 > 
 >     On Wed, Nov 16, 2022 at 2:38 AM Kent Yao 
mailto:y...@apache.org>>; wrote:
 > 
 >         +1, non-binding
 > 
 >         Gengliang Wang mailto:ltn...@gmail.com>>; ??
 >         2022??11??16??16:36??
 >         >
 >         > Hi all,
 >         >
 >         > I??d like to start a vote for SPIP: 
"Better Spark UI scalability and Driver stability for large applications"
 >         >
 >         > The goal of the SPIP is to improve 
the Driver's stability by supporting storing Spark's UI data on RocksDB. 
Furthermore, to fasten the read and write operations on RocksDB, it introduces 
a new Protobuf serializer.
 >         >
 >         > Please also refer to the following:
 >         >
 >         > Previous discussion in the dev 
mailing list: [DISCUSS] SPIP: Better Spark UI scalability and Driver stability 
for large applications
 >         > Design Doc: Better Spark UI 
scalability and Driver stability for large applications
 >         > JIRA: SPARK-41053
 >         >
 >         >
 >         > Please vote on the SPIP for the 
next 72 hours:
 >         >
 >         > [ ] +1: Accept the proposal as an 
official SPIP
 >         > [ ] +0
 >         > [ ] -1: I don??t think this is a 
good idea because ??
 >         >
 >         > Kind Regards,
 >         > Gengliang
 > 
 >        
 -
 >         To unsubscribe e-mail: 
dev-unsubscr...@spark.apache.org
 >        
 
 > 
 
 -- 
 Best regards,
 Maciej Szymkiewicz
 
 Web: https://zero323.net
 PGP: A30CEF0C31A501EC
 
 
 
 



-- 

Zhou, Ye  

Re: [VOTE] Release Spark 3.2.3 (RC1)

[416161...@qq.com]

+1 




Ruifeng Zheng
ruife...@foxmail.com



 




-- Original --
From:   
 "Wenchen Fan"  
  
http://spark.apache.org/
 >>
 >> The tag to be voted on is v3.2.3-rc1 (commit
 >> b53c341e0fefbb33d115ab630369a18765b7763d):
 >>  https://github.com/apache/spark/tree/v3.2.3-rc1
 >>
 >> The release files, including signatures, digests, etc. can be found 
at:
 >>  https://dist.apache.org/repos/dist/dev/spark/v3.2.3-rc1-bin/
 >>
 >> Signatures used for Spark RCs can be found in this file:
 >>  https://dist.apache.org/repos/dist/dev/spark/KEYS
 >>
 >> The staging repository for this release can be found at:
 >>  
https://repository.apache.org/content/repositories/orgapachespark-1431/
 >>
 >> The documentation corresponding to this release can be found at:
 >>  https://dist.apache.org/repos/dist/dev/spark/v3.2.3-rc1-docs/
 >>
 >> The list of bug fixes going into 3.2.3 can be found at the following 
URL:
 >>  https://issues.apache.org/jira/projects/SPARK/versions/12352105
 >>
 >> This release is using the release script of the tag v3.2.3-rc1.
 >>
 >>
 >> FAQ
 >>
 >> =
 >> How can I help test this release?
 >> =
 >> If you are a Spark user, you can help us test this release by taking
 >> an existing Spark workload and running on this release candidate, then
 >> reporting any regressions.
 >>
 >> If you're working in PySpark you can set up a virtual env and install
 >> the current RC and see if anything important breaks, in the Java/Scala
 >> you can add the staging repository to your projects resolvers and test
 >> with the RC (make sure to clean up the artifact cache before/after so
 >> you don't end up building with a out of date RC going forward).
 >>
 >> ===
 >> What should happen to JIRA tickets still targeting 3.2.3?
 >> ===
 >> The current list of open tickets targeted at 3.2.3 can be found at:
 >>  https://issues.apache.org/jira/projects/SPARK and search for "Target
 >> Version/s" = 3.2.3
 >>
 >> Committers should look at those and triage. Extremely important bug
 >> fixes, documentation, and API tweaks that impact compatibility should
 >> be worked on immediately. Everything else please retarget to an
 >> appropriate release.
 >>
 >> ==
 >> But my bug isn't fixed?
 >> ==
 >> In order to make timely releases, we will typically not hold the
 >> release unless the bug in question is a regression from the previous
 >> release. That being said, if there is something which is a regression
 >> that has not been correctly targeted please ping me or a committer to
 >> help target the issue.
 >>
 >> -
 >> To unsubscribe e-mail:  dev-unsubscr...@spark.apache.org
 >>
 
 -
 To unsubscribe e-mail:  dev-unsubscr...@spark.apache.org

Re: Apache Spark 3.2.3 Release?

[416161...@qq.com]

+1




Ruifeng Zheng
ruife...@foxmail.com



 




-- Original --
From:   
 "Yuming Wang"  
  

Re: Welcome Yikun Jiang as a Spark committer

[416161...@qq.com]

Congrats, Yikun!





Ruifeng Zheng
ruife...@foxmail.com



 




-- Original --
From:   
 "Martin Grigorov"  
  

Re: [VOTE] SPIP: Support Docker Official Image for Spark

[416161...@qq.com]

+1




Ruifeng Zheng
ruife...@foxmail.com



 




-- Original --
From:   
 "Hyukjin Kwon" 
   

Re: [DISCUSS] SPIP: Support Docker Official Image for Spark

[416161...@qq.com]

+1




Ruifeng Zheng
ruife...@foxmail.com



 




-- Original --
From:   
 "Chao Sun" 
   
https://docs.google.com/document/d/1nN-pKuvt-amUcrkTvYAQ-bJBgtsWb9nAkNoVNRM2S2o
>> >>>
>> >>>
>> >>> cc: Ruifeng (co-author) and Hyukjin 
(shepherd)
>> >>>
>> >>>
>> >>> Regards,
>> >>> Yikun
>>
>> 
-
>> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>>

-
To unsubscribe e-mail: dev-unsubscr...@spark.apache.org