Hi Dongjoon, thank you for this summary! It was great to read.
Regards, Zoltan Ratkai On Sat, Nov 2, 2024 at 3:02 PM Dongjoon Hyun <dongjoon.h...@gmail.com> wrote: > This is an email on private@orc mailing list yesterday. > I'm sharing this again for the broader audience. > > https://lists.apache.org/thread/trdwkspbwn6kbh29mn9skormo0yyl5bn > > ============================== > > Hi, All. > > There is no reason that a 3rd-party module contribution is > different from a 3rd-party pull request. > > As a member of Apache ORC PMC, I want to help this contribution > properly and responsibly in a systematic way. > > Here, let me illustrate a recent example of Apache Spark K8s Operator > which happened in the Apache Spark community. > > 1. 2023-11-09 Discussion starts with asking a new repository > https://lists.apache.org/thread/wdy7jfhf7m8jy74p6s0npjfd15ym5rxz > [DISCUSSION] SPIP: An Official Kubernetes Operator for Apache Spark > > 2. 2023-11-13 One of Apache Spark PMC volunteered as a shepherd > https://lists.apache.org/thread/1xl64k2bjtqj153168zd4trwlst7xkml > > 3. 2023-11-14 Umbrella JIRA issue was created for tracking > SPARK-45923 Spark Kubernetes Operator > > 4. 2023-11-14 A module vote started > https://lists.apache.org/thread/kvcf74n603nspg4j7whhst06zdmk66th > [VOTE] SPIP: An Official Kubernetes Operator for Apache Spark > > 5. 2023-11-17 Vote passed with 19 +1s (11 binding +1s) > https://lists.apache.org/thread/92v6mgyk9kvzcfygf52rdkht6tj2c17p > [VOTE][RESULT] SPIP: An Official Kubernetes Operator for Apache Spark > > 6. 2024-03-29 Repository is created. > https://github.com/apache/spark-kubernetes-operator > > 7. 2024-04-02 The working PR was provided and reviewed. > https://github.com/apache/spark-kubernetes-operator/pull/2 > > 8. Apache Spark PMC decided to use it as a reference to review responsibly. > > https://github.com/apache/spark-kubernetes-operator/pull/2#issuecomment-2033278195 > > > A 19k diff patch is unfortunately not going to be easy to review, > > or result in good quality reviews. Can you please split this up > > into more manageable chunks to aid with it ? > > We can keep this PR as reference to help drive the actual PR reviews > > 9. Apache Spark PMC helped the voluntary contributors' activities > and shared the progress. > - 2024-04-22 [1] > - 2024-04-26 [2] > - 2024-05-03 [3] > - 2024-05-20 [4] > - 2024-07-28 [5] > - 2024-08-06 [6] > > 10. 2024-08-28 SPARK-45923 was resolved. > > 11. 2024-08-08 Updated Apache Spark website > https://github.com/apache/spark-website/pull/542 > Add a curated list for repositories governed by Apache Spark PMC > > 12. This was a huge activity for about 1 year for the community. > As a result, the community organized the related domains into three > seamlessly > as parts of Apache Spark > - SPARK-45923 Spark K8s Operator (New Repository: 132 tasks) > - SPARK-45869 Revisit Spark Standalone Cluster (Supporting SPIP: 110 tasks) > - SPARK-49524 Improve K8s support (Existing spark repository area: 70 > tasks) > > > During the journey, Apache Spark community achieved to > - Extend the original proposed scope from SparkApp to SparkApp+SparkCluster > - Integrate seamlessly in all area including website/docs > - Build a community in organic way > > Sincerely, > Dongjoon > > [1] > > https://github.com/apache/spark-kubernetes-operator/pull/2#issuecomment-2071471093 > [2] > > https://github.com/apache/spark-kubernetes-operator/pull/2#issuecomment-2080135136 > [3] > > https://github.com/apache/spark-kubernetes-operator/pull/2#issuecomment-2093722066 > [4] > > https://github.com/apache/spark-kubernetes-operator/pull/2#issuecomment-2120918277 > [5] > > https://github.com/apache/spark-kubernetes-operator/pull/2#issuecomment-2254902900 > [6] > > https://github.com/apache/spark-kubernetes-operator/pull/2#issuecomment-2272129504 >
