Re: [VOTE] Release Apache Uniffle (Incubating) V0.8.0 RC3
+1. BR, Zhankun On Sat, 9 Dec 2023 at 06:40, Felix Cheung wrote: > +1 > > - incubating in name > - signature and hash fine > - DISCLAIMER is fine > - LICENSE and NOTICE are fine > - No unexpected binary files > - All source files have ASF headers > > > On Thu, Dec 7, 2023 at 6:36 AM Xianjing Feng > wrote: > > > Hello Incubator Community, > > > > This is a call for a vote to release Apache Uniffle(Incubating) > version > > V0.8.0 RC3 > > > > The Apache Uniffle community has voted on and approved a proposal to > > release > > Apache Uniffle(Incubating) version V0.8.0 RC3 > > > > We now kindly request the Incubator PMC members review and vote on > this > > incubator release. > > > > Uniffle community vote thread: > > • https://lists.apache.org/thread/9psgtxkdynqrcsjcgotfzmx4jl33t0d2 > > > > Vote result thread: > > • https://lists.apache.org/thread/j8nhy5o4k5j3c1jd5vrmqg9zmxfz7y92 > > > > The release candidate: > > • > https://dist.apache.org/repos/dist/dev/incubator/uniffle/0.8.0-rc3/ > > > > Git tag for the release: > > • https://github.com/apache/incubator-uniffle/tree/v0.8.0-rc3 > > > > Release notes: > > • https://uniffle.apache.org/download/release-notes-0.8.0 > > > > The artifacts signed with PGP key [3E6F20AC33D1F201], > > corresponding to [xianjingf...@apache.org], that can be found in keys > > file: > > • https://dist.apache.org/repos/dist/dev/incubator/uniffle/KEYS > > > > As the DISCLAIMER-WIP shows, this release still left some license > > problems, which will be gradually resolved during incubation. > > > > The vote will be open for at least 72 hours or until necessary > > number of votes are reached. > > > > Please vote accordingly: > > > > [] +1 approve > > [] +0 no opinion > > [] -1 disapprove with the reason > > > > Thanks, > > On behalf of Apache Uniffle (Incubating) community > > > > - > > To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org > > For additional commands, e-mail: general-h...@incubator.apache.org > > > > >
Re: [VOTE] Release Apache Uniffle (Incubating) 0.7.1 rc2
+1 (Binding). Thanks. BR, Zhankun Liu Xun 于2023年7月5日 周三15:35写道： > +1 (binding) from me, > > I have checked the following items: > - Incubating in name > - LICENSE and NOTICE are fine > - DISCLAIMER-WIP exists > - All links are valid > - No unexpected binary files > - All ASF files have ASF headers > - Can compile from source > `mvn clean install` > > On 2023/06/28 02:03:01 Jiafu Zhang wrote: > > Hello Incubator Community, > > > > This is a call for a vote to release Apache Uniffle(Incubating) > > version 0.7.1 rc2 > > > > The Apache Uniffle community has voted on and approved a proposal to > release > > Apache Uniffle(Incubating) version 0.7.1 rc2 > > > > We now kindly request the Incubator PMC members review and vote on this > > incubator release. > > > > Uniffle community vote thread: > > • https://lists.apache.org/thread/rfp3cll7l5q6525xs5jths7d4f6t0kt0 > > > > Vote result thread: > > • https://lists.apache.org/thread/hnt45glbdkl75gtgb9czbcbc0r9d19s7 > > > > The release candidate: > > • https://dist.apache.org/repos/dist/dev/incubator/uniffle/0.7.1-rc2/ > > > > Git tag for the release: > > • https://github.com/apache/incubator-uniffle/tree/v0.7.1-rc2/ > > > > Release notes: > > • https://uniffle.apache.org/download/release-notes-0.7.1 > > > > The artifacts signed with PGP key A5F1ABF0, corresponding to > > jiafu...@apache.org, that can be found in keys file: > > • https://downloads.apache.org/incubator/uniffle/KEYS > > > > As the DISCLAIMER-WIP shows, this release still left some license > > problems, which will be gradually resolved during incubation. > > > > The vote will be open for at least 72 hours or until necessary number > > of votes are reached. > > > > Please vote accordingly: > > > > [] +1 approve > > [] +0 no opinion > > [] -1 disapprove with the reason > > > > Thanks, > > On behalf of Apache Uniffle (Incubating) community > > > > - > > To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org > > For additional commands, e-mail: general-h...@incubator.apache.org > > > > > > - > To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org > For additional commands, e-mail: general-h...@incubator.apache.org > >
Re: [VOTE] Release Apache Uniffle(Incubating) 0.7.0
+1 (binding). Thanks for the hard work. BR, Zhankun On Wed, 5 Apr 2023 at 09:33, Felix Cheung wrote: > +1 binding > > - incubating in name > - signature and hash fine > - DISCLAIMER is fine > - LICENSE and NOTICE are fine > - No unexpected binary files > - All source files have ASF headers > > > On Sun, Apr 2, 2023 at 9:24 PM Liu Xun wrote: > > > +1 (binding) from me, > > > > I have checked the following items: > > - Incubating in name > > - LICENSE and NOTICE are fine > > - DISCLAIMER-WIP exists > > - All links are valid > > - No unexpected binary files > > - All ASF files have ASF headers > > - Can compile from source > > `mvn clean install` > > > > Best regards > > Xun Liu > > > > On 2023/03/30 02:59:51 Junfan Zhang wrote: > > > Hello IPMC, This is an official vote for the Apache > > > Uniffle(Incubating) 0.7.0 that we have been working toward. > > > > > > To learn more about Apache Uniffle(Incubating), please see: > > > > > > https://uniffle.apache.org > > > > > > The Apache Uniffle (incubating) community has voted and approved the > > release. > > > > > > Vote thread: > > > > > > https://lists.apache.org/thread/f9yko759l24y30l7n098tgk56sdt1d33 > > > > > > Result thread: > > > > > > https://lists.apache.org/thread/yrnql56fnkl453jhvo0wsbvfn98y2zg8 > > > > > > Release changes: > > > Compared to 0.6.1, the most important features are as follows > > > 1. Better support for spark AQE > > > 2. Optimization of a huge partition to improve stability of shuffle > > servers > > > 3. More bug fixes and usability improvements of K8S operator > > > 4. Add support of user quota management and more compression algorithms > > > 5. Add support for the spark data eviction mechanism of stage level > > > 6. Some improvement of stability and performance > > > > > > And the detailed changelog could be found in > > > https://github.com/apache/incubator-uniffle/compare/v0.6.1..v0.7.0-rc4 > > > > > > > > > The release candidates: > > > > > > https://dist.apache.org/repos/dist/dev/incubator/uniffle/0.7.0-rc4/ > > > > > > Git tag for the release: > > > > > > https://github.com/apache/incubator-uniffle/tree/v0.7.0-rc4 > > > > > > Release Commit ID: > > > > > > 4ffee9eb1efa17e2faa66b72472dcd1613886cc1 > > > > > > Keys to verify the Release Candidate: > > > > > > https://dist.apache.org/repos/dist/dev/incubator/uniffle/KEYS > > > > > > GPG user ID: > > > > > > Junfan Zhang > > > > > > The vote will be open for at least 72 hours or until necessary numbers > > > of votes are reached. > > > > > > Please vote accordingly: > > > > > > [ ] +1 approve > > > [ ] +0 no opinion > > > [ ] -1 disapprove with the reason > > > > > > Checklist for reference: > > > > > > * Download links, checksums and PGP signatures are valid. > > > * Source code distributions have correct names matching the current > > release. > > > * Release files have the word incubating in their name. > > > * DISCLAIMER, LICENSE and NOTICE files are correct. > > > * All files have license headers if necessary. > > > * No unlicensed compiled archives bundled in source archive. > > > * The source tarball matches the git tag. > > > > > > More detail checklist please refer: > > > > > > https://cwiki.apache.org/confluence/display/INCUBATOR/Incubator+Release+Checklist > > > > > > The following votes are carried over from the Uniffle dev mailing list: > > > > > > +1(binding) > > > roryqi, > > > Meng Duan, > > > Xianjin Ye > > > > > > Best Regards, > > > Junfan Zhang > > > > > > - > > > To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org > > > For additional commands, e-mail: general-h...@incubator.apache.org > > > > > > > > > > - > > To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org > > For additional commands, e-mail: general-h...@incubator.apache.org > > > > >
Re: [VOTE] Accept Uniffle into the Apache Incubator
+1 (binding) BR, Zhankun li gang 于2022年5月31日 周二下午10:54写道： > +1 (non-binding) > Good luck! > > Jerry Shao 于2022年5月31日周二 09:37写道： > > > Hi all, > > > > Following up the [DISCUSS] thread on Uniffle[1] and Firestorm[2], I would > > like to > > call a VOTE to accept Uniffle into the Apache Incubator, please check out > > the Uniffle Proposal from the incubator wiki[3]. > > > > Please cast your vote: > > > > [ ] +1, bring Uniffle into the Incubator > > [ ] +0, I don't care either way > > [ ] -1, do not bring Uniffle into the Incubator, because... > > > > The vote will open at least for 72 hours, and only votes from the > > Incubator PMC are binding, but votes from everyone are welcome. > > > > [1] https://lists.apache.org/thread/fyyhkjvhzl4hpzr52hd64csh5lt2wm6h > > [2] https://lists.apache.org/thread/y07xjkqzvpchncym9zr1hgm3c4l4ql0f > > [3] > https://cwiki.apache.org/confluence/display/INCUBATOR/UniffleProposal > > > > Best regards, > > Jerry > > > > > -- > > > -- > Best Regards > > DolphinScheduler PMC > Gang Li 李岗 > > lgcar...@apache.org >
Re: [DISCUSSION] Incubating Proposal of Uniffle
+1 (Non-binding). Looking forward to see it grows a bigger community and possibly cover more scenarios like public cloud. :D BR, Zhankun Willem Jiang 于2022年5月25日 周三下午8:59写道： > +1 （binding）. > > Willem Jiang > > Twitter: willemjiang > Weibo: 姜宁willem > > On Wed, May 25, 2022 at 12:05 AM Jerry Shao wrote: > > > > Hi all, > > > > Due to the name issue in thread ( > > https://lists.apache.org/thread/y07xjkqzvpchncym9zr1hgm3c4l4ql0f), we > > figured out a new project name "Uniffle" and created a new Thread. Please > > help to discuss. > > > > We would like to propose Uniffle[1] as a new Apache incubator project, > you > > can find the proposal here [2] for more details. > > > > Uniffle is a high performance, general purpose Remote Shuffle Service for > > distributed compute engines like Apache Spark > > <https://spark.apache.org/>, Apache > > Hadoop MapReduce <https://hadoop.apache.org/>, Apache Flink > > <https://flink.apache.org/> and so on. We are aiming to make Firestorm a > > universal shuffle service for distributed compute engines. > > > > Shuffle is the key part for a distributed compute engine to exchange the > > data between distributed tasks, the performance and stability of shuffle > > will directly affect the whole job. Current “local file pull-like shuffle > > style” has several limitations: > > > >1. Current shuffle is hard to support super large workloads, > especially > >in a high load environment, the major problem is IO problem (random > disk IO > >issue, network congestion and timeout). > >2. Current shuffle is hard to deploy on the disaggregated compute > >storage environment, as disk capacity is quite limited on compute > nodes. > >3. The constraint of storing shuffle data locally makes it hard to > scale > >elastically. > > > > Remote Shuffle Service is the key technology for enterprises to build big > > data platforms, to expand big data applications to disaggregated, > > online-offline hybrid environments, and to solve above problems. > > > > The implementation of Remote Shuffle Service - “Uniffle” - is heavily > > adopted in Tencent, and shows its advantages in production. Other > > enterprises also adopted or prepared to adopt Firestorm in their > > environments. > > > > Uniffle's key idea is brought from Salfish shuffle > > < > https://www.researchgate.net/publication/262241541_Sailfish_a_framework_for_large_scale_data_processing > >, > > it has several key design goals: > > > >1. High performance. Firestorm’s performance is close enough to local > >file based shuffle style for small workloads. For large workloads, it > is > >far better than the current shuffle style. > >2. Fault tolerance. Firestorm provides high availability for > Coordinated > >nodes, and failover for Shuffle nodes. > >3. Pluggable. Firestorm is highly pluggable, which could be suited to > >different compute engines, different backend storages, and different > >wire-protocols. > > > > We believe that Uniffle project will provide the great value for the > > community if it is accepted by the Apache incubator. > > > > I will help this project as champion and many thanks to the 3 mentors: > > > >- > > > >Felix Cheung (felixche...@apache.org) > >- Junping du (junping...@apache.org) > >- Weiwei Yang (w...@apache.org) > >- Xun liu (liu...@apache.org) > >- Zhankun Tang (zt...@apache.org) > > > > > > [1] https://github.com/Tencent/Firestorm > > [2] > https://cwiki.apache.org/confluence/display/INCUBATOR/UniffleProposal > > > > Best regards, > > Jerry > > - > To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org > For additional commands, e-mail: general-h...@incubator.apache.org > >
