Re: [VOTE] Release Apache Uniffle (Incubating) 0.9.0 RC2

2024-06-23 Thread roryqi
+1 binding I checked UT passed in my local machine, I used the command ``` ./mvnw package ``` License is correct Notice is correct DISCLAIMER-WIP exists. Signature is correct and Hash value is correct. Enrico Minack 于2024年6月19日周三 17:05写道: > Hello Uniffle Community, > > the Staging Repository

June Podding Report

2024-05-26 Thread roryqi
Hi Uniffle community, I have finished the podding report. Util this report, Uniffe community has 70 contributors 1022 pull requests, 834 are merged. 682 issues, 491 closed Rory

Release 0.9 version

2024-04-09 Thread roryqi
Hi, community We have released 0.8 for a long time. So I want to prepare for release 0.9 version. Rory

March Podding Report

2024-03-03 Thread roryqi
Hi Uniffle Community. I have finished the podding report. Util this report, Uniffle community has 69 contributors 25 discussion Pull requests total 910 765 merged Issue total 607 430 Rory

Uniffle Regular Meeting Notes 2024-02-29

2024-02-28 Thread roryqi
2024.2.28 1. Spark BlockId Layout refactor Fix the issues of split write side Fix the Netty issues 1. MR/TEZ Refactor the blockId https://docs.google.com/document/d/1Ni87Wt4hKqyW73xDrwMYgoTAx8JIYuNKoXofbUPTI8Q/edit

[VOTE] Nominate Qing Liu as Uniffle committer

2024-01-26 Thread roryqi
Hi all, I'm going to nominate Qing Liu as an Apache Uniffle Committer. He has a long period of contributions for Uniffle, He adds the support of Apache Tez. You can check his contribution history ( https://github.com/apache/incubator-uniffle/commits?author=lifeSo) and the co-designed doc (

Uniffle Regular Meeting Notes 2024-01-24

2024-01-23 Thread roryqi
2023.1.24 1. Spark Finish dynamic split write side Dashboard support multiple coordinators 1. MR/TEZ Discussion with ID issues The document of remote merge has been updated. https://docs.google.com/document/d/1Ni87Wt4hKqyW73xDrwMYgoTAx8JIYuNKoXofbUPTI8Q/edit

Uniffle Regular Meeting Notes 2023-12-27

2023-12-26 Thread roryqi
2023.12.27 1. Version Management 2. Spark Dashboard finished. Dynamic allocation needs refactor Integrate with Gluten Dynamic split 1. MR & TEZ Sort in the server 1. Flink Flink uses multiple readers may cause too much random IO. Flink readers will

December Podding Report

2023-12-13 Thread roryqi
Hi Uniffle Community. I have finished the podding report. Util this report, Uniffle Community has Contributors 64, Discussion 23, Pull Requests total 797, merged 673. Issues total 539, closed 369

Re: [VOTE] Release Apache Uniffle (Incubating) V0.8.0 RC3

2023-12-06 Thread roryqi
+1 binding I checked. Download links, checksums and PGP signatures are valid. Source code distributions have correct names matching the current release. Release files have the word incubating in their name. DISCLAIMER-WIP, LICENSE and NOTICE files are correct. Tests passed. I run `mvn package`

Re: [VOTE] Release Apache Uniffle (Incubating) V0.8.0 RC2

2023-11-12 Thread roryqi
I run the command `mvn package`. There are always failure uts. Could we disable some the flaky tests? *ShuffleTaskManagerTest.checkAndClearLeakShuffleDataTest:940 expected: but was: * *GrpcServerTest.testGrpcExecutorPool:83 expected: <1.0> but was: <0.0>* Xianjing Feng 于2023年11月2日周四 09:51写道:

Re: [ANNOUNCE] New committer: Chenyu Zheng

2023-11-04 Thread roryqi
Congrats! Kaijie Chen 于2023年11月4日周六 21:47写道: > Congrats, Chenyu.Best,Kaijie On Sat,04 Nov 2023 20:25:17 +0800 > yangji...@apache.org wrote The Project Management Committee (PMC) > *for* Apache Uniffle (incubating) > has asked Chenyu Zheng to become a committer and we are pleased to

Uniffle Regular Meeting Notes 2023-10-18

2023-10-17 Thread roryqi
2023.10.18 1. 0.8.0 version release rc2 is preparing 1. Spark on Uniffle Dynamic assignment needs a fix Netty implement is on going Partition split will be planned after dynamic assignment.. 1. TEZ/MR on Uniffle Find some issues in

Re: [VOTE] Release Apache Uniffle (Incubating) V0.8.0 RC1

2023-10-10 Thread roryqi
should be renamed to LICENCE) NOTICE-binary(should be renamed to NOTICE) license-binary (should be renamed to license) Xianjing Feng 于2023年10月9日周一 15:52写道: > Fixed. Thanks for pointing it out @roryqi > > On 2023/10/09 06:26:37 roryqi wrote: > > [image: 企业微信截图_f3c866fd-a668-4915-ac76-bf18a5

Re: [VOTE] Release Apache Uniffle (Incubating) V0.8.0 RC1

2023-10-09 Thread roryqi
[image: 企业微信截图_f3c866fd-a668-4915-ac76-bf18a5d095cf.png] https://dist.apache.org/repos/dist/dev/incubator/uniffle/KEYS There are messy code. Xianjing Feng 于2023年10月9日周一 13:56写道: > Hello Uniffle Community, > > This is a call for vote to release Apache Uniffle (Incubating) version > 0.8.0-rc1. >

Re: [DISCUSS] Allow external contributors to run CI without approval

2023-09-10 Thread roryqi
Thanks for your support, I'll come up with a JIRA ticket to change this setting to "only requires approval first time". zhang junfan 于2023年9月8日周五 20:08写道: > +1. thanks jerqi. > > Best > Junfan Zhang > ________ > 发件人: roryqi > 发送时间: Saturda

Re: [DISCUSS] Allow external contributors to run CI without approval

2023-09-03 Thread roryqi
n first commit too? > > On 2023/09/02 07:56:54 roryqi wrote: > > Recent moves by Apache Infra have changed the policy on GitHub Actions > from > > "Only requires approval first time" to "Requires approval every time". I > > think this is not f

[DISCUSS] Allow external contributors to run CI without approval

2023-09-02 Thread roryqi
Recent moves by Apache Infra have changed the policy on GitHub Actions from "Only requires approval first time" to "Requires approval every time". I think this is not friendly for getting folks involved in the project and this increased the cost for committers to process the pull requests. Please

September Podding Report

2023-09-02 Thread roryqi
Hi Uniffle Community. I have finished the podding report. Util this report, Uniffle Community have Contributors 58, Discussion 23, Pull Requests total 691, merged 582 Issues total 464, closed 308 Rory

Re: [ANNOUNCE] New committer: Xianming Lei

2023-08-24 Thread roryqi
Gongrats! Junfan Zhang 于2023年8月24日周四 16:35写道: > The Project Management Committee (PMC) *for* Apache Uniffle (incubating) > has asked Xianming Lei to become a committer and we are pleased to > announce that he has accepted. > > Xianming has a long period of contributions for Uniffle, he improves

Uniffle Regular Meeting Notes 2023-08-09

2023-08-09 Thread roryqi
Uniffle Regular Meeting Notes 2023-08-09 is as follows: https://docs.google.com/document/d/1Ni87Wt4hKqyW73xDrwMYgoTAx8JIYuNKoXofbUPTI8Q/edit?usp=sharing

Re: [Remind] GitHub issues are forwarded to issues mail list now

2023-07-31 Thread roryqi
Thanks, Kaijie. Great work! Kaijie Chen 于2023年7月31日周一 15:19写道: > Hi Uniffle community, > > I’m sending this email to remind you a recent change to the mail list. > > Starting from today, GitHub issues are no longer forwarded to > dev@uniffle.apache.org. > They will be forwarded to

Re: [DISCUSS] Release 0.8.0

2023-07-24 Thread roryqi
Thanks, Xianjing. Xianjing Feng 于2023年7月24日周一 15:50写道: > Hi roryqi. I want to be the release manager of this version. > > On 2023/07/23 05:40:30 roryqi wrote: > > Hi team, > > > > Shall we release a new version 0.8.0? There are many important > > improvemen

[DISCUSS] Release 0.8.0

2023-07-22 Thread roryqi
Hi team, Shall we release a new version 0.8.0? There are many important improvements. For example, we supported Tez and Netty. It's great to release these useful features to let more users to use them. More discussions, we can discuss below https://github.com/apache/incubator-uniffle/issues/1029.

Re: [VOTE] Release Apache Uniffle (Incubating) 0.7.1 rc2

2023-06-18 Thread roryqi
+1 binding I checked : Download links are valid. Checksums and PGP signatures are valid. LICENSE and NOTICE files are correct Compile is ok. I run the command `mvn package` All files have license headers if necessary. Jiafu Zhang 于2023年6月16日周五 15:03写道: > +1 > > I've checked below list: >

Re: [VOTE] Release Apache Uniffle (Incubating) 0.7.1 rc1

2023-06-15 Thread roryqi
release node isn't correct. You refer to our other release nodes. https://uniffle.apache.org/download/release-notes-0.7.0 roryqi 于2023年6月15日周四 15:01写道: > -1 from my side. The version isn't right. The version is 0.7.1-snapshot. > The correct version is 0.7.1. > > Jiafu Zhang 于2023年6

Re: [VOTE] Release Apache Uniffle (Incubating) 0.7.1 rc1

2023-06-15 Thread roryqi
-1 from my side. The version isn't right. The version is 0.7.1-snapshot. The correct version is 0.7.1. Jiafu Zhang 于2023年6月15日周四 14:53写道: > Hello Uniffle Community, > > This is a call for vote to release Apache Uniffle (Incubating) version > 0.7.1-rc1. > > Release notes: >

June Podding Report

2023-05-22 Thread roryqi
Hi Uniffle Community. I have finished the podding report. Util this report, Uniffle Community have Contributors 47, Discussion 13, Pull Requests total 576, merged 446 Issues total 314, closed 214 Rory

Re: [VOTE] Release Apache Uniffle(Incubating) 0.7.0

2023-04-01 Thread roryqi
he word incubating in their name. > * DISCLAIMER, LICENSE and NOTICE files are correct. > * All files have license headers if necessary. > * No unlicensed compiled archives bundled in source archive. > * The source tarball matches the git tag. > > More detail checklist please refer: > &

[ANNOUNCE] New committer: Jingxiong Zhong

2023-03-27 Thread roryqi
The Project Management Committee (PMC) *for* Apache Uniffle (incubating) has asked Jingxiong Zhong to become a committer and we are pleased to announce that he has accepted. Jingxiong Zhong has been contributing to Uniffle for several months and has authored 30+ prs. He is response for the

Re: [VOTE] Release Apache Uniffle (Incubating) 0.7.0-rc4

2023-03-16 Thread roryqi
+1 (binding) I checked. Download links, checksums and PGP signatures are valid. Source code distributions have correct names matching the current release. Release files have the word incubating in their name. DISCLAIMER-WIP, LICENSE and NOTICE files are correct. Tests passed. I run `mvn package`

Re: [VOTE] Release Apache Uniffle (Incubating) 0.7.0-rc3

2023-03-16 Thread roryqi
I revert a2b9c17bbf60df0462978b1be6d279182562181f, It's ok. Could we release rc4? roryqi 于2023年3月16日周四 20:12写道: > We run > ``` > mvn package > > The test fail > > *ERROR*] *Tests **run: 1*, Failures: 0, *Errors: 1*, Skipped: 0, Time > elaps

Re: [VOTE] Release Apache Uniffle (Incubating) 0.7.0-rc3

2023-03-16 Thread roryqi
viderTest Time elapsed: 1.896 s <<< ERROR! java.lang.Exception: java.io.FileNotFoundException: /Users/roryqi/Downloads/apache-uniffle-0.7.0-incubating-src/common/target/tmp/junit1553702532156578735/serverKS.jks (No such file or directory) Junfan Zhang 于2023年3月16日周四 20:01写道: >

About Podding Report

2023-03-09 Thread roryqi
Hi Uniffle Community I have finished the podding report. Util this report, Uniffle community have Contributors 38, Discussion 13, Pull request total 417, merged 356, Issue total 267, closed 157 Rory

Re: [VOTE] Release Apache Uniffle (Incubating) 0.7.0-rc2

2023-03-08 Thread roryqi
For my side + binding I have checked that 1. Download links, checksums and PGP signatures are valid. 2. I run the `mvn package`, tests passed. remind that the version of maven should be higher than 3.6.3. I encounter the failure when I use maven 3.6.1 3. DISCLAIMER, LICENSE and NOTICE files are

Re: [VOTE] Release Apache Uniffle (Incubating) 0.7.0-rc1

2023-02-28 Thread roryqi
Have you run uts in your local machine? I run `mvn package` twice. They all failed. Maybe we should cherrypick test fix to branch 0.7. https://github.com/apache/incubator-uniffle/issues/408 https://github.com/apache/incubator-uniffle/issues/612

Re: 回复: [DISCUSS] Release 0.7.0

2023-02-09 Thread roryqi
or features you would like to see in 0.7.0, please > let us know. > > > > Regards > > Junfan Zhang > > > > 发件人: roryqi > > 发送时间: 2023年2月2日 16:33 > > 收件人: dev@uniffle.apache.org > > 主题: [DISCUSS] Release 0.7.

[ANNOUNCE] New committer: Xianjing Feng

2023-02-08 Thread roryqi
The Project Management Committee (PMC) *for* Apache Uniffle (incubating) has asked Xianjing Feng to become a committer and we are pleased to announce that he has accepted. Xianjing Feng has been contributing to the Uniffle for several months and has authored 30+ prs. He is responsible for the

Re: [DISCUSS] Release 0.7.0

2023-02-02 Thread roryqi
r proposing this. I'd like to be a release manager for this > 0.7.0. > > > > If there are any PRs or features you would like to see in 0.7.0, please > let us know. > > > > Regards > > Junfan Zhang > > > > 发件人: rory

[DISCUSS] Release 0.7.0

2023-02-02 Thread roryqi
Hi Uniffle community, Shall we release a new version 0.7.0? There are many important improvements and bug fixes such as AQE improvement, K8S operator improvement, huge partition improvement, etc. It's great to release these useful features to let more users to use them. Regards Rory Qi

Re: [DISCUSS] Do we need a online meeting to discuss future plan about Uniffle

2022-12-08 Thread roryqi
Our online meeting link is https://meeting.tencent.com/dm/Vu30COk8v1ky zhang junfan 于2022年12月5日周一 22:50写道: > > Please send me the invitation. > > Thanks > > > 获取 Outlook for iOS<https://aka.ms/o0ukef> > ____ > 发件人: roryqi > 发送时间:

Re: [DISCUSS] Do we need a online meeting to discuss future plan about Uniffle

2022-12-08 Thread roryqi
Our online meeting link is https://meeting.tencent.com/dm/Vu30COk8v1ky 雷献铭 Jerry Lei 于2022年12月6日周二 01:45写道: > Please send me the invitation. > > Thanks > > On 2022/12/05 14:21:41 roryqi wrote: > > Hi, Uniffle Community! > > > > It's almost the end of th

[DISCUSS] Do we need a online meeting to discuss future plan about Uniffle

2022-12-05 Thread roryqi
Hi, Uniffle Community! It's almost the end of the year. We're preparing the plans of Uniffle. Maybe you're doing the same things. So I think we can communicate with each other. If you have interest, you can reply the mail, I will send you an online meeting invitation. The meeting is next

Re: [VOTE] Release Apache Uniffle (Incubating) 0.6.1-rc3

2022-12-01 Thread roryqi
>From my side +1 (binding) I have checked * Download links, checksums and PGP signatures are valid * LICENSE, NOTICE and DISCLAIMER-WIP files are correct * No unlicensed compiled archives bundled in source archive. * UT passed. I use the command `mvn package -Pspark3 Kaijie Chen 于2022年12月1日周四

Re: [VOTE] Release Apache Uniffle (Incubating) 0.6.1 rc2

2022-11-28 Thread roryqi
>From my side +1 (binding) I have checked * Download links, checksums and PGP signatures are valid * LICENSE, NOTICE and DISCLAIMER-WIP files are correct * No unlicensed compiled archives bundled in source archive. * UT passed. I use the command `mvn package -Pspark3` Kaijie Chen

Re: [DISCUSS] Release 0.6.1

2022-11-28 Thread roryqi
Do you want to volunteer as a release manager? roryqi 于2022年11月14日周一 10:24写道: > I checked 0.6 branch. There should be nothing other fixes missing. Thanks > Kajie Chen. It's really great work. > > Kaijie Chen 于2022年11月12日周六 15:28写道: > >> Hi Uniffle Community, >>

Re: [DISCUSS] Release 0.6.1

2022-11-13 Thread roryqi
I checked 0.6 branch. There should be nothing other fixes missing. Thanks Kajie Chen. It's really great work. Kaijie Chen 于2022年11月12日周六 15:28写道: > Hi Uniffle Community, > > It’s really great to see Uniffle released its first release 0.6.0 in > Apache incubator. > However, there are some

Re: Discuss about some important issues

2022-10-26 Thread roryqi
Meeting link is https://meeting.tencent.com/dm/oR95wASCNe91 zhang junfan 于2022年10月25日周二 21:02写道: > I will be available at that time. All the best, junfan > > 获取 Outlook for iOS<https://aka.ms/o0ukef> > ____ > 发件人: roryqi > 发送时间: Tuesday, Oct

Discuss about some important issues

2022-10-25 Thread roryqi
Hi, all We have some important issues, such as https://github.com/apache/incubator-uniffle/issues/133 https://github.com/apache/incubator-uniffle/issues/80 https://github.com/apache/incubator-uniffle/issues/211 We think we should start a meeting to

[ANNOUNCE] Apache Uniffle (incubating) 0.6.0 available

2022-10-21 Thread roryqi
Hi all, Apache Uniffle (incubating) Team is glad to announce the new release of Apache Uniffle (incubating) 0.6.0. Apache Uniffle (incubating) is a high performance, general purpose Remote Shuffle Service for distributed compute engines like Apache Spark < https://spark.apache.org/>, Apache

[RESULT][VOTE]. Release Apache Uniffle (incubating) 0.6.0 rc2

2022-10-20 Thread roryqi
Hi all Thanks for reviewing and voting for Apache Uniffle (incubating) 0.6.0 rc2, I am happy to announce the release voting has passed with 3binding votes, no +0 or -1 votes. Binding votes are from IPMC -- Jerry Shao -- Jean-Baptiste Onofré -- Xun Liu The voting thread is

[RESULT][VOTE] Release Apache Uniffle (incubating) 0.6.0 rc2

2022-10-17 Thread roryqi
Hello Apache Uniffle PPMC and Community, The vote closes now as 72hr have passed. The vote PASSES with 4 (+1binding) votes from the PPMC, 2 (+1non-binding) votes from the rest of the developer community, and no further 0 or -1 votes. The vote thread:

[VOTE] Release Apache Uniffle (Incubating) 0.6.0 rc2

2022-10-12 Thread roryqi
Keys to verify the Release Candidate: https://downloads.apache.org/incubator/uniffle/KEYS GPG user ID: roryqi The vote will be open for at least 72 hours or until necessary number of votes are reached. Please vote accordingly: [ ] +1 approve

[CANCEL][VOTE] Release Apache Uniffle (Incubating) 0.6.0 rc1

2022-10-12 Thread roryqi
-pick some flaky test fix prs 2. I will cherry-pick https://github.com/apache/incubator-uniffle/pull/255 to fix character encoding's problem. 3. I will replace DISCLAIMER with DISCLAIMER-WIP for our first release Thanks a lot for your help roryqi

[VOTE] Release Apache Uniffle (Incubating) 0.6.0 rc1

2022-10-09 Thread roryqi
-uniffle/commits/v0.6.0-rc1 Keys to verify the Release Candidate: https://downloads.apache.org/incubator/uniffle/KEYS GPG user ID: roryqi The vote will be open for at least 72 hours or until necessary number of votes are reached. Please vote accordingly

[ANNOUNCE] New committer: Junfan Zhang

2022-09-23 Thread roryqi
The Project Management Committee (PMC) *for* Apache Uniffle (incubating) has asked Junfan Zhang to become a committer and we are pleased to announce that he has accepted. Junfan Zhang has been contributing to the Uniffle for several months and has authored 40+ prs. He is responsible for the

Apache Uniffle (incubating) 0.6 Release

2022-09-15 Thread roryqi
Hi All, I have created the branch for Uniffle 0.6 https://github.com/apache/incubator-uniffle/commits/branch-0.6 Please backport important fixes to it, and if you have some doubts, ping me in the PR