Re: [VOTE] Release Apache YuniKorn 1.5.1 RC1

2024-05-14 Thread TingYao
+1 (binding)

- Verified signatures and checksums
- Verified LICENSE and NOTICE files
- Built release on Mac Sonoma (ARM64)
  - make image with go 1.21.8
- Ran make test, all tests passed
- Installed locally on Kind cluster (1.29.4)
- Ran simple sleep jobs

Wilfred Spiegelenburg  於 2024年5月14日 週二 下午12:25寫道:

> +1 (binding)
>
> - Verified signatures and checksums
> - Verified LICENSE and NOTICE files
> - Verified release tarball structure
> - Built release on Mac Sonoma (ARM64):
>   - make image with go 1.22 and 1.21
> - Ran make test, all tests passed
> - Installed locally on Kind cluster (1.29)
>
> - REST interface checks:
>   - verified the SHA references in the cluster detail
>   - verified the build date is set correctly
> - checked REST endpoints and UI
>
> On Fri, 10 May 2024 at 18:40, Peter Bacsko  wrote:
> >
> > Hello everyone,
> >
> > I would like to call a vote for releasing Apache YuniKorn 1.5.1 RC1.
> > This is a minor release which contains only bugfixes.
> >
> > The release artefacts have been uploaded here:
> >   https://dist.apache.org/repos/dist/dev/yunikorn/1.5.1-RC1/
> >
> > My public key is located in the KEYS file:
> >   https://downloads.apache.org//yunikorn/KEYS
> >
> > JIRA issues that have been resolved in this release:
> >https://issues.apache.org/jira/issues/?filter=12353383
> >
> > The release solves a deadlock issue. If possible, test Yunikorn with
> > workloads that put Yunikorn under stress (ie. thousands/tens of thousands
> > of pods).
> >
> > Git tags for each component are as follows:
> > yunikorn-scheduler-interface: v1.5.1-1
> > yunikorn-core: v1.5.1-1
> > yunikorn-k8shim: v1.5.1-1
> > yunikorn-web: v1.5.1-1
> > yunikorn-release: v1.5.1-1
> >
> > Once the release is voted on and approved, all repos will be tagged
> > 1.5.1 for consistency.
> >
> > Please review and vote. The vote will be open for at least 96 hours
> > and closes on Tuesday 14 May 2024, 20:00:00 CEST.
> >
> > [ ] +1 Approve
> > [ ] +0 No opinion
> > [ ] -1 Disapprove (and the reason why)
> >
> >
> > Thank you,
> > Peter
>
> -
> To unsubscribe, e-mail: dev-unsubscr...@yunikorn.apache.org
> For additional commands, e-mail: dev-h...@yunikorn.apache.org
>
>


[ANNOUNCE] Apache YuniKorn v1.5.0 release

2024-03-14 Thread TingYao
Hi all,

It gives me great pleasure to announce that the Apache YuniKorn community
has
voted to release Apache YuniKorn v1.5.0.

It contains 219 fixes and improvements. The release details, list of
major features and incompatible changes are on the v1.5.0 announcement
page [1].

You can also download the release from the Downloads page [2],

Many thanks to everyone who contributed to the release.

Tingyao

[1] https://yunikorn.apache.org/release-announce/1.5.0
[2] https://yunikorn.apache.org/community/download/


[jira] [Resolved] (YUNIKORN-2385) Update website for v1.5 release

2024-03-14 Thread TingYao Huang (Jira)


 [ 
https://issues.apache.org/jira/browse/YUNIKORN-2385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

TingYao Huang resolved YUNIKORN-2385.
-
Fix Version/s: 1.5.0
   Resolution: Fixed

> Update website for v1.5 release
> ---
>
> Key: YUNIKORN-2385
> URL: https://issues.apache.org/jira/browse/YUNIKORN-2385
> Project: Apache YuniKorn
>  Issue Type: Sub-task
>  Components: website
>Reporter: Wilfred Spiegelenburg
>Assignee: TingYao Huang
>Priority: Major
> Fix For: 1.5.0
>
>
> Multiple tasks all need to be done at once:
>  * create versioned docs
>  * create release announcement
>  * update downloads page
>  * update roadmap doc
>  * update doap file
> all to be performed at release time



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: dev-unsubscr...@yunikorn.apache.org
For additional commands, e-mail: dev-h...@yunikorn.apache.org



Re: [VOTE]Release Apache YuniKorn 1.5.0 RC2

2024-03-13 Thread TingYao
Thank you all for the voting on the RC2 for 1.5.0 That concludes the voting,

Voting for the release has passed with:
4 binding +1
3 non binding +1

no 0 or -1 votes.

As the next step, I'll publish the release, images and update the website.
After that is done I will send an announcement email.

Thank you,
Tingyao

Craig Condit  於 2024年3月13日 週三 上午4:03寫道:

> +1 (binding).
>
> - Verified signatures and checksums
> - Verified LICENSE and NOTICE
> - Verified tarball structure
> - Build release on macOS Sonoma (amd64)
> - Installed locally on Kind cluster (1.29)
> - Ran E2E tests
>
> Craig
>
>
> > On Mar 7, 2024, at 8:31 AM, TingYao  wrote:
> >
> > Hello everyone,
> >
> > I would like to call a vote for releasing Apache YuniKorn 1.5.0 RC2.
> >
> > The release artefacts have been uploaded here:
> >  https://dist.apache.org/repos/dist/dev/yunikorn/1.5.0-RC2/
> >
> > My public key is located in the KEYS file:
> >  https://downloads.apache.org//yunikorn/KEYS
> >
> > JIRA issues that have been resolved in this release:
> >  https://issues.apache.org/jira/issues/?filter=12352958
> >
> > This release artifact build with go 1.21.8 to fix some CVEs issue.
> > Compared to the RC1, the RC2 addresses several CVEs and memory leak
> issues.
> > Also remove reproducible build artifacts from draft release note. Please
> > read the draft release notes
> > attached to this vote for further details.
> >  https://github.com/apache/yunikorn-site/pull/405
> >
> > Git tags for each component are as follows:
> > yunikorn-scheduler-interface: v1.5.0-1
> > yunikorn-core: v1.5.0-3
> > yunikorn-k8shim: v1.5.0-3
> > yunikorn-web: v1.5.0-1
> > yunikorn-release: v1.5.0-3
> >
> > Once the release is voted on and approved, all repos will be tagged
> > 1.5.0 for consistency.
> >
> > Please review and vote. The vote will be open for at least 72 hours
> > and closes on Sunday 10 March 2024, 15:00:00 UTC
> >
> > [ ] +1 Approve
> > [ ] +0 No opinion
> > [ ] -1 Disapprove (and the reason why)
> >
> > Thank you,
> > Tingyao
>
>
> -
> To unsubscribe, e-mail: dev-unsubscr...@yunikorn.apache.org
> For additional commands, e-mail: dev-h...@yunikorn.apache.org
>
>


[VOTE]Release Apache YuniKorn 1.5.0 RC2

2024-03-07 Thread TingYao
Hello everyone,

I would like to call a vote for releasing Apache YuniKorn 1.5.0 RC2.

The release artefacts have been uploaded here:
  https://dist.apache.org/repos/dist/dev/yunikorn/1.5.0-RC2/

My public key is located in the KEYS file:
  https://downloads.apache.org//yunikorn/KEYS

JIRA issues that have been resolved in this release:
  https://issues.apache.org/jira/issues/?filter=12352958

This release artifact build with go 1.21.8 to fix some CVEs issue.
Compared to the RC1, the RC2 addresses several CVEs and memory leak issues.
Also remove reproducible build artifacts from draft release note. Please
read the draft release notes
attached to this vote for further details.
  https://github.com/apache/yunikorn-site/pull/405

Git tags for each component are as follows:
yunikorn-scheduler-interface: v1.5.0-1
yunikorn-core: v1.5.0-3
yunikorn-k8shim: v1.5.0-3
yunikorn-web: v1.5.0-1
yunikorn-release: v1.5.0-3

Once the release is voted on and approved, all repos will be tagged
1.5.0 for consistency.

Please review and vote. The vote will be open for at least 72 hours
and closes on Sunday 10 March 2024, 15:00:00 UTC

[ ] +1 Approve
[ ] +0 No opinion
[ ] -1 Disapprove (and the reason why)

Thank you,
Tingyao


Re: [VOTE] Release Apache YuniKorn 1.5.0 RC1

2024-03-06 Thread TingYao
Thank you all for your responses and assistance in resolving the issue.
Based on the discussion outcome, I will build RC2 with go 1.21.8 as soon as
possible and initiate the voting process.

Tingyao

Wilfred Spiegelenburg  於 2024年3月6日 週三 上午8:18寫道:

> Yes I think we need to spin a new RC: -1 for RC1
>
> Go 1.21.8 delivers a total of 5 CVE fixes, with another CVE in the
> protobuf code.
> We should fix the two memory leaks discovered. Both are simple and
> non-invasive fixes.
>
> We should remove the reproducible build details from the README until
> we figure out what is happening.
>
> Wilfred
>
> On Wed, 6 Mar 2024 at 10:15, Craig Condit  wrote:
> >
> > All of the below-mentioned issues have been resolved in branch-1.5.0 in
> preparation for a possible 1.5.0-rc2. Assuming we move forward with rc2, we
> should build with go 1.21.8 to ensure the latest fixes in the go standard
> library are included as well.
> >
> > Craig
> >
> >
> > > On Mar 5, 2024, at 3:12 PM, Craig Condit  wrote:
> > >
> > > -1 (binding).
> > >
> > > All,
> > >
> > > We have a few issues in rc1 that I believe we should address before
> shipping 1.5.0:
> > >
> > > CVEs:
> > >
> > > - CVE-2024-24783 (requires rebuild with go 1.21.8)
> > > - CVE-2023-45290 (requires rebuild with go 1.21.8)
> > > - CVE-2023-45289 (requires rebuild with go 1.21.8)
> > > - CVE-2024-24786 (requires updates to google.golang.org/protobuf <
> http://google.golang.org/protobuf> and possibly github.com/golang/protobuf
> <http://github.com/golang/protobuf>)
> > >
> > > Broken functionality:
> > >
> > > - Reproducible builds (unknown why this has failed, but we will need
> to remove the content from the README.md that claims reproducible status)
> > >
> > > Critical bugs (both memory leaks):
> > >
> > > - https://issues.apache.org/jira/browse/YUNIKORN-2465 - Remove Task
> objects from the shim upon pod completion (fix merged to master and to
> branch-1.5)
> > > - https://issues.apache.org/jira/browse/YUNIKORN-2467 - Remove
> AllocationAsk from the core when a pod is completed (PR available; needs
> review to determine if this is a 1.5 blocker).
> > >
> > > I think we should address each of these and cut an rc2. Thought?
> > >
> > > Craig Condit
> > >
> > >> On Mar 2, 2024, at 10:38 AM, TingYao  wrote:
> > >>
> > >> Hello everyone,
> > >>
> > >> I would like to call a vote for releasing Apache YuniKorn 1.5.0 RC1.
> > >>
> > >> The release artefacts have been uploaded here:
> > >> https://dist.apache.org/repos/dist/dev/yunikorn/1.5.0-RC1
> > >>
> > >> My public key is located in the KEYS file:
> > >> https://downloads.apache.org//yunikorn/KEYS
> > >>
> > >> JIRA issues that have been resolved in this release:
> > >> https://issues.apache.org/jira/issues/?filter=12352958
> > >>
> > >> Git tags for each component are as follows:
> > >> yunikorn-scheduler-interface: v1.5.0-1
> > >> yunikorn-core: v1.5.0-2
> > >> yunikorn-k8shim: v1.5.0-2
> > >> yunikorn-web: v1.5.0-1
> > >> yunikorn-release: v1.5.0-2
> > >>
> > >> Once the release is voted on and approved, all repos will be tagged
> > >> 1.5.0 for consistency.
> > >>
> > >> Please review and vote. The vote will be open for at least 72 hours
> > >> and closes on Wednesday 5 March 2024, 17:00:00 UTC
> > >>
> > >> [ ] +1 Approve
> > >> [ ] +0 No opinion
> > >> [ ] -1 Disapprove (and the reason why)
> > >>
> > >> Thank you,
> > >> Tingyao
> > >
> >
> >
> > -
> > To unsubscribe, e-mail: dev-unsubscr...@yunikorn.apache.org
> > For additional commands, e-mail: dev-h...@yunikorn.apache.org
> >
>
> -
> To unsubscribe, e-mail: dev-unsubscr...@yunikorn.apache.org
> For additional commands, e-mail: dev-h...@yunikorn.apache.org
>
>


[VOTE] Release Apache YuniKorn 1.5.0 RC1

2024-03-02 Thread TingYao
Hello everyone,

I would like to call a vote for releasing Apache YuniKorn 1.5.0 RC1.

The release artefacts have been uploaded here:
  https://dist.apache.org/repos/dist/dev/yunikorn/1.5.0-RC1

My public key is located in the KEYS file:
  https://downloads.apache.org//yunikorn/KEYS

JIRA issues that have been resolved in this release:
  https://issues.apache.org/jira/issues/?filter=12352958

Git tags for each component are as follows:
yunikorn-scheduler-interface: v1.5.0-1
yunikorn-core: v1.5.0-2
yunikorn-k8shim: v1.5.0-2
yunikorn-web: v1.5.0-1
yunikorn-release: v1.5.0-2

Once the release is voted on and approved, all repos will be tagged
1.5.0 for consistency.

Please review and vote. The vote will be open for at least 72 hours
and closes on Wednesday 5 March 2024, 17:00:00 UTC

[ ] +1 Approve
[ ] +0 No opinion
[ ] -1 Disapprove (and the reason why)

Thank you,
Tingyao


Re: [DISCUSSION] Yunikorn release 1.5.0

2024-02-23 Thread TingYao
Hi Everyone,

Update:

We've move some jiras to the next release, and we still got two jiras in
progress.
I have created Yunikorn 1.5 branch for all 4 repos(core, k8shim, interface,
web) as well. Upon the blocker issue fixed, I will start to cherry-picked,
tagging and go mod dependency changes.

Thanks,
Tingyao

TingYao  於 2024年2月18日 週日 下午8:45寫道:

> Hi Everyone,
>
> I would like to start the discussion for Release 1.5.0.
>
> Planned major features:
>
> YUNIKORN-970 Change queue metrics to labeled
> <https://issues.apache.org/jira/browse/YUNIKORN-970>
> YUNIKORN-2099 [Umbrella] K8shim simplification
> <https://issues.apache.org/jira/browse/YUNIKORN-2099>
> YUNIKORN-2115 [Umbrella] Application tracking history - Phase 2
>  <https://issues.apache.org/jira/browse/YUNIKORN-2125>
> YUNIKORN-1362 filtering nodes in UI
> <https://issues.apache.org/jira/browse/YUNIKORN-1362>
> YUNIKORN-1922 display pending resources in web UI
> <https://issues.apache.org/jira/browse/YUNIKORN-1922>
> YUNIKORN-2140 Web UI: resource display rework
> i<https://issues.apache.org/jira/browse/YUNIKORN-2140>
>
> Additionally, minor enhancements and bug fixes have been covered as part
> of this release.
>
> There are some open items with target version 1.5.0:
>
> https://issues.apache.org/jira/browse/YUNIKORN-2030?jql=project%20%3D%20YUNIKORN%20AND%20status%20in%20(Open%2C%20%22In%20Progress%22%2C%20Reopened)%20AND%20%22Target%20Version%22%20%3D%201.5.0%20ORDER%20BY%20priority%20DESC
>
> Please review this list and decide whether it's feasible to
> complete them before code freeze. If not, I will retarget the tickets
> to 1.6.0.
>
> There are some in progress blocker or critical issues with target version
> 1.5.0:
>
> YUNIKORN-2030 Need to check headroom when trying other nodes for reserved
> allocations
>  <https://issues.apache.org/jira/browse/YUNIKORN-2030>
> YUNIKORN-1706 We should clean up failed apps in shim side
> <https://issues.apache.org/jira/browse/YUNIKORN-1706>
> YUNIKORN-1089 Application handling with invalid task group annotations
> <https://issues.apache.org/jira/browse/YUNIKORN-1089>
>
> Hope we can include those change, otherwise we might need to postpone
> release.
>
> Here is the preliminary schedule:
> Code freeze on 22 Feb
> Branch on 23 Feb
> First RC out latest by 1 March
>
> Based on the voting process, we can tentatively plan for release Yunikorn
> 1.5.0 around the week of 4 - 8 March.
>
> Please feel free to share your thoughts.
>
> Thanks,
> Tingyao
>


[DISCUSSION] Yunikorn release 1.5.0

2024-02-18 Thread TingYao
Hi Everyone,

I would like to start the discussion for Release 1.5.0.

Planned major features:

YUNIKORN-970 Change queue metrics to labeled
<https://issues.apache.org/jira/browse/YUNIKORN-970>
YUNIKORN-2099 [Umbrella] K8shim simplification
<https://issues.apache.org/jira/browse/YUNIKORN-2099>
YUNIKORN-2115 [Umbrella] Application tracking history - Phase 2
 <https://issues.apache.org/jira/browse/YUNIKORN-2125>
YUNIKORN-1362 filtering nodes in UI
<https://issues.apache.org/jira/browse/YUNIKORN-1362>
YUNIKORN-1922 display pending resources in web UI
<https://issues.apache.org/jira/browse/YUNIKORN-1922>
YUNIKORN-2140 Web UI: resource display rework
i<https://issues.apache.org/jira/browse/YUNIKORN-2140>

Additionally, minor enhancements and bug fixes have been covered as part of
this release.

There are some open items with target version 1.5.0:
https://issues.apache.org/jira/browse/YUNIKORN-2030?jql=project%20%3D%20YUNIKORN%20AND%20status%20in%20(Open%2C%20%22In%20Progress%22%2C%20Reopened)%20AND%20%22Target%20Version%22%20%3D%201.5.0%20ORDER%20BY%20priority%20DESC

Please review this list and decide whether it's feasible to
complete them before code freeze. If not, I will retarget the tickets
to 1.6.0.

There are some in progress blocker or critical issues with target version
1.5.0:

YUNIKORN-2030 Need to check headroom when trying other nodes for reserved
allocations
 <https://issues.apache.org/jira/browse/YUNIKORN-2030>
YUNIKORN-1706 We should clean up failed apps in shim side
<https://issues.apache.org/jira/browse/YUNIKORN-1706>
YUNIKORN-1089 Application handling with invalid task group annotations
<https://issues.apache.org/jira/browse/YUNIKORN-1089>

Hope we can include those change, otherwise we might need to postpone
release.

Here is the preliminary schedule:
Code freeze on 22 Feb
Branch on 23 Feb
First RC out latest by 1 March

Based on the voting process, we can tentatively plan for release Yunikorn
1.5.0 around the week of 4 - 8 March.

Please feel free to share your thoughts.

Thanks,
Tingyao


[jira] [Resolved] (YUNIKORN-2397) Improve plugin registration unit test coverage

2024-02-17 Thread TingYao Huang (Jira)


 [ 
https://issues.apache.org/jira/browse/YUNIKORN-2397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

TingYao Huang resolved YUNIKORN-2397.
-
Fix Version/s: 1.5.0
   Resolution: Fixed

The PR already merged to master, so close this Jira as resolved.

c.c. [~wilfreds] 

> Improve plugin registration unit test coverage
> --
>
> Key: YUNIKORN-2397
> URL: https://issues.apache.org/jira/browse/YUNIKORN-2397
> Project: Apache YuniKorn
>  Issue Type: Improvement
>  Components: core - common
>Reporter: Wilfred Spiegelenburg
>Assignee: Wilfred Spiegelenburg
>Priority: Major
>  Labels: pull-request-available
> Fix For: 1.5.0
>
>
> The core plugins code has a test coverage of 63% that should be improved.
> Currently we do not test seperate interface registrations or retrievals.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: dev-unsubscr...@yunikorn.apache.org
For additional commands, e-mail: dev-h...@yunikorn.apache.org



[jira] [Resolved] (YUNIKORN-2376) Remove dummy plugin for the state dump

2024-02-17 Thread TingYao Huang (Jira)


 [ 
https://issues.apache.org/jira/browse/YUNIKORN-2376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

TingYao Huang resolved YUNIKORN-2376.
-
Fix Version/s: 1.5.0
   Resolution: Fixed

> Remove dummy plugin for the state dump
> --
>
> Key: YUNIKORN-2376
> URL: https://issues.apache.org/jira/browse/YUNIKORN-2376
> Project: Apache YuniKorn
>  Issue Type: Improvement
>  Components: core - common
>Reporter: Wilfred Spiegelenburg
>Assignee: Wilfred Spiegelenburg
>Priority: Major
>  Labels: pull-request-available
> Fix For: 1.5.0
>
>
> A dummy state dump plugin is added to prevent a nil pointer panic when the RM 
> has not implemented the state dump interface. Instead of adding a dummy 
> implementation we should handle the nil and omit the dump or show an 
> "unimplemented message" in the full dump.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: dev-unsubscr...@yunikorn.apache.org
For additional commands, e-mail: dev-h...@yunikorn.apache.org



[jira] [Closed] (YUNIKORN-1032) Add Chinese translation for user guide documents

2024-02-17 Thread TingYao Huang (Jira)


 [ 
https://issues.apache.org/jira/browse/YUNIKORN-1032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

TingYao Huang closed YUNIKORN-1032.
---
Resolution: Won't Do

> Add Chinese translation for user guide documents
> 
>
> Key: YUNIKORN-1032
> URL: https://issues.apache.org/jira/browse/YUNIKORN-1032
> Project: Apache YuniKorn
>  Issue Type: Improvement
>  Components: documentation
>Reporter: cdmikechen
>Priority: Major
>
> Add Chinese translation for user guide documents
> This issue include YuniKorn site user guide documents.
> Words translation table:
> admin controller -> 准入控制器
> queue -> 队列
> partition -> 分区
> preemption -> 抢占
> task -> 任务
> job -> 工作
> group -> 群组
> child and sub queue ->  子模板队列和子队列



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: dev-unsubscr...@yunikorn.apache.org
For additional commands, e-mail: dev-h...@yunikorn.apache.org



[jira] [Closed] (YUNIKORN-2002) Adding Chinese translation of K8s Scheduler Plugin

2024-02-14 Thread TingYao Huang (Jira)


 [ 
https://issues.apache.org/jira/browse/YUNIKORN-2002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

TingYao Huang closed YUNIKORN-2002.
---
Resolution: Won't Do

> Adding Chinese translation of K8s Scheduler Plugin
> --
>
> Key: YUNIKORN-2002
> URL: https://issues.apache.org/jira/browse/YUNIKORN-2002
> Project: Apache YuniKorn
>  Issue Type: Task
>  Components: documentation
>Reporter: Huang Guan Hao
>Assignee: JiaSheng Chen
>Priority: Major
>  Labels: newbie, pull-request-available
>




--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: dev-unsubscr...@yunikorn.apache.org
For additional commands, e-mail: dev-h...@yunikorn.apache.org



[jira] [Closed] (YUNIKORN-2021) Adding Chinese translation of User/Group handling and lookup design

2024-02-14 Thread TingYao Huang (Jira)


 [ 
https://issues.apache.org/jira/browse/YUNIKORN-2021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

TingYao Huang closed YUNIKORN-2021.
---
Resolution: Won't Do

> Adding Chinese translation of User/Group handling and lookup design
> ---
>
> Key: YUNIKORN-2021
> URL: https://issues.apache.org/jira/browse/YUNIKORN-2021
> Project: Apache YuniKorn
>  Issue Type: Task
>Reporter: Huang Guan Hao
>Assignee: Chenchen Lai
>Priority: Major
>




--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: dev-unsubscr...@yunikorn.apache.org
For additional commands, e-mail: dev-h...@yunikorn.apache.org



[jira] [Closed] (YUNIKORN-2003) Adding Chinese translation of Gang scheduling design

2024-02-14 Thread TingYao Huang (Jira)


 [ 
https://issues.apache.org/jira/browse/YUNIKORN-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

TingYao Huang closed YUNIKORN-2003.
---
Resolution: Won't Do

> Adding Chinese translation of Gang scheduling design
> 
>
> Key: YUNIKORN-2003
> URL: https://issues.apache.org/jira/browse/YUNIKORN-2003
> Project: Apache YuniKorn
>  Issue Type: Task
>  Components: documentation
>Reporter: Huang Guan Hao
>Assignee: Chenchen Lai
>Priority: Major
>




--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: dev-unsubscr...@yunikorn.apache.org
For additional commands, e-mail: dev-h...@yunikorn.apache.org



[jira] [Closed] (YUNIKORN-2022) Adding Chinese translation of User Based Resource Usage Tracking

2024-02-14 Thread TingYao Huang (Jira)


 [ 
https://issues.apache.org/jira/browse/YUNIKORN-2022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

TingYao Huang closed YUNIKORN-2022.
---
Resolution: Won't Do

> Adding Chinese translation of User Based Resource Usage Tracking
> 
>
> Key: YUNIKORN-2022
> URL: https://issues.apache.org/jira/browse/YUNIKORN-2022
> Project: Apache YuniKorn
>  Issue Type: Task
>Reporter: Huang Guan Hao
>Assignee: Huang Guan Hao
>Priority: Major
>




--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: dev-unsubscr...@yunikorn.apache.org
For additional commands, e-mail: dev-h...@yunikorn.apache.org



[jira] [Closed] (YUNIKORN-2028) Add Chinese translation of priority scheduling document

2024-02-14 Thread TingYao Huang (Jira)


 [ 
https://issues.apache.org/jira/browse/YUNIKORN-2028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

TingYao Huang closed YUNIKORN-2028.
---
Resolution: Won't Do

> Add Chinese translation of priority scheduling document
> ---
>
> Key: YUNIKORN-2028
> URL: https://issues.apache.org/jira/browse/YUNIKORN-2028
> Project: Apache YuniKorn
>  Issue Type: Task
>  Components: documentation
>Reporter: JiaChi Wang
>Assignee: JiaChi Wang
>Priority: Minor
>




--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: dev-unsubscr...@yunikorn.apache.org
For additional commands, e-mail: dev-h...@yunikorn.apache.org



[jira] [Closed] (YUNIKORN-2023) Adding Chinese translation of User Based Quota Enforcement

2024-02-14 Thread TingYao Huang (Jira)


 [ 
https://issues.apache.org/jira/browse/YUNIKORN-2023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

TingYao Huang closed YUNIKORN-2023.
---
Resolution: Won't Do

> Adding Chinese translation of User Based Quota Enforcement
> --
>
> Key: YUNIKORN-2023
> URL: https://issues.apache.org/jira/browse/YUNIKORN-2023
> Project: Apache YuniKorn
>  Issue Type: Task
>Reporter: Huang Guan Hao
>Assignee: Chenchen Lai
>Priority: Major
>




--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: dev-unsubscr...@yunikorn.apache.org
For additional commands, e-mail: dev-h...@yunikorn.apache.org



[jira] [Closed] (YUNIKORN-2000) Adding Chinese translation of Architecture

2024-02-14 Thread TingYao Huang (Jira)


 [ 
https://issues.apache.org/jira/browse/YUNIKORN-2000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

TingYao Huang closed YUNIKORN-2000.
---
Resolution: Won't Do

> Adding Chinese translation of Architecture
> --
>
> Key: YUNIKORN-2000
> URL: https://issues.apache.org/jira/browse/YUNIKORN-2000
> Project: Apache YuniKorn
>  Issue Type: Task
>  Components: documentation
>Reporter: Huang Guan Hao
>Assignee: Chenchen Lai
>Priority: Major
>  Labels: newbie, pull-request-available
>




--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: dev-unsubscr...@yunikorn.apache.org
For additional commands, e-mail: dev-h...@yunikorn.apache.org



[jira] [Closed] (YUNIKORN-1999) Adding Chinese translation of Design Documents

2024-02-14 Thread TingYao Huang (Jira)


 [ 
https://issues.apache.org/jira/browse/YUNIKORN-1999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

TingYao Huang closed YUNIKORN-1999.
---
Resolution: Won't Do

> Adding Chinese translation of Design Documents
> --
>
> Key: YUNIKORN-1999
> URL: https://issues.apache.org/jira/browse/YUNIKORN-1999
> Project: Apache YuniKorn
>  Issue Type: Task
>  Components: documentation
>Reporter: Huang Guan Hao
>Priority: Major
>  Labels: newbie
>
> Adding Chinese translation of Design Documents
>  * Architecture
>  * K8s Scheduler Plugin
>  * Gang scheduling design
>  * User/Group handling and lookup design
>  * User Based Resource Usage Tracking
>  * User Based Quota Enforcement
>  * Simplifying Interface Messages
>  * Scheduler cache removal design
>  * Preemption
>  * DaemonSet Scheduling using Simple Preemptor
>  * Generic Resource Types in Namespace Quota
>  * Pluggable App Management
>  * Priority Scheduling
>  * Resilience
>  * Batch Workloads Ordering with StateAware Policy
>  * Scheduler Object States
>  * Configuration V2
>  * Scheduler Configuration



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: dev-unsubscr...@yunikorn.apache.org
For additional commands, e-mail: dev-h...@yunikorn.apache.org



[jira] [Closed] (YUNIKORN-1561) make lint should pass when there are no go file changes

2024-02-11 Thread TingYao Huang (Jira)


 [ 
https://issues.apache.org/jira/browse/YUNIKORN-1561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

TingYao Huang closed YUNIKORN-1561.
---
Resolution: Won't Do

> make lint should pass when there are no go file changes
> ---
>
> Key: YUNIKORN-1561
> URL: https://issues.apache.org/jira/browse/YUNIKORN-1561
> Project: Apache YuniKorn
>  Issue Type: Improvement
>  Components: core - common, shim - kubernetes
>Reporter: Wilfred Spiegelenburg
>Assignee: TingYao Huang
>Priority: Major
>
> If we have no changes in go files at all the make lint check fails:
> {code:java}
> Run make lint
> 4curl -sSfL 
> https://raw.githubusercontent.com/golangci/golangci-lint/master/install.sh | 
> sh -s -- -b /home/runner/go/bin v1.50.1
> 5golangci/golangci-lint info checking GitHub for tag 'v1.50.1'
> 6golangci/golangci-lint info found version: 1.50.1 for v1.50.1/linux/amd64
> 7golangci/golangci-lint info installed /home/runner/go/bin/golangci-lint
> 8stat /home/runner/go/bin/golangci-lint > /dev/null 2>&1
> 9running golangci-lint
> 10git symbolic-ref -q HEAD && REV="origin/HEAD" || REV="HEAD^" ; \
> 11headSHA=$(git rev-parse --short=12 ${REV}) ; \
> 12echo "checking against commit sha ${headSHA}" ; \
> 13/home/runner/go/bin/golangci-lint run --new-from-rev=${headSHA}
> 14checking against commit sha a9cdd44d9785
> 15level=error msg="Running error: context loading failed: no go files to 
> analyze"
> 16make: *** [Makefile:121: lint] Error 5
> 17Error: Process completed with exit code 2. {code}
> A return code of 5 
> [NoGoFiles|https://github.com/golangci/golangci-lint/blob/master/pkg/exitcodes/exitcodes.go]
>  should be eaten and still give a success



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: dev-unsubscr...@yunikorn.apache.org
For additional commands, e-mail: dev-h...@yunikorn.apache.org



Re: [VOTE] Release Apache YuniKorn 1.4.0 RC1

2023-11-17 Thread TingYao
+1

- Verified signatures and checksums
- Verified LICENSE and NOTICE files
- Built images from source on Mac M1 (arm64) with go 1.21
- Run the scheduler with a local kind cluster (version 1.27.1),  run simple
jobs and worked fine

Thanks
Tingyao

Craig Condit  於 2023年11月17日 週五 上午4:40寫道:

> +1 (binding).
>
> - Verified keys and sums
> - Built images from source with go 1.21.4 on Mac (amd64)
> - Ran e2e tests and some simple applications
>
> Only issue encountered was it seems the (relatively) new UserGroupLimit
> e2e tests are not stable. Given this is a brand new feature and that test
> was recently committed, I don’t see this as a blocker.
>
> Craig
>
>
> > On Nov 15, 2023, at 3:36 AM, Wilfred Spiegelenburg 
> wrote:
> >
> > Hello everyone,
> >
> > I would like to call a vote for releasing Apache YuniKorn 1.4.0 RC1.
> > It is a large release with 250+ jiras included.
> > Please note that K8s v1.23 and earlier are no longer supported.
> >
> > The release artefacts have been uploaded here:
> >  https://dist.apache.org/repos/dist/dev/yunikorn/1.4.0-RC1/
> >
> > My public key is located in the KEYS file:
> >  https://downloads.apache.org//yunikorn/KEYS
> >
> > JIRA issues that have been resolved in this release:
> >  https://issues.apache.org/jira/issues/?filter=12352769
> >
> > The release contains a number of incompatible changes that could
> > impact the release verification. Please read the draft release notes
> > attached to this vote for further details.
> >
> > Git tags for each component are as follows:
> > yunikorn-scheduler-interface: v1.4.0-1
> > yunikorn-core: v1.4.0-1
> > yunikorn-k8shim: v1.4.0-2
> > yunikorn-web: v1.4.0-2
> > yunikorn-release: v1.4.0-1
> >
> > Once the release is voted on and approved, all repos will be tagged
> > 1.4.0 for consistency.
> >
> > Please review and vote. The vote will be open for at least 72 hours
> > and closes on Saturday 18 November 2023, 10:00:00 UTC
> >
> > [ ] +1 Approve
> > [ ] +0 No opinion
> > [ ] -1 Disapprove (and the reason why)
> >
> >
> > Thank you,
> > Wilfred
> >
> > -
> > To unsubscribe, e-mail: dev-unsubscr...@yunikorn.apache.org
> > For additional commands, e-mail: dev-h...@yunikorn.apache.org
> >
>
>
> -
> To unsubscribe, e-mail: dev-unsubscr...@yunikorn.apache.org
> For additional commands, e-mail: dev-h...@yunikorn.apache.org
>
>


[jira] [Closed] (YUNIKORN-1970) Fix outdated metrics document

2023-09-15 Thread TingYao Huang (Jira)


 [ 
https://issues.apache.org/jira/browse/YUNIKORN-1970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

TingYao Huang closed YUNIKORN-1970.
---
 Fix Version/s: 1.4.0
Target Version: 1.4.0
Resolution: Fixed

> Fix outdated metrics document
> -
>
> Key: YUNIKORN-1970
> URL: https://issues.apache.org/jira/browse/YUNIKORN-1970
> Project: Apache YuniKorn
>  Issue Type: Bug
>  Components: website
>Reporter: Kuan-Po Tseng
>Assignee: Kuan-Po Tseng
>Priority: Major
>  Labels: pull-request-available
> Fix For: 1.4.0
>
>
> [https://yunikorn.apache.org/docs/next/performance/metrics] has never been 
> updated after [https://github.com/apache/yunikorn-site/pull/94] . Part of the 
> metrics documentation not aligns with the yunikorn-core master branch. e.g. 
> {{tryPreemptionLatency}} not mentioned in doc



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: dev-unsubscr...@yunikorn.apache.org
For additional commands, e-mail: dev-h...@yunikorn.apache.org



Re: [ANNOUNCE] New committer: Rainie Li

2022-12-14 Thread TingYao
Congratulations.

Manikandan R  於 2022年12月15日 週四 下午1:21寫道:

> Congratulations Rainie. Welcome.
>
> On Thu, Dec 15, 2022 at 10:40 AM Desai, Mit 
> wrote:
>
> > Congratulations Rainie!
> >
> > Get Outlook for iOS
> > 
> > From: Wilfred Spiegelenburg 
> > Sent: Wednesday, December 14, 2022 8:57:13 PM
> > To: dev@yunikorn.apache.org 
> > Subject: [ANNOUNCE] New committer: Rainie Li
> >
> > The Project Management Committee (PMC) for Apache YuniKorn has invited
> > Rainie Li to become a committer and we are pleased to announce that she
> has
> > accepted.
> > Please join me in congratulating her.
> >
> > Congratulations & Welcome aboard Rainie !
> >
> > Wilfred
> >
>


Re: [VOTE] Release Apache YuniKorn 1.1.0 RC1

2022-09-06 Thread TingYao
+1

- build images(ubuntu/amd64)
- run unit test
- deploy Yunikorn to kubernetes cluster

Thanks Peter

Tingyao

Peter Bacsko  於 2022年9月5日 週一 下午4:20寫道:

> Thanks for the votes so far.
>
> Some folks are still out, so I'm extending the voting deadline until
> September 7, 2020 12:00pm CEST.
>
> Thanks,
> Peter
>
> On Sat, Sep 3, 2022 at 5:05 PM 陳Chen宥騰Yuteng  wrote:
>
> > +1
> > - Built ARM based image(arm64v8)
> > - Ran unit tests
> > - Deployed Yunikorn on Kubernetes cluster.
> > - Tried the sleep example. Pods could be scheduled by Yunikorn.
> >
> > Wilfred Spiegelenburg  於 2022年9月2日 週五 上午10:35寫道:
> >
> > > +1 (binding)
> > >
> > > - Verified signatures
> > > - Verified sha512 sum
> > > - Verified the LICENSE changes
> > > - Built ARM based image on Mac/amd64
> > > - Ran validation script to verify proper startup
> > > - Ran unit tests
> > >
> > > Filed YUNIKORN-1305 to fix the sha labeling in the generated image but
> > that
> > > is not important enough to stop the release.
> > >
> > > Wilfred
> > >
> > > On Fri, 2 Sept 2022 at 03:23, Craig Condit 
> > wrote:
> > >
> > > > +1.
> > > >
> > > > - Verified signatures
> > > > - Verified sha512 sum
> > > > - Built release (on Mac/amd64)
> > > > - Ran validation script to verify proper startup
> > > > - Executed e2e tests on both standard and plugin mode
> > > >
> > > > Other than a couple of flaky tests (known issue) everything looks
> > great.
> > > >
> > > > Thanks Peter for the release work!
> > > >
> > > >
> > > > Craig
> > > >
> > > >
> > > >
> > > > > On Sep 1, 2022, at 7:03 AM, Peter Bacsko 
> wrote:
> > > > >
> > > > > Thanks Craig.
> > > > >
> > > > > I re-generated the artifacts with just using "1.1.0" in
> > > > > release-configs.json.
> > > > >
> > > > > It's based the same code base/tags, so it's still the RC1.
> > > > >
> > > > > I removed the previous artifacts and the new ones are available
> here:
> > > > >  https://dist.apache.org/repos/dist/dev/yunikorn/1.1.0-RC1/
> > > > >
> > > > > Thanks,
> > > > > Peter
> > > > >
> > > > > On Wed, Aug 31, 2022 at 11:34 PM Wilfred Spiegelenburg <
> > > > wilfr...@apache.org>
> > > > > wrote:
> > > > >
> > > > >> The version that is used in the name is also in the substitutions
> in
> > > the
> > > > >> Makefile, helm charts etc.
> > > > >>
> > > > >> Updating the release-configs.json should be clarified in:
> > > > >> * update the version with the release version: examples: 0.12.2 or
> > > 1.1.0
> > > > >> * update the tags with the current release tag examples: 0.12.2-1
> or
> > > > >> 1.0.0-1
> > > > >>
> > > > >> We need to re-run the release tool with the update in the version.
> > > > >>
> > > > >> Wilfred
> > > > >>
> > > > >> On Thu, 1 Sept 2022 at 00:17, Craig Condit 
> > > wrote:
> > > > >>
> > > > >>> Unfortunately, I have to vote -1 on this.
> > > > >>>
> > > > >>> Release candidates, if they are to become actual releases, must
> be
> > > > binary
> > > > >>> identical once voted upon and released. This archive contains
> > > numerous
> > > > >>> references to “RC1” including the top-level directory within the
> > > > archive
> > > > >>> itself. All of these will at a minimum change the sha512sum of
> the
> > > > >> archive,
> > > > >>> and logically result in different contents.
> > > > >>>
> > > > >>> However, I don’t see an issue with the source code, so simply
> > > > >> re-releasing
> > > > >>> the tarball without ‘-RC1’ in the version will probably work.
> > > > >>>
> > > > >>>
> > > > >>> Craig
> > > > >>>
> > > > >>>
> > > > >>>
> &

Re: Apache YuniKorn (Incubating) - Community Graduation Vote

2022-01-26 Thread TingYao
+1

Craig Condit  於 2022年1月26日 週三 下午11:59寫道:

> +1 to graduate YuniKorn to a top level project. Looking forward to this
> important milestone.
>
> Craig
>
>
> > On Jan 25, 2022, at 11:08 PM, Weiwei Yang  wrote:
> >
> > Hi YuniKorn community and mentors
> >
> > Based on the discussion thread [1], after 2 years time of incubating, it
> is considered that now is a good time to graduate YuniKorn from the ASF
> incubator and become a top-level Apache project. We have reviewed the ASF
> project maturity model [2] and provided some assessment of the project's
> maturity based on the guidelines. Details are included as the following. I
> have enough reasons to believe the project has done sustainable development
> successfully in the Apache way. Please read this and add your vote by
> replying to this email, your feedback will be much appreciated!!! Note,
> this vote is not just for committers or PPMC members, we welcome anyone in
> the community to vote, thanks!
> >
> > Code, License, and Copyright
> >
> > All code is maintained on github, under Apache 2.0 license. We have
> reviewed all the dependencies and ensured they do not bring any license
> issues. All the status files, license headers, and copyright are up to date.
> >
> > Release
> >
> > The community has released 5 releases in the past 2 years, i.e v0.8,
> v0.9, v0.10, v0,11, and v0.12. These releases were done by 5 different
> release managers [3] and indicate the community can create releases
> independently. We have also a well-documented release process, automated
> tools to help new release managers with the process.
> >
> > Quality
> >
> > The community has developed a comprehensive CI/CD pipeline as a guard of
> the code quality. The pipeline runs per-commit license check, code-format
> check, code-coverage check, UT, and end-to-end tests. All these are built
> as automated github actions, new contributors can easily trigger and view
> results when submitting patches.
> >
> > Community
> >
> > The community has developed an easy-to-read homepage for the project
> [4], the website hosts all the materials related to the project including
> versioned documentation, user docs, developer docs, design docs,
> performance docs. It provides the top-level navigation to the software
> download page, where links to all our previous releases. It also has the
> pages for the new contributors on-boarding with the project, such as how to
> join community meetings, events links, etc.
> >
> > The community shows appreciation to all contributors and welcomes all
> kinds of contributions (not just for code). We have built an open, diverse
> community and gathered many people to work together. With that, we have 41
> unique code contributors and some non-code contributors as well. Many of
> them have becoming to be committers and PPMC members while working with the
> community. There were 2 new mentors, 8 new committers, 4 new PPMC from 6
> different organizations [5] added in the incubating phase. And in total,
> the project has 6 mentors, 23 PPMC, and 29 committers from at least 14
> different organizations. All the info are generally available on the
> project website, including some guidelines to help people become
> committer/PPMC member [6]. Community collaboration was done in a
> wide-public, open manner, we leverage regular bi-weekly/weekly community
> meetings for 2 different timezones [7] and dev/user slack channels, mailing
> lists for offline discussions.
> >
> > Independence
> >
> > The project was initially donated by Cloudera, but with a diverse open
> source community, it has been operated as an independent project since it
> entered into ASF incubator. The committers and PPMC members are a group of
> passionate people from at least 14 different organizations, such as
> Alibaba, Apple, Cloudera, Databricks, LinkedIn, Microsoft, Snowflake, etc.
> The project's success is not depending on any single entity.
> >
> > [1] https://lists.apache.org/thread/dno411y59g2pcy1d3kd7s3kdjz9jw65n <
> https://lists.apache.org/thread/dno411y59g2pcy1d3kd7s3kdjz9jw65n>
> > [2]
> https://community.apache.org/apache-way/apache-project-maturity-model.html
> <
> https://community.apache.org/apache-way/apache-project-maturity-model.html
> >
> > [3] https://yunikorn.apache.org/community/download <
> https://yunikorn.apache.org/community/download>
> > [4] https://yunikorn.apache.org/ 
> > [5] https://incubator.apache.org/projects/yunikorn.html <
> https://incubator.apache.org/projects/yunikorn.html>
> > [6] https://yunikorn.apache.org/community/people <
> https://yunikorn.apache.org/community/people>
> > [6]
> https://docs.google.com/document/d/165gzC7uhcKc5XDWiMYSRKBiPQBy2tDtXADUPuhGlUa0
> <
> https://docs.google.com/document/d/165gzC7uhcKc5XDWiMYSRKBiPQBy2tDtXADUPuhGlUa0
> >
> >
>
>


Re: [ANNOUNCE] Tingyao Huang is a new Apache YuniKorn (Incubating) committer

2021-02-04 Thread , TingYao
 Hi all

Thanks for the invitation, also thanks to community members for their help.
I will participate actively in the future.
Hope I can contribute more to Apache YuniKorn (Incubating) .

Best,
Tingyao

Weiwei Yang  於 2021年2月4日 週四 上午1:39寫道:

> Hi all
>
> I am pleased to announce that Tingyao Huang has accepted the invitation to
> become a Apache YuniKorn (Incubating) committer.
>
> Tingyao has been closely working with the community on many tasks/features,
> such as app CRD, spark-operator/kubeflow support, gang scheduling etc, for
> almost
> 10 months now. We are so glad to add Tingyao as a committer, thanks for all
> the contributions
> and look forward to more involvement.
>
> All the best
> Weiwei
>