I was running federated workloads yesterday, and unfortunately, there
were some regressions as well. The regression is that each federated
request spawns its own thread and thread pool for execution. I will
merge a fix today that reuses our commonThreadPool on federated requests.
Best regards
Sebastian
On 23.03.25 12:18, Matthias Boehm wrote:
alright in order to finally cut the next release, I just started the
perftest suite on our cluster. Unfortunately, these modified perftest
scripts were not functional and I had to recover some of the data
generation dml files from an older release. Now they are running
though and we should have some results in the next days (running all
tests up to 80GB).
Once we confirmed that there are no performance regressions we should
start cutting the release candidate.
Regards,
Matthias
On 1/25/2025 11:58 AM, Matthias Boehm wrote:
thanks Janardhan for serving again as the release manager. Yes, we'll
help to flag the necessary open tasks and bug fixes for SystemDS 3.3
during next week in order to track them.
Regards,
Matthias
On 1/24/2025 4:35 PM, Janardhan wrote:
Hi all,
Let us initiate the release preparations. I'd like to mention the
release date shortly after our discussion in this mail thread.
Let us take this opportunity to wrap up any features recently
introduced. Hopefully, the features are functional and reasonably
tested for the release. If not, you can mention here if you would need
some assistance, and reviews.
You can start with Updating version details in Jira as follows:
1. Apply version
Affects Version/s: SystemDS 3.3
Fix Version/s: SystemDS 3.3
2. Fill in Components the Jira is related to
Component/s:
some of component names:
Documentation, Runtime, Compiler, Build, APIs, Algorithms,
Federated, Compression, Builtins, Frame, Matrix, GPU, CLA
--
Helpful links
[1] all Jira components list:
https://issues.apache.org/jira/projects/SYSTEMDS?selectedItem=com.atlassian.jira.jira-projects-plugin:components-page
[2] SystemDS Kanban Board:
https://issues.apache.org/jira/secure/RapidBoard.jspa?projectKey=SYSTEMDS&rapidView=466
[3] Release Process: https://apache.github.io/systemds/site/release
-process.html
Best Regards,
Janardhan