[jira] [Comment Edited] (CASSANDRA-18197) Builds being often aborted because of python3 ./scripts/gen-nodetool-docs.py being slow
[ https://issues.apache.org/jira/browse/CASSANDRA-18197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17680652#comment-17680652 ] Brandon Williams edited comment on CASSANDRA-18197 at 1/25/23 8:34 PM: --- Patch adds concurrency to the adoc generation, working in batches of 3 (more doesn't really help at least on my macine) and this cuts the run time to around 30s. ||Branch||CI|| |[3.11|https://github.com/driftx/cassandra/tree/CASSANDRA-18197-3.11]|[j8|https://app.circleci.com/pipelines/github/driftx/cassandra/821/workflows/2b13ee0b-a523-4d9f-bc58-1bb6a98894be]| |[4.0|https://github.com/driftx/cassandra/tree/CASSANDRA-18197-4.0]|[j8|https://app.circleci.com/pipelines/github/driftx/cassandra/820/workflows/ab7f2d3b-f47d-4c60-80e0-99afd5961c8c], [j11|https://app.circleci.com/pipelines/github/driftx/cassandra/820/workflows/b707fbe5-d245-4bef-af49-191a4a54b201]| |[4.1|https://github.com/driftx/cassandra/tree/CASSANDRA-18197-4.1]|[j8|https://app.circleci.com/pipelines/github/driftx/cassandra/822/workflows/7a76a7eb-0697-4ca8-a4a2-9c3985838c1f], [j11|https://app.circleci.com/pipelines/github/driftx/cassandra/822/workflows/cab41040-0506-460a-8022-ec944e879814]| |[trunk|https://github.com/driftx/cassandra/tree/CASSANDRA-18197-trunk]|[j8|https://app.circleci.com/pipelines/github/driftx/cassandra/823/workflows/3ce42dbc-7b9e-4c85-8211-9c449d0870df], [j11|https://app.circleci.com/pipelines/github/driftx/cassandra/823/workflows/992604c1-3a14-4e64-8ede-10721fc15fbb]| Jenkins for a smoke test: [!https://ci-cassandra.apache.org/job/Cassandra-devbranch/2228/badge/icon!|https://ci-cassandra.apache.org/blue/organizations/jenkins/Cassandra-devbranch/detail/Cassandra-devbranch/2228/pipeline] was (Author: brandon.williams): Patch adds concurrency to the adoc generation, working in batches of 3 (more doesn't really help at least on my macine) and this cuts the run time to around 30s. ||Branch||CI|| |[3.11|https://github.com/driftx/cassandra/tree/CASSANDRA-18197-3.11]|[j8|https://app.circleci.com/pipelines/github/driftx/cassandra/821/workflows/2b13ee0b-a523-4d9f-bc58-1bb6a98894be]| |[4.0|https://github.com/driftx/cassandra/tree/CASSANDRA-18197-4.0]|[j8|https://app.circleci.com/pipelines/github/driftx/cassandra/820/workflows/ab7f2d3b-f47d-4c60-80e0-99afd5961c8c], [j11|https://app.circleci.com/pipelines/github/driftx/cassandra/820/workflows/b707fbe5-d245-4bef-af49-191a4a54b201]| |[4.1|https://github.com/driftx/cassandra/tree/CASSANDRA-18197-4.1]|[j8|https://app.circleci.com/pipelines/github/driftx/cassandra/822/workflows/7a76a7eb-0697-4ca8-a4a2-9c3985838c1f], [j11|https://app.circleci.com/pipelines/github/driftx/cassandra/822/workflows/cab41040-0506-460a-8022-ec944e879814]| |[trunk|https://github.com/driftx/cassandra/tree/CASSANDRA-18197-trunk]|[j8|https://app.circleci.com/pipelines/github/driftx/cassandra/823/workflows/3ce42dbc-7b9e-4c85-8211-9c449d0870df], [j11|https://app.circleci.com/pipelines/github/driftx/cassandra/823/workflows/992604c1-3a14-4e64-8ede-10721fc15fbb]| Jenkins for a smoke test: [!https://ci-cassandra.apache.org/job/Cassandra-devbranch/2224/badge/icon!|https://ci-cassandra.apache.org/blue/organizations/jenkins/Cassandra-devbranch/detail/Cassandra-devbranch/2224/pipeline] > Builds being often aborted because of python3 ./scripts/gen-nodetool-docs.py > being slow > --- > > Key: CASSANDRA-18197 > URL: https://issues.apache.org/jira/browse/CASSANDRA-18197 > Project: Cassandra > Issue Type: Bug > Components: Build >Reporter: Ekaterina Dimitrova >Assignee: Brandon Williams >Priority: Normal > Fix For: 3.11.x, 4.0.x, 4.1.x, 4.x > > > As discussed on CASSANDRA-18181, recently we see builds aborted as python3 > ./scripts/gen-nodetool-docs.py is too slow. > According to [~brandon.williams] most of the time in the script is spent in > create_adoc, which is serially forking nodetool help for every command to > gather it. > CC [~Anthony Grasso] -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org For additional commands, e-mail: commits-h...@cassandra.apache.org
[jira] [Comment Edited] (CASSANDRA-18197) Builds being often aborted because of python3 ./scripts/gen-nodetool-docs.py being slow
[ https://issues.apache.org/jira/browse/CASSANDRA-18197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17680652#comment-17680652 ] Brandon Williams edited comment on CASSANDRA-18197 at 1/25/23 5:36 PM: --- Patch adds concurrency to the adoc generation, working in batches of 3 (more doesn't really help at least on my macine) and this cuts the run time to around 30s. ||Branch||CI|| |[3.11|https://github.com/driftx/cassandra/tree/CASSANDRA-18197-3.11]|[j8|https://app.circleci.com/pipelines/github/driftx/cassandra/821/workflows/2b13ee0b-a523-4d9f-bc58-1bb6a98894be]| |[4.0|https://github.com/driftx/cassandra/tree/CASSANDRA-18197-4.0]|[j8|https://app.circleci.com/pipelines/github/driftx/cassandra/820/workflows/ab7f2d3b-f47d-4c60-80e0-99afd5961c8c], [j11|https://app.circleci.com/pipelines/github/driftx/cassandra/820/workflows/b707fbe5-d245-4bef-af49-191a4a54b201]| |[4.1|https://github.com/driftx/cassandra/tree/CASSANDRA-18197-4.1]|[j8|https://app.circleci.com/pipelines/github/driftx/cassandra/822/workflows/7a76a7eb-0697-4ca8-a4a2-9c3985838c1f], [j11|https://app.circleci.com/pipelines/github/driftx/cassandra/822/workflows/cab41040-0506-460a-8022-ec944e879814]| |[trunk|https://github.com/driftx/cassandra/tree/CASSANDRA-18197-trunk]|[j8|https://app.circleci.com/pipelines/github/driftx/cassandra/823/workflows/3ce42dbc-7b9e-4c85-8211-9c449d0870df], [j11|https://app.circleci.com/pipelines/github/driftx/cassandra/823/workflows/992604c1-3a14-4e64-8ede-10721fc15fbb]| Jenkins for a smoke test: [!https://ci-cassandra.apache.org/job/Cassandra-devbranch/2224/badge/icon!|https://ci-cassandra.apache.org/blue/organizations/jenkins/Cassandra-devbranch/detail/Cassandra-devbranch/2224/pipeline] was (Author: brandon.williams): Patch adds concurrency to the adoc generation, working in batches of 3 (more doesn't really help at least on my macine) and this cuts the run time to around 30s. ||Branch||CI|| |[3.11|https://github.com/driftx/cassandra/tree/CASSANDRA-18197-3.11]|[j8|https://app.circleci.com/pipelines/github/driftx/cassandra/821/workflows/2b13ee0b-a523-4d9f-bc58-1bb6a98894be]| |[4.0|https://github.com/driftx/cassandra/tree/CASSANDRA-18197-4.0]|[j8|https://app.circleci.com/pipelines/github/driftx/cassandra/820/workflows/ab7f2d3b-f47d-4c60-80e0-99afd5961c8c], [j11|https://app.circleci.com/pipelines/github/driftx/cassandra/820/workflows/b707fbe5-d245-4bef-af49-191a4a54b201]| |[4.1|https://github.com/driftx/cassandra/tree/CASSANDRA-18197-4.1]|[j8|https://app.circleci.com/pipelines/github/driftx/cassandra/822/workflows/7a76a7eb-0697-4ca8-a4a2-9c3985838c1f], [j11|https://app.circleci.com/pipelines/github/driftx/cassandra/822/workflows/cab41040-0506-460a-8022-ec944e879814]| |[trunk|https://github.com/driftx/cassandra/tree/CASSANDRA-18197-trunk]|[j8|https://app.circleci.com/pipelines/github/driftx/cassandra/823/workflows/3ce42dbc-7b9e-4c85-8211-9c449d0870df], [j11|https://app.circleci.com/pipelines/github/driftx/cassandra/823/workflows/992604c1-3a14-4e64-8ede-10721fc15fbb]| > Builds being often aborted because of python3 ./scripts/gen-nodetool-docs.py > being slow > --- > > Key: CASSANDRA-18197 > URL: https://issues.apache.org/jira/browse/CASSANDRA-18197 > Project: Cassandra > Issue Type: Bug > Components: Build >Reporter: Ekaterina Dimitrova >Assignee: Brandon Williams >Priority: Normal > Fix For: 3.11.x, 4.0.x, 4.1.x, 4.x > > > As discussed on CASSANDRA-18181, recently we see builds aborted as python3 > ./scripts/gen-nodetool-docs.py is too slow. > According to [~brandon.williams] most of the time in the script is spent in > create_adoc, which is serially forking nodetool help for every command to > gather it. > CC [~Anthony Grasso] -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org For additional commands, e-mail: commits-h...@cassandra.apache.org
