mik-laj edited a comment on issue #6045: [AIRFLOW-5433] Add script to check external links in docs URL: https://github.com/apache/airflow/pull/6045#issuecomment-529129343 > Plus. You can very easily parallelise it using xargs -p. This script mostly waits from answer from an external sites, so just running it in parallell with like 16 processes or so should make it much, much faster. @potiuk I tried to do it, but the task is a little more difficult if the check process is not a program, but a function and we need to check the exit code and build arrays depending on it. I can do it, but the task is a little more difficult if the check process is not a program, but a function and we need to check the exit code and build arrays depending on it. I can do it, but I don't think it's worth it to optimize, because I don't think that this script is still sufficiently stable. I mainly did it for the site, where the links will be less and it will be easier to maintain stability. This is part of the SOW.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
