potiuk commented on issue #10388:
URL: https://github.com/apache/airflow/issues/10388#issuecomment-679913304


   > @mik-laj Yes, the development version fixes the issue with the `airflow` 
command, at least. But, I cannot start the scheduler due to the aforementioned 
issues.
   > 
   > @potiuk Are you sure there are no fork-like mechanisms for windows? I 
would really like to get this working at least using Local/SequentialExecutor.
   
   There are different mechanisms - here is the whole discussion about it: 
https://docs.python.org/3/library/subprocess.html#popen-constructor - but they 
work differently and Airflow relies on some of the properties of Popen and 
passing opened file handlers (for example to opened log files). I think there 
are also a number of other dependencies and possibly hard-coded UNIX path "/" 
across the code, also Windows is not POSIX-compliant, and I think there are 
many places where we rely on some tools or binaries which are part of POSIX 
standard.
   
   I am not saying it's impossible, I just think it's quite an effort and 
unless you make all the tests pass on windows we can't even start thinking 
about it.  You can start with forking Airflow and trying to make the test work 
on Windows. Github Actions support Windows runners, so this should be easy to 
enable.
   
   We are heavily relying on Bash scripts for executing the tests and building 
Docker Images - and all our tests are run in Ubuntu docker image - however if 
you want to run it on Windows, it has to be done differently and likey not 
using Docker images - simply creating a virtualenv and installing everything.
   
   Maybe you can find others who have time and would like to take a look at 
that together with you ? Simply start a discussion on our devlist and ask for 
help. I am afraid at this stage for the community, the fact that it works for 
WSL2 for Windows users is quite enough.
   
   I know there were some changes implemented by @evgenyshulman from DataBand 
to make Airlfow work in a very limited way on Windows - so maybe rather than 
run a full set of tests on Windows, just getting a very simple support for 
Local Executor is possible ? Still Starting from a GitHub actions step 
installing Airflow on Windows is a good start, we cannot accept the code that 
is not tested, so being able to test it automatically is a prerequisite. 
   
   Happy to review any changes if you come up with tests running on Windows :).
   
   
   
   
   
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[email protected]


Reply via email to