potiuk commented on issue #4938: [AIRFLOW-4117] Multi-staging Image - Travis CI 
tests [Step 3/3]
URL: https://github.com/apache/airflow/pull/4938#issuecomment-478016580
 
 
   @fokko @ashb -> I pushed the latest version with pretty much all comments 
applied (except setup.py).
   
   There is one change that might require longer discussion/argumentation.
   
   I had to change the ci image to use root rather than "airflow" user - so the 
Dockerfile is now configurable (main airflow image uses "airflow" user and "CI" 
image user root user. 
   
   This was needed in order to replicate CI environment on Linux. I tested it 
now extensively on Linux and the main problem was that when you tried to map 
local source folder to the container, you could not easily map it as "airflow" 
user and the folders are not accesible to airflow user.
   
   This is a known Docker problem (there is an open issue for that 
https://github.com/moby/moby/issues/2259 ). I looked at possible workaround, 
but it turns out, until this issue is solved, it's easiest if airflow is run as 
root (then everything is root-owned inside the container).
   
   This problem does not occur on Mac because on Mac local volumes are mounted 
to virtual machine using user-space synchronising filesystem via virtual 
machine (which makes it much slower on one hand, but it allows to carry the 
user mapping with the bind volume). But if someone develops on Linux that could 
be a huge blocker for convenient development environment. 
   
   I hope this is something that you will be able to leave with :)
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


With regards,
Apache Git Services

Reply via email to