mohamedawnallah commented on PR #35216:
URL: https://github.com/apache/beam/pull/35216#issuecomment-2983590723

   So currently, test cases fail on the following platforms in 
(https://github.com/apache/beam/blob/master/.github/workflows/python_tests.yml) 
due to using `MilvusContainer` in 
`sdks/python/apache_beam/ml/rag/enrichment/milvus_search_it_test.py` that 
requires docker container runtime to be available:
   
   - `macos-latest`
   - `windows-latest`
   
   The failures are due to a lack of support for **nested virtualization** on 
these GitHub-hosted runners.
   
   I have attempted several workarounds, but most of them result in unreliable 
behavior. It's possible I missed something. For example, I tried using:
   
   - https://github.com/abiosoft/colima
   - https://github.com/docker/setup-docker-action
   
   I have also run those test cases on `ubuntu-latest` and it worked fine.
   
   ## How can this be resolved?
   
   There are few solutions as far as I can think of:
   1. Having accessible milvus db container that can be used during tests (may 
be longterm?)
   2. Running only those test cases that requires docker runtime on linux 
platform by using for example `@unittest.skipUnless(platform.system() == 
"Linux", "Test runs only on Linux/Ubuntu")` and also add `ubuntu-latest` in the 
platforms in this job (may not be the cleanest solution but almost feasible)
   
   ## References
   
   1. **Support container operations on Windows runners**  
      GitHub Actions currently does not support container operations on Windows 
runners:  
      https://github.com/actions/runner/issues/904
   
   4. **Nested virtualization on Apple silicon (M3)**  
      Nested virtualization is not yet supported or integrated in GitHub 
runners for M3/macOS-15:  
      
https://developer.apple.com/documentation/virtualization/vzgenericplatformconfiguration/isnestedvirtualizationsupported
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscr...@beam.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

Reply via email to