daviskirk opened a new issue, #5263:
URL: https://github.com/apache/arrow-rs/issues/5263

   
   **Which part is this question about**
   object_store, gcs interface
   
   **Describe your question**
   
   Does object_store support the STORAGE_EMULATOR_HOST environment variable for 
google cloud (or any other way of setting the google cloud endpoint for 
emulation support)?
   
   **Additional context**
   
   I am using object_store within the polars library and would like to use the 
google cloud storage emulator endpoint so that I can run tests on our code.
   
   I am using fake-gcs-server for testing applications that use gcs and 
utilizing https://github.com/fsouza/fake-gcs-server. However, I can't find a 
way to use it with object_store.
   I was previously using pythons fsspec 
(https://filesystem-spec.readthedocs.io/en/latest/) and the gcs client directly 
which support this. Now that polars is using object_store exclusively as it's 
cloud access layer this is no longer possible.
   
   Is there any recommended solution for this? Or is this just missing 
functionality in object_store?
   
   The previous workflow is to run:
   
   docker run -d --name fake-gcs-server -p 127.0.0.1:9090:9090 -v 
${PWD}/examples/data:/data fsouza/fake-gcs-server -scheme http -port 9090 
-external-url http://127.0.0.1:9090
   
   and then either set the environment variable STORAGE_EMULATOR_HOST or just 
configure the python fsspec client to use this emulator url.
   
   Here is the related polars issue where it was suggested I come here: 
https://github.com/pola-rs/polars/issues/13085#issue-2045150511
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to