(iceberg-python) branch main updated: dev: add `pyarrow` to Dockerfile to suppress error (#2174)

[fokko]

This is an automated email from the ASF dual-hosted git repository.

fokko pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/iceberg-python.git


The following commit(s) were added to refs/heads/main by this push:
     new fa714985 dev: add `pyarrow` to Dockerfile to suppress error (#2174)
fa714985 is described below

commit fa714985ade6b8e619d436706c86cb73fab9cb66
Author: Kevin Liu <kevinjq...@users.noreply.github.com>
AuthorDate: Mon Jul 7 23:53:58 2025 -0700

    dev: add `pyarrow` to Dockerfile to suppress error (#2174)
    
    <!--
    Thanks for opening a pull request!
    -->
    
    <!-- In the case this PR will resolve an issue, please replace
    ${GITHUB_ISSUE_ID} below with the actual Github issue id. -->
    <!-- Closes #${GITHUB_ISSUE_ID} -->
    
    # Rationale for this change
    Adding `pyiceberg["pyarrow"]` dep to the Dockefile resolves these
    warning log lines:
    ```
    Could not initialize FileIO: pyiceberg.io.pyarrow.PyArrowFileIO
    Traceback (most recent call last):
      File "/usr/local/lib/python3.9/site-packages/pyiceberg/io/__init__.py", 
line 317, in _import_file_io
        module = importlib.import_module(module_name)
      File "/usr/local/lib/python3.9/importlib/__init__.py", line 127, in 
import_module
        return _bootstrap._gcd_import(name[level:], package, level)
      File "<frozen importlib._bootstrap>", line 1030, in _gcd_import
      File "<frozen importlib._bootstrap>", line 1007, in _find_and_load
      File "<frozen importlib._bootstrap>", line 986, in _find_and_load_unlocked
      File "<frozen importlib._bootstrap>", line 680, in _load_unlocked
      File "<frozen importlib._bootstrap_external>", line 850, in exec_module
      File "<frozen importlib._bootstrap>", line 228, in 
_call_with_frames_removed
      File "/usr/local/lib/python3.9/site-packages/pyiceberg/io/pyarrow.py", 
line 62, in <module>
        import pyarrow as pa
    ModuleNotFoundError: No module named 'pyarrow'
    ```
    
    I also took the liberty to upgrade the Dockerfile python version from
    3.9 to 3.12
    
    # Are these changes tested?
    
    # Are there any user-facing changes?
    
    <!-- In the case of user-facing changes, please add the changelog label.
    -->
---
 dev/Dockerfile | 4 ++--
 1 file changed, 2 insertions(+), 2 deletions(-)

diff --git a/dev/Dockerfile b/dev/Dockerfile
index c6ce71b2..5292e264 100644
--- a/dev/Dockerfile
+++ b/dev/Dockerfile
@@ -13,7 +13,7 @@
 # See the License for the specific language governing permissions and
 # limitations under the License.
 
-FROM python:3.9-bullseye
+FROM python:3.12-bullseye
 
 RUN apt-get -qq update && \
     apt-get -qq install -y --no-install-recommends \
@@ -63,7 +63,7 @@ RUN chmod u+x /opt/spark/sbin/* && \
 
 RUN pip3 install -q ipython
 
-RUN pip3 install "pyiceberg[s3fs,hive]==${PYICEBERG_VERSION}"
+RUN pip3 install "pyiceberg[s3fs,hive,pyarrow]==${PYICEBERG_VERSION}"
 
 COPY entrypoint.sh .
 COPY provision.py .