mauropagano commented on issue #34118: URL: https://github.com/apache/arrow/issues/34118#issuecomment-1690528581
I do have the same identical behavior of @austinzh from plain python (3.9.6), confirmed using 13.0 too ``` ARROW_IO_THREADS=1 OMP_NUM_THREADS=1 poetry run python Python 3.9.6 (default, Jul 27 2021, 22:14:48) [GCC 9.1.0] on linux Type "help", "copyright", "credits" or "license" for more information. >>> from pyarrow._s3fs import initialize_s3 >>> initialize_s3(num_event_loop_threads=1) >>> import pyarrow as pa >>> import os >>> os.getpid() 15589 ps -eT -o "ppid,pid,tid,comm" | grep 15589 30694 15589 15589 python 30694 15589 15623 jemalloc_bg_thd 30694 15589 15624 AwsEventLoop 1 30694 15589 15625 AwsEventLoop 2 30694 15589 15626 AwsEventLoop 3 30694 15589 15627 AwsEventLoop 4 30694 15589 15628 AwsEventLoop 5 30694 15589 15629 AwsEventLoop 6 30694 15589 15630 AwsEventLoop 7 30694 15589 15631 AwsEventLoop 8 30694 15589 15632 AwsEventLoop 9 30694 15589 15633 AwsEventLoop 10 30694 15589 15634 AwsEventLoop 11 30694 15589 15635 AwsEventLoop 12 30694 15589 15636 AwsEventLoop 13 30694 15589 15637 AwsEventLoop 14 30694 15589 15638 AwsEventLoop 15 30694 15589 15639 AwsEventLoop 16 ``` One of the annoying things is this is triggered by also just importing `pyarrow.parquet`, not matter if reading from S3 or not -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
