kou commented on PR #36464: URL: https://github.com/apache/arrow/pull/36464#issuecomment-1620868667
It seems that there are still pandas related warnings. Could you check them? https://github.com/ursacomputing/crossbow/actions/runs/5459147218/jobs/9934838239#step:6:6102 ```text =============================== warnings summary =============================== opt/conda/envs/arrow/lib/python3.10/site-packages/pyarrow/tests/test_dataset.py::test_make_fragment /opt/conda/envs/arrow/lib/python3.10/site-packages/numpy/core/fromnumeric.py:59: FutureWarning: 'DataFrame.swapaxes' is deprecated and will be removed in a future version. Please use 'DataFrame.transpose' instead. return bound(*args, **kwds) opt/conda/envs/arrow/lib/python3.10/site-packages/pyarrow/tests/test_dataset.py::test_legacy_write_to_dataset_drops_null /opt/conda/envs/arrow/lib/python3.10/site-packages/pyarrow/parquet/core.py:3471: FutureWarning: The default of observed=False is deprecated and will be changed to True in a future version of pandas. Pass observed=False to retain current behavior or observed=True to adopt the future default and silence this warning. for keys, subgroup in data_df.groupby(partition_keys): opt/conda/envs/arrow/lib/python3.10/site-packages/pyarrow/tests/test_pandas.py::TestConvertMisc::test_category opt/conda/envs/arrow/lib/python3.10/site-packages/pyarrow/tests/test_pandas.py::TestConvertMisc::test_category opt/conda/envs/arrow/lib/python3.10/site-packages/pyarrow/tests/test_pandas.py::TestConvertMisc::test_category /opt/conda/envs/arrow/lib/python3.10/site-packages/pyarrow/tests/test_pandas.py:102: FutureWarning: Mismatched null-like values None and nan found. In a future version, pandas equality-testing functions (e.g. assert_frame_equal) will consider these not-matching and raise. tm.assert_frame_equal(result, expected, check_dtype=check_dtype, opt/conda/envs/arrow/lib/python3.10/site-packages/pyarrow/tests/test_pandas.py::TestConvertMisc::test_category opt/conda/envs/arrow/lib/python3.10/site-packages/pyarrow/tests/test_pandas.py::TestConvertMisc::test_category opt/conda/envs/arrow/lib/python3.10/site-packages/pyarrow/tests/test_pandas.py::TestConvertMisc::test_category /opt/conda/envs/arrow/lib/python3.10/site-packages/pyarrow/tests/test_pandas.py:138: FutureWarning: Mismatched null-like values None and nan found. In a future version, pandas equality-testing functions (e.g. assert_frame_equal) will consider these not-matching and raise. tm.assert_series_equal(pd.Series(result), expected, check_names=False) opt/conda/envs/arrow/lib/python3.10/site-packages/pyarrow/tests/parquet/test_dataset.py::test_read_s3fs[True] /opt/conda/envs/arrow/lib/python3.10/site-packages/_pytest/fixtures.py:902: ResourceWarning: unclosed <socket.socket fd=27, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=6, laddr=('127.0.0.1', 37716), raddr=('127.0.0.1', 36733)> fixture_result = fixturefunc(**kwargs) Enable tracemalloc to get traceback where the object was allocated. See https://docs.pytest.org/en/stable/how-to/capture-warnings.html#resource-warnings for more info. opt/conda/envs/arrow/lib/python3.10/site-packages/pyarrow/tests/parquet/test_dataset.py::test_read_s3fs[False] /opt/conda/envs/arrow/lib/python3.10/site-packages/_pytest/fixtures.py:902: ResourceWarning: unclosed <socket.socket fd=197, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=6, laddr=('127.0.0.1', 37742), raddr=('127.0.0.1', 36733)> fixture_result = fixturefunc(**kwargs) Enable tracemalloc to get traceback where the object was allocated. See https://docs.pytest.org/en/stable/how-to/capture-warnings.html#resource-warnings for more info. opt/conda/envs/arrow/lib/python3.10/site-packages/pyarrow/tests/parquet/test_dataset.py::test_read_directory_s3fs[True] /opt/conda/envs/arrow/lib/python3.10/site-packages/_pytest/fixtures.py:902: ResourceWarning: unclosed <socket.socket fd=197, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=6, laddr=('127.0.0.1', 37748), raddr=('127.0.0.1', 36733)> fixture_result = fixturefunc(**kwargs) Enable tracemalloc to get traceback where the object was allocated. See https://docs.pytest.org/en/stable/how-to/capture-warnings.html#resource-warnings for more info. opt/conda/envs/arrow/lib/python3.10/site-packages/pyarrow/tests/parquet/test_dataset.py::test_read_directory_s3fs[False] /opt/conda/envs/arrow/lib/python3.10/site-packages/_pytest/fixtures.py:902: ResourceWarning: unclosed <socket.socket fd=197, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=6, laddr=('127.0.0.1', 37750), raddr=('127.0.0.1', 36733)> fixture_result = fixturefunc(**kwargs) Enable tracemalloc to get traceback where the object was allocated. See https://docs.pytest.org/en/stable/how-to/capture-warnings.html#resource-warnings for more info. opt/conda/envs/arrow/lib/python3.10/site-packages/pyarrow/tests/parquet/test_dataset.py::test_read_partitioned_directory_s3fs_wrapper[True] /opt/conda/envs/arrow/lib/python3.10/site-packages/_pytest/fixtures.py:902: ResourceWarning: unclosed <socket.socket fd=197, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=6, laddr=('127.0.0.1', 37762), raddr=('127.0.0.1', 36733)> fixture_result = fixturefunc(**kwargs) Enable tracemalloc to get traceback where the object was allocated. See https://docs.pytest.org/en/stable/how-to/capture-warnings.html#resource-warnings for more info. opt/conda/envs/arrow/lib/python3.10/site-packages/pyarrow/tests/parquet/test_dataset.py::test_read_partitioned_directory_s3fs_wrapper[False] /opt/conda/envs/arrow/lib/python3.10/site-packages/_pytest/fixtures.py:902: ResourceWarning: unclosed <socket.socket fd=197, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=6, laddr=('127.0.0.1', 37764), raddr=('127.0.0.1', 36733)> fixture_result = fixturefunc(**kwargs) Enable tracemalloc to get traceback where the object was allocated. See https://docs.pytest.org/en/stable/how-to/capture-warnings.html#resource-warnings for more info. opt/conda/envs/arrow/lib/python3.10/site-packages/pyarrow/tests/parquet/test_dataset.py::test_read_partitioned_directory_s3fs[True] /opt/conda/envs/arrow/lib/python3.10/site-packages/_pytest/fixtures.py:902: ResourceWarning: unclosed <socket.socket fd=197, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=6, laddr=('127.0.0.1', 37776), raddr=('127.0.0.1', 36733)> fixture_result = fixturefunc(**kwargs) Enable tracemalloc to get traceback where the object was allocated. See https://docs.pytest.org/en/stable/how-to/capture-warnings.html#resource-warnings for more info. opt/conda/envs/arrow/lib/python3.10/site-packages/pyarrow/tests/parquet/test_dataset.py::test_read_partitioned_directory_s3fs[False] /opt/conda/envs/arrow/lib/python3.10/site-packages/_pytest/fixtures.py:902: ResourceWarning: unclosed <socket.socket fd=197, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=6, laddr=('127.0.0.1', 40896), raddr=('127.0.0.1', 36733)> fixture_result = fixturefunc(**kwargs) Enable tracemalloc to get traceback where the object was allocated. See https://docs.pytest.org/en/stable/how-to/capture-warnings.html#resource-warnings for more info. opt/conda/envs/arrow/lib/python3.10/site-packages/pyarrow/tests/parquet/test_dataset.py::test_write_to_dataset_pathlib_nonlocal[True] /opt/conda/envs/arrow/lib/python3.10/site-packages/_pytest/fixtures.py:902: ResourceWarning: unclosed <socket.socket fd=197, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=6, laddr=('127.0.0.1', 40906), raddr=('127.0.0.1', 36733)> fixture_result = fixturefunc(**kwargs) Enable tracemalloc to get traceback where the object was allocated. See https://docs.pytest.org/en/stable/how-to/capture-warnings.html#resource-warnings for more info. opt/conda/envs/arrow/lib/python3.10/site-packages/pyarrow/tests/parquet/test_dataset.py::test_write_to_dataset_pathlib_nonlocal[False] /opt/conda/envs/arrow/lib/python3.10/site-packages/_pytest/fixtures.py:902: ResourceWarning: unclosed <socket.socket fd=197, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=6, laddr=('127.0.0.1', 40916), raddr=('127.0.0.1', 36733)> fixture_result = fixturefunc(**kwargs) Enable tracemalloc to get traceback where the object was allocated. See https://docs.pytest.org/en/stable/how-to/capture-warnings.html#resource-warnings for more info. opt/conda/envs/arrow/lib/python3.10/site-packages/pyarrow/tests/parquet/test_dataset.py::test_write_to_dataset_with_partitions_s3fs[True] /opt/conda/envs/arrow/lib/python3.10/site-packages/_pytest/fixtures.py:902: ResourceWarning: unclosed <socket.socket fd=197, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=6, laddr=('127.0.0.1', 40930), raddr=('127.0.0.1', 36733)> fixture_result = fixturefunc(**kwargs) Enable tracemalloc to get traceback where the object was allocated. See https://docs.pytest.org/en/stable/how-to/capture-warnings.html#resource-warnings for more info. opt/conda/envs/arrow/lib/python3.10/site-packages/pyarrow/tests/parquet/test_dataset.py::test_write_to_dataset_with_partitions_s3fs[False] /opt/conda/envs/arrow/lib/python3.10/site-packages/_pytest/fixtures.py:902: ResourceWarning: unclosed <socket.socket fd=197, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=6, laddr=('127.0.0.1', 40936), raddr=('127.0.0.1', 36733)> fixture_result = fixturefunc(**kwargs) Enable tracemalloc to get traceback where the object was allocated. See https://docs.pytest.org/en/stable/how-to/capture-warnings.html#resource-warnings for more info. opt/conda/envs/arrow/lib/python3.10/site-packages/pyarrow/tests/parquet/test_dataset.py::test_write_to_dataset_no_partitions_s3fs[True] /opt/conda/envs/arrow/lib/python3.10/site-packages/_pytest/fixtures.py:902: ResourceWarning: unclosed <socket.socket fd=204, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=6, laddr=('127.0.0.1', 40966), raddr=('127.0.0.1', 36733)> fixture_result = fixturefunc(**kwargs) Enable tracemalloc to get traceback where the object was allocated. See https://docs.pytest.org/en/stable/how-to/capture-warnings.html#resource-warnings for more info. opt/conda/envs/arrow/lib/python3.10/site-packages/pyarrow/tests/parquet/test_dataset.py::test_write_to_dataset_no_partitions_s3fs[False] /opt/conda/envs/arrow/lib/python3.10/site-packages/_pytest/fixtures.py:902: ResourceWarning: unclosed <socket.socket fd=204, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=6, laddr=('127.0.0.1', 40970), raddr=('127.0.0.1', 36733)> fixture_result = fixturefunc(**kwargs) Enable tracemalloc to get traceback where the object was allocated. See https://docs.pytest.org/en/stable/how-to/capture-warnings.html#resource-warnings for more info. opt/conda/envs/arrow/lib/python3.10/site-packages/pyarrow/tests/parquet/test_metadata.py::test_write_metadata_fs_file_combinations /opt/conda/envs/arrow/lib/python3.10/site-packages/_pytest/fixtures.py:902: ResourceWarning: unclosed <socket.socket fd=204, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=6, laddr=('127.0.0.1', 38198), raddr=('127.0.0.1', 36733)> fixture_result = fixturefunc(**kwargs) Enable tracemalloc to get traceback where the object was allocated. See https://docs.pytest.org/en/stable/how-to/capture-warnings.html#resource-warnings for more info. opt/conda/envs/arrow/lib/python3.10/site-packages/pyarrow/tests/parquet/test_parquet_writer.py::test_parquet_writer_filesystem_s3fs /opt/conda/envs/arrow/lib/python3.10/site-packages/_pytest/fixtures.py:902: ResourceWarning: unclosed <socket.socket fd=204, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=6, laddr=('127.0.0.1', 45602), raddr=('127.0.0.1', 36733)> fixture_result = fixturefunc(**kwargs) Enable tracemalloc to get traceback where the object was allocated. See https://docs.pytest.org/en/stable/how-to/capture-warnings.html#resource-warnings for more info. -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
