llama90 opened a new issue, #41312:
URL: https://github.com/apache/arrow/issues/41312
### Describe the bug, including details regarding any error messages,
version, and platform.
I've received the latest code and encountered an error while running the
Python unit tests.
<details><summary>error message</summary>
```
python -m pytest pyarrow/tests/test_dataset.py
============================================================================================================
test session starts
=============================================================================================================
platform darwin -- Python 3.10.13, pytest-7.4.4, pluggy-1.4.0
rootdir: /Users/lama/workspace/arrow-new/python
configfile: setup.cfg
plugins: hypothesis-6.99.9
collected 351 items
pyarrow/tests/test_dataset.py
...............................................................................................................s........................................................................................
[ 56%]
...........ssssss....................ssss.s.................................................................................ss........................Fatal
Python error: Segmentation fault
Current thread 0x000000020330bac0 (most recent call first):
File
"/Users/lama/workspace/arrow-new/python/pyarrow/tests/test_dataset.py", line
5645 in test_make_write_options_error
File
"/Users/lama/anaconda3/envs/pyarrow-dev-310/lib/python3.10/site-packages/_pytest/python.py",
line 194 in pytest_pyfunc_call
File
"/Users/lama/anaconda3/envs/pyarrow-dev-310/lib/python3.10/site-packages/pluggy/_callers.py",
line 102 in _multicall
File
"/Users/lama/anaconda3/envs/pyarrow-dev-310/lib/python3.10/site-packages/pluggy/_manager.py",
line 119 in _hookexec
File
"/Users/lama/anaconda3/envs/pyarrow-dev-310/lib/python3.10/site-packages/pluggy/_hooks.py",
line 501 in __call__
File
"/Users/lama/anaconda3/envs/pyarrow-dev-310/lib/python3.10/site-packages/_pytest/python.py",
line 1792 in runtest
File
"/Users/lama/anaconda3/envs/pyarrow-dev-310/lib/python3.10/site-packages/_pytest/runner.py",
line 169 in pytest_runtest_call
File
"/Users/lama/anaconda3/envs/pyarrow-dev-310/lib/python3.10/site-packages/pluggy/_callers.py",
line 102 in _multicall
File
"/Users/lama/anaconda3/envs/pyarrow-dev-310/lib/python3.10/site-packages/pluggy/_manager.py",
line 119 in _hookexec
File
"/Users/lama/anaconda3/envs/pyarrow-dev-310/lib/python3.10/site-packages/pluggy/_hooks.py",
line 501 in __call__
File
"/Users/lama/anaconda3/envs/pyarrow-dev-310/lib/python3.10/site-packages/_pytest/runner.py",
line 262 in <lambda>
File
"/Users/lama/anaconda3/envs/pyarrow-dev-310/lib/python3.10/site-packages/_pytest/runner.py",
line 341 in from_call
File
"/Users/lama/anaconda3/envs/pyarrow-dev-310/lib/python3.10/site-packages/_pytest/runner.py",
line 261 in call_runtest_hook
File
"/Users/lama/anaconda3/envs/pyarrow-dev-310/lib/python3.10/site-packages/_pytest/runner.py",
line 222 in call_and_report
File
"/Users/lama/anaconda3/envs/pyarrow-dev-310/lib/python3.10/site-packages/_pytest/runner.py",
line 133 in runtestprotocol
File
"/Users/lama/anaconda3/envs/pyarrow-dev-310/lib/python3.10/site-packages/_pytest/runner.py",
line 114 in pytest_runtest_protocol
File
"/Users/lama/anaconda3/envs/pyarrow-dev-310/lib/python3.10/site-packages/pluggy/_callers.py",
line 102 in _multicall
File
"/Users/lama/anaconda3/envs/pyarrow-dev-310/lib/python3.10/site-packages/pluggy/_manager.py",
line 119 in _hookexec
File
"/Users/lama/anaconda3/envs/pyarrow-dev-310/lib/python3.10/site-packages/pluggy/_hooks.py",
line 501 in __call__
File
"/Users/lama/anaconda3/envs/pyarrow-dev-310/lib/python3.10/site-packages/_pytest/main.py",
line 350 in pytest_runtestloop
File
"/Users/lama/anaconda3/envs/pyarrow-dev-310/lib/python3.10/site-packages/pluggy/_callers.py",
line 102 in _multicall
File
"/Users/lama/anaconda3/envs/pyarrow-dev-310/lib/python3.10/site-packages/pluggy/_manager.py",
line 119 in _hookexec
File
"/Users/lama/anaconda3/envs/pyarrow-dev-310/lib/python3.10/site-packages/pluggy/_hooks.py",
line 501 in __call__
File
"/Users/lama/anaconda3/envs/pyarrow-dev-310/lib/python3.10/site-packages/_pytest/main.py",
line 325 in _main
File
"/Users/lama/anaconda3/envs/pyarrow-dev-310/lib/python3.10/site-packages/_pytest/main.py",
line 271 in wrap_session
File
"/Users/lama/anaconda3/envs/pyarrow-dev-310/lib/python3.10/site-packages/_pytest/main.py",
line 318 in pytest_cmdline_main
File
"/Users/lama/anaconda3/envs/pyarrow-dev-310/lib/python3.10/site-packages/pluggy/_callers.py",
line 102 in _multicall
File
"/Users/lama/anaconda3/envs/pyarrow-dev-310/lib/python3.10/site-packages/pluggy/_manager.py",
line 119 in _hookexec
File
"/Users/lama/anaconda3/envs/pyarrow-dev-310/lib/python3.10/site-packages/pluggy/_hooks.py",
line 501 in __call__
File
"/Users/lama/anaconda3/envs/pyarrow-dev-310/lib/python3.10/site-packages/_pytest/config/__init__.py",
line 169 in main
File
"/Users/lama/anaconda3/envs/pyarrow-dev-310/lib/python3.10/site-packages/_pytest/config/__init__.py",
line 192 in console_main
File
"/Users/lama/anaconda3/envs/pyarrow-dev-310/lib/python3.10/site-packages/pytest/__main__.py",
line 5 in <module>
File "/Users/lama/anaconda3/envs/pyarrow-dev-310/lib/python3.10/runpy.py",
line 86 in _run_code
File "/Users/lama/anaconda3/envs/pyarrow-dev-310/lib/python3.10/runpy.py",
line 196 in _run_module_as_main
Extension modules: numpy.core._multiarray_umath,
numpy.core._multiarray_tests, numpy.linalg._umath_linalg,
numpy.fft._pocketfft_internal, numpy.random._common,
numpy.random.bit_generator, numpy.random._bounded_integers,
numpy.random._mt19937, numpy.random.mtrand, numpy.random._philox,
numpy.random._pcg64, numpy.random._sfc64, numpy.random._generator, pyarrow.lib,
pyarrow._fs, cython.cimports.libc.math, pyarrow._compute, pyarrow._acero,
pyarrow._csv, pyarrow._json, pandas._libs.tslibs.ccalendar,
pandas._libs.tslibs.np_datetime, pandas._libs.tslibs.dtypes,
pandas._libs.tslibs.base, pandas._libs.tslibs.nattype,
pandas._libs.tslibs.timezones, pandas._libs.tslibs.fields,
pandas._libs.tslibs.timedeltas, pandas._libs.tslibs.tzconversion,
pandas._libs.tslibs.timestamps, pandas._libs.properties,
pandas._libs.tslibs.offsets, pandas._libs.tslibs.strptime,
pandas._libs.tslibs.parsing, pandas._libs.tslibs.conversion,
pandas._libs.tslibs.period, pandas._libs.tslibs.vectorized, pandas._libs.ops_
dispatch, pandas._libs.missing, pandas._libs.hashtable, pandas._libs.algos,
pandas._libs.interval, pandas._libs.lib, pandas._libs.ops,
pandas._libs.hashing, pandas._libs.arrays, pandas._libs.tslib,
pandas._libs.sparse, pandas._libs.internals, pandas._libs.indexing,
pandas._libs.index, pandas._libs.writers, pandas._libs.join,
pandas._libs.window.aggregations, pandas._libs.window.indexers,
pandas._libs.reshape, pandas._libs.groupby, pandas._libs.json,
pandas._libs.parsers, pandas._libs.testing, pyarrow._dataset, pyarrow._parquet,
pyarrow._dataset_parquet, pyarrow._feather (total: 64)
[1] 41728 segmentation fault python -m pytest
pyarrow/tests/test_dataset.py
```
</details>
There was an error in `test_dataset.py`, so I checked whether the submodule
was up to date.
```bash
git submodule status
74278bc4a1122d74945969e6dec405abd1533ec3 ../cpp/submodules/parquet-testing
(heads/master)
735ae7128d571398dd798d7ff004adebeb342883 ../testing (remotes/origin/HEAD)
```
Upon further inspection, it turns out that the error occurs in the tests for
the `test_make_write_options_error` function.
<details><summary>run test without test_make_write_options_error</summary>
```bash
python -m pytest pyarrow/tests/test_dataset.py -k "not
test_make_write_options_error"
============================================================================================================
test session starts
=============================================================================================================
platform darwin -- Python 3.10.13, pytest-7.4.4, pluggy-1.4.0
rootdir: /Users/lama/workspace/arrow-new/python
configfile: setup.cfg
plugins: hypothesis-6.99.9
collected 351 items / 1 deselected / 350 selected
pyarrow/tests/test_dataset.py
...............................................................................................................s........................................................................................
[ 57%]
...........ssssss....................ssss.s.................................................................................ss........................
[100%]
===============================================================================================
336 passed, 14 skipped, 1 deselected in 17.20s
===============================================================================================
```
</details>
If I exclude that test, all other tests pass successfully.
I use an M1 Macbook.
### Component(s)
Python
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
