[
https://issues.apache.org/jira/browse/ARROW-1880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16345903#comment-16345903
]
Wes McKinney commented on ARROW-1880:
-------------------------------------
I was able to get this error locally
{code}
$ py.test pyarrow/tests/test_plasma.py --pdb -v
==================================================== test session starts
=====================================================
platform linux -- Python 3.5.2, pytest-3.0.6, py-1.4.31, pluggy-0.4.0 --
/home/wesm/anaconda3/envs/arrow-test/bin/python
cachedir: .cache
rootdir: /home/wesm/code/arrow/python, inifile: setup.cfg
collected 20 items
pyarrow/tests/test_plasma.py::TestPlasmaClient::test_connection_failure_raises_exception
PASSED
pyarrow/tests/test_plasma.py::TestPlasmaClient::test_create PASSED
pyarrow/tests/test_plasma.py::TestPlasmaClient::test_create_with_metadata PASSED
pyarrow/tests/test_plasma.py::TestPlasmaClient::test_create_existing PASSED
pyarrow/tests/test_plasma.py::TestPlasmaClient::test_get PASSED
pyarrow/tests/test_plasma.py::TestPlasmaClient::test_put_and_get PASSED
pyarrow/tests/test_plasma.py::TestPlasmaClient::test_put_and_get_serialization_context
PASSED
pyarrow/tests/test_plasma.py::TestPlasmaClient::test_store_arrow_objects PASSED
pyarrow/tests/test_plasma.py::TestPlasmaClient::test_store_pandas_dataframe
PASSED
pyarrow/tests/test_plasma.py::TestPlasmaClient::test_pickle_object_ids PASSED
pyarrow/tests/test_plasma.py::TestPlasmaClient::test_store_full PASSED
pyarrow/tests/test_plasma.py::TestPlasmaClient::test_contains PASSED
pyarrow/tests/test_plasma.py::TestPlasmaClient::test_hash PASSED
pyarrow/tests/test_plasma.py::TestPlasmaClient::test_many_hashes PASSED
pyarrow/tests/test_plasma.py::TestPlasmaClient::test_illegal_functionality
PASSED
pyarrow/tests/test_plasma.py::TestPlasmaClient::test_evict PASSED
pyarrow/tests/test_plasma.py::TestPlasmaClient::test_subscribe PASSED
pyarrow/tests/test_plasma.py::TestPlasmaClient::test_subscribe_deletions PASSED
pyarrow/tests/test_plasma.py::TestPlasmaClient::test_use_one_memory_mapped_file
ERROR
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> traceback
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
self = <pyarrow.tests.test_plasma.TestPlasmaClient object at 0x7f7763c66400>
test_method = <bound method TestPlasmaClient.test_use_one_memory_mapped_file of
<pyarrow.tests.test_plasma.TestPlasmaClient object at 0x7f7763c66400>>
def setup_method(self, test_method):
use_one_memory_mapped_file = (test_method ==
self.test_use_one_memory_mapped_file)
import pyarrow.plasma as plasma
# Start Plasma store.
plasma_store_name, self.p = start_plasma_store(
use_valgrind=os.getenv("PLASMA_VALGRIND") == "1",
use_one_memory_mapped_file=use_one_memory_mapped_file)
# Connect to Plasma.
> self.plasma_client = plasma.connect(plasma_store_name, "", 64)
pyarrow/tests/test_plasma.py:166:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
pyarrow/plasma.pyx:678: in pyarrow.plasma.connect
(/home/wesm/code/arrow/python/build/temp.linux-x86_64-3.5/plasma.cxx:8311)
check_status(result.client.get()
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
> raise ArrowIOError(message)
E pyarrow.lib.ArrowIOError: ../src/plasma/client.cc:600 code:
ConnectIpcSocketRetry(store_socket_name, num_retries, -1, &store_conn_)
E Could not connect to socket /tmp/plasma_store42362948
pyarrow/error.pxi:79: ArrowIOError
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> entering PDB
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
> /home/wesm/code/arrow/python/pyarrow/error.pxi(79)pyarrow.lib.check_status
> (/home/wesm/code/arrow/python/build/temp.linux-x86_64-3.5/lib.cxx:8373)()
-> raise ArrowIOError(message)
(Pdb)
{code}
Starting the Plasma store fails with
{code}
(Pdb) plasma_store_name, self.p =
start_plasma_store(use_valgrind=os.getenv("PLASMA_VALGRIND") ==
"1",use_one_memory_mapped_file=use_one_memory_mapped_file)
Allowing the Plasma store to use up to 0.536871GB of memory.
Starting object store with directory /dev/shm and huge page support disabled
../src/plasma/store.cc:744 Check failed: pointer != NULL
{code}
This happened when I tried reducing the amount of memory available to the
Plasma store by default in 512MB
> [Python] Plasma test flakiness in Travis CI
> -------------------------------------------
>
> Key: ARROW-1880
> URL: https://issues.apache.org/jira/browse/ARROW-1880
> Project: Apache Arrow
> Issue Type: Bug
> Components: Python
> Reporter: Wes McKinney
> Priority: Major
>
> We've been seeing intermittent flakiness of the variety:
> {code}
> ==================================== ERRORS
> ====================================
> ______ ERROR at setup of TestPlasmaClient.test_use_one_memory_mapped_file
> ______
> self = <pyarrow.tests.test_plasma.TestPlasmaClient object at 0x7fb85e67d668>
> test_method = <bound method TestPlasmaClient.test_use_one_memory_mapped_file
> of <pyarrow.tests.test_plasma.TestPlasmaClient object at 0x7fb85e67d668>>
> [1m def setup_method(self, test_method):[0m
> [1m use_one_memory_mapped_file = (test_method ==[0m
> [1m
> self.test_use_one_memory_mapped_file)[0m
> [1m [0m
> [1m import pyarrow.plasma as plasma[0m
> [1m # Start Plasma store.[0m
> [1m plasma_store_name, self.p = start_plasma_store([0m
> [1m use_valgrind=os.getenv("PLASMA_VALGRIND") == "1",[0m
> [1m use_one_memory_mapped_file=use_one_memory_mapped_file)[0m
> [1m # Connect to Plasma.[0m
> [1m> self.plasma_client = plasma.connect(plasma_store_name, "", 64)[0m
> [1m[31mpyarrow-test-3.6/lib/python3.6/site-packages/pyarrow/tests/test_plasma.py[0m:164:
>
> _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
> _
> [1m[31mplasma.pyx[0m:672: in pyarrow.plasma.connect
> [1m ???[0m
> _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
> _
> [1m> ???[0m
> [1m[31mE pyarrow.lib.ArrowIOError: Could not connect to socket
> /tmp/plasma_store43998835[0m
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
