[ 
https://issues.apache.org/jira/browse/ARROW-1338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16117805#comment-16117805
 ] 

Wes McKinney commented on ARROW-1338:
-------------------------------------

I've got a valgrind warning for this on Linux, for some reason this has not 
been causing segfaults there, though:

{code}
pyarrow/tests/test_io.py::test_mock_output_stream ==11767== Invalid write of 
size 2
==11767==    at 0x4C2E0EB: memcpy@@GLIBC_2.14 (vg_replace_strmem.c:1018)
==11767==    by 0xC1CDCBF: arrow::io::BufferOutputStream::Write(unsigned char 
const*, long) (memory.cc:86)
==11767==    by 0xC24FD99: 
arrow::ipc::RecordBatchStreamWriter::RecordBatchStreamWriterImpl::Write(unsigned
 char const*, long) (writer.cc:716)
==11767==    by 0xC24F4A4: 
arrow::ipc::RecordBatchStreamWriter::RecordBatchStreamWriterImpl::Close() 
(writer.cc:645)
==11767==    by 0xC24BCC7: arrow::ipc::RecordBatchStreamWriter::Close() 
(writer.cc:763)
==11767==    by 0xBCD11F4: 
__pyx_pf_7pyarrow_3lib_18_RecordBatchWriter_8close(__pyx_obj_7pyarrow_3lib__RecordBatchWriter*)
 (lib.cxx:56013)
==11767==    by 0xBCD11A6: 
__pyx_pw_7pyarrow_3lib_18_RecordBatchWriter_9close(_object*, _object*) 
(lib.cxx:55979)
==11767==    by 0xBD10DEC: __Pyx_PyObject_CallMethO(_object*, _object*) 
(lib.cxx:79953)
==11767==    by 0xBD12220: __Pyx_PyObject_CallNoArg(_object*) (lib.cxx:80473)
==11767==    by 0xBCD07F0: 
__pyx_pf_7pyarrow_3lib_18_RecordBatchWriter_2__dealloc__(__pyx_obj_7pyarrow_3lib__RecordBatchWriter*)
 (lib.cxx:55651)
==11767==    by 0xBCD05D7: 
__pyx_pw_7pyarrow_3lib_18_RecordBatchWriter_3__dealloc__(_object*) 
(lib.cxx:55604)
==11767==    by 0xBCE668B: 
__pyx_tp_dealloc_7pyarrow_3lib__RecordBatchWriter(_object*) (lib.cxx:70981)
==11767==  Address 0xd44a740 is 0 bytes after a block of size 832 alloc'd
==11767==    at 0x4C2BB84: memalign (vg_replace_malloc.c:857)
==11767==    by 0x4C2BC4C: posix_memalign (vg_replace_malloc.c:1020)
==11767==    by 0xC18EEB8: arrow::(anonymous namespace)::AllocateAligned(long, 
unsigned char**) (memory_pool.cc:64)
==11767==    by 0xC18F31D: arrow::DefaultMemoryPool::Reallocate(long, long, 
unsigned char**) (memory_pool.cc:115)
==11767==    by 0xC13E4A4: arrow::PoolBuffer::Resize(long, bool) (buffer.cc:105)
==11767==    by 0xC1CDA01: arrow::io::BufferOutputStream::Close() (memory.cc:65)
==11767==    by 0xBCB1361: 
__pyx_pf_7pyarrow_3lib_18BufferOutputStream_2get_result(__pyx_obj_7pyarrow_3lib_BufferOutputStream*)
 (lib.cxx:45797)
==11767==    by 0xBCB12F1: 
__pyx_pw_7pyarrow_3lib_18BufferOutputStream_3get_result(_object*, _object*) 
(lib.cxx:45762)
==11767==    by 0x4F78294: call_function (ceval.c:4634)
==11767==    by 0x4F78294: PyEval_EvalFrameEx (ceval.c:3185)
==11767==    by 0x4F79348: _PyEval_EvalCodeWithName (ceval.c:3966)
==11767==    by 0x4F794D7: PyEval_EvalCodeEx (ceval.c:3987)
==11767==    by 0x4ECF030: function_call (funcobject.c:632)
{code} 

> [Python] Investigate non-deterministic core dump on Python 2.7, Travis CI 
> builds
> --------------------------------------------------------------------------------
>
>                 Key: ARROW-1338
>                 URL: https://issues.apache.org/jira/browse/ARROW-1338
>             Project: Apache Arrow
>          Issue Type: Bug
>          Components: Python
>            Reporter: Wes McKinney
>            Assignee: Wes McKinney
>             Fix For: 0.6.0
>
>
> {code}
> pyarrow-test-2.7/lib/python2.7/site-packages/pyarrow/tests/test_io.py::test_python_file_write
>  PASSED
> pyarrow-test-2.7/lib/python2.7/site-packages/pyarrow/tests/test_io.py::test_python_file_read
>  PASSED
> pyarrow-test-2.7/lib/python2.7/site-packages/pyarrow/tests/test_io.py::test_bytes_reader
>  PASSED
> pyarrow-test-2.7/lib/python2.7/site-packages/pyarrow/tests/test_io.py::test_bytes_reader_non_bytes
>  PASSED
> pyarrow-test-2.7/lib/python2.7/site-packages/pyarrow/tests/test_io.py::test_bytes_reader_retains_parent_reference
>  PASSED
> pyarrow-test-2.7/lib/python2.7/site-packages/pyarrow/tests/test_io.py::test_buffer_bytes
>  PASSED
> pyarrow-test-2.7/lib/python2.7/site-packages/pyarrow/tests/test_io.py::test_buffer_memoryview
>  PASSED
> pyarrow-test-2.7/lib/python2.7/site-packages/pyarrow/tests/test_io.py::test_buffer_bytearray
>  PASSED
> pyarrow-test-2.7/lib/python2.7/site-packages/pyarrow/tests/test_io.py::test_buffer_numpy
>  PASSED
> pyarrow-test-2.7/lib/python2.7/site-packages/pyarrow/tests/test_io.py::test_buffer_memoryview_is_immutable
>  PASSED
> pyarrow-test-2.7/lib/python2.7/site-packages/pyarrow/tests/test_io.py::test_memory_output_stream
>  PASSED
> pyarrow-test-2.7/lib/python2.7/site-packages/pyarrow/tests/test_io.py::test_inmemory_write_after_closed
>  PASSED
> pyarrow-test-2.7/lib/python2.7/site-packages/pyarrow/tests/test_io.py::test_buffer_protocol_ref_counting
>  PASSED
> pyarrow-test-2.7/lib/python2.7/site-packages/pyarrow/tests/test_io.py::test_nativefile_write_memoryview
>  PASSED
> pyarrow-test-2.7/lib/python2.7/site-packages/pyarrow/tests/test_io.py::test_mock_output_stream
>  /Users/travis/build/apache/arrow/ci/travis_script_python.sh: line 81:  8186 
> Segmentation fault: 11  (core dumped) python -m pytest -vv -r sxX -s 
> $PYARROW_PATH --parquet
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Reply via email to