Re: Continuous benchmarking setup

2018-04-12 Thread Tom Augspurger
https://github.com/TomAugspurger/asv-runner/ is the setup for the projects currently running. Adding arrow to https://github.com/TomAugspurger/asv-runner/blob/master/tests/full.yml might work. I'll have to redeploy with the update. From: Wes McKinney

Re: Continuous benchmarking setup

2018-04-23 Thread Tom Augspurger
; thanks! > Wes > > On Fri, Apr 13, 2018 at 8:36 AM, Tom Augspurger > <tom.augspurge...@gmail.com> wrote: > > They are run daily and published to http://pandas.pydata.org/speed/ > > > > > > > > From: Antoine Pitr

Re: Benchmarking dashboard proposal

2019-01-18 Thread Tom Augspurger
I'll see if I can figure out why the benchmarks at https://pandas.pydata.org/speed/arrow/ aren't being updated this weekend. On Fri, Jan 18, 2019 at 2:34 AM Uwe L. Korn wrote: > Hello, > > note that we have(had?) the Python benchmarks continuously running and > reported at

Is FileSystem._isfilestore considered public?

2019-11-26 Thread Tom Augspurger
Hi, In https://github.com/dask/dask/issues/5526, we're seeing an issue stemming from a hack to ensure compatibility for Pyarrow. The details aren't too important. The core of the issue is that the Pyarrow parquet writer makes a couple checks for `FileSystem._isfilestore` via

Re: AttributeError importing pyarrow 0.16.0

2020-02-10 Thread Tom Augspurger
d probably fix that regardless > > https://issues.apache.org/jira/browse/ARROW-7826 > > - Wes > > On Mon, Feb 10, 2020 at 12:17 PM Tom Augspurger > wrote: > > > > Hi all, > > > > I'm seeing a strange issue when importing pyarrow on the intake CI. I >

AttributeError importing pyarrow 0.16.0

2020-02-10 Thread Tom Augspurger
Hi all, I'm seeing a strange issue when importing pyarrow on the intake CI. I get an exception saying AttributeError: type object 'pyarrow.lib.Message' has no attribute '__reduce_cython__' The full traceback is: __ test_arrow_import

[jira] [Created] (ARROW-1585) serialize_pandas round trip fails on integer columns

2017-09-20 Thread Tom Augspurger (JIRA)
Tom Augspurger created ARROW-1585: - Summary: serialize_pandas round trip fails on integer columns Key: ARROW-1585 URL: https://issues.apache.org/jira/browse/ARROW-1585 Project: Apache Arrow

[jira] [Created] (ARROW-1586) [PYTHON] serialize_pandas roundtrip loses columns name

2017-09-20 Thread Tom Augspurger (JIRA)
Tom Augspurger created ARROW-1586: - Summary: [PYTHON] serialize_pandas roundtrip loses columns name Key: ARROW-1586 URL: https://issues.apache.org/jira/browse/ARROW-1586 Project: Apache Arrow

[jira] [Created] (ARROW-1593) [PYTHON] serialize_pandas should pass through the preserve_index keyword

2017-09-21 Thread Tom Augspurger (JIRA)
Tom Augspurger created ARROW-1593: - Summary: [PYTHON] serialize_pandas should pass through the preserve_index keyword Key: ARROW-1593 URL: https://issues.apache.org/jira/browse/ARROW-1593 Project

[jira] [Created] (ARROW-1557) pyarrow.Table.from_arrays doesn't validate names length

2017-09-19 Thread Tom Augspurger (JIRA)
Tom Augspurger created ARROW-1557: - Summary: pyarrow.Table.from_arrays doesn't validate names length Key: ARROW-1557 URL: https://issues.apache.org/jira/browse/ARROW-1557 Project: Apache Arrow

[jira] [Created] (ARROW-1897) Incorrect numpy_type for pandas metadata of Categoricals

2017-12-07 Thread Tom Augspurger (JIRA)
Tom Augspurger created ARROW-1897: - Summary: Incorrect numpy_type for pandas metadata of Categoricals Key: ARROW-1897 URL: https://issues.apache.org/jira/browse/ARROW-1897 Project: Apache Arrow

[jira] [Created] (ARROW-7102) Make filesystem wrappers compatible with fsspec

2019-11-08 Thread Tom Augspurger (Jira)
Tom Augspurger created ARROW-7102: - Summary: Make filesystem wrappers compatible with fsspec Key: ARROW-7102 URL: https://issues.apache.org/jira/browse/ARROW-7102 Project: Apache Arrow Issue

[jira] [Created] (ARROW-8462) Crash in lib.concat_tables on Windows

2020-04-14 Thread Tom Augspurger (Jira)
Tom Augspurger created ARROW-8462: - Summary: Crash in lib.concat_tables on Windows Key: ARROW-8462 URL: https://issues.apache.org/jira/browse/ARROW-8462 Project: Apache Arrow Issue Type: Bug