Hi David, Those packages are different because they are maintained by different people, and generally the one in anaconda is lagging behind (https://github.com/conda-forge/arrow-cpp-feedstock vs https://github.com/AnacondaRecipes/arrow-cpp-feedstock). As pyarrow maintainers we have some control over the conda-forge packages, because we are co-maintainers of the recipe (although a lot of the work to maintain this is done by the awesome people of the conda-forge community), but we do not have any control over the defaults anaconda package. If you have any problems with the anaconda package, probably the best option is to open an issue at https://github.com/AnacondaRecipes/arrow-cpp-feedstock.
Because of those differences, it's strongly recommended to either use all packages from conda-forge, or all from the defaults channel (but I assume you are already doing that, from defaults). Specifically about the arrow-cpp vs libarrow naming difference, I wouldn't worry: originally also in conda-forge the package was named arrow-cpp, but that was renamed to libarrow some time ago. Given that you mention the problem occurring with flight, one difference between both packages is the version of libprotobuf (but you also can't change as a user when installing pyarrow). Best, Joris On Mon, 16 Oct 2023 at 16:52, David Chapman <[email protected]> wrote: > > Hello, > > > > While trying to debug a reproducible segfault in the python flight client I > have noticed many pyarrow package dependencies differ between the versions in > conda-forge and anaconda, for the same version of pyarrow (11.0.0). In > particular the conda version depends on arrow-cpp whereas conda-forge depends > on libarrow. > > > > Does anyone know why these are different? I’m unfortunately only able to use > anaconda packages. I can reproduce the crash 100% in the anaconda version, it > works fine with the conda-forge version. > > > > Environment information: > > python version 3.10.12 > > pyarrow version 11.0.0 > > Platform: Windows 10 Enterprise > > > > Thanks, > > David > > > > SEFE Marketing & Trading Limited is a limited company registered in England > and Wales with registered number 3768267 and registered office at 20 Triton > Street, London NW1 3BF. This message is intended solely for the addressee and > may contain confidential information. If you have received this message in > error, please send it back to us, and immediately and permanently delete it. > Do not use, copy or disclose the information contained in this message or in > any attachment. If the content of this email is personal or unconnected with > our business, we accept no liability or responsibility for it.
