[GitHub] [arrow] terencehonles commented on pull request #8386: ARROW-10224: [Python] Build, test, and support Python 3.9
terencehonles commented on pull request #8386: URL: https://github.com/apache/arrow/pull/8386#issuecomment-742973701 It looks like the windows wheels are broken on `master` https://github.com/apache/arrow/pull/8878#issuecomment-742417983 and not sure if the OSX packages should be updated to use Github Actions rather than travis which seems to not be running. Other than waiting on https://github.com/pypa/manylinux/pull/872 should I do anything futher @xhochy / @kou ? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [arrow] terencehonles commented on pull request #8386: ARROW-10224: [Python] Build, test, and support Python 3.9
terencehonles commented on pull request #8386: URL: https://github.com/apache/arrow/pull/8386#issuecomment-742971245 Looks like that did the trick, I can create a comment linking to https://github.com/pypa/manylinux/pull/872 or we can wait till that is merged in and built This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [arrow] terencehonles commented on pull request #8386: ARROW-10224: [Python] Build, test, and support Python 3.9
terencehonles commented on pull request #8386: URL: https://github.com/apache/arrow/pull/8386#issuecomment-742959553 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [arrow] terencehonles commented on pull request #8386: ARROW-10224: [Python] Build, test, and support Python 3.9
terencehonles commented on pull request #8386: URL: https://github.com/apache/arrow/pull/8386#issuecomment-742933400 @github-actions crossbow submit wheel-manylinux1-* This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [arrow] terencehonles commented on pull request #8386: ARROW-10224: [Python] Build, test, and support Python 3.9
terencehonles commented on pull request #8386: URL: https://github.com/apache/arrow/pull/8386#issuecomment-742783390 That's odd that yum worked on one and not the other. It looks like it might be a tempermental issue and the fix in #8881 may need to be applied to manylinux1? It looks like that's on another tree and _might_ be related. https://github.com/apache/arrow/pull/8386#issuecomment-742112004  https://github.com/apache/arrow/pull/8386#issuecomment-742219891  https://github.com/apache/arrow/pull/8386#issuecomment-742740508  This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [arrow] terencehonles commented on pull request #8386: ARROW-10224: [Python] Build, test, and support Python 3.9
terencehonles commented on pull request #8386: URL: https://github.com/apache/arrow/pull/8386#issuecomment-742780393 @github-actions crossbow submit wheel-manylinux1-cp36m wheel-manylinux1-cp38 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [arrow] terencehonles commented on pull request #8386: ARROW-10224: [Python] Build, test, and support Python 3.9
terencehonles commented on pull request #8386: URL: https://github.com/apache/arrow/pull/8386#issuecomment-742726547 @xhochy is windows failing on `master`? I see your PR #8881 and not sure if I should leave windows as is. I also notice that the osx wheels aren't building either and not sure if that needs to be moved to github from travis too (as windows was). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [arrow] terencehonles commented on pull request #8386: ARROW-10224: [Python] Build, test, and support Python 3.9
terencehonles commented on pull request #8386: URL: https://github.com/apache/arrow/pull/8386#issuecomment-742723943 @github-actions crossbow submit wheel-manylinux* This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [arrow] terencehonles commented on pull request #8386: ARROW-10224: [Python] Build, test, and support Python 3.9
terencehonles commented on pull request #8386: URL: https://github.com/apache/arrow/pull/8386#issuecomment-742719093 I'll try to build locally, there seems to be a SSL/TLS error when trying to use `yum` This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [arrow] terencehonles commented on pull request #8386: ARROW-10224: [Python] Build, test, and support Python 3.9
terencehonles commented on pull request #8386: URL: https://github.com/apache/arrow/pull/8386#issuecomment-742219280 @github-actions crossbow submit -g wheel This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [arrow] terencehonles commented on pull request #8386: ARROW-10224: [Python] Build, test, and support Python 3.9
terencehonles commented on pull request #8386: URL: https://github.com/apache/arrow/pull/8386#issuecomment-742112735 I _believe_ https://github.com/apache/arrow/pull/8386/commits/ec5e6797e48fb0f4679c12496444ceead0861524 should be sufficient and I shouldn't have to remove `dev/tasks/conda-recipes/.ci_support/win*`. It looks like crossbow agrees, but not sure if there is any other builders that might be looking elsewhere. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [arrow] terencehonles commented on pull request #8386: ARROW-10224: [Python] Build, test, and support Python 3.9
terencehonles commented on pull request #8386: URL: https://github.com/apache/arrow/pull/8386#issuecomment-742111272 @github-actions crossbow submit -g conda -g wheel This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [arrow] terencehonles commented on pull request #8386: ARROW-10224: [Python] Build, test, and support Python 3.9
terencehonles commented on pull request #8386: URL: https://github.com/apache/arrow/pull/8386#issuecomment-742109501 @github-actions crossbow submit -g conda -g wheel This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [arrow] terencehonles commented on pull request #8386: ARROW-10224: [Python] Build, test, and support Python 3.9
terencehonles commented on pull request #8386: URL: https://github.com/apache/arrow/pull/8386#issuecomment-742103484 > I got a bit further in #8778 but we aren't fully there yet. I would rather merge the changes here bit-by-bit as the PR got already quite a bit stale. > > @terencehonles would issue the subparts as a PR or should I take care of that? I can probably handle that. Can I just pull out the windows wheels or how do you think it should be broken up? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [arrow] terencehonles commented on pull request #8386: ARROW-10224: [Python] Build, test, and support Python 3.9
terencehonles commented on pull request #8386: URL: https://github.com/apache/arrow/pull/8386#issuecomment-738338473 @xhochy not sure if your debugging in #8778 changes anything as far as the things attempted so far in @kou 's message https://github.com/apache/arrow/pull/8386#issuecomment-728321361 Unfortunately I don't have access to a Windows machine right now and don't really have the time to set up a VM or borrow one in order to test things out locally. I'm not sure if releasing wheels - windows is an option as @ns-admetrics suggests. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [arrow] terencehonles commented on pull request #8386: ARROW-10224: [Python] Build, test, and support Python 3.9
terencehonles commented on pull request #8386: URL: https://github.com/apache/arrow/pull/8386#issuecomment-738335287 I can rebase if needed (I had done that first), but figured it might be easier if others are committing to just merge. It's going to be squashed anyways so I doubt that matters too much. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [arrow] terencehonles commented on pull request #8386: ARROW-10224: [Python] Build, test, and support Python 3.9
terencehonles commented on pull request #8386: URL: https://github.com/apache/arrow/pull/8386#issuecomment-724962295 done This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [arrow] terencehonles commented on pull request #8386: ARROW-10224: [Python] Build, test, and support Python 3.9
terencehonles commented on pull request #8386: URL: https://github.com/apache/arrow/pull/8386#issuecomment-721863894 > Revision: [3d8adc2](https://github.com/apache/arrow/commit/3d8adc29623abae7e2cb29e5b2a77cc3161c12e8) > > Submitted crossbow builds: [ursa-labs/crossbow @ actions-687](https://github.com/ursa-labs/crossbow/branches/all?query=actions-687) > > Task Status > wheel-win-cp35m [](https://ci.appveyor.com/project/ursa-labs/crossbow/history) > wheel-win-cp36m [](https://ci.appveyor.com/project/ursa-labs/crossbow/history) > wheel-win-cp37m [](https://ci.appveyor.com/project/ursa-labs/crossbow/history) > wheel-win-cp38 [](https://ci.appveyor.com/project/ursa-labs/crossbow/history) > wheel-win-cp39 [](https://ci.appveyor.com/project/ursa-labs/crossbow/history) @kou any chance you know what happened to appveyor? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [arrow] terencehonles commented on pull request #8386: ARROW-10224: [Python] Build, test, and support Python 3.9
terencehonles commented on pull request #8386: URL: https://github.com/apache/arrow/pull/8386#issuecomment-721808090 @github-actions crossbow submit wheel-win-* This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [arrow] terencehonles commented on pull request #8386: ARROW-10224: [Python] Build, test, and support Python 3.9
terencehonles commented on pull request #8386: URL: https://github.com/apache/arrow/pull/8386#issuecomment-715425280 > Revision: [d26b20c](https://github.com/apache/arrow/commit/d26b20cb64debc6f022fdce1cde3ea3f812981ad) > > Submitted crossbow builds: [ursa-labs/crossbow @ actions-676](https://github.com/ursa-labs/crossbow/branches/all?query=actions-676) > > Task Status > wheel-osx-high-sierra-cp35m [](https://travis-ci.org/ursa-labs/crossbow/branches) > wheel-osx-high-sierra-cp36m [](https://travis-ci.org/ursa-labs/crossbow/branches) > wheel-osx-high-sierra-cp37m [](https://travis-ci.org/ursa-labs/crossbow/branches) > wheel-osx-high-sierra-cp38 [](https://travis-ci.org/ursa-labs/crossbow/branches) > wheel-osx-high-sierra-cp39 [](https://travis-ci.org/ursa-labs/crossbow/branches) > wheel-osx-mavericks-cp35m [](https://travis-ci.org/ursa-labs/crossbow/branches) > wheel-osx-mavericks-cp36m [](https://travis-ci.org/ursa-labs/crossbow/branches) > wheel-osx-mavericks-cp37m [](https://travis-ci.org/ursa-labs/crossbow/branches) > wheel-osx-mavericks-cp38 [](https://travis-ci.org/ursa-labs/crossbow/branches) > wheel-osx-mavericks-cp39 [](https://travis-ci.org/ursa-labs/crossbow/branches) Looks like more patience is needed. Since numpy and pandas will be built from source they exceed the time limit on Travis :confused: , I'll follow up again once at least one of them has Python 3.9 wheels. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [arrow] terencehonles commented on pull request #8386: ARROW-10224: [Python] Build, test, and support Python 3.9
terencehonles commented on pull request #8386: URL: https://github.com/apache/arrow/pull/8386#issuecomment-714984695 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [arrow] terencehonles commented on pull request #8386: ARROW-10224: [Python] Build, test, and support Python 3.9
terencehonles commented on pull request #8386: URL: https://github.com/apache/arrow/pull/8386#issuecomment-714923961 @github-actions crossbow submit wheel-osx-mavericks-cp39 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [arrow] terencehonles commented on pull request #8386: ARROW-10224: [Python] Build, test, and support Python 3.9
terencehonles commented on pull request #8386: URL: https://github.com/apache/arrow/pull/8386#issuecomment-714898194 @github-actions crossbow submit wheel-osx-mavericks-cp39 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [arrow] terencehonles commented on pull request #8386: ARROW-10224: [Python] Build, test, and support Python 3.9
terencehonles commented on pull request #8386: URL: https://github.com/apache/arrow/pull/8386#issuecomment-714865023 @github-actions crossbow submit wheel-osx-mavericks-cp39 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [arrow] terencehonles commented on pull request #8386: ARROW-10224: [Python] Build, test, and support Python 3.9
terencehonles commented on pull request #8386: URL: https://github.com/apache/arrow/pull/8386#issuecomment-714841368 @github-actions crossbow submit wheel-osx-mavericks-cp39 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [arrow] terencehonles commented on pull request #8386: ARROW-10224: [Python] Build, test, and support Python 3.9
terencehonles commented on pull request #8386: URL: https://github.com/apache/arrow/pull/8386#issuecomment-714818669 @github-actions crossbow submit wheel-osx-mavericks-cp39 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [arrow] terencehonles commented on pull request #8386: ARROW-10224: [Python] Build, test, and support Python 3.9
terencehonles commented on pull request #8386: URL: https://github.com/apache/arrow/pull/8386#issuecomment-714794643 @github-actions crossbow submit wheel-osx-mavericks-cp39 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [arrow] terencehonles commented on pull request #8386: ARROW-10224: [Python] Build, test, and support Python 3.9
terencehonles commented on pull request #8386: URL: https://github.com/apache/arrow/pull/8386#issuecomment-714772528 @github-actions crossbow submit wheel-osx-mavericks-cp39 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [arrow] terencehonles commented on pull request #8386: ARROW-10224: [Python] Build, test, and support Python 3.9
terencehonles commented on pull request #8386: URL: https://github.com/apache/arrow/pull/8386#issuecomment-714758705 @github-actions crossbow submit wheel-osx-mavericks-cp39 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [arrow] terencehonles commented on pull request #8386: ARROW-10224: [Python] Build, test, and support Python 3.9
terencehonles commented on pull request #8386: URL: https://github.com/apache/arrow/pull/8386#issuecomment-714195699 @github-actions crossbow submit wheel-osx-* This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [arrow] terencehonles commented on pull request #8386: ARROW-10224: [Python] Build, test, and support Python 3.9
terencehonles commented on pull request #8386: URL: https://github.com/apache/arrow/pull/8386#issuecomment-714191764 > Could you try the command lines that are executed in CMake on the environment? > > * https://gitlab.kitware.com/cmake/cmake/-/blob/v3.17.0/Modules/FindPython/Support.cmake#L2333 > * https://gitlab.kitware.com/cmake/cmake/-/blob/v3.17.0/Modules/FindPython/Support.cmake#L2357 It looks like the issue is likely this https://github.com/numpy/numpy/issues/15947 when using Python directly as suggested: ``` Building wheels for collected packages: numpy Building wheel for numpy (PEP 517): started Building wheel for numpy (PEP 517): still running... Building wheel for numpy (PEP 517): still running... Building wheel for numpy (PEP 517): finished with status 'done' Created wheel for numpy: filename=numpy-1.19.2-cp39-cp39-macosx_10_13_x86_64.whl size=4626041 sha256=be42ba9492a0f018618368d2193572162468dd640733db26582bae57715247d5 Stored in directory: /Users/travis/Library/Caches/pip/wheels/a3/17/dd/f2dba23a35bb6008732772ccfb13d3d0e537fbc6919ce6862b Successfully built numpy Installing collected packages: cython, numpy Successfully installed cython-0.29.21 numpy-1.19.2 ++python -c 'import numpy; print(numpy.get_include())' init_dgelsd failed init Traceback (most recent call last): File "", line 1, in File "/Users/travis/build/ursa-labs/crossbow/venv/lib/python3.9/site-packages/numpy/__init__.py", line 286, in raise RuntimeError(msg) RuntimeError: Polyfit sanity test emitted a warning, most likely due to using a buggy Accelerate backend. If you compiled yourself, see site.cfg.example for information. Otherwise report this to the vendor that provided NumPy. RankWarning: Polyfit may be poorly conditioned ``` This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [arrow] terencehonles commented on pull request #8386: ARROW-10224: [Python] Build, test, and support Python 3.9
terencehonles commented on pull request #8386: URL: https://github.com/apache/arrow/pull/8386#issuecomment-714178549 @github-actions crossbow submit wheel-win-* This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [arrow] terencehonles commented on pull request #8386: ARROW-10224: [Python] Build, test, and support Python 3.9
terencehonles commented on pull request #8386: URL: https://github.com/apache/arrow/pull/8386#issuecomment-714178008 > We need to add 1.74.0 to https://github.com/apache/arrow/blob/master/cpp/cmake_modules/ThirdpartyToolchain.cmake#L770 Thanks! I was literally just looking at that file. I'll adjust. What about python/CMakeLists.txt? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [arrow] terencehonles commented on pull request #8386: ARROW-10224: [Python] Build, test, and support Python 3.9
terencehonles commented on pull request #8386: URL: https://github.com/apache/arrow/pull/8386#issuecomment-714174255 > > ``` > > * For the windows wheel it looks like the issue is the VS runtime is pinned [here](https://github.com/apache/arrow/blob/fa456de6d03c4fa5bac104b5b31f72d7be92f450/dev/tasks/python-wheels/win-build.bat#L28). I'm not sure if I can just remove that or what I should adjust it to. > > ``` > > Could you try removing `"vs2015_runtime<14.16"`? It looks like all of the windows wheels are failing on ``` -- Including C:/Miniconda3-x64/envs/wheel-build/Library/lib/cmake/boost_regex-1.74.0/libboost_regex-variant-shared.cmake -- [ ] boost_regex.lib CMake Error at C:/Miniconda3-x64/envs/wheel-build/Library/lib/cmake/Boost-1.74.0/BoostConfig.cmake:141 (find_package): Found package configuration file: C:/Miniconda3-x64/envs/wheel-build/Library/lib/cmake/boost_regex-1.74.0/boost_regex-config.cmake but it set boost_regex_FOUND to FALSE so package "boost_regex" is considered to be NOT FOUND. Reason given by package: No suitable build variant has been found. The following variants have been tried and rejected: * boost_regex.lib (shared, Boost_USE_STATIC_LIBS=ON) Call Stack (most recent call first): ``` This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [arrow] terencehonles commented on pull request #8386: ARROW-10224: [Python] Build, test, and support Python 3.9
terencehonles commented on pull request #8386: URL: https://github.com/apache/arrow/pull/8386#issuecomment-714172270 @github-actions crossbow submit wheel-osx-* This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [arrow] terencehonles commented on pull request #8386: ARROW-10224: [Python] Build, test, and support Python 3.9
terencehonles commented on pull request #8386: URL: https://github.com/apache/arrow/pull/8386#issuecomment-714167236 @github-actions crossbow submit wheel-osx-* This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [arrow] terencehonles commented on pull request #8386: ARROW-10224: [Python] Build, test, and support Python 3.9
terencehonles commented on pull request #8386: URL: https://github.com/apache/arrow/pull/8386#issuecomment-714166626 @github-actions crossbow submit wheel-win-* This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [arrow] terencehonles commented on pull request #8386: ARROW-10224: [Python] Build, test, and support Python 3.9
terencehonles commented on pull request #8386: URL: https://github.com/apache/arrow/pull/8386#issuecomment-713838185 @kou not sure if you have any thoughts on the following: - For the windows wheel it looks like the issue is the VS runtime is pinned [here](https://github.com/apache/arrow/blob/fa456de6d03c4fa5bac104b5b31f72d7be92f450/dev/tasks/python-wheels/win-build.bat#L28). I'm not sure if I can just remove that or what I should adjust it to. - For Mac it looks like it's [something to do with CMake](https://travis-ci.com/github/ursa-labs/crossbow/builds/191503619#L467-L475) and I'm not sure where to go from here - C++ / AMD64 Windows MinGW 64 C++ (pull_request) looks like it's starting to fail now, and it's because of a timeout error. The timeout is set to 5 minutes, but I'm wondering if it's OK for me to bump it up higher. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [arrow] terencehonles commented on pull request #8386: ARROW-10224: [Python] Build, test, and support Python 3.9
terencehonles commented on pull request #8386: URL: https://github.com/apache/arrow/pull/8386#issuecomment-713754384 I can't tell what's actually the issue with the OS X Python 3.9 builds. I see https://travis-ci.com/github/ursa-labs/crossbow/builds/191336854 and my guess is that CMake [has not been updated in either homebrew or on Travis](https://travis-ci.com/github/ursa-labs/crossbow/builds/191336854#L119) to support [Python 3.9](https://travis-ci.com/github/ursa-labs/crossbow/builds/191336854#L467-L475)? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [arrow] terencehonles commented on pull request #8386: ARROW-10224: [Python] Build, test, and support Python 3.9
terencehonles commented on pull request #8386: URL: https://github.com/apache/arrow/pull/8386#issuecomment-713745132 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [arrow] terencehonles commented on pull request #8386: ARROW-10224: [Python] Build, test, and support Python 3.9
terencehonles commented on pull request #8386: URL: https://github.com/apache/arrow/pull/8386#issuecomment-713261883 @github-actions crossbow submit -g conda -g wheel This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [arrow] terencehonles commented on pull request #8386: ARROW-10224: [Python] Build, test, and support Python 3.9
terencehonles commented on pull request #8386: URL: https://github.com/apache/arrow/pull/8386#issuecomment-713244425 I believe I identified the test on Python3.7 that is failing, and going to see if that fixes things @github-actions crossbow submit -g conda -g wheel This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [arrow] terencehonles commented on pull request #8386: ARROW-10224: [Python] Build, test, and support Python 3.9
terencehonles commented on pull request #8386: URL: https://github.com/apache/arrow/pull/8386#issuecomment-713206837 @github-actions crossbow submit -g conda -g wheel This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [arrow] terencehonles commented on pull request #8386: ARROW-10224: [Python] Build, test, and support Python 3.9
terencehonles commented on pull request #8386: URL: https://github.com/apache/arrow/pull/8386#issuecomment-713199449 > > Py3.7 looks like it's something wrong when testing the wheel (I'll see if I can reproduce locally). I and I'm not sure what do do about llvm 10/11 [here](https://github.com/apache/arrow/pull/8386/checks?check_run_id=1282217190) > > I'll check if it's just a pinning issue since it looks related to #8492 It looks like removing the unpinned llvm and jusing using the pinned llvm@8 did the trick. In the long term it makes sense to try to support LLVM 11 since it doesn't look like homebrew is looking to support llvm@10 https://github.com/Homebrew/homebrew-core/pull/63177 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [arrow] terencehonles commented on pull request #8386: ARROW-10224: [Python] Build, test, and support Python 3.9
terencehonles commented on pull request #8386: URL: https://github.com/apache/arrow/pull/8386#issuecomment-713087418 > Py3.7 looks like it's something wrong when testing the wheel (I'll see if I can reproduce locally). I and I'm not sure what do do about llvm 10/11 [here](https://github.com/apache/arrow/pull/8386/checks?check_run_id=1282217190) I'll check if it's just a pinning issue since it looks related to https://github.com/apache/arrow/pull/8492 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [arrow] terencehonles commented on pull request #8386: ARROW-10224: [Python] Build, test, and support Python 3.9
terencehonles commented on pull request #8386: URL: https://github.com/apache/arrow/pull/8386#issuecomment-713086735 Py3.7 looks like it's something wrong when testing the wheel (I'll see if I can reproduce locally). I and I'm not sure what do do about llvm 10 [here](https://github.com/apache/arrow/pull/8386/checks?check_run_id=1282217190) This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [arrow] terencehonles commented on pull request #8386: ARROW-10224: [Python] Build, test, and support Python 3.9
terencehonles commented on pull request #8386: URL: https://github.com/apache/arrow/pull/8386#issuecomment-712992643 @github-actions crossbow submit -g conda -g wheel This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [arrow] terencehonles commented on pull request #8386: ARROW-10224: [Python] Build, test, and support Python 3.9
terencehonles commented on pull request #8386: URL: https://github.com/apache/arrow/pull/8386#issuecomment-712992230 I'm definitely moving into very uncharted territory for me since I'm not familiar with conda, but I believe it looks like numpy for Py39 was pinned to 1.16 here [dev/tasks/conda-recipes/arrow-cpp/meta.yaml](https://github.com/apache/arrow/pull/8386/files#diff-e1dc9dc44f82817c013424829588fc3fe48e63c78b42ce47e012016a243de09bL182) and I am expecting that removing that should fix Py39 since looking at https://dev.azure.com/ursa-labs/crossbow/_build/results?buildId=19036=logs=0da5d1d9-276d-5173-c4c4-9d4d4ed14fdb=d9b15392-e4ce-5e4c-0c8c-b69645229181=711 it looks like Py39 is still trying to use numpy 1.16 instead of 1.19 as specified in the .ci_support files for Py3.9. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [arrow] terencehonles commented on pull request #8386: ARROW-10224: [Python] Build, test, and support Python 3.9
terencehonles commented on pull request #8386: URL: https://github.com/apache/arrow/pull/8386#issuecomment-712546156 @github-actions crossbow submit -g conda -g wheel This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [arrow] terencehonles commented on pull request #8386: ARROW-10224: [Python] Build, test, and support Python 3.9
terencehonles commented on pull request #8386: URL: https://github.com/apache/arrow/pull/8386#issuecomment-712546068 I didn't realize the .ci_support files were vendored from https://github.com/conda-forge/arrow-cpp-feedstock. I updated the files to https://github.com/conda-forge/arrow-cpp-feedstock/commit/abbcc009d4171a8d6cb5dbfd5c49ddc38ab8e7f5 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [arrow] terencehonles commented on pull request #8386: ARROW-10224: [Python] Build, test, and support Python 3.9
terencehonles commented on pull request #8386: URL: https://github.com/apache/arrow/pull/8386#issuecomment-712468902 @github-actions crossbow submit -g conda -g wheel This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [arrow] terencehonles commented on pull request #8386: ARROW-10224: [Python] Build, test, and support Python 3.9
terencehonles commented on pull request #8386: URL: https://github.com/apache/arrow/pull/8386#issuecomment-711433191 @xhochy do you mind if I get a resubmit to test the conda recipe changes? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [arrow] terencehonles commented on pull request #8386: ARROW-10224: [Python] Build, test, and support Python 3.9
terencehonles commented on pull request #8386: URL: https://github.com/apache/arrow/pull/8386#issuecomment-711433055 I pinned semver to 2.10.2 since it looks like there is a breaking change for `archery/release.py` that was committed in the last few days. I can look to create a PR for that, but I figured it probably shouldn't be rolled into this PR. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [arrow] terencehonles commented on pull request #8386: ARROW-10224: [Python] Build, test, and support Python 3.9
terencehonles commented on pull request #8386: URL: https://github.com/apache/arrow/pull/8386#issuecomment-711428048 > @github-actions crossbow submit -g conda I _think_ the issue with the failed jobs is I didn't bump the numpy version in the `conda-recipies/.ci_support` ? I noticed that even Python 3.8 was set to numpy 1.16 so I might be wrong about that. I updated the following https://github.com/apache/arrow/pull/8386/files#diff-0bd27b86c3660caa163f79bd5077954145a206949c81b9d8770a5d06a7c89c5bR39-R40 in each of the files ```yaml numpy: - '1.19.2' ``` and rebased the changes. It looks like a test is now failing and I'll look to see if I can quickly resolve that. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [arrow] terencehonles commented on pull request #8386: ARROW-10224: [Python] Build, test, and support Python 3.9
terencehonles commented on pull request #8386: URL: https://github.com/apache/arrow/pull/8386#issuecomment-705332107 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [arrow] terencehonles commented on pull request #8386: ARROW-10224: [Python] Build, test, and support Python 3.9
terencehonles commented on pull request #8386: URL: https://github.com/apache/arrow/pull/8386#issuecomment-705697163 > Note that Numpy doesn't provide [pre-compiled wheels](https://pypi.org/project/numpy/#files) for 3.9 currently. > > Also, conda-forge doesn't seem to be ready either. Yeah, that's fine. I'm not really in a rush, I just wanted to help to get things in place that we could move forward as soon as all of the dependencies are met (and to identify where things are and what is still missing) This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [arrow] terencehonles commented on pull request #8386: ARROW-10224: [Python] Build, test, and support Python 3.9
terencehonles commented on pull request #8386: URL: https://github.com/apache/arrow/pull/8386#issuecomment-705348517 I reverted some of the OS X changes. I'm not sure I actually needed to change Python 3.8 there since it looks like that travis file is templated out to all OS X wheels and it is still using Python 3.8 in all of them. That's either a bug or that there's something else that's using the `python_version` that's also specified in the travis jobs (more likely the latter). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [arrow] terencehonles commented on pull request #8386: ARROW-10224: [Python] Build, test, and support Python 3.9
terencehonles commented on pull request #8386: URL: https://github.com/apache/arrow/pull/8386#issuecomment-705332360 Not sure if that will work for me, but might as well give it a shot 路 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [arrow] terencehonles commented on pull request #8386: ARROW-10224: [Python] Build, test, and support Python 3.9
terencehonles commented on pull request #8386: URL: https://github.com/apache/arrow/pull/8386#issuecomment-705332230 @github-actions crossbow submit -g conda -g wheel This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [arrow] terencehonles commented on pull request #8386: ARROW-10224: [Python] Build, test, and support Python 3.9
terencehonles commented on pull request #8386: URL: https://github.com/apache/arrow/pull/8386#issuecomment-705332107 It looks like cmake was already part of the quay.io/pypa/manylinux2014_x86_64:2020-10-06-b2ca7a1 and `scripts/install_cmake.sh` needed to be updated. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [arrow] terencehonles commented on pull request #8386: ARROW-10224: [Python] Build, test, and support Python 3.9
terencehonles commented on pull request #8386: URL: https://github.com/apache/arrow/pull/8386#issuecomment-705219863 It looks like I "missed" the github workflows, but that might need to be done after the wheels are built and published as I haven't looked at what exactly are doing, and I kinda doubt they are building from source. I can open that up as a separate PR if that is helpful. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
