[jira] [Commented] (BEAM-5663) Add tox suites for various Python 3 versions
[ https://issues.apache.org/jira/browse/BEAM-5663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16648346#comment-16648346 ] Valentyn Tymofieiev commented on BEAM-5663: --- Lowered the priority to 'Minor' for now - I suggest reserving 'Major' priorities for issues that we must finish for Beam to be viable on Python 3. > Add tox suites for various Python 3 versions > > > Key: BEAM-5663 > URL: https://issues.apache.org/jira/browse/BEAM-5663 > Project: Beam > Issue Type: Sub-task > Components: sdk-py-core >Reporter: Manu Zhang >Priority: Minor > > Currently, Python 3.5.2 is set up for Jenkins tests but we've seen test > failings across various Python 3 versions. It will be valuable to add tox > suites for Python 3.4, 3.5, 3.6 and 3.7 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (BEAM-5663) Add tox suites for various Python 3 versions
[ https://issues.apache.org/jira/browse/BEAM-5663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16647174#comment-16647174 ] Udi Meiri commented on BEAM-5663: - My investigation from April 2018 is here: https://github.com/udim/beam/commit/3c08b21a9950e39bf71b150a087ae7bf7350f7c3 I haven't test with cython yet, but I just checked and Bazel has experimental support for pip: https://github.com/bazelbuild/rules_python/tree/master/examples/version > Add tox suites for various Python 3 versions > > > Key: BEAM-5663 > URL: https://issues.apache.org/jira/browse/BEAM-5663 > Project: Beam > Issue Type: Sub-task > Components: sdk-py-core >Reporter: Manu Zhang >Priority: Major > > Currently, Python 3.5.2 is set up for Jenkins tests but we've seen test > failings across various Python 3 versions. It will be valuable to add tox > suites for Python 3.4, 3.5, 3.6 and 3.7 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (BEAM-5663) Add tox suites for various Python 3 versions
[ https://issues.apache.org/jira/browse/BEAM-5663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16647072#comment-16647072 ] Valentyn Tymofieiev commented on BEAM-5663: --- Thanks [~yifanzou]. I think we should find a way to parallelize the test execution, before adding more test suites, since slow precommits will impact developer productivity. I heard from [~udim] that Bazel has better isolation of test environments and natively supports parallelizing test execution, on test suite and test level. > Add tox suites for various Python 3 versions > > > Key: BEAM-5663 > URL: https://issues.apache.org/jira/browse/BEAM-5663 > Project: Beam > Issue Type: Sub-task > Components: sdk-py-core >Reporter: Manu Zhang >Priority: Major > > Currently, Python 3.5.2 is set up for Jenkins tests but we've seen test > failings across various Python 3 versions. It will be valuable to add tox > suites for Python 3.4, 3.5, 3.6 and 3.7 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (BEAM-5663) Add tox suites for various Python 3 versions
[ https://issues.apache.org/jira/browse/BEAM-5663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16647066#comment-16647066 ] yifan zou commented on BEAM-5663: - AFAIK, the python is installed with ubuntu-1604 in Jenkins slaves that configured by Apache Infra. [https://github.com/apache/infrastructure-puppet/blob/deployment/data/ubuntu/ubuntu_1604.yaml.] We do have plans to try running tests in a docker container. https://docs.google.com/document/d/1y0YuQj_oZXC0uM5-gniG7r9-5gv2uiDhzbtgYYJW48c/edit > Add tox suites for various Python 3 versions > > > Key: BEAM-5663 > URL: https://issues.apache.org/jira/browse/BEAM-5663 > Project: Beam > Issue Type: Sub-task > Components: sdk-py-core >Reporter: Manu Zhang >Priority: Major > > Currently, Python 3.5.2 is set up for Jenkins tests but we've seen test > failings across various Python 3 versions. It will be valuable to add tox > suites for Python 3.4, 3.5, 3.6 and 3.7 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (BEAM-5663) Add tox suites for various Python 3 versions
[ https://issues.apache.org/jira/browse/BEAM-5663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16646940#comment-16646940 ] Valentyn Tymofieiev commented on BEAM-5663: --- Hey [~alanmyrvold], [~markliu], [~yifanzou] Do you know how do we configure the version of Python interpreter on Jenkins? We eventually would like to have multiple versions of the interpreter, so I wonder what the best practices are to achieve that. One option may be to simply install multiple versions of interpreter on Jenkins machines and rely on tox to discern, another - try to run test suites in a docker container with all necessary dependencies as desired. Do you have any advice here or perhaps you're working on something similar already? > Add tox suites for various Python 3 versions > > > Key: BEAM-5663 > URL: https://issues.apache.org/jira/browse/BEAM-5663 > Project: Beam > Issue Type: Sub-task > Components: sdk-py-core >Reporter: Manu Zhang >Priority: Major > > Currently, Python 3.5.2 is set up for Jenkins tests but we've seen test > failings across various Python 3 versions. It will be valuable to add tox > suites for Python 3.4, 3.5, 3.6 and 3.7 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (BEAM-5663) Add tox suites for various Python 3 versions
[ https://issues.apache.org/jira/browse/BEAM-5663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16645989#comment-16645989 ] Manu Zhang commented on BEAM-5663: -- Do you (or anyone) know how to set up Python version on Jenkins ? > Add tox suites for various Python 3 versions > > > Key: BEAM-5663 > URL: https://issues.apache.org/jira/browse/BEAM-5663 > Project: Beam > Issue Type: Sub-task > Components: sdk-py-core >Reporter: Manu Zhang >Priority: Major > > Currently, Python 3.5.2 is set up for Jenkins tests but we've seen test > failings across various Python 3 versions. It will be valuable to add tox > suites for Python 3.4, 3.5, 3.6 and 3.7 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (BEAM-5663) Add tox suites for various Python 3 versions
[ https://issues.apache.org/jira/browse/BEAM-5663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16645955#comment-16645955 ] Valentyn Tymofieiev commented on BEAM-5663: --- Another interesting question whether we can easily make these suites run in parallel so that we don't slow down precommits too much. > Add tox suites for various Python 3 versions > > > Key: BEAM-5663 > URL: https://issues.apache.org/jira/browse/BEAM-5663 > Project: Beam > Issue Type: Sub-task > Components: sdk-py-core >Reporter: Manu Zhang >Priority: Major > > Currently, Python 3.5.2 is set up for Jenkins tests but we've seen test > failings across various Python 3 versions. It will be valuable to add tox > suites for Python 3.4, 3.5, 3.6 and 3.7 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (BEAM-5663) Add tox suites for various Python 3 versions
[ https://issues.apache.org/jira/browse/BEAM-5663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16642614#comment-16642614 ] Valentyn Tymofieiev commented on BEAM-5663: --- +1. Thanks for filing this issue. > Add tox suites for various Python 3 versions > > > Key: BEAM-5663 > URL: https://issues.apache.org/jira/browse/BEAM-5663 > Project: Beam > Issue Type: Sub-task > Components: sdk-py-core >Reporter: Manu Zhang >Priority: Major > > Currently, Python 3.5.2 is set up for Jenkins tests but we've seen test > failings across various Python 3 versions. It will be valuable to add tox > suites for Python 3.4, 3.5, 3.6 and 3.7 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
