See
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/4350/display/redirect?page=changes>
Changes:
[noreply] [BEAM-11514] Make schema error more helpful (#15075)
[noreply] Minor: Fix missing f-string in nlargest/nsmallest error messages
------------------------------------------
[...truncated 1.69 MB...]
p.options.view_as(GoogleCloudOptions).temp_location or
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file:
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/pytest_py38-pyarrow-3.xml>
-
============== 28 passed, 1 skipped, 22 warnings in 35.89 seconds ==============
============================= test session starts ==============================
platform linux -- Python 3.8.5, pytest-4.6.11, py-1.10.0, pluggy-0.13.1
cachedir: target/.tox-py38-pyarrow-3/py38-pyarrow-3/.pytest_cache
rootdir:
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python,>
inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.3.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
collected 4726 items / 4698 deselected / 3 skipped / 25 selected
apache_beam/dataframe/io_test.py . [ 3%]
apache_beam/io/parquetio_test.py
> Task :sdks:python:test-suites:dataflow:py36:preCommitIT_streaming_V2
DEBUG:google.api_core.retry:Retrying due to 503 502:Bad Gateway, sleeping 0.0s
...
> Task :sdks:python:test-suites:dataflow:py37:preCommitIT_streaming_V2
Worker logs:
https://console.cloud.google.com/dataflow/jobs/us-central1/2021-06-24_17_36_09-7430196394717614351?project=apache-beam-testing
test_streaming_wordcount_it
(apache_beam.examples.streaming_wordcount_it_test.StreamingWordCountIT) ... ok
----------------------------------------------------------------------
XML: nosetests-preCommitIT-df-py37.xml
----------------------------------------------------------------------
XML:
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 1 test in 611.166s
OK
> Task :sdks:python:test-suites:tox:py38:testPy38pyarrow-3
........................... [100%]
=============================== warnings summary ===============================
target/.tox-py38-pyarrow-3/py38-pyarrow-3/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pyarrow-3/py38-pyarrow-3/lib/python3.8/site-packages/tenacity/_asyncio.py>:42:
DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use
"async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/dataframe/io_test.py::IOTest::test_read_write_parquet
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/apache_beam/dataframe/io.py>:566:
FutureWarning: WriteToFiles is experimental.
return pcoll | fileio.WriteToFiles(
apache_beam/dataframe/io_test.py::IOTest::test_read_write_parquet
apache_beam/dataframe/io_test.py::IOTest::test_read_write_parquet
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/apache_beam/io/fileio.py>:478:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
p.options.view_as(GoogleCloudOptions).temp_location or
apache_beam/io/parquetio_test.py::TestParquet::test_int96_type_conversion
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/apache_beam/io/parquetio_test.py>:416:
FutureWarning: The parameter chunksize is deprecated for
pyarrow.Table.to_batches as of 0.15, please use the parameter max_chunksize
instead
for batch in orig.to_batches(chunksize=20)
apache_beam/io/parquetio_test.py::TestParquet::test_read_with_splitting_multiple_row_group
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/apache_beam/io/parquetio_test.py>:377:
FutureWarning: The parameter chunksize is deprecated for
pyarrow.Table.to_batches as of 0.15, please use the parameter max_chunksize
instead
pa.Table.from_batches([batch]) for batch in self._records_as_arrow(
apache_beam/io/parquetio_test.py::TestParquet::test_read_without_splitting_multiple_row_group
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/apache_beam/io/parquetio_test.py>:367:
FutureWarning: The parameter chunksize is deprecated for
pyarrow.Table.to_batches as of 0.15, please use the parameter max_chunksize
instead
pa.Table.from_batches([batch]) for batch in self._records_as_arrow(
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file:
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/pytest_py38-pyarrow-3_no_xdist.xml>
-
====== 28 passed, 3 skipped, 4698 deselected, 7 warnings in 46.21 seconds ======
[1mpy38-pyarrow-3 run-test-post: commands[0] | bash
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary
____________________________________
[32m py38-pyarrow-3: commands succeeded
[0m[32m congratulations :)
[0m
> Task :sdks:python:test-suites:tox:py38:testPy38pyarrow-4
[1mGLOB sdist-make:
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/setup.py>
[0m[1mpy38-pyarrow-4 create:
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pyarrow-4/py38-pyarrow-4>
[0m[1mpy38-pyarrow-4 installdeps: pyarrow>=4,<5
[0m[1mpy38-pyarrow-4 inst:
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pyarrow-4/.tmp/package/1/apache-beam-2.32.0.dev0.zip>
[0m[1mpy38-pyarrow-4 installed: apache-beam @
file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pyarrow-4/.tmp/package/1/apache-beam-2.32.0.dev0.zip,atomicwrites==1.4.0,attrs==21.2.0,avro-python3==1.9.2.1,certifi==2021.5.30,chardet==4.0.0,crcmod==1.7,deprecation==2.1.0,dill==0.3.1.1,docker==5.0.0,docopt==0.6.2,execnet==1.9.0,fastavro==1.4.1,freezegun==1.1.0,future==0.18.2,greenlet==1.1.0,grpcio==1.38.1,hdfs==2.6.0,httplib2==0.19.1,idna==2.10,mock==2.0.0,more-itertools==8.8.0,nose==1.3.7,nose-xunitmp==0.4.1,numpy==1.20.3,oauth2client==4.1.3,orjson==3.5.3,packaging==20.9,pandas==1.2.5,parameterized==0.7.5,pbr==5.6.0,pluggy==0.13.1,protobuf==3.17.3,psycopg2-binary==2.9.1,py==1.10.0,pyarrow==4.0.1,pyasn1==0.4.8,pyasn1-modules==0.2.8,pydot==1.4.2,PyHamcrest==1.10.1,pymongo==3.11.4,pyparsing==2.4.7,pytest==4.6.11,pytest-forked==1.3.0,pytest-timeout==1.4.2,pytest-xdist==1.34.0,python-dateutil==2.8.1,pytz==2021.1,PyYAML==5.4.1,requests==2.25.1,requests-mock==1.9.3,rsa==4.7.2,six==1.16.0,SQLAlchemy==1.4.19,tenacity==5.1.5,testcontainers==3.4.1,typing-extensions==3.7.4.3,urllib3==1.26.5,wcwidth==0.2.5,websocket-client==1.1.0,wrapt==1.12.1>
[0m[1mpy38-pyarrow-4 run-test-pre: PYTHONHASHSEED='1783264240'
[0m[1mpy38-pyarrow-4 run-test-pre: commands[0] | python --version
[0mPython 3.8.5
[1mpy38-pyarrow-4 run-test-pre: commands[1] | pip --version
[0mpip 21.1.2 from
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pyarrow-4/py38-pyarrow-4/lib/python3.8/site-packages/pip>
(python 3.8)
[1mpy38-pyarrow-4 run-test-pre: commands[2] | pip check
[0mNo broken requirements found.
[1mpy38-pyarrow-4 run-test-pre: commands[3] | bash
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m[1mpy38-pyarrow-4 run-test: commands[0] | /bin/sh -c 'pip freeze | grep -E
'"'"'(pyarrow|numpy)'"'"''
[0mapache-beam @
file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pyarrow-4/.tmp/package/1/apache-beam-2.32.0.dev0.zip>
numpy==1.20.3
pyarrow==4.0.1
[1mpy38-pyarrow-4 run-test: commands[1] |
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_pytest.sh>
py38-pyarrow-4 '-m uses_pyarrow'
[0m============================= test session starts
==============================
platform linux -- Python 3.8.5, pytest-4.6.11, py-1.10.0, pluggy-0.13.1
cachedir: target/.tox-py38-pyarrow-4/py38-pyarrow-4/.pytest_cache
rootdir:
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python,>
inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.3.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I
> Task :sdks:python:test-suites:dataflow:py36:preCommitIT_streaming_V2
Worker logs:
https://console.cloud.google.com/dataflow/jobs/us-central1/2021-06-24_17_36_39-4700519831229546743?project=apache-beam-testing
test_streaming_wordcount_it
(apache_beam.examples.streaming_wordcount_it_test.StreamingWordCountIT) ... ok
----------------------------------------------------------------------
XML: nosetests-preCommitIT-df-py36.xml
----------------------------------------------------------------------
XML:
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 1 test in 650.216s
OK
> Task :sdks:python:test-suites:dataflow:preCommitIT_V2
> Task :sdks:python:test-suites:tox:py38:testPy38pyarrow-4
gw0 [28] / gw1 [28] / gw2 [28] / gw3 [28] / gw4 [28] / gw5 [28]
............................ [100%]
=============================== warnings summary ===============================
target/.tox-py38-pyarrow-4/py38-pyarrow-4/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-4/py38-pyarrow-4/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-4/py38-pyarrow-4/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-4/py38-pyarrow-4/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-4/py38-pyarrow-4/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-4/py38-pyarrow-4/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pyarrow-4/py38-pyarrow-4/lib/python3.8/site-packages/tenacity/_asyncio.py>:42:
DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use
"async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/apache_beam/io/filesystems_test.py>:54:
DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint:
disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/apache_beam/io/filesystems_test.py>:62:
DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), #
pylint: disable=anomalous-backslash-in-string
apache_beam/io/parquetio_test.py:416
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/apache_beam/io/parquetio_test.py>:416:
FutureWarning: The parameter chunksize is deprecated for
pyarrow.Table.to_batches as of 0.15, please use the parameter max_chunksize
instead
for batch in orig.to_batches(chunksize=20)
apache_beam/io/parquetio_test.py:377
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/apache_beam/io/parquetio_test.py>:377:
FutureWarning: The parameter chunksize is deprecated for
pyarrow.Table.to_batches as of 0.15, please use the parameter max_chunksize
instead
pa.Table.from_batches([batch]) for batch in self._records_as_arrow(
apache_beam/io/parquetio_test.py:367
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/apache_beam/io/parquetio_test.py>:367:
FutureWarning: The parameter chunksize is deprecated for
pyarrow.Table.to_batches as of 0.15, please use the parameter max_chunksize
instead
pa.Table.from_batches([batch]) for batch in self._records_as_arrow(
apache_beam/dataframe/io.py:566
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/apache_beam/dataframe/io.py>:566:
FutureWarning: WriteToFiles is experimental.
return pcoll | fileio.WriteToFiles(
apache_beam/io/fileio.py:478
apache_beam/io/fileio.py:478
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/apache_beam/io/fileio.py>:478:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
p.options.view_as(GoogleCloudOptions).temp_location or
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file:
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/pytest_py38-pyarrow-4.xml>
-
============== 28 passed, 1 skipped, 18 warnings in 36.70 seconds ==============
============================= test session starts ==============================
platform linux -- Python 3.8.5, pytest-4.6.11, py-1.10.0, pluggy-0.13.1
cachedir: target/.tox-py38-pyarrow-4/py38-pyarrow-4/.pytest_cache
rootdir:
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python,>
inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.3.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
collected 4726 items / 4698 deselected / 3 skipped / 25 selected
apache_beam/dataframe/io_test.py . [ 3%]
apache_beam/io/parquetio_test.py ........................... [100%]
=============================== warnings summary ===============================
target/.tox-py38-pyarrow-4/py38-pyarrow-4/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pyarrow-4/py38-pyarrow-4/lib/python3.8/site-packages/tenacity/_asyncio.py>:42:
DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use
"async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/dataframe/io_test.py::IOTest::test_read_write_parquet
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/apache_beam/dataframe/io.py>:566:
FutureWarning: WriteToFiles is experimental.
return pcoll | fileio.WriteToFiles(
apache_beam/dataframe/io_test.py::IOTest::test_read_write_parquet
apache_beam/dataframe/io_test.py::IOTest::test_read_write_parquet
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/apache_beam/io/fileio.py>:478:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
p.options.view_as(GoogleCloudOptions).temp_location or
apache_beam/io/parquetio_test.py::TestParquet::test_int96_type_conversion
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/apache_beam/io/parquetio_test.py>:416:
FutureWarning: The parameter chunksize is deprecated for
pyarrow.Table.to_batches as of 0.15, please use the parameter max_chunksize
instead
for batch in orig.to_batches(chunksize=20)
apache_beam/io/parquetio_test.py::TestParquet::test_read_with_splitting_multiple_row_group
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/apache_beam/io/parquetio_test.py>:377:
FutureWarning: The parameter chunksize is deprecated for
pyarrow.Table.to_batches as of 0.15, please use the parameter max_chunksize
instead
pa.Table.from_batches([batch]) for batch in self._records_as_arrow(
apache_beam/io/parquetio_test.py::TestParquet::test_read_without_splitting_multiple_row_group
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/apache_beam/io/parquetio_test.py>:367:
FutureWarning: The parameter chunksize is deprecated for
pyarrow.Table.to_batches as of 0.15, please use the parameter max_chunksize
instead
pa.Table.from_batches([batch]) for batch in self._records_as_arrow(
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file:
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/pytest_py38-pyarrow-4_no_xdist.xml>
-
====== 28 passed, 3 skipped, 4698 deselected, 7 warnings in 46.77 seconds ======
[1mpy38-pyarrow-4 run-test-post: commands[0] | bash
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary
____________________________________
[32m py38-pyarrow-4: commands succeeded
[0m[32m congratulations :)
[0m
> Task :sdks:python:test-suites:tox:py38:preCommitPy38
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:tox:py37:testPy37Cloud'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:tox:py36:testPy36Cloud'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 40m 37s
103 actionable tasks: 74 executed, 29 from cache
Publishing build scan...
https://gradle.com/s/ympejdcvyuzya
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
