See
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Integration_Cron/23/display/redirect?page=changes>
Changes:
[noreply] Add doLast on Playground integration tests (#24954) (#24955)
------------------------------------------
[...truncated 62.32 KB...]
============================= test session starts ==============================
platform linux -- Python 3.10.2, pytest-7.2.0, pluggy-1.0.0
rootdir:
/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_Integration_Cron/src/sdks/python,
configfile: pytest.ini
plugins: xdist-2.5.0, timeout-2.1.0, forked-1.4.0, requests-mock-1.10.0,
hypothesis-6.62.0
timeout: 1800.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I
[gw1] Python 3.10.2 (main, Jan 15 2022, 18:02:07) [GCC 9.3.0]
[gw0] Python 3.10.2 (main, Jan 15 2022, 18:02:07) [GCC 9.3.0]
gw0 [1] / gw1 [1]
scheduling tests via LoadScheduling
apache_beam/examples/streaming_wordcount_it_test.py::StreamingWordCountIT::test_streaming_wordcount_it
> Task :sdks:python:test-suites:dataflow:py37:preCommitIT_batch
[gw0] PASSED
apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it
=============================== warnings summary ===============================
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_Integration_Cron/src/build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15:
DeprecationWarning: the imp module is deprecated in favour of importlib; see
the module's documentation for alternative uses
from imp import load_source
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file:
/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_Integration_Cron/src/sdks/python/pytest_preCommitIT-df-py37.xml
-
================== 1 passed, 3 warnings in 748.50s (0:12:28) ===================
> Task :sdks:python:test-suites:dataflow:py37:preCommitIT_streaming
>>> RUNNING integration tests with pipeline options:
>>> --runner=TestDataflowRunner --project=apache-beam-testing
>>> --region=us-central1
>>> --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it
>>> --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it
>>> --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output
>>> --sdk_location=/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_Integration_Cron/src/sdks/python/build/apache-beam.tar.gz
>>> --requirements_file=postcommit_requirements.txt --num_workers=1
>>> --sleep_secs=20 --streaming --experiments=use_runner_v2
>>> --enable_streaming_engine
>>> --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>>
>>> --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options:
>>> apache_beam/examples/streaming_wordcount_it_test.py::StreamingWordCountIT::test_streaming_wordcount_it
>>> --capture=no --numprocesses=2 --timeout=1800
>>> collect markers:
============================= test session starts ==============================
platform linux -- Python 3.7.12, pytest-7.2.0, pluggy-1.0.0
rootdir:
/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_Integration_Cron/src/sdks/python,
configfile: pytest.ini
plugins: xdist-2.5.0, timeout-2.1.0, forked-1.4.0, requests-mock-1.10.0,
hypothesis-6.62.0
timeout: 1800.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I
[gw0] Python 3.7.12 (default, Jan 15 2022, 18:42:10) -- [GCC 9.3.0]
[gw1] Python 3.7.12 (default, Jan 15 2022, 18:42:10) -- [GCC 9.3.0]
gw0 [1] / gw1 [1]
scheduling tests via LoadScheduling
apache_beam/examples/streaming_wordcount_it_test.py::StreamingWordCountIT::test_streaming_wordcount_it
> Task :sdks:python:test-suites:dataflow:py310:preCommitIT_streaming
[gw1] PASSED
apache_beam/examples/streaming_wordcount_it_test.py::StreamingWordCountIT::test_streaming_wordcount_it
=============================== warnings summary ===============================
../../build/gradleenv/2050596098/lib/python3.10/site-packages/hdfs/config.py:15
../../build/gradleenv/2050596098/lib/python3.10/site-packages/hdfs/config.py:15
../../build/gradleenv/2050596098/lib/python3.10/site-packages/hdfs/config.py:15
/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_Integration_Cron/src/build/gradleenv/2050596098/lib/python3.10/site-packages/hdfs/config.py:15:
DeprecationWarning: the imp module is deprecated in favour of importlib and
slated for removal in Python 3.12; see the module's documentation for
alternative uses
from imp import load_source
apache_beam/examples/streaming_wordcount_it_test.py::StreamingWordCountIT::test_streaming_wordcount_it
apache_beam/examples/streaming_wordcount_it_test.py::StreamingWordCountIT::test_streaming_wordcount_it
/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_Integration_Cron/src/build/gradleenv/2050596098/lib/python3.10/site-packages/httplib2/__init__.py:147:
DeprecationWarning: ssl.PROTOCOL_TLS is deprecated
context = ssl.SSLContext(DEFAULT_TLS_VERSION)
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file:
/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_Integration_Cron/src/sdks/python/pytest_preCommitIT-df-py310.xml
-
================== 1 passed, 5 warnings in 745.81s (0:12:25) ===================
> Task :sdks:python:test-suites:dataflow:py310:preCommitIT_batch_V2
>>> RUNNING integration tests with pipeline options:
>>> --runner=TestDataflowRunner --project=apache-beam-testing
>>> --region=us-central1
>>> --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it
>>> --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it
>>> --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output
>>> --sdk_location=/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_Integration_Cron/src/sdks/python/build/apache-beam.tar.gz
>>> --requirements_file=postcommit_requirements.txt --num_workers=1
>>> --sleep_secs=20 --experiments=use_runner_v2 --experiments=beam_fn_api
>>> --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>>
>>> --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options:
>>> apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it
>>> --capture=no --numprocesses=2 --timeout=1800
>>> collect markers:
============================= test session starts ==============================
platform linux -- Python 3.10.2, pytest-7.2.0, pluggy-1.0.0
rootdir:
/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_Integration_Cron/src/sdks/python,
configfile: pytest.ini
plugins: xdist-2.5.0, timeout-2.1.0, forked-1.4.0, requests-mock-1.10.0,
hypothesis-6.62.0
timeout: 1800.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I
[gw0] Python 3.10.2 (main, Jan 15 2022, 18:02:07) [GCC 9.3.0]
[gw1] Python 3.10.2 (main, Jan 15 2022, 18:02:07) [GCC 9.3.0]
gw0 [1] / gw1 [1]
scheduling tests via LoadScheduling
apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it
> Task :sdks:python:test-suites:dataflow:py37:preCommitIT_streaming
[gw0] PASSED
apache_beam/examples/streaming_wordcount_it_test.py::StreamingWordCountIT::test_streaming_wordcount_it
=============================== warnings summary ===============================
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_Integration_Cron/src/build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15:
DeprecationWarning: the imp module is deprecated in favour of importlib; see
the module's documentation for alternative uses
from imp import load_source
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file:
/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_Integration_Cron/src/sdks/python/pytest_preCommitIT-df-py37.xml
-
================== 1 passed, 3 warnings in 797.24s (0:13:17) ===================
> Task :sdks:python:test-suites:dataflow:preCommitIT
> Task :sdks:python:test-suites:dataflow:py37:preCommitIT_batch_V2
>>> RUNNING integration tests with pipeline options:
>>> --runner=TestDataflowRunner --project=apache-beam-testing
>>> --region=us-central1
>>> --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it
>>> --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it
>>> --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output
>>> --sdk_location=/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_Integration_Cron/src/sdks/python/build/apache-beam.tar.gz
>>> --requirements_file=postcommit_requirements.txt --num_workers=1
>>> --sleep_secs=20 --experiments=use_runner_v2 --experiments=beam_fn_api
>>> --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>>
>>> --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options:
>>> apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it
>>> --capture=no --numprocesses=2 --timeout=1800
>>> collect markers:
============================= test session starts ==============================
platform linux -- Python 3.7.12, pytest-7.2.0, pluggy-1.0.0
rootdir:
/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_Integration_Cron/src/sdks/python,
configfile: pytest.ini
plugins: xdist-2.5.0, timeout-2.1.0, forked-1.4.0, requests-mock-1.10.0,
hypothesis-6.62.0
timeout: 1800.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I
[gw0] Python 3.7.12 (default, Jan 15 2022, 18:42:10) -- [GCC 9.3.0]
[gw1] Python 3.7.12 (default, Jan 15 2022, 18:42:10) -- [GCC 9.3.0]
gw0 [1] / gw1 [1]
scheduling tests via LoadScheduling
apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it
> Task :sdks:python:test-suites:dataflow:py310:preCommitIT_batch_V2
[gw0] PASSED
apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it
=============================== warnings summary ===============================
../../build/gradleenv/2050596098/lib/python3.10/site-packages/hdfs/config.py:15
../../build/gradleenv/2050596098/lib/python3.10/site-packages/hdfs/config.py:15
../../build/gradleenv/2050596098/lib/python3.10/site-packages/hdfs/config.py:15
/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_Integration_Cron/src/build/gradleenv/2050596098/lib/python3.10/site-packages/hdfs/config.py:15:
DeprecationWarning: the imp module is deprecated in favour of importlib and
slated for removal in Python 3.12; see the module's documentation for
alternative uses
from imp import load_source
apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it
apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it
apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it
apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it
apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it
apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it
apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it
apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it
/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_Integration_Cron/src/build/gradleenv/2050596098/lib/python3.10/site-packages/httplib2/__init__.py:147:
DeprecationWarning: ssl.PROTOCOL_TLS is deprecated
context = ssl.SSLContext(DEFAULT_TLS_VERSION)
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file:
/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_Integration_Cron/src/sdks/python/pytest_preCommitIT-df-py310.xml
-
================== 1 passed, 11 warnings in 680.03s (0:11:20) ==================
> Task :sdks:python:test-suites:dataflow:py310:preCommitIT_streaming_V2
>>> RUNNING integration tests with pipeline options:
>>> --runner=TestDataflowRunner --project=apache-beam-testing
>>> --region=us-central1
>>> --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it
>>> --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it
>>> --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output
>>> --sdk_location=/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_Integration_Cron/src/sdks/python/build/apache-beam.tar.gz
>>> --requirements_file=postcommit_requirements.txt --num_workers=1
>>> --sleep_secs=20 --streaming --experiments=use_runner_v2
>>> --enable_streaming_engine
>>> --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>>
>>> --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options:
>>> apache_beam/examples/streaming_wordcount_it_test.py::StreamingWordCountIT::test_streaming_wordcount_it
>>> --capture=no --numprocesses=2 --timeout=1800
>>> collect markers:
============================= test session starts ==============================
platform linux -- Python 3.10.2, pytest-7.2.0, pluggy-1.0.0
rootdir:
/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_Integration_Cron/src/sdks/python,
configfile: pytest.ini
plugins: xdist-2.5.0, timeout-2.1.0, forked-1.4.0, requests-mock-1.10.0,
hypothesis-6.62.0
timeout: 1800.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I
[gw0] Python 3.10.2 (main, Jan 15 2022, 18:02:07) [GCC 9.3.0]
[gw1] Python 3.10.2 (main, Jan 15 2022, 18:02:07) [GCC 9.3.0]
gw0 [1] / gw1 [1]
scheduling tests via LoadScheduling
apache_beam/examples/streaming_wordcount_it_test.py::StreamingWordCountIT::test_streaming_wordcount_it
> Task :sdks:python:test-suites:dataflow:py37:preCommitIT_batch_V2
[gw0] PASSED
apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it
=============================== warnings summary ===============================
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_Integration_Cron/src/build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15:
DeprecationWarning: the imp module is deprecated in favour of importlib; see
the module's documentation for alternative uses
from imp import load_source
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file:
/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_Integration_Cron/src/sdks/python/pytest_preCommitIT-df-py37.xml
-
================== 1 passed, 3 warnings in 715.51s (0:11:55) ===================
> Task :sdks:python:test-suites:dataflow:py37:preCommitIT_streaming_V2
>>> RUNNING integration tests with pipeline options:
>>> --runner=TestDataflowRunner --project=apache-beam-testing
>>> --region=us-central1
>>> --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it
>>> --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it
>>> --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output
>>> --sdk_location=/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_Integration_Cron/src/sdks/python/build/apache-beam.tar.gz
>>> --requirements_file=postcommit_requirements.txt --num_workers=1
>>> --sleep_secs=20 --streaming --experiments=use_runner_v2
>>> --enable_streaming_engine
>>> --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>>
>>> --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options:
>>> apache_beam/examples/streaming_wordcount_it_test.py::StreamingWordCountIT::test_streaming_wordcount_it
>>> --capture=no --numprocesses=2 --timeout=1800
>>> collect markers:
============================= test session starts ==============================
platform linux -- Python 3.7.12, pytest-7.2.0, pluggy-1.0.0
rootdir:
/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_Integration_Cron/src/sdks/python,
configfile: pytest.ini
plugins: xdist-2.5.0, timeout-2.1.0, forked-1.4.0, requests-mock-1.10.0,
hypothesis-6.62.0
timeout: 1800.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I
[gw0] Python 3.7.12 (default, Jan 15 2022, 18:42:10) -- [GCC 9.3.0]
[gw1] Python 3.7.12 (default, Jan 15 2022, 18:42:10) -- [GCC 9.3.0]
gw0 [1] / gw1 [1]
scheduling tests via LoadScheduling
apache_beam/examples/streaming_wordcount_it_test.py::StreamingWordCountIT::test_streaming_wordcount_it
FATAL: command execution failed
hudson.remoting.ChannelClosedException: Channel
"hudson.remoting.Channel@5fafe68a:apache-beam-jenkins-7": Remote call on
apache-beam-jenkins-7 failed. The channel is closing down or has closed down
at hudson.remoting.Channel.call(Channel.java:993)
at
hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:285)
at com.sun.proxy.$Proxy147.isAlive(Unknown Source)
at hudson.Launcher$RemoteLauncher$ProcImpl.isAlive(Launcher.java:1215)
at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:1207)
at hudson.Launcher$ProcStarter.join(Launcher.java:524)
at hudson.plugins.gradle.Gradle.perform(Gradle.java:317)
at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
at
hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:814)
at hudson.model.Build$BuildExecution.build(Build.java:199)
at hudson.model.Build$BuildExecution.doRun(Build.java:164)
at
hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:522)
at hudson.model.Run.execute(Run.java:1896)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:44)
at hudson.model.ResourceController.execute(ResourceController.java:101)
at hudson.model.Executor.run(Executor.java:442)
Caused by: java.io.IOException: Pipe closed after 0 cycles
at
org.apache.sshd.common.channel.ChannelPipedInputStream.read(ChannelPipedInputStream.java:126)
at
org.apache.sshd.common.channel.ChannelPipedInputStream.read(ChannelPipedInputStream.java:105)
at
hudson.remoting.FlightRecorderInputStream.read(FlightRecorderInputStream.java:94)
at
hudson.remoting.ChunkedInputStream.readHeader(ChunkedInputStream.java:75)
at
hudson.remoting.ChunkedInputStream.readUntilBreak(ChunkedInputStream.java:105)
at
hudson.remoting.ChunkedCommandTransport.readBlock(ChunkedCommandTransport.java:39)
at
hudson.remoting.AbstractSynchronousByteArrayCommandTransport.read(AbstractSynchronousByteArrayCommandTransport.java:34)
at
hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:61)
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
FATAL: Channel "hudson.remoting.Channel@5fafe68a:apache-beam-jenkins-7": Remote
call on apache-beam-jenkins-7 failed. The channel is closing down or has closed
down
java.io.IOException: Pipe closed after 0 cycles
at
org.apache.sshd.common.channel.ChannelPipedInputStream.read(ChannelPipedInputStream.java:126)
at
org.apache.sshd.common.channel.ChannelPipedInputStream.read(ChannelPipedInputStream.java:105)
at
hudson.remoting.FlightRecorderInputStream.read(FlightRecorderInputStream.java:94)
at
hudson.remoting.ChunkedInputStream.readHeader(ChunkedInputStream.java:75)
at
hudson.remoting.ChunkedInputStream.readUntilBreak(ChunkedInputStream.java:105)
at
hudson.remoting.ChunkedCommandTransport.readBlock(ChunkedCommandTransport.java:39)
at
hudson.remoting.AbstractSynchronousByteArrayCommandTransport.read(AbstractSynchronousByteArrayCommandTransport.java:34)
at
hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:61)
Caused: hudson.remoting.ChannelClosedException: Channel
"hudson.remoting.Channel@5fafe68a:apache-beam-jenkins-7": Remote call on
apache-beam-jenkins-7 failed. The channel is closing down or has closed down
at hudson.remoting.Channel.call(Channel.java:993)
at hudson.Launcher$RemoteLauncher.kill(Launcher.java:1150)
at
hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:534)
at hudson.model.Run.execute(Run.java:1896)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:44)
at hudson.model.ResourceController.execute(ResourceController.java:101)
at hudson.model.Executor.run(Executor.java:442)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
