Build failed in Jenkins: beam_PostCommit_Java_DataflowV2 #4030

[Apache Jenkins Server]

See 


Changes:

[noreply] Decommission all remaining jenkins jobs (#30113)


--
[...truncated 40.67 KB...]
> Task :sdks:java:harness:compileJava FROM-CACHE
> Task :sdks:java:harness:classes UP-TO-DATE
> Task :sdks:java:harness:jar
> Task :runners:java-fn-execution:compileJava FROM-CACHE
> Task :runners:java-fn-execution:classes UP-TO-DATE
> Task :runners:java-fn-execution:jar
> Task :sdks:java:extensions:avro:compileTestJava FROM-CACHE
> Task :sdks:java:expansion-service:compileJava FROM-CACHE
> Task :sdks:java:extensions:google-cloud-platform-core:compileTestJava 
> FROM-CACHE
> Task :sdks:java:expansion-service:classes UP-TO-DATE
> Task :sdks:java:extensions:avro:testClasses UP-TO-DATE
> Task :sdks:java:expansion-service:jar
> Task :sdks:java:extensions:avro:testJar
> Task :runners:core-java:compileTestJava FROM-CACHE
> Task :runners:direct-java:compileJava FROM-CACHE
> Task :runners:core-java:testClasses UP-TO-DATE
> Task :runners:direct-java:classes UP-TO-DATE
> Task :runners:core-java:testJar
> Task :sdks:java:extensions:google-cloud-platform-core:testClasses UP-TO-DATE
> Task :sdks:java:extensions:google-cloud-platform-core:testJar
> Task :sdks:java:io:kafka:compileJava FROM-CACHE
> Task :sdks:java:io:kafka:classes UP-TO-DATE
> Task :sdks:java:io:kafka:jar
> Task :sdks:java:harness:shadowJar FROM-CACHE
> Task :runners:direct-java:shadowJar FROM-CACHE
> Task :sdks:java:container:java8:copyDockerfileDependencies
> Task :runners:direct-java:compileTestJava FROM-CACHE
> Task :runners:direct-java:testClasses UP-TO-DATE
> Task :sdks:java:io:google-cloud-platform:compileJava FROM-CACHE
> Task :sdks:java:io:google-cloud-platform:classes UP-TO-DATE
> Task :runners:direct-java:shadowTestJar FROM-CACHE
> Task :sdks:java:extensions:protobuf:extractIncludeTestProto
> Task :sdks:java:io:google-cloud-platform:jar
> Task :sdks:java:extensions:protobuf:generateTestProto FROM-CACHE

> Task :sdks:java:container:pullLicenses
Collecting pip

> Task :sdks:java:extensions:protobuf:compileTestJava FROM-CACHE
> Task :sdks:java:extensions:protobuf:testClasses
> Task :runners:google-cloud-dataflow-java:compileJava FROM-CACHE
> Task :runners:google-cloud-dataflow-java:classes
> Task :sdks:java:extensions:protobuf:testJar
> Task :runners:google-cloud-dataflow-java:jar

> Task :release:go-licenses:java:dockerRun
go: downloading github.com/golang/protobuf v1.5.3
go: downloading google.golang.org/grpc v1.59.0
go: downloading google.golang.org/protobuf v1.31.0
go: downloading golang.org/x/sys v0.15.0
go: downloading golang.org/x/net v0.19.0
go: downloading google.golang.org/genproto/googleapis/rpc 
v0.0.0-20231120223509-83a465c0220f
go: downloading google.golang.org/genproto v0.0.0-20231106174013-bbf56f31fb17
go: downloading golang.org/x/text v0.14.0

> Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE
> Task :sdks:java:io:google-cloud-platform:testClasses
> Task :sdks:java:io:google-cloud-platform:testJar

> Task :sdks:java:container:pullLicenses
  Using cached pip-23.3.2-py3-none-any.whl (2.1 MB)
Collecting setuptools
  Using cached setuptools-69.0.3-py3-none-any.whl (819 kB)
Collecting wheel
  Using cached wheel-0.42.0-py3-none-any.whl (65 kB)
Installing collected packages: pip, setuptools, wheel
  Attempting uninstall: pip
Found existing installation: pip 20.0.2
Uninstalling pip-20.0.2:
  Successfully uninstalled pip-20.0.2
  Attempting uninstall: setuptools
Found existing installation: setuptools 44.0.0
Uninstalling setuptools-44.0.0:
  Successfully uninstalled setuptools-44.0.0
Successfully installed pip-23.3.2 setuptools-69.0.3 wheel-0.42.0
Collecting beautifulsoup4<5.0,>=4.9.0 (from -r 
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Java_DataflowV2/src/sdks/java/container/license_scripts/requirement.txt
 (line 19))
  Using cached beautifulsoup4-4.12.3-py3-none-any.whl.metadata (3.8 kB)
Collecting pyyaml<7,>=6.0.1 (from -r 
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Java_DataflowV2/src/sdks/java/container/license_scripts/requirement.txt
 (line 20))
  Using cached 
PyYAML-6.0.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata 
(2.1 kB)
Collecting tenacity<9.0,>=6.1.0 (from -r 
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Java_DataflowV2/src/sdks/java/container/license_scripts/requirement.txt
 (line 21))
  Using cached tenacity-8.2.3-py3-none-any.whl.metadata (1.0 kB)
Collecting soupsieve>1.2 (from beautifulsoup4<5.0,>=4.9.0->-r 
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Java_DataflowV2/src/sdks/java/container/license_scripts/requirement.txt
 (line 19))
  Using cached soupsieve-2.5-py3-none-any.whl.metadata (4.7 kB)
Using cached beautifulsoup4-4.12.3-py3-none-any.whl (147 kB)
Using cached 
PyYAML-6.0.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (736 kB)
Using cached 

Build failed in Jenkins: beam_PostCommit_Python311 #1158

[Apache Jenkins Server]

See 


Changes:

[noreply] Decommission all remaining jenkins jobs (#30113)


--
[...truncated 11.99 MB...]
   
  File 
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python311/src/build/gradleenv/-1720702906/lib/python3.11/site-packages/grpc/_channel.py",
 line 966, in _next
raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that 
terminated with:
status = StatusCode.UNAVAILABLE
details = "recvmsg:Connection reset by peer"
debug_error_string = "UNKNOWN:Error received from peer 
ipv6:%5B::1%5D:38045 {created_time:"2024-01-25T17:15:24.115698433+00:00", 
grpc_status:14, grpc_message:"recvmsg:Connection reset by peer"}"
>
Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.11/threading.py", line 1038, in _bootstrap_inner
self.run()
  File "/usr/lib/python3.11/threading.py", line 975, in run
self.run()
  File "/usr/lib/python3.11/threading.py", line 975, in run
self._target(*self._args, **self._kwargs)
  File 
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python311/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",
 line 1060, in pull_responses
self._target(*self._args, **self._kwargs)
self._target(*self._args, **self._kwargs)
  File 
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python311/src/sdks/python/apache_beam/runners/worker/data_plane.py",
 line 686, in 
  File 
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python311/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",
 line 266, in run
target=lambda: self._read_inputs(elements_iterator),
for response in responses:
   
  File 
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python311/src/sdks/python/apache_beam/runners/worker/data_plane.py",
 line 669, in _read_inputs
  File 
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python311/src/build/gradleenv/-1720702906/lib/python3.11/site-packages/grpc/_channel.py",
 line 540, in __next__
for work_request in self._control_stub.Control(get_responses()):
  File 
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python311/src/build/gradleenv/-1720702906/lib/python3.11/site-packages/grpc/_channel.py",
 line 540, in __next__
for elements in elements_iterator:
  File 
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python311/src/build/gradleenv/-1720702906/lib/python3.11/site-packages/grpc/_channel.py",
 line 540, in __next__
return self._next()
   
  File 
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python311/src/build/gradleenv/-1720702906/lib/python3.11/site-packages/grpc/_channel.py",
 line 966, in _next
return self._next()
return self._next()
   
   
  File 
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python311/src/build/gradleenv/-1720702906/lib/python3.11/site-packages/grpc/_channel.py",
 line 966, in _next
  File 
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python311/src/build/gradleenv/-1720702906/lib/python3.11/site-packages/grpc/_channel.py",
 line 966, in _next
raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that 
terminated with:
status = StatusCode.UNAVAILABLE
details = "recvmsg:Connection reset by peer"
debug_error_string = "UNKNOWN:Error received from peer 
ipv6:%5B::1%5D:38045 {created_time:"2024-01-25T17:15:24.115698433+00:00", 
grpc_status:14, grpc_message:"recvmsg:Connection reset by peer"}"
>
raise self
raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that 
terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "UNKNOWN:Error received from peer 
ipv6:%5B::1%5D:44521 {created_time:"2024-01-25T17:15:24.115703577+00:00", 
grpc_status:14, grpc_message:"Socket closed"}"
>
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that 
terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "UNKNOWN:Error received from peer 
ipv6:%5B::1%5D:38391 {created_time:"2024-01-25T17:15:24.115698521+00:00", 
grpc_status:14, grpc_message:"Socket closed"}"
>

> Task :sdks:python:test-suites:portable:py311:postCommitPy311

> Task :sdks:python:test-suites:dataflow:py311:postCommitIT

[gw6] PASSED 
apache_beam/dataframe/io_it_test.py::ReadUsingReadGbqTests::test_ReadGbq_export_with_project
 
apache_beam/dataframe/io_it_test.py::ReadUsingReadGbqTests::test_ReadGbq_with_computation
 
[gw4] PASSED 
apache_beam/io/gcp/bigquery_write_it_test.py::BigQueryWriteIntegrationTests::test_big_query_write_new_types
 

Build failed in Jenkins: beam_PostCommit_XVR_Direct #5097

[Apache Jenkins Server]

See 


Changes:

[noreply] Decommission all remaining jenkins jobs (#30113)


--
[...truncated 1.76 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:spanner_replace:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@524d6d96
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:spanner_insert_or_update:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@152aa092
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:spanner_delete:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@44a7bfbc
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:spanner_read:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4ef37659
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:kafka_read_with_metadata:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@776b83cc
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:kafka_read_without_metadata:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@37858383
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:kafka_write:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e268090
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:external:java:generate_sequence:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1bb266b3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:bigquery_read:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@306cf3ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:bigquery_write:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2beee7ff
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:pubsub_read:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5136d012
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:pubsub_write:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5939a379
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:pubsub_write:v2: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@e1de817
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:combine_globally:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@52102734
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:combine_grouped_values:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3541cb24
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:combine_per_key:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2177849e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:create_view:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@40cb8df7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:flatten:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@13b13b5d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:group_by_key:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2892dae4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:group_into_batches:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@355ce81c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:group_into_batches_with_sharded_key:v1: 

Build failed in Jenkins: beam_PostCommit_Java_ValidatesRunner_Flink_Java11 #5467

[Apache Jenkins Server]

See 


Changes:

[noreply] Decommission all remaining jenkins jobs (#30113)


--
[...truncated 1.29 KB...]
Using shallow fetch with depth 1
Fetching upstream changes from https://github.com/apache/beam.git
 > git fetch --no-tags --force --progress --depth=1 -- 
 > https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* 
 > +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* # 
 > timeout=10
 > git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 93073e74e11aa3c5bc8448e7547bd4b7995e5c7b (origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 93073e74e11aa3c5bc8448e7547bd4b7995e5c7b # timeout=10
Commit message: "Decommission all remaining jenkins jobs (#30113)"
 > git rev-list --no-walk 61a62e19c4a822c92b3db5018ed1d522aad67423 # timeout=10
No emails were triggered.
[EnvInject] - Executing scripts and injecting environment variables after the 
SCM step.
[EnvInject] - Injecting as environment variables the properties content 
SETUPTOOLS_USE_DISTUTILS=stdlib
SPARK_LOCAL_IP=127.0.0.1

[EnvInject] - Variables injected successfully.
[Gradle] - Launching build.
[src] $ 

 -Dorg.gradle.java.home=/usr/lib/jvm/java-8-openjdk-amd64 
:runners:flink:1.15:jar :runners:flink:1.15:testJar
To honour the JVM settings for this build a single-use Daemon process will be 
forked. For more on this, please refer to 
https://docs.gradle.org/8.4/userguide/gradle_daemon.html#sec:disabling_the_daemon
 in the Gradle documentation.
Daemon will be stopped at the end of the build 
Configuration on demand is an incubating feature.
Gradle Enterprise plugins resolution: https://plugins.gradle.org/m2
Enforcing Gradle Enterprise: https://ge.apache.org, allowUntrustedServer: false
> Task :buildSrc:compileJava NO-SOURCE
> Task :buildSrc:compileGroovy FROM-CACHE
> Task :buildSrc:pluginDescriptors
> Task :buildSrc:processResources
> Task :buildSrc:classes
> Task :buildSrc:jar
> Task :sdks:java:extensions:avro:createCheckerFrameworkManifest
> Task :model:fn-execution:createCheckerFrameworkManifest
> Task :runners:core-construction-java:createCheckerFrameworkManifest
> Task :model:job-management:createCheckerFrameworkManifest
> Task :runners:java-fn-execution:createCheckerFrameworkManifest
> Task :sdks:java:core:createCheckerFrameworkManifest
> Task :model:pipeline:createCheckerFrameworkManifest
> Task :runners:core-java:createCheckerFrameworkManifest
> Task :sdks:java:expansion-service:createCheckerFrameworkManifest
> Task :sdks:java:build-tools:createCheckerFrameworkManifest
> Task :sdks:java:harness:createCheckerFrameworkManifest
> Task :sdks:java:transform-service:launcher:createCheckerFrameworkManifest
> Task :sdks:java:extensions:avro:generateAvroProtocol NO-SOURCE
> Task :runners:java-fn-execution:processResources NO-SOURCE
> Task :runners:core-construction-java:processResources NO-SOURCE
> Task 
> :sdks:java:extensions:google-cloud-platform-core:createCheckerFrameworkManifest
> Task :runners:core-java:processResources NO-SOURCE
> Task :sdks:java:expansion-service:processResources NO-SOURCE
> Task :sdks:java:harness:processResources NO-SOURCE
> Task :sdks:java:fn-execution:createCheckerFrameworkManifest
> Task :sdks:java:extensions:avro:generateAvroJava NO-SOURCE
> Task :runners:java-job-service:createCheckerFrameworkManifest
> Task :runners:core-java:processTestResources NO-SOURCE
> Task :sdks:java:extensions:google-cloud-platform-core:processResources 
> NO-SOURCE
> Task :model:fn-execution:extractProto
> Task :model:job-management:extractProto
> Task :runners:java-job-service:processResources NO-SOURCE
> Task :sdks:java:extensions:avro:processResources NO-SOURCE
> Task :sdks:java:fn-execution:processResources NO-SOURCE
> Task :runners:flink:1.15:copySourceOverrides
> Task :sdks:java:extensions:arrow:createCheckerFrameworkManifest
> Task :runners:flink:1.15:createCheckerFrameworkManifest
> Task :sdks:java:extensions:protobuf:createCheckerFrameworkManifest
> Task :runners:flink:1.15:copyResourcesOverrides NO-SOURCE
> Task :sdks:java:extensions:arrow:processResources NO-SOURCE
> Task :model:job-management:processResources
> Task :sdks:java:io:google-cloud-platform:createCheckerFrameworkManifest
> Task :sdks:java:extensions:protobuf:extractProto
> Task :sdks:java:core:generateGrammarSource FROM-CACHE
> Task :model:fn-execution:processResources
> Task :sdks:java:extensions:protobuf:processResources NO-SOURCE
> Task :runners:flink:1.15:processResources
> Task :sdks:java:io:google-cloud-platform:processResources NO-SOURCE
> Task :runners:flink:1.15:copyTestSourceOverrides
> Task :runners:flink:1.15:copyTestResourcesOverrides NO-SOURCE
> Task :runners:flink:1.15:processTestResources
> Task :sdks:java:core:processResources
> 

Build failed in Jenkins: beam_PostCommit_Python310 #1820

[Apache Jenkins Server]

See 


Changes:

[noreply] Decommission all remaining jenkins jobs (#30113)


--
[...truncated 11.92 MB...]
apitools.base.py.exceptions.HttpBadRequestError: HttpError accessing 
:
 response: <{'vary': 'Origin, X-Origin, Referer', 'content-type': 
'application/json; charset=UTF-8', 'date': 'Thu, 25 Jan 2024 15:19:57 GMT', 
'server': 'ESF', 'cache-control': 'private', 'x-xss-protection': '0', 
'x-frame-options': 'SAMEORIGIN', 'x-content-type-options': 'nosniff', 
'transfer-encoding': 'chunked', 'status': '400', 'content-length': '318', 
'-content-encoding': 'gzip'}>, content <{
  "error": {
"code": 400,
"message": "Load configuration must specify at least one source URI",
"errors": [
  {
"message": "Load configuration must specify at least one source URI",
"domain": "global",
"reason": "invalid"
  }
],
"status": "INVALID_ARGUMENT"
  }
}
>

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/runners/worker/sdk_worker.py",
 line 311, in _execute
response = task()
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/runners/worker/sdk_worker.py",
 line 386, in 
lambda: self.create_worker().do_instruction(request), request)
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/runners/worker/sdk_worker.py",
 line 650, in do_instruction
return getattr(self, request_type)(
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/runners/worker/sdk_worker.py",
 line 688, in process_bundle
bundle_processor.process_bundle(instruction_id))
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/runners/worker/bundle_processor.py",
 line 1113, in process_bundle
input_op_by_transform_id[element.transform_id].process_encoded(
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/runners/worker/bundle_processor.py",
 line 237, in process_encoded
self.output(decoded_value)
  File "apache_beam/runners/worker/operations.py", line 570, in 
apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 572, in 
apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 263, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 266, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 953, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/worker/operations.py", line 954, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/common.py", line 1437, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 1526, in 
apache_beam.runners.common.DoFnRunner._reraise_augmented
  File "apache_beam/runners/common.py", line 1435, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 636, in 
apache_beam.runners.common.SimpleInvoker.invoke_process
  File "apache_beam/runners/common.py", line 1621, in 
apache_beam.runners.common._OutputHandler.handle_process_outputs
  File "apache_beam/runners/common.py", line 1736, in 
apache_beam.runners.common._OutputHandler._write_value_to_tag
  File "apache_beam/runners/worker/operations.py", line 263, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 266, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 1351, in 
apache_beam.runners.worker.operations.FlattenOperation.process
  File "apache_beam/runners/worker/operations.py", line 1354, in 
apache_beam.runners.worker.operations.FlattenOperation.process
  File "apache_beam/runners/worker/operations.py", line 572, in 
apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 263, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 266, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 953, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/worker/operations.py", line 954, in 

Build failed in Jenkins: beam_PostCommit_Python38 #5086

[Apache Jenkins Server]

See 


Changes:


--
[...truncated 12.25 MB...]
return getattr(self, request_type)(
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py",
 line 688, in process_bundle
bundle_processor.process_bundle(instruction_id))
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py",
 line 1113, in process_bundle
input_op_by_transform_id[element.transform_id].process_encoded(
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py",
 line 237, in process_encoded
self.output(decoded_value)
  File "apache_beam/runners/worker/operations.py", line 570, in 
apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 572, in 
apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 263, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 266, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 953, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/worker/operations.py", line 954, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/common.py", line 1437, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 1526, in 
apache_beam.runners.common.DoFnRunner._reraise_augmented
  File "apache_beam/runners/common.py", line 1435, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 636, in 
apache_beam.runners.common.SimpleInvoker.invoke_process
  File "apache_beam/runners/common.py", line 1621, in 
apache_beam.runners.common._OutputHandler.handle_process_outputs
  File "apache_beam/runners/common.py", line 1736, in 
apache_beam.runners.common._OutputHandler._write_value_to_tag
  File "apache_beam/runners/worker/operations.py", line 263, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 266, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 1351, in 
apache_beam.runners.worker.operations.FlattenOperation.process
  File "apache_beam/runners/worker/operations.py", line 1354, in 
apache_beam.runners.worker.operations.FlattenOperation.process
  File "apache_beam/runners/worker/operations.py", line 572, in 
apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 263, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 266, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 953, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/worker/operations.py", line 954, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/common.py", line 1437, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 1547, in 
apache_beam.runners.common.DoFnRunner._reraise_augmented
  File "apache_beam/runners/common.py", line 1435, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 851, in 
apache_beam.runners.common.PerWindowInvoker.invoke_process
  File "apache_beam/runners/common.py", line 995, in 
apache_beam.runners.common.PerWindowInvoker._invoke_process_per_window
  File "apache_beam/runners/common.py", line 1611, in 
apache_beam.runners.common._OutputHandler.handle_process_outputs
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.8/site-packages/apache_beam/io/gcp/bigquery_file_loads.py",
 line 750, in process
job_reference = self.bq_wrapper.perform_load_job(
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.8/site-packages/apache_beam/io/gcp/bigquery_tools.py",
 line 1022, in perform_load_job
return self._insert_load_job(
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.8/site-packages/apache_beam/utils/retry.py",
 line 298, in wrapper
return fun(*args, **kwargs)
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.8/site-packages/apache_beam/io/gcp/bigquery_tools.py",
 line 559, in _insert_load_job
return self._start_job(request, stream=source_stream).jobReference
  File 

Build failed in Jenkins: beam_SeedJob_Standalone #11033

[Apache Jenkins Server]

See 


Changes:

[noreply] Decommission all remaining jenkins jobs (#30113)


--
Started by timer
Running as SYSTEM
[EnvInject] - Loading node environment variables.
Building remotely on apache-beam-jenkins-13 (beam) in workspace 

The recommended git tool is: NONE
No credentials specified
 > git rev-parse --resolve-git-dir 
 >  # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
 > git --version # timeout=10
 > git --version # 'git version 2.25.1'
 > git fetch --tags --force --progress -- https://github.com/apache/beam.git 
 > +refs/heads/*:refs/remotes/origin/* 
 > +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* # 
 > timeout=10
 > git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 93073e74e11aa3c5bc8448e7547bd4b7995e5c7b (origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 93073e74e11aa3c5bc8448e7547bd4b7995e5c7b # timeout=10
Commit message: "Decommission all remaining jenkins jobs (#30113)"
 > git rev-list --no-walk 61a62e19c4a822c92b3db5018ed1d522aad67423 # timeout=10
Cleaning workspace
 > git rev-parse --verify HEAD # timeout=10
Resetting working tree
 > git reset --hard # timeout=10
 > git clean -fdx # timeout=10
ERROR: no Job DSL script(s) found at .test-infra/jenkins/job_*.groovy

-
To unsubscribe, e-mail: builds-unsubscr...@beam.apache.org
For additional commands, e-mail: builds-h...@beam.apache.org

Jenkins build is back to normal : beam_PostCommit_Java_ValidatesRunner_Flink #12790

[Apache Jenkins Server]

See 



-
To unsubscribe, e-mail: builds-unsubscr...@beam.apache.org
For additional commands, e-mail: builds-h...@beam.apache.org

Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #2623

[Apache Jenkins Server]

See 


Changes:


--
[...truncated 1.24 MB...]
  "namespace": "go_options",
  "type": "STRING",
  "value": "true"
},
{
  "key": "test.timeout",
  "namespace": "go_options",
  "type": "STRING",
  "value": "3h0m0s"
},
{
  "key": "bt_instance",
  "namespace": "go_options",
  "type": "STRING",
  "value": "projects/apache-beam-testing/instances/beam-test"
},
{
  "key": "expansion_addr",
  "namespace": "go_options",
  "type": "STRING",
  "value": "[test:localhost:42533]"
},
{
  "key": "temp_location",
  "namespace": "go_options",
  "type": "STRING",
  "value": 
"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test4786"
}
  ],
  "options": {
"experiments": [
  "beam_fn_api",
  "use_runner_v2",
  "use_unified_worker",
  "use_portable_job_submission"
],
"pipelineUrl": 
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test4786/go-2-1706193420932849694/model",
"region": "us-central1",
"tempLocation": 
"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test4786"
  },
  "beam:option:go_options:v1": {
"options": {
  "bq_dataset": "apache-beam-testing.beam_bigquery_io_test_temp",
  "bt_instance": "projects/apache-beam-testing/instances/beam-test",
  "expansion_addr": "[test:localhost:42533]",
  "expansion_jar": 
"[io:
 
schemaio:
 
debeziumio:
 
gcpio:
  "experiments": 
"beam_fn_api,use_runner_v2,use_unified_worker,use_portable_job_submission",
  "hookOrder": "[\"default_remote_logging\"]",
  "hooks": "{\"default_remote_logging\":null}",
  "kafka_jar": 
"
  "sdk_harness_container_image_override": 
"[.*java.*,us.gcr.io/apache-beam-testing/java-postcommit-it/java:20240125142043]",
  "temp_location": 
"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test4786",
  "test.paniconexit0": "true",
  "test.timeout": "3h0m0s",
  "test.v": "true"
}
  }
},
"tempStoragePrefix": 
"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test4786",
"userAgent": {
  "name": "Apache Beam SDK for Go",
  "version": "2.55.0.dev"
},
"version": {
  "job_type": "FNAPI_BATCH",
  "major": "6"
},
"workerPools": [
  {
"autoscalingSettings": {},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 1,
"packages": [
  {
"location": 
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test4786/go-2-1706193420932849694/worker",
"name": "worker"
  },
  {
"location": 
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test4786/go-2-1706193420932849694/xlang/beam-sdks-java-io-google-cloud-platform-expansion-service-2.55.0-SNAPSHOT-Rl5Li4_jNz8tkNrb-pAhLFpzoGdvjSP6m_kWJcr34OM.jar",
"name": 
"beam-sdks-java-io-google-cloud-platform-expansion-service-2.55.0-SNAPSHOT-Rl5Li4_jNz8tkNrb-pAhLFpzoGdvjSP6m_kWJcr34OM.jar"
  }
],
"sdkHarnessContainerImages": [
  {
"capabilities": [
  "beam:protocol:progress_reporting:v1",
  "beam:protocol:multi_core_bundle_processing:v1",
  "beam:transform:sdf_truncate_sized_restrictions:v1",
  "beam:protocol:worker_status:v1",
  "beam:protocol:monitoring_info_short_ids:v1",
  "beam:version:sdk_base:go:apache/beam_go_sdk:2.55.0.dev",
  "beam:transform:to_string:v1",

Build failed in Jenkins: beam_PostCommit_Python39 #2807

[Apache Jenkins Server]

See 


Changes:


--
[...truncated 8.22 MB...]

INFO:root:severity: INFO
timestamp {
  seconds: 1706186479
  nanos: 880798578
}
message: "SDK Harness waiting for in-flight requests to complete"
log_location: 
"/usr/local/lib/python3.9/site-packages/apache_beam/runners/worker/sdk_worker.py:289"
thread: "MainThread"

INFO:root:severity: INFO
timestamp {
  seconds: 1706186479
  nanos: 880876779
}
message: "Closing all cached grpc data channels."
log_location: 
"/usr/local/lib/python3.9/site-packages/apache_beam/runners/worker/data_plane.py:820"
thread: "MainThread"

INFO:root:severity: INFO
timestamp {
  seconds: 1706186479
  nanos: 880944490
}
message: "Closing all cached gRPC state handlers."
log_location: 
"/usr/local/lib/python3.9/site-packages/apache_beam/runners/worker/sdk_worker.py:929"
thread: "MainThread"

INFO:root:severity: INFO
timestamp {
  seconds: 1706186479
  nanos: 881733655
}
message: "Done consuming work."
log_location: 
"/usr/local/lib/python3.9/site-packages/apache_beam/runners/worker/sdk_worker.py:301"
thread: "MainThread"

INFO:root:severity: INFO
timestamp {
  seconds: 1706186479
  nanos: 881847381
}
message: "Python sdk harness exiting."
log_location: 
"/usr/local/lib/python3.9/site-packages/apache_beam/runners/worker/sdk_worker_main.py:213"
thread: "MainThread"

173f01634ebf521caab901db0cd3e9fa79873f7ba492d7212cdb5cb64a070d8a
INFO:apache_beam.runners.portability.local_job_service:Completed job in 
35.60045385360718 seconds with state DONE.
INFO:root:Completed job in 35.60045385360718 seconds with state DONE.
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE

> Task :sdks:python:test-suites:portable:py39:portableWordCountSparkRunnerBatch
INFO:apache_beam.runners.worker.worker_pool_main:Listening for workers at 
localhost:36093
INFO:apache_beam.runners.portability.fn_api_runner.translations:
  
INFO:apache_beam.runners.portability.fn_api_runner.translations:
  
INFO:apache_beam.runners.portability.fn_api_runner.translations:
  
INFO:apache_beam.utils.subprocess_server:Starting service with ('java' '-jar' 
'
 '--spark-master-url' 'local[4]' '--artifacts-dir' 
'/tmp/beam-tempotve5sha/artifactsdty6jhl4' '--job-port' '58783' 
'--artifact-port' '0' '--expansion-port' '0')
INFO:apache_beam.utils.subprocess_server:24/01/25 12:41:31 WARN 
software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to 
retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:24/01/25 12:41:32 INFO 
org.apache.beam.runners.jobsubmission.JobServerDriver: ArtifactStagingService 
started on localhost:36667
INFO:apache_beam.utils.subprocess_server:24/01/25 12:41:32 INFO 
org.apache.beam.runners.jobsubmission.JobServerDriver: Java ExpansionService 
started on localhost:35683
INFO:apache_beam.utils.subprocess_server:24/01/25 12:41:32 INFO 
org.apache.beam.runners.jobsubmission.JobServerDriver: JobService started on 
localhost:58783
INFO:apache_beam.utils.subprocess_server:24/01/25 12:41:32 INFO 
org.apache.beam.runners.jobsubmission.JobServerDriver: Job server now running, 
terminate with Ctrl+C
WARNING:root:Waiting for grpc channel to be ready at localhost:58783.
INFO:apache_beam.utils.subprocess_server:24/01/25 12:41:33 INFO 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Staging 
artifacts for job_33fe9a6b-2c58-4d77-b9db-5c6de6bb207c.
INFO:apache_beam.utils.subprocess_server:24/01/25 12:41:33 INFO 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Resolving 
artifacts for 
job_33fe9a6b-2c58-4d77-b9db-5c6de6bb207c.0:ref_Environment_default_environment_1.
INFO:apache_beam.utils.subprocess_server:24/01/25 12:41:33 INFO 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Getting 1 
artifacts for job_33fe9a6b-2c58-4d77-b9db-5c6de6bb207c.null.
INFO:apache_beam.utils.subprocess_server:24/01/25 12:41:33 INFO 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Artifacts 
fully staged for job_33fe9a6b-2c58-4d77-b9db-5c6de6bb207c.
INFO:apache_beam.utils.subprocess_server:24/01/25 12:41:34 INFO 
org.apache.beam.runners.spark.SparkJobInvoker: Invoking job 
BeamApp-jenkins-0125124134-a50b9acb_cb328bc3-63a4-4072-a60b-e3414e3a4810
INFO:apache_beam.utils.subprocess_server:24/01/25 12:41:34 INFO 
org.apache.beam.runners.jobsubmission.JobInvocation: Starting job invocation 
BeamApp-jenkins-0125124134-a50b9acb_cb328bc3-63a4-4072-a60b-e3414e3a4810
INFO:apache_beam.runners.portability.portable_runner:Environment "LOOPBACK" has 
started a component necessary for the execution. Be sure to run the pipeline 
using
  with 

Jenkins build is back to normal : beam_PostCommit_Java_DataflowV2 #4029

[Apache Jenkins Server]

See 



-
To unsubscribe, e-mail: builds-unsubscr...@beam.apache.org
For additional commands, e-mail: builds-h...@beam.apache.org

Build failed in Jenkins: beam_PostCommit_Python311 #1157

[Apache Jenkins Server]

See 


Changes:


--
[...truncated 11.85 MB...]
  File "apache_beam/runners/common.py", line 995, in 
apache_beam.runners.common.PerWindowInvoker._invoke_process_per_window
  File "apache_beam/runners/common.py", line 1611, in 
apache_beam.runners.common._OutputHandler.handle_process_outputs
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.11/site-packages/apache_beam/io/gcp/bigquery_file_loads.py",
 line 750, in process
job_reference = self.bq_wrapper.perform_load_job(
^
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.11/site-packages/apache_beam/io/gcp/bigquery_tools.py",
 line 1022, in perform_load_job
return self._insert_load_job(
   ^^
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.11/site-packages/apache_beam/utils/retry.py",
 line 298, in wrapper
return fun(*args, **kwargs)
   
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.11/site-packages/apache_beam/io/gcp/bigquery_tools.py",
 line 559, in _insert_load_job
return self._start_job(request, stream=source_stream).jobReference
   ^^
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.11/site-packages/apache_beam/io/gcp/bigquery_tools.py",
 line 578, in _start_job
response = self.client.jobs.Insert(request, upload=upload)
   ^^^
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.11/site-packages/apache_beam/io/gcp/internal/clients/bigquery/bigquery_v2_client.py",
 line 356, in Insert
return self._RunMethod(
   
  File "/usr/local/lib/python3.11/site-packages/apitools/base/py/base_api.py", 
line 731, in _RunMethod
return self.ProcessHttpResponse(method_config, http_response, request)
   ^^^
  File "/usr/local/lib/python3.11/site-packages/apitools/base/py/base_api.py", 
line 737, in ProcessHttpResponse
self.__ProcessHttpResponse(method_config, http_response, request))
^
  File "/usr/local/lib/python3.11/site-packages/apitools/base/py/base_api.py", 
line 603, in __ProcessHttpResponse
raise exceptions.HttpError.FromResponse(
RuntimeError: apitools.base.py.exceptions.HttpBadRequestError: HttpError 
accessing 
:
 response: <{'vary': 'Origin, X-Origin, Referer', 'content-type': 
'application/json; charset=UTF-8', 'date': 'Thu, 25 Jan 2024 11:06:03 GMT', 
'server': 'ESF', 'cache-control': 'private', 'x-xss-protection': '0', 
'x-frame-options': 'SAMEORIGIN', 'x-content-type-options': 'nosniff', 
'transfer-encoding': 'chunked', 'status': '400', 'content-length': '318', 
'-content-encoding': 'gzip'}>, content <{
  "error": {
"code": 400,
"message": "Load configuration must specify at least one source URI",
"errors": [
  {
"message": "Load configuration must specify at least one source URI",
"domain": "global",
"reason": "invalid"
  }
],
"status": "INVALID_ARGUMENT"
  }
}
> [while running 
> 'WriteWithMultipleDestsFreely/BigQueryBatchFileLoads/TriggerLoadJobsWithTempTables/ParDo(TriggerLoadJobs)-ptransform-71']

  Worker ID: beamapp-jenkins-012511023-01250302-5xp1-harness-w0lz
INFO 
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:201 
2024-01-25T11:06:04.892Z: JOB_MESSAGE_BASIC: Finished operation 
WriteWithMultipleDests/BigQueryBatchFileLoads/GroupShardedRows/Read+WriteWithMultipleDests/BigQueryBatchFileLoads/DropShardNumber+WriteWithMultipleDests/BigQueryBatchFileLoads/WriteGroupedRecordsToFile+WriteWithMultipleDests/BigQueryBatchFileLoads/DestinationFilesUnion/InputIdentity+WriteWithMultipleDests/BigQueryBatchFileLoads/IdentityWorkaround+WriteWithMultipleDests/BigQueryBatchFileLoads/GroupFilesByTableDestinations/Write
INFO 
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:201 
2024-01-25T11:06:05.218Z: JOB_MESSAGE_BASIC: Stopping worker pool...
INFO 
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:201 
2024-01-25T11:08:16.570Z: JOB_MESSAGE_BASIC: Worker pool stopped.
INFO 
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:151 Job 
2024-01-25_03_02_35-4556418147885796967 is in state JOB_STATE_FAILED
ERROR    
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:777 Console 
URL: 
https://console.cloud.google.com/dataflow/jobs//2024-01-25_03_02_35-4556418147885796967?project=
INFO 

Build failed in Jenkins: beam_PostCommit_XVR_Direct #5096

[Apache Jenkins Server]

See 


Changes:


--
[...truncated 1.63 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:spanner_replace:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@524d6d96
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:spanner_insert_or_update:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@152aa092
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:spanner_delete:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@44a7bfbc
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:spanner_read:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4ef37659
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:kafka_read_with_metadata:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@776b83cc
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:kafka_read_without_metadata:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@37858383
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:kafka_write:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e268090
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:external:java:generate_sequence:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1bb266b3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:bigquery_read:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@306cf3ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:bigquery_write:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2beee7ff
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:pubsub_read:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5136d012
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:pubsub_write:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5939a379
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:pubsub_write:v2: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@e1de817
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:combine_globally:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@52102734
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:combine_grouped_values:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3541cb24
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:combine_per_key:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2177849e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:create_view:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@40cb8df7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:flatten:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@13b13b5d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:group_by_key:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2892dae4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:group_into_batches:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@355ce81c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:group_into_batches_with_sharded_key:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@29647f75
INFO 

Build failed in Jenkins: beam_PostCommit_Java_ValidatesRunner_Flink_Java11 #5466

[Apache Jenkins Server]

See 


Changes:


--
[...truncated 1.29 KB...]
Using shallow fetch with depth 1
Fetching upstream changes from https://github.com/apache/beam.git
 > git fetch --no-tags --force --progress --depth=1 -- 
 > https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* 
 > +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* # 
 > timeout=10
 > git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 61a62e19c4a822c92b3db5018ed1d522aad67423 (origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 61a62e19c4a822c92b3db5018ed1d522aad67423 # timeout=10
Commit message: "rename ExternalSchemaTransform to ExternalTransform (#30102)"
 > git rev-list --no-walk 61a62e19c4a822c92b3db5018ed1d522aad67423 # timeout=10
No emails were triggered.
[EnvInject] - Executing scripts and injecting environment variables after the 
SCM step.
[EnvInject] - Injecting as environment variables the properties content 
SETUPTOOLS_USE_DISTUTILS=stdlib
SPARK_LOCAL_IP=127.0.0.1

[EnvInject] - Variables injected successfully.
[Gradle] - Launching build.
[src] $ 

 -Dorg.gradle.java.home=/usr/lib/jvm/java-8-openjdk-amd64 
:runners:flink:1.15:jar :runners:flink:1.15:testJar
To honour the JVM settings for this build a single-use Daemon process will be 
forked. For more on this, please refer to 
https://docs.gradle.org/8.4/userguide/gradle_daemon.html#sec:disabling_the_daemon
 in the Gradle documentation.
Daemon will be stopped at the end of the build 
Configuration on demand is an incubating feature.
Gradle Enterprise plugins resolution: https://plugins.gradle.org/m2
Enforcing Gradle Enterprise: https://ge.apache.org, allowUntrustedServer: false
> Task :buildSrc:compileJava NO-SOURCE
> Task :buildSrc:compileGroovy FROM-CACHE
> Task :buildSrc:pluginDescriptors
> Task :buildSrc:processResources
> Task :buildSrc:classes
> Task :buildSrc:jar
> Task :model:fn-execution:createCheckerFrameworkManifest
> Task :runners:core-construction-java:createCheckerFrameworkManifest
> Task :sdks:java:core:createCheckerFrameworkManifest
> Task :sdks:java:transform-service:launcher:createCheckerFrameworkManifest
> Task :sdks:java:fn-execution:createCheckerFrameworkManifest
> Task :model:pipeline:createCheckerFrameworkManifest
> Task :runners:core-construction-java:processResources NO-SOURCE
> Task :runners:java-fn-execution:createCheckerFrameworkManifest
> Task :sdks:java:harness:createCheckerFrameworkManifest
> Task :sdks:java:extensions:avro:createCheckerFrameworkManifest
> Task :sdks:java:fn-execution:processResources NO-SOURCE
> Task :model:job-management:createCheckerFrameworkManifest
> Task :runners:core-java:createCheckerFrameworkManifest
> Task :sdks:java:expansion-service:createCheckerFrameworkManifest
> Task :sdks:java:harness:processResources NO-SOURCE
> Task :runners:java-job-service:createCheckerFrameworkManifest
> Task :sdks:java:extensions:avro:generateAvroProtocol NO-SOURCE
> Task :runners:core-java:processResources NO-SOURCE
> Task 
> :sdks:java:extensions:google-cloud-platform-core:createCheckerFrameworkManifest
> Task :runners:java-fn-execution:processResources NO-SOURCE
> Task :sdks:java:expansion-service:processResources NO-SOURCE
> Task :sdks:java:build-tools:createCheckerFrameworkManifest
> Task :runners:java-job-service:processResources NO-SOURCE
> Task :sdks:java:extensions:avro:generateAvroJava NO-SOURCE
> Task :runners:core-java:processTestResources NO-SOURCE
> Task :sdks:java:extensions:google-cloud-platform-core:processResources 
> NO-SOURCE
> Task :model:fn-execution:extractProto
> Task :model:job-management:extractProto
> Task :sdks:java:extensions:avro:processResources NO-SOURCE
> Task :sdks:java:extensions:protobuf:createCheckerFrameworkManifest
> Task :sdks:java:io:google-cloud-platform:createCheckerFrameworkManifest
> Task :sdks:java:io:google-cloud-platform:processResources NO-SOURCE
> Task :sdks:java:core:generateGrammarSource FROM-CACHE
> Task :sdks:java:extensions:protobuf:extractProto
> Task :sdks:java:extensions:arrow:createCheckerFrameworkManifest
> Task :sdks:java:extensions:protobuf:processResources NO-SOURCE
> Task :model:job-management:processResources
> Task :sdks:java:extensions:arrow:processResources NO-SOURCE
> Task :model:fn-execution:processResources
> Task :sdks:java:core:processResources
> Task :sdks:java:core:generateTestGrammarSource NO-SOURCE
> Task :sdks:java:core:processTestResources
> Task :runners:flink:1.15:copySourceOverrides
> Task :runners:flink:1.15:createCheckerFrameworkManifest
> Task :sdks:java:build-tools:compileJava FROM-CACHE
> Task :sdks:java:transform-service:launcher:compileJava FROM-CACHE
> Task :runners:flink:1.15:copyResourcesOverrides NO-SOURCE
> Task :runners:flink:1.15:processResources
> 

beam_PostCommit_Python310 - Build # 1819 - Aborted!

[Apache Jenkins Server]

beam_PostCommit_Python310 - Build # 1819 - Aborted:

Check console output at 
https://ci-beam.apache.org/job/beam_PostCommit_Python310/1819/ to view the 
results.

-
To unsubscribe, e-mail: builds-unsubscr...@beam.apache.org
For additional commands, e-mail: builds-h...@beam.apache.org

Build failed in Jenkins: beam_PostCommit_Python_Xlang_IO_Dataflow #619

[Apache Jenkins Server]

See 


Changes:


--
[...truncated 298.06 KB...]
d44c5fd40519b8bbf58d931c13869fa282edbe413645cd6a97d118ecb7b94a0f
+ /bin/true
+ mkdir -p /project

   ✓ 9.21s
Copying project into container...

+ mkdir -p /project

   ✓ 0.25s

Building cp311-manylinux_x86_64 wheel
CPython 3.11 manylinux x86_64

Setting up build environment...

+ /opt/python/cp38-cp38/bin/python -c 'import sys, json, os; 
json.dump(os.environ.copy(), sys.stdout)'
+ which python
+ which pip

   ✓ 0.34s
Building wheel...

+ rm -rf /tmp/cibuildwheel/built_wheel
+ mkdir -p /tmp/cibuildwheel/built_wheel
+ python -m pip wheel /project --wheel-dir=/tmp/cibuildwheel/built_wheel 
--no-deps

[notice] A new release of pip available: 22.2.2 -> 23.3.2
[notice] To update, run: pip install --upgrade pip
Processing /project
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: finished with status 'done'
  Preparing metadata (pyproject.toml): started
  Preparing metadata (pyproject.toml): finished with status 'done'
Building wheels for collected packages: apache-beam
  Building wheel for apache-beam (pyproject.toml): started
  Building wheel for apache-beam (pyproject.toml): still running...
  Building wheel for apache-beam (pyproject.toml): still running...
  Building wheel for apache-beam (pyproject.toml): still running...
  Building wheel for apache-beam (pyproject.toml): finished with status 'done'
  Created wheel for apache-beam: 
filename=apache_beam-2.55.0.dev0-cp311-cp311-linux_x86_64.whl size=15853286 
sha256=7b08a9db13ed4011ec34fb764f912a0c2c2920cb4299634b5a4a047aff993720
  Stored in directory: 
/tmp/pip-ephem-wheel-cache-gxihyh6f/wheels/aa/0c/49/7c4d39428e78274ff9f1db5b9c539aa0d6bd6becda70207fa7
Successfully built apache-beam
+ /opt/python/cp38-cp38/bin/python -c 'import sys, json, glob; 
json.dump(glob.glob('"'"'/tmp/cibuildwheel/built_wheel/*.whl'"'"'), sys.stdout)'
+ rm -rf /tmp/cibuildwheel/repaired_wheel
+ mkdir -p /tmp/cibuildwheel/repaired_wheel

 ✓ 232.93s
Repairing wheel...

+ sh -c 'auditwheel repair -w /tmp/cibuildwheel/repaired_wheel 
/tmp/cibuildwheel/built_wheel/apache_beam-2.55.0.dev0-cp311-cp311-linux_x86_64.whl'
INFO:auditwheel.main_repair:Repairing 
apache_beam-2.55.0.dev0-cp311-cp311-linux_x86_64.whl
INFO:auditwheel.wheeltools:Previous filename tags: linux_x86_64
INFO:auditwheel.wheeltools:New filename tags: manylinux_2_17_x86_64, 
manylinux2014_x86_64
INFO:auditwheel.wheeltools:Previous WHEEL info tags: cp311-cp311-linux_x86_64
INFO:auditwheel.wheeltools:New WHEEL info tags: 
cp311-cp311-manylinux_2_17_x86_64, cp311-cp311-manylinux2014_x86_64
INFO:auditwheel.main_repair:
Fixed-up wheel written to 
/tmp/cibuildwheel/repaired_wheel/apache_beam-2.55.0.dev0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
+ /opt/python/cp38-cp38/bin/python -c 'import sys, json, glob; 
json.dump(glob.glob('"'"'/tmp/cibuildwheel/repaired_wheel/*.whl'"'"'), 
sys.stdout)'
+ mkdir -p /output
+ mv 
/tmp/cibuildwheel/repaired_wheel/apache_beam-2.55.0.dev0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
 /output

   ✓ 6.90s

✓ cp311-manylinux_x86_64 finished in 240.27s
Copying wheels back to host...


   ✓ 0.13s

1 wheels produced in 4 minutes:
  
apache_beam-2.55.0.dev0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
   15,499 kB

> Task :sdks:python:test-suites:dataflow:py311:initializeForDataflowJob

> Task :sdks:python:test-suites:dataflow:py311:ioCrossLanguageSetup
Launching Java expansion service @ 44061
Launching Python expansion service @ 
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Xlang_IO_Dataflow/src/sdks/python/scripts/run_expansion_services.sh:
 line 128: /bin/activate: No such file or directory

> Task :sdks:python:bdistPy38linux
Requirement already satisfied: cibuildwheel==2.9.0 in 
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Xlang_IO_Dataflow/src/build/gradleenv/192237/lib/python3.8/site-packages
 (2.9.0)
Requirement already satisfied: bashlex!=0.13 in 
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Xlang_IO_Dataflow/src/build/gradleenv/192237/lib/python3.8/site-packages
 (from cibuildwheel==2.9.0) (0.18)
Requirement already satisfied: bracex in 

Build failed in Jenkins: beam_PostCommit_Python38 #5085

[Apache Jenkins Server]

See 


Changes:


--
[...truncated 5.34 MB...]
}
message: "No more requests from control plane"
log_location: 
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py:288"
thread: "MainThread"

INFO:root:severity: INFO
timestamp {
  seconds: 1706172385
  nanos: 788440942
}
message: "SDK Harness waiting for in-flight requests to complete"
log_location: 
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py:289"
thread: "MainThread"

INFO:root:severity: INFO
timestamp {
  seconds: 1706172385
  nanos: 788528442
}
message: "Closing all cached grpc data channels."
log_location: 
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/data_plane.py:820"
thread: "MainThread"

INFO:root:severity: INFO
timestamp {
  seconds: 1706172385
  nanos: 788603305
}
message: "Closing all cached gRPC state handlers."
log_location: 
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py:929"
thread: "MainThread"

INFO:root:severity: INFO
timestamp {
  seconds: 1706172385
  nanos: 788823127
}
message: "Done consuming work."
log_location: 
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py:301"
thread: "MainThread"

INFO:root:severity: INFO
timestamp {
  seconds: 1706172385
  nanos: 74162
}
message: "Python sdk harness exiting."
log_location: 
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker_main.py:213"
thread: "MainThread"

ff290db0fd8ad52fc96acbbac72b73a1e85d91960ad021c9673de4f59a3394a0
INFO:apache_beam.runners.portability.local_job_service:Completed job in 
28.80355978012085 seconds with state DONE.
INFO:root:Completed job in 28.80355978012085 seconds with state DONE.
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE

> Task :sdks:python:test-suites:portable:py38:portableWordCountSparkRunnerBatch
INFO:apache_beam.runners.worker.worker_pool_main:Listening for workers at 
localhost:43023
INFO:apache_beam.runners.portability.fn_api_runner.translations:
  
INFO:apache_beam.runners.portability.fn_api_runner.translations:
  
INFO:apache_beam.runners.portability.fn_api_runner.translations:
  
INFO:apache_beam.utils.subprocess_server:Starting service with ('java' '-jar' 
'/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python38/src/runners/spark/3/job-server/build/libs/beam-runners-spark-3-job-server-2.55.0-SNAPSHOT.jar'
 '--spark-master-url' 'local[4]' '--artifacts-dir' 
'/tmp/beam-tempph3hyak6/artifactsoq8mp370' '--job-port' '36423' 
'--artifact-port' '0' '--expansion-port' '0')
INFO:apache_beam.utils.subprocess_server:24/01/25 08:46:38 WARN 
software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to 
retrieve the requested metadata.
WARNING:root:Waiting for grpc channel to be ready at localhost:36423.
INFO:apache_beam.utils.subprocess_server:24/01/25 08:46:39 INFO 
org.apache.beam.runners.jobsubmission.JobServerDriver: ArtifactStagingService 
started on localhost:37469
INFO:apache_beam.utils.subprocess_server:24/01/25 08:46:39 INFO 
org.apache.beam.runners.jobsubmission.JobServerDriver: Java ExpansionService 
started on localhost:44309
INFO:apache_beam.utils.subprocess_server:24/01/25 08:46:39 INFO 
org.apache.beam.runners.jobsubmission.JobServerDriver: JobService started on 
localhost:36423
INFO:apache_beam.utils.subprocess_server:24/01/25 08:46:39 INFO 
org.apache.beam.runners.jobsubmission.JobServerDriver: Job server now running, 
terminate with Ctrl+C
WARNING:root:Waiting for grpc channel to be ready at localhost:36423.
WARNING:root:Waiting for grpc channel to be ready at localhost:36423.
WARNING:root:Waiting for grpc channel to be ready at localhost:36423.
INFO:apache_beam.utils.subprocess_server:24/01/25 08:46:43 INFO 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Staging 
artifacts for job_a7477053-b07a-45b6-a02d-6cd2993b208f.
INFO:apache_beam.utils.subprocess_server:24/01/25 08:46:43 INFO 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Resolving 
artifacts for 
job_a7477053-b07a-45b6-a02d-6cd2993b208f.0:ref_Environment_default_environment_1.
INFO:apache_beam.utils.subprocess_server:24/01/25 08:46:43 INFO 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Getting 1 
artifacts for job_a7477053-b07a-45b6-a02d-6cd2993b208f.null.
INFO:apache_beam.utils.subprocess_server:24/01/25 08:46:43 INFO 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Artifacts 
fully staged for job_a7477053-b07a-45b6-a02d-6cd2993b208f.
INFO:apache_beam.utils.subprocess_server:24/01/25 08:46:44 INFO 
org.apache.beam.runners.spark.SparkJobInvoker: Invoking job 
BeamApp-jenkins-0125084644-414af922_7f2adb9a-2517-4dd6-9a17-3aaef96e09e9

Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #2622

[Apache Jenkins Server]

See 


Changes:


--
[...truncated 839.04 KB...]
backports.zoneinfo==0.2.1
beautifulsoup4==4.12.2
bs4==0.0.1
build==1.0.3
cachetools==5.3.2
certifi==2023.11.17
cffi==1.16.0
charset-normalizer==3.3.2
click==8.1.7
cloudpickle==2.2.1
crcmod==1.7
cryptography==41.0.7
Cython==0.29.37
deprecation==2.1.0
dill==0.3.1.1
dnspython==2.4.2
docker==7.0.0
docopt==0.6.2
docstring-parser==0.15
exceptiongroup==1.2.0
execnet==2.0.2
fastavro==1.9.3
fasteners==0.19
freezegun==1.4.0
future==0.18.3
google-api-core==2.15.0
google-api-python-client==2.113.0
google-apitools==0.5.31
google-auth==2.26.1
google-auth-httplib2==0.1.1
google-cloud-aiplatform==1.39.0
google-cloud-bigquery==3.15.0
google-cloud-bigquery-storage==2.24.0
google-cloud-bigtable==2.22.0
google-cloud-core==2.4.1
google-cloud-datastore==2.19.0
google-cloud-dlp==3.14.0
google-cloud-language==2.12.0
google-cloud-profiler==4.1.0
google-cloud-pubsub==2.19.0
google-cloud-pubsublite==1.9.0
google-cloud-recommendations-ai==0.10.6
google-cloud-resource-manager==1.11.0
google-cloud-spanner==3.40.1
google-cloud-storage==2.14.0
google-cloud-videointelligence==2.12.0
google-cloud-vision==3.5.0
google-crc32c==1.5.0
google-resumable-media==2.7.0
googleapis-common-protos==1.62.0
greenlet==3.0.3
grpc-google-iam-v1==0.13.0
grpcio==1.60.0
grpcio-status==1.60.0
guppy3==3.1.4.post1
hdfs==2.7.3
httplib2==0.22.0
hypothesis==6.92.7
idna==3.6
importlib-metadata==7.0.1
importlib-resources==6.1.1
iniconfig==2.0.0
joblib==1.3.2
Js2Py==0.74
jsonpickle==3.0.2
jsonschema==4.20.0
jsonschema-specifications==2023.12.1
mmh3==4.1.0
mock==5.1.0
nltk==3.8.1
nose==1.3.7
numpy==1.24.4
oauth2client==4.1.3
objsize==0.7.0
orjson==3.9.10
overrides==7.4.0
packaging==23.2
pandas==2.0.3
parameterized==0.9.0
pip==23.3.2
pkgutil_resolve_name==1.3.10
pluggy==1.3.0
proto-plus==1.23.0
protobuf==4.25.1
psycopg2-binary==2.9.9
pyarrow==14.0.2
pyarrow-hotfix==0.6
pyasn1==0.5.1
pyasn1-modules==0.3.0
pycparser==2.21
pydot==1.4.2
PyHamcrest==2.1.0
pyjsparser==2.7.1
pymongo==4.6.1
PyMySQL==1.1.0
pyparsing==3.1.1
pyproject_hooks==1.0.0
pytest==7.4.4
pytest-timeout==2.2.0
pytest-xdist==3.5.0
python-dateutil==2.8.2
python-snappy==0.6.1
pytz==2023.3.post1
PyYAML==6.0.1
referencing==0.32.1
regex==2023.12.25
requests==2.31.0
requests-mock==1.11.0
rpds-py==0.16.2
rsa==4.9
scikit-learn==1.3.2
scipy==1.10.1
setuptools==69.0.3
shapely==2.0.2
six==1.16.0
sortedcontainers==2.4.0
soupsieve==2.5
SQLAlchemy==1.4.51
sqlparse==0.4.4
tenacity==8.2.3
testcontainers==3.7.1
threadpoolctl==3.2.0
tomli==2.0.1
tqdm==4.66.1
typing_extensions==4.9.0
tzdata==2023.4
tzlocal==5.2
uritemplate==4.1.1
urllib3==2.1.0
wheel==0.42.0
wrapt==1.16.0
zipp==3.17.0
zstandard==0.22.0
Removing intermediate container 39c98bf1715c
 ---> 5ce565783b16
Step 12/22 : ENTRYPOINT ["/opt/apache/beam/boot"]
 ---> Running in 59c743bcc668
Removing intermediate container 59c743bcc668
 ---> 2d1f12652f5f
Step 13/22 : FROM beam as third_party_licenses
 ---> 2d1f12652f5f
Step 14/22 : ARG pull_licenses
 ---> Running in 18154ebafb57
Removing intermediate container 18154ebafb57
 ---> 2c9fb1652f8a
Step 15/22 : COPY target/license_scripts /tmp/license_scripts/
 ---> 726411be3e17
Step 16/22 : COPY  target/go-licenses/* 
/opt/apache/beam/third_party_licenses/golang/
 ---> 4dcd52b5f9c8
Step 17/22 : COPY target/license_scripts /tmp/license_scripts/
 ---> bd148416d7b6
Step 18/22 : RUN if [ "$pull_licenses" = "true" ] ; then   pip install 
'pip-licenses<5' pyyaml tenacity &&   python 
/tmp/license_scripts/pull_licenses_py.py ; fi
 ---> Running in 099548d64c6b
Collecting pip-licenses<5
  Downloading pip_licenses-4.3.4-py3-none-any.whl.metadata (31 kB)
Requirement already satisfied: pyyaml in /usr/local/lib/python3.8/site-packages 
(6.0.1)
Requirement already satisfied: tenacity in 
/usr/local/lib/python3.8/site-packages (8.2.3)
Collecting prettytable>=2.3.0 (from pip-licenses<5)
  Downloading prettytable-3.9.0-py3-none-any.whl.metadata (26 kB)
Collecting wcwidth (from prettytable>=2.3.0->pip-licenses<5)
  Downloading wcwidth-0.2.13-py2.py3-none-any.whl.metadata (14 kB)
Downloading pip_licenses-4.3.4-py3-none-any.whl (20 kB)
Downloading prettytable-3.9.0-py3-none-any.whl (27 kB)
Downloading wcwidth-0.2.13-py2.py3-none-any.whl (34 kB)
Installing collected packages: wcwidth, prettytable, pip-licenses
Successfully installed pip-licenses-4.3.4 prettytable-3.9.0 wcwidth-0.2.13
WARNING: Running pip as the 'root' user can result in broken permissions 
and conflicting behaviour with the system package manager. It is recommended to 
use a virtual environment instead: https://pip.pypa.io/warnings/venv
Skip pulling license for  bs4
INFO:root:Successfully pulled licenses for 131 dependencies
Removing intermediate container 099548d64c6b
 ---> 1b165833b02b
Step 19/22 : FROM beam
 ---> 2d1f12652f5f
Step 20/22 : ARG pull_licenses
 ---> Running in 

beam_PostRelease_NightlySnapshot - Build # 2368 - Aborted!

[Apache Jenkins Server]

beam_PostRelease_NightlySnapshot - Build # 2368 - Aborted:

Check console output at 
https://ci-beam.apache.org/job/beam_PostRelease_NightlySnapshot/2368/ to view 
the results.

-
To unsubscribe, e-mail: builds-unsubscr...@beam.apache.org
For additional commands, e-mail: builds-h...@beam.apache.org

Build failed in Jenkins: beam_PostCommit_Python39 #2806

[Apache Jenkins Server]

See 


Changes:


--
[...truncated 8.37 MB...]
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/io/gcp/bigquery_tools.py",
 line 1022, in perform_load_job
return self._insert_load_job(
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/utils/retry.py",
 line 298, in wrapper
return fun(*args, **kwargs)
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/io/gcp/bigquery_tools.py",
 line 559, in _insert_load_job
return self._start_job(request, stream=source_stream).jobReference
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/io/gcp/bigquery_tools.py",
 line 578, in _start_job
response = self.client.jobs.Insert(request, upload=upload)
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/io/gcp/internal/clients/bigquery/bigquery_v2_client.py",
 line 356, in Insert
return self._RunMethod(
  File "/usr/local/lib/python3.9/site-packages/apitools/base/py/base_api.py", 
line 731, in _RunMethod
return self.ProcessHttpResponse(method_config, http_response, request)
  File "/usr/local/lib/python3.9/site-packages/apitools/base/py/base_api.py", 
line 737, in ProcessHttpResponse
self.__ProcessHttpResponse(method_config, http_response, request))
  File "/usr/local/lib/python3.9/site-packages/apitools/base/py/base_api.py", 
line 603, in __ProcessHttpResponse
raise exceptions.HttpError.FromResponse(
apitools.base.py.exceptions.HttpBadRequestError: HttpError accessing 
:
 response: <{'vary': 'Origin, X-Origin, Referer', 'content-type': 
'application/json; charset=UTF-8', 'date': 'Thu, 25 Jan 2024 06:29:12 GMT', 
'server': 'ESF', 'cache-control': 'private', 'x-xss-protection': '0', 
'x-frame-options': 'SAMEORIGIN', 'x-content-type-options': 'nosniff', 
'transfer-encoding': 'chunked', 'status': '400', 'content-length': '318', 
'-content-encoding': 'gzip'}>, content <{
  "error": {
"code": 400,
"message": "Load configuration must specify at least one source URI",
"errors": [
  {
"message": "Load configuration must specify at least one source URI",
"domain": "global",
"reason": "invalid"
  }
],
"status": "INVALID_ARGUMENT"
  }
}
>

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/runners/worker/sdk_worker.py",
 line 311, in _execute
response = task()
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/runners/worker/sdk_worker.py",
 line 386, in 
lambda: self.create_worker().do_instruction(request), request)
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/runners/worker/sdk_worker.py",
 line 650, in do_instruction
return getattr(self, request_type)(
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/runners/worker/sdk_worker.py",
 line 688, in process_bundle
bundle_processor.process_bundle(instruction_id))
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/runners/worker/bundle_processor.py",
 line 1113, in process_bundle
input_op_by_transform_id[element.transform_id].process_encoded(
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/runners/worker/bundle_processor.py",
 line 237, in process_encoded
self.output(decoded_value)
  File "apache_beam/runners/worker/operations.py", line 570, in 
apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 572, in 
apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 263, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 266, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 953, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/worker/operations.py", line 954, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/common.py", line 1437, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 1526, in 
apache_beam.runners.common.DoFnRunner._reraise_augmented
  File "apache_beam/runners/common.py", line 1435, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", 

Build failed in Jenkins: beam_PostCommit_Java_DataflowV2 #4028

[Apache Jenkins Server]

See 


Changes:


--
[...truncated 48.12 KB...]
> Task :sdks:java:extensions:protobuf:compileTestJava FROM-CACHE
> Task :sdks:java:extensions:protobuf:testClasses
> Task :runners:direct-java:shadowTestJar FROM-CACHE
> Task :sdks:java:extensions:protobuf:testJar
> Task :sdks:java:io:google-cloud-platform:jar
> Task :runners:google-cloud-dataflow-java:compileJava FROM-CACHE
> Task :runners:google-cloud-dataflow-java:classes
> Task :runners:google-cloud-dataflow-java:jar
> Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE
> Task :sdks:java:io:google-cloud-platform:testClasses
> Task :sdks:java:io:google-cloud-platform:testJar

> Task :sdks:java:container:pullLicenses
Collecting pip
  Using cached pip-23.3.2-py3-none-any.whl (2.1 MB)
Collecting setuptools
  Using cached setuptools-69.0.3-py3-none-any.whl (819 kB)
Collecting wheel
  Using cached wheel-0.42.0-py3-none-any.whl (65 kB)
Installing collected packages: pip, setuptools, wheel
  Attempting uninstall: pip
Found existing installation: pip 20.0.2
Uninstalling pip-20.0.2:
  Successfully uninstalled pip-20.0.2
  Attempting uninstall: setuptools
Found existing installation: setuptools 44.0.0
Uninstalling setuptools-44.0.0:
  Successfully uninstalled setuptools-44.0.0
Successfully installed pip-23.3.2 setuptools-69.0.3 wheel-0.42.0
Collecting beautifulsoup4<5.0,>=4.9.0 (from -r 

 (line 19))
  Using cached beautifulsoup4-4.12.3-py3-none-any.whl.metadata (3.8 kB)
Collecting pyyaml<7,>=6.0.1 (from -r 

 (line 20))
  Using cached 
PyYAML-6.0.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata 
(2.1 kB)
Collecting tenacity<9.0,>=6.1.0 (from -r 

 (line 21))
  Using cached tenacity-8.2.3-py3-none-any.whl.metadata (1.0 kB)
Collecting soupsieve>1.2 (from beautifulsoup4<5.0,>=4.9.0->-r 

 (line 19))
  Using cached soupsieve-2.5-py3-none-any.whl.metadata (4.7 kB)
Using cached beautifulsoup4-4.12.3-py3-none-any.whl (147 kB)
Using cached 
PyYAML-6.0.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (736 kB)
Using cached tenacity-8.2.3-py3-none-any.whl (24 kB)
Using cached soupsieve-2.5-py3-none-any.whl (36 kB)
Installing collected packages: tenacity, soupsieve, pyyaml, beautifulsoup4
Successfully installed beautifulsoup4-4.12.3 pyyaml-6.0.1 soupsieve-2.5 
tenacity-8.2.3
Executing python 

 
--license_index=

--output_dir=

--dep_url_yaml=

--manual_license_path=
INFO:root:Pulling license for 129 dependencies using 16 threads.
INFO:root:Replaced local file URL with 
file://
 for xz-1.5
INFO:root:pull_licenses_java.py succeed. It took 1.632155 seconds with 16 
threads.
Copying licenses from 

 to 

Finished license_scripts.sh

> Task :release:go-licenses:java:dockerRun
go: downloading github.com/golang/protobuf v1.5.3
go: downloading google.golang.org/grpc v1.59.0
go: downloading google.golang.org/protobuf v1.31.0
go: downloading golang.org/x/sys v0.15.0
go: downloading golang.org/x/net v0.19.0
go: downloading google.golang.org/genproto/googleapis/rpc 
v0.0.0-20231120223509-83a465c0220f
go: downloading google.golang.org/genproto v0.0.0-20231106174013-bbf56f31fb17
go: downloading golang.org/x/text v0.14.0
go: added github.com/apache/beam/sdks/v2 v2.53.0
go: added github.com/golang/protobuf v1.5.3
go: added golang.org/x/net v0.19.0
go: added golang.org/x/sys 

Build failed in Jenkins: beam_PostCommit_Python311 #1156

[Apache Jenkins Server]

See 


Changes:


--
[...truncated 5.55 MB...]
  seconds: 1706159793
  nanos: 7424831
}
message: "SDK Harness waiting for in-flight requests to complete"
log_location: 
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:289"
thread: "MainThread"

INFO:root:severity: INFO
timestamp {
  seconds: 1706159793
  nanos: 7495880
}
message: "Closing all cached grpc data channels."
log_location: 
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/data_plane.py:820"
thread: "MainThread"

INFO:root:severity: INFO
timestamp {
  seconds: 1706159793
  nanos: 7571220
}
message: "Closing all cached gRPC state handlers."
log_location: 
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:929"
thread: "MainThread"

INFO:root:severity: INFO
timestamp {
  seconds: 1706159793
  nanos: 8620977
}
message: "Done consuming work."
log_location: 
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:301"
thread: "MainThread"

INFO:root:severity: INFO
timestamp {
  seconds: 1706159793
  nanos: 8751392
}
message: "Python sdk harness exiting."
log_location: 
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker_main.py:213"
thread: "MainThread"

INFO:apache_beam.runners.portability.local_job_service:Completed job in 
29.027992963790894 seconds with state DONE.
INFO:root:Completed job in 29.027992963790894 seconds with state DONE.
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE

> Task :sdks:python:test-suites:portable:py311:portableWordCountSparkRunnerBatch
INFO:apache_beam.runners.worker.worker_pool_main:Listening for workers at 
localhost:40659
INFO:apache_beam.runners.portability.fn_api_runner.translations:
  
INFO:apache_beam.runners.portability.fn_api_runner.translations:
  
INFO:apache_beam.runners.portability.fn_api_runner.translations:
  
INFO:apache_beam.utils.subprocess_server:Starting service with ('java' '-jar' 
'
 '--spark-master-url' 'local[4]' '--artifacts-dir' 
'/tmp/beam-temp0_dmhms3/artifactsgccf4etc' '--job-port' '47393' 
'--artifact-port' '0' '--expansion-port' '0')
INFO:apache_beam.utils.subprocess_server:24/01/25 05:16:43 WARN 
software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to 
retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:24/01/25 05:16:43 INFO 
org.apache.beam.runners.jobsubmission.JobServerDriver: ArtifactStagingService 
started on localhost:35799
INFO:apache_beam.utils.subprocess_server:24/01/25 05:16:43 INFO 
org.apache.beam.runners.jobsubmission.JobServerDriver: Java ExpansionService 
started on localhost:35963
INFO:apache_beam.utils.subprocess_server:24/01/25 05:16:43 INFO 
org.apache.beam.runners.jobsubmission.JobServerDriver: JobService started on 
localhost:47393
INFO:apache_beam.utils.subprocess_server:24/01/25 05:16:43 INFO 
org.apache.beam.runners.jobsubmission.JobServerDriver: Job server now running, 
terminate with Ctrl+C
INFO:apache_beam.utils.subprocess_server:24/01/25 05:16:45 INFO 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Staging 
artifacts for job_00b38cfc-2b0e-48b7-b62e-081120bcc3a1.
INFO:apache_beam.utils.subprocess_server:24/01/25 05:16:45 INFO 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Resolving 
artifacts for 
job_00b38cfc-2b0e-48b7-b62e-081120bcc3a1.0:ref_Environment_default_environment_1.
INFO:apache_beam.utils.subprocess_server:24/01/25 05:16:45 INFO 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Getting 1 
artifacts for job_00b38cfc-2b0e-48b7-b62e-081120bcc3a1.null.
INFO:apache_beam.utils.subprocess_server:24/01/25 05:16:45 INFO 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Artifacts 
fully staged for job_00b38cfc-2b0e-48b7-b62e-081120bcc3a1.
INFO:apache_beam.utils.subprocess_server:24/01/25 05:16:46 INFO 
org.apache.beam.runners.spark.SparkJobInvoker: Invoking job 
BeamApp-jenkins-0125051646-c36f0b1f_95fa490b-e0b7-457f-a0cf-ef944707fab0
INFO:apache_beam.utils.subprocess_server:24/01/25 05:16:46 INFO 
org.apache.beam.runners.jobsubmission.JobInvocation: Starting job invocation 
BeamApp-jenkins-0125051646-c36f0b1f_95fa490b-e0b7-457f-a0cf-ef944707fab0
INFO:apache_beam.runners.portability.portable_runner:Environment "LOOPBACK" has 
started a component necessary for the execution. Be sure to run the pipeline 
using
  with Pipeline() as p:
p.apply(..)
This ensures that the pipeline finishes before this program exits.
INFO:apache_beam.runners.portability.portable_runner:Job state changed to 

Build failed in Jenkins: beam_PostCommit_XVR_Direct #5095

[Apache Jenkins Server]

See 


Changes:


--
[...truncated 1.74 MB...]
apache_beam/runners/portability/portable_runner.py:576: RuntimeError
-- Captured log call ---
INFO apache_beam.utils.subprocess_server:subprocess_server.py:339 Using 
pre-built snapshot at 

INFO root:external.py:1017 Starting a JAR-based expansion service from JAR 

 
INFO apache_beam.utils.subprocess_server:subprocess_server.py:203 Starting 
service with ['java' '-jar' 
'
 '42139' 
'--filesToStage=
 '--alsoStartLoopbackWorker']
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Starting 
expansion service at localhost:42139
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 25, 
2024 5:58:54 AM org.apache.beam.sdk.expansion.service.ExpansionService 
loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: 
Registering external transforms: [beam:external:java:sql:v1, 
beam:transform:org.apache.beam:pubsub_read:v1, 
beam:transform:org.apache.beam:pubsub_write:v1, 
beam:transform:org.apache.beam:pubsublite_write:v1, 
beam:transform:org.apache.beam:pubsublite_read:v1, 
beam:transform:org.apache.beam:spanner_insert:v1, 
beam:transform:org.apache.beam:spanner_update:v1, 
beam:transform:org.apache.beam:spanner_replace:v1, 
beam:transform:org.apache.beam:spanner_insert_or_update:v1, 
beam:transform:org.apache.beam:spanner_delete:v1, 
beam:transform:org.apache.beam:spanner_read:v1, 
beam:transform:org.apache.beam:kafka_read_with_metadata:v1, 
beam:transform:org.apache.beam:kafka_read_without_metadata:v1, 
beam:transform:org.apache.beam:kafka_write:v1, 
beam:external:java:generate_sequence:v1, 
beam:transform:org.apache.beam:bigquery_read:v1, 
beam:transform:org.apache.beam:bigquery_write:v1, 
beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, 
beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, 
beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, 
beam:transform:create_view:v1, beam:transform:flatten:v1, 
beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, 
beam:transform:group_into_batches_with_sharded_key:v1, 
beam:transform:impulse:v1, beam:transform:reshuffle:v1, 
beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, 
beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 
Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:external:java:sql:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6c779568
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:pubsub_read:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@f381794
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:pubsub_write:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2cdd0d4b
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:pubsublite_write:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7e9131d5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:pubsublite_read:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2e1d27ba
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:spanner_insert:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@61d6015a
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:spanner_update:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2525ff7e
INFO 

Jenkins build is back to normal : beam_PostCommit_Java_ValidatesRunner_Flink_Java11 #5465

[Apache Jenkins Server]

See 



-
To unsubscribe, e-mail: builds-unsubscr...@beam.apache.org
For additional commands, e-mail: builds-h...@beam.apache.org

Build failed in Jenkins: beam_PostCommit_Python310 #1818

[Apache Jenkins Server]

See 


Changes:


--
[...truncated 11.86 MB...]
input_op_by_transform_id[element.transform_id].process_encoded(
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/runners/worker/bundle_processor.py",
 line 237, in process_encoded
self.output(decoded_value)
  File "apache_beam/runners/worker/operations.py", line 570, in 
apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 572, in 
apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 263, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 266, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 953, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/worker/operations.py", line 954, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/common.py", line 1437, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 1526, in 
apache_beam.runners.common.DoFnRunner._reraise_augmented
  File "apache_beam/runners/common.py", line 1435, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 636, in 
apache_beam.runners.common.SimpleInvoker.invoke_process
  File "apache_beam/runners/common.py", line 1621, in 
apache_beam.runners.common._OutputHandler.handle_process_outputs
  File "apache_beam/runners/common.py", line 1736, in 
apache_beam.runners.common._OutputHandler._write_value_to_tag
  File "apache_beam/runners/worker/operations.py", line 263, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 266, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 1351, in 
apache_beam.runners.worker.operations.FlattenOperation.process
  File "apache_beam/runners/worker/operations.py", line 1354, in 
apache_beam.runners.worker.operations.FlattenOperation.process
  File "apache_beam/runners/worker/operations.py", line 572, in 
apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 263, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 266, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 953, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/worker/operations.py", line 954, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/common.py", line 1437, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 1547, in 
apache_beam.runners.common.DoFnRunner._reraise_augmented
  File "apache_beam/runners/common.py", line 1435, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 851, in 
apache_beam.runners.common.PerWindowInvoker.invoke_process
  File "apache_beam/runners/common.py", line 995, in 
apache_beam.runners.common.PerWindowInvoker._invoke_process_per_window
  File "apache_beam/runners/common.py", line 1611, in 
apache_beam.runners.common._OutputHandler.handle_process_outputs
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/io/gcp/bigquery_file_loads.py",
 line 750, in process
job_reference = self.bq_wrapper.perform_load_job(
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/io/gcp/bigquery_tools.py",
 line 1022, in perform_load_job
return self._insert_load_job(
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/utils/retry.py",
 line 298, in wrapper
return fun(*args, **kwargs)
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/io/gcp/bigquery_tools.py",
 line 559, in _insert_load_job
return self._start_job(request, stream=source_stream).jobReference
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/io/gcp/bigquery_tools.py",
 line 578, in _start_job
response = self.client.jobs.Insert(request, upload=upload)
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/io/gcp/internal/clients/bigquery/bigquery_v2_client.py",
 line 356, in Insert
return self._RunMethod(
  File "/usr/local/lib/python3.10/site-packages/apitools/base/py/base_api.py", 
line 

Build failed in Jenkins: beam_PostCommit_Python38 #5084

[Apache Jenkins Server]

See 


Changes:


--
[...truncated 5.71 MB...]
}
message: "Python sdk harness exiting."
log_location: 
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker_main.py:213"
thread: "MainThread"

731eb4924348820838396bb99f9e9dd475b1073b106b7d958a800b2867471b92
INFO:apache_beam.runners.portability.local_job_service:Completed job in 
29.40090537071228 seconds with state DONE.
INFO:root:Completed job in 29.40090537071228 seconds with state DONE.
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE

> Task :sdks:python:test-suites:portable:py38:portableWordCountSparkRunnerBatch
INFO:apache_beam.runners.worker.worker_pool_main:Listening for workers at 
localhost:44623
INFO:apache_beam.runners.portability.fn_api_runner.translations:
  
INFO:apache_beam.runners.portability.fn_api_runner.translations:
  
INFO:apache_beam.runners.portability.fn_api_runner.translations:
  
INFO:apache_beam.utils.subprocess_server:Starting service with ('java' '-jar' 
'
 '--spark-master-url' 'local[4]' '--artifacts-dir' 
'/tmp/beam-tempgzvb9i_m/artifactscix8anpm' '--job-port' '59579' 
'--artifact-port' '0' '--expansion-port' '0')
INFO:apache_beam.utils.subprocess_server:24/01/25 02:47:43 WARN 
software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to 
retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:24/01/25 02:47:44 INFO 
org.apache.beam.runners.jobsubmission.JobServerDriver: ArtifactStagingService 
started on localhost:44019
INFO:apache_beam.utils.subprocess_server:24/01/25 02:47:44 INFO 
org.apache.beam.runners.jobsubmission.JobServerDriver: Java ExpansionService 
started on localhost:40513
WARNING:root:Waiting for grpc channel to be ready at localhost:59579.
INFO:apache_beam.utils.subprocess_server:24/01/25 02:47:45 INFO 
org.apache.beam.runners.jobsubmission.JobServerDriver: JobService started on 
localhost:59579
INFO:apache_beam.utils.subprocess_server:24/01/25 02:47:45 INFO 
org.apache.beam.runners.jobsubmission.JobServerDriver: Job server now running, 
terminate with Ctrl+C
INFO:apache_beam.utils.subprocess_server:24/01/25 02:47:46 INFO 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Staging 
artifacts for job_ff24f84c-ef2e-45f0-a65f-2914bc25d87a.
INFO:apache_beam.utils.subprocess_server:24/01/25 02:47:46 INFO 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Resolving 
artifacts for 
job_ff24f84c-ef2e-45f0-a65f-2914bc25d87a.0:ref_Environment_default_environment_1.
INFO:apache_beam.utils.subprocess_server:24/01/25 02:47:46 INFO 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Getting 1 
artifacts for job_ff24f84c-ef2e-45f0-a65f-2914bc25d87a.null.
INFO:apache_beam.utils.subprocess_server:24/01/25 02:47:46 INFO 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Artifacts 
fully staged for job_ff24f84c-ef2e-45f0-a65f-2914bc25d87a.
INFO:apache_beam.utils.subprocess_server:24/01/25 02:47:46 INFO 
org.apache.beam.runners.spark.SparkJobInvoker: Invoking job 
BeamApp-jenkins-0125024746-26de4555_90e2cc41-81cd-4e8f-8393-c1ceb6683b7c
INFO:apache_beam.utils.subprocess_server:24/01/25 02:47:47 INFO 
org.apache.beam.runners.jobsubmission.JobInvocation: Starting job invocation 
BeamApp-jenkins-0125024746-26de4555_90e2cc41-81cd-4e8f-8393-c1ceb6683b7c
INFO:apache_beam.runners.portability.portable_runner:Environment "LOOPBACK" has 
started a component necessary for the execution. Be sure to run the pipeline 
using
  with Pipeline() as p:
p.apply(..)
This ensures that the pipeline finishes before this program exits.
INFO:apache_beam.runners.portability.portable_runner:Job state changed to 
STOPPED
INFO:apache_beam.runners.portability.portable_runner:Job state changed to 
STARTING
INFO:apache_beam.runners.portability.portable_runner:Job state changed to 
RUNNING
INFO:apache_beam.utils.subprocess_server:24/01/25 02:47:47 INFO 
org.apache.beam.runners.spark.translation.SparkContextFactory: Creating a brand 
new Spark Context.
INFO:apache_beam.utils.subprocess_server:24/01/25 02:47:48 WARN 
org.apache.hadoop.util.NativeCodeLoader: Unable to load native-hadoop library 
for your platform... using builtin-java classes where applicable
INFO:apache_beam.utils.subprocess_server:24/01/25 02:47:49 INFO 
org.sparkproject.jetty.util.log: Logging initialized @9780ms to 
org.sparkproject.jetty.util.log.Slf4jLog
INFO:apache_beam.utils.subprocess_server:24/01/25 02:47:50 INFO 
org.sparkproject.jetty.server.Server: jetty-9.4.44.v20210927; built: 
2021-09-27T23:02:44.612Z; git: 

Build failed in Jenkins: beam_PostCommit_Java_ValidatesRunner_Flink #12789

[Apache Jenkins Server]

See 


Changes:


--
Started by timer
Running as SYSTEM
[EnvInject] - Loading node environment variables.
Building remotely on apache-beam-jenkins-13 (beam) in workspace 

The recommended git tool is: NONE
No credentials specified
Wiping out workspace first.
Cloning the remote Git repository
Using shallow clone with depth 1
Avoid fetching tags
Cloning repository https://github.com/apache/beam.git
 > git init 
 > 
 >  # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
 > git --version # timeout=10
 > git --version # 'git version 2.25.1'
 > git fetch --no-tags --force --progress --depth=1 -- 
 > https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* # 
 > timeout=10
 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # 
 > timeout=10
 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Using shallow fetch with depth 1
Fetching upstream changes from https://github.com/apache/beam.git
 > git fetch --no-tags --force --progress --depth=1 -- 
 > https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* 
 > +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* # 
 > timeout=10
 > git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 61a62e19c4a822c92b3db5018ed1d522aad67423 (origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 61a62e19c4a822c92b3db5018ed1d522aad67423 # timeout=10
Commit message: "rename ExternalSchemaTransform to ExternalTransform (#30102)"
 > git rev-list --no-walk 674fe77df47cadca16196af0d9d759592d9ef04f # timeout=10
First time build. Skipping changelog.
No emails were triggered.
[EnvInject] - Executing scripts and injecting environment variables after the 
SCM step.
[EnvInject] - Injecting as environment variables the properties content 
SETUPTOOLS_USE_DISTUTILS=stdlib
SPARK_LOCAL_IP=127.0.0.1

[EnvInject] - Variables injected successfully.
[Gradle] - Launching build.
[src] $ 

 --continue --max-workers=8 -Dorg.gradle.jvmargs=-Xms2g 
-Dorg.gradle.jvmargs=-Xmx6g -Dorg.gradle.vfs.watch=false -Pdocker-pull-licenses 
:runners:flink:1.15:validatesRunner
To honour the JVM settings for this build a single-use Daemon process will be 
forked. For more on this, please refer to 
https://docs.gradle.org/8.4/userguide/gradle_daemon.html#sec:disabling_the_daemon
 in the Gradle documentation.
Daemon will be stopped at the end of the build 
Configuration on demand is an incubating feature.
Gradle Enterprise plugins resolution: https://plugins.gradle.org/m2
Enforcing Gradle Enterprise: https://ge.apache.org, allowUntrustedServer: false
> Task :buildSrc:compileJava NO-SOURCE
> Task :buildSrc:compileGroovy FROM-CACHE
> Task :buildSrc:pluginDescriptors
> Task :buildSrc:processResources
> Task :buildSrc:classes
> Task :buildSrc:jar
> Task :sdks:java:transform-service:launcher:createCheckerFrameworkManifest
> Task :model:fn-execution:createCheckerFrameworkManifest
> Task :sdks:java:core:createCheckerFrameworkManifest
> Task :sdks:java:fn-execution:createCheckerFrameworkManifest
> Task :sdks:java:fn-execution:processResources NO-SOURCE
> Task :sdks:java:extensions:avro:createCheckerFrameworkManifest
> Task :model:fn-execution:extractProto
> Task :model:pipeline:createCheckerFrameworkManifest
> Task :model:job-management:createCheckerFrameworkManifest
> Task :runners:core-construction-java:createCheckerFrameworkManifest
> Task :runners:core-construction-java:processResources NO-SOURCE
> Task :sdks:java:extensions:avro:generateAvroProtocol NO-SOURCE
> Task :runners:core-java:createCheckerFrameworkManifest
> Task :model:job-management:extractProto
> Task :sdks:java:extensions:avro:generateAvroJava NO-SOURCE
> Task :runners:core-java:processResources NO-SOURCE
> Task :sdks:java:extensions:avro:processResources NO-SOURCE
> Task :runners:java-fn-execution:createCheckerFrameworkManifest
> Task :runners:java-job-service:createCheckerFrameworkManifest
> Task :model:job-management:processResources
> Task :sdks:java:core:generateGrammarSource FROM-CACHE
> Task :model:fn-execution:processResources
> Task :runners:java-fn-execution:processResources NO-SOURCE
> Task :sdks:java:harness:createCheckerFrameworkManifest
> Task :runners:java-job-service:processResources NO-SOURCE
> Task :sdks:java:harness:processResources NO-SOURCE
> Task :sdks:java:expansion-service:createCheckerFrameworkManifest
> Task :runners:core-java:processTestResources NO-SOURCE
> Task :sdks:java:expansion-service:processResources 

Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #2621

[Apache Jenkins Server]

See 


Changes:


--
[...truncated 1.21 MB...]
  "namespace": "go_options",
  "type": "STRING",
  "value": "true"
},
{
  "key": "expansion_addr",
  "namespace": "go_options",
  "type": "STRING",
  "value": "[test:localhost:41169]"
},
{
  "key": "bt_instance",
  "namespace": "go_options",
  "type": "STRING",
  "value": "projects/apache-beam-testing/instances/beam-test"
},
{
  "key": "experiments",
  "namespace": "go_options",
  "type": "STRING",
  "value": 
"beam_fn_api,use_runner_v2,use_unified_worker,use_portable_job_submission"
},
{
  "key": "hooks",
  "namespace": "go_options",
  "type": "STRING",
  "value": "{\"default_remote_logging\":null}"
}
  ],
  "options": {
"experiments": [
  "beam_fn_api",
  "use_runner_v2",
  "use_unified_worker",
  "use_portable_job_submission"
],
"pipelineUrl": 
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test14317/go-2-1706150280755303984/model",
"region": "us-central1",
"tempLocation": 
"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test14317"
  },
  "beam:option:go_options:v1": {
"options": {
  "bq_dataset": "apache-beam-testing.beam_bigquery_io_test_temp",
  "bt_instance": "projects/apache-beam-testing/instances/beam-test",
  "expansion_addr": "[test:localhost:41169]",
  "expansion_jar": 
"[io:
 
schemaio:
 
debeziumio:
 
gcpio:
  "experiments": 
"beam_fn_api,use_runner_v2,use_unified_worker,use_portable_job_submission",
  "hookOrder": "[\"default_remote_logging\"]",
  "hooks": "{\"default_remote_logging\":null}",
  "kafka_jar": 
"
  "sdk_harness_container_image_override": 
"[.*java.*,us.gcr.io/apache-beam-testing/java-postcommit-it/java:20240125022041]",
  "temp_location": 
"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test14317",
  "test.paniconexit0": "true",
  "test.timeout": "3h0m0s",
  "test.v": "true"
}
  }
},
"tempStoragePrefix": 
"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test14317",
"userAgent": {
  "name": "Apache Beam SDK for Go",
  "version": "2.55.0.dev"
},
"version": {
  "job_type": "FNAPI_BATCH",
  "major": "6"
},
"workerPools": [
  {
"autoscalingSettings": {},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 1,
"packages": [
  {
"location": 
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test14317/go-2-1706150280755303984/worker",
"name": "worker"
  },
  {
"location": 
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test14317/go-2-1706150280755303984/xlang/beam-sdks-java-io-google-cloud-platform-expansion-service-2.55.0-SNAPSHOT-Rl5Li4_jNz8tkNrb-pAhLFpzoGdvjSP6m_kWJcr34OM.jar",
"name": 
"beam-sdks-java-io-google-cloud-platform-expansion-service-2.55.0-SNAPSHOT-Rl5Li4_jNz8tkNrb-pAhLFpzoGdvjSP6m_kWJcr34OM.jar"
  }
],
"sdkHarnessContainerImages": [
  {
"capabilities": [
  "beam:protocol:progress_reporting:v1",
  "beam:protocol:multi_core_bundle_processing:v1",
  "beam:transform:sdf_truncate_sized_restrictions:v1",
  "beam:protocol:worker_status:v1",
  "beam:protocol:monitoring_info_short_ids:v1",
  "beam:version:sdk_base:go:apache/beam_go_sdk:2.55.0.dev",
  

Build failed in Jenkins: beam_PostCommit_Python39 #2805

[Apache Jenkins Server]

See 


Changes:


--
[...truncated 12.37 MB...]
  File "apache_beam/runners/worker/operations.py", line 953, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/worker/operations.py", line 954, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/common.py", line 1437, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 1547, in 
apache_beam.runners.common.DoFnRunner._reraise_augmented
  File "apache_beam/runners/common.py", line 1435, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 851, in 
apache_beam.runners.common.PerWindowInvoker.invoke_process
  File "apache_beam/runners/common.py", line 995, in 
apache_beam.runners.common.PerWindowInvoker._invoke_process_per_window
  File "apache_beam/runners/common.py", line 1611, in 
apache_beam.runners.common._OutputHandler.handle_process_outputs
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/io/gcp/bigquery_file_loads.py",
 line 750, in process
job_reference = self.bq_wrapper.perform_load_job(
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/io/gcp/bigquery_tools.py",
 line 1022, in perform_load_job
return self._insert_load_job(
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/utils/retry.py",
 line 298, in wrapper
return fun(*args, **kwargs)
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/io/gcp/bigquery_tools.py",
 line 559, in _insert_load_job
return self._start_job(request, stream=source_stream).jobReference
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/io/gcp/bigquery_tools.py",
 line 578, in _start_job
response = self.client.jobs.Insert(request, upload=upload)
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/io/gcp/internal/clients/bigquery/bigquery_v2_client.py",
 line 356, in Insert
return self._RunMethod(
  File "/usr/local/lib/python3.9/site-packages/apitools/base/py/base_api.py", 
line 731, in _RunMethod
return self.ProcessHttpResponse(method_config, http_response, request)
  File "/usr/local/lib/python3.9/site-packages/apitools/base/py/base_api.py", 
line 737, in ProcessHttpResponse
self.__ProcessHttpResponse(method_config, http_response, request))
  File "/usr/local/lib/python3.9/site-packages/apitools/base/py/base_api.py", 
line 603, in __ProcessHttpResponse
raise exceptions.HttpError.FromResponse(
RuntimeError: apitools.base.py.exceptions.HttpBadRequestError: HttpError 
accessing 
:
 response: <{'vary': 'Origin, X-Origin, Referer', 'content-type': 
'application/json; charset=UTF-8', 'date': 'Thu, 25 Jan 2024 00:29:10 GMT', 
'server': 'ESF', 'cache-control': 'private', 'x-xss-protection': '0', 
'x-frame-options': 'SAMEORIGIN', 'x-content-type-options': 'nosniff', 
'transfer-encoding': 'chunked', 'status': '400', 'content-length': '318', 
'-content-encoding': 'gzip'}>, content <{
  "error": {
"code": 400,
"message": "Load configuration must specify at least one source URI",
"errors": [
  {
"message": "Load configuration must specify at least one source URI",
"domain": "global",
"reason": "invalid"
  }
],
"status": "INVALID_ARGUMENT"
  }
}
> [while running 
> 'WriteWithMultipleDestsFreely/BigQueryBatchFileLoads/TriggerLoadJobsWithTempTables/ParDo(TriggerLoadJobs)-ptransform-71']

  Worker ID: beamapp-jenkins-012500254-01241625-uy51-harness-w2wg
WARNING  
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:203 
2024-01-25T00:29:11.982Z: JOB_MESSAGE_WARNING: Unable to delete temp files: 
"gs://temp-storage-for-end-to-end-tests/temp-it/beamapp-jenkins-0125002540-066487-zmwbf9ko.1706142340.066646/dax-tmp-2024-01-24_16_25_40-3576056548624936316-S56-2-ba1d8146837ee981/tmp-ba1d8146837eed58@DAX.recordio."
WARNING  
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:203 
2024-01-25T00:29:11.983Z: JOB_MESSAGE_WARNING: Unable to delete temp files: 
"gs://temp-storage-for-end-to-end-tests/temp-it/beamapp-jenkins-0125002540-066487-zmwbf9ko.1706142340.066646/dax-tmp-2024-01-24_16_25_40-3576056548624936316-S56-1-a88f64f614a2a437/tmp-a88f64f614a2a2e2@DAX.recordio."
WARNING  
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:203 
2024-01-25T00:29:11.987Z: JOB_MESSAGE_WARNING: Unable to delete temp files: 

Build failed in Jenkins: beam_PostCommit_Java_DataflowV2 #4027

[Apache Jenkins Server]

See 


Changes:


--
[...truncated 49.56 KB...]
  Attempting uninstall: pip
Found existing installation: pip 20.0.2
Uninstalling pip-20.0.2:
  Successfully uninstalled pip-20.0.2
  Attempting uninstall: setuptools
Found existing installation: setuptools 44.0.0
Uninstalling setuptools-44.0.0:
  Successfully uninstalled setuptools-44.0.0
Successfully installed pip-23.3.2 setuptools-69.0.3 wheel-0.42.0
Collecting beautifulsoup4<5.0,>=4.9.0 (from -r 

 (line 19))
  Using cached beautifulsoup4-4.12.3-py3-none-any.whl.metadata (3.8 kB)
Collecting pyyaml<7,>=6.0.1 (from -r 

 (line 20))
  Using cached 
PyYAML-6.0.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata 
(2.1 kB)
Collecting tenacity<9.0,>=6.1.0 (from -r 

 (line 21))
  Using cached tenacity-8.2.3-py3-none-any.whl.metadata (1.0 kB)
Collecting soupsieve>1.2 (from beautifulsoup4<5.0,>=4.9.0->-r 

 (line 19))
  Using cached soupsieve-2.5-py3-none-any.whl.metadata (4.7 kB)
Using cached beautifulsoup4-4.12.3-py3-none-any.whl (147 kB)
Using cached 
PyYAML-6.0.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (736 kB)
Using cached tenacity-8.2.3-py3-none-any.whl (24 kB)
Using cached soupsieve-2.5-py3-none-any.whl (36 kB)
Installing collected packages: tenacity, soupsieve, pyyaml, beautifulsoup4
Successfully installed beautifulsoup4-4.12.3 pyyaml-6.0.1 soupsieve-2.5 
tenacity-8.2.3
Executing python 

 
--license_index=

--output_dir=

--dep_url_yaml=

--manual_license_path=
INFO:root:Pulling license for 129 dependencies using 16 threads.
INFO:root:Replaced local file URL with 
file://
 for xz-1.5
INFO:root:pull_licenses_java.py succeed. It took 3.235201 seconds with 16 
threads.
Copying licenses from 

 to 

Finished license_scripts.sh

> Task :release:go-licenses:java:dockerRun
go: downloading github.com/golang/protobuf v1.5.3
go: downloading google.golang.org/grpc v1.59.0
go: downloading google.golang.org/protobuf v1.31.0
go: downloading golang.org/x/sys v0.15.0
go: downloading golang.org/x/net v0.19.0
go: downloading google.golang.org/genproto/googleapis/rpc 
v0.0.0-20231120223509-83a465c0220f
go: downloading google.golang.org/genproto v0.0.0-20231106174013-bbf56f31fb17
go: downloading golang.org/x/text v0.14.0
go: added github.com/apache/beam/sdks/v2 v2.53.0
go: added github.com/golang/protobuf v1.5.3
go: added golang.org/x/net v0.19.0
go: added golang.org/x/sys v0.15.0
go: added golang.org/x/text v0.14.0
go: added google.golang.org/genproto/googleapis/rpc 
v0.0.0-20231120223509-83a465c0220f
go: added google.golang.org/grpc v1.59.0
go: added google.golang.org/protobuf v1.31.0
+ go-licenses save github.com/apache/beam/sdks/v2/java/container 
--save_path=/output/licenses
W0124 21:58:01.063849  38 library.go:101] "golang.org/x/sys/unix" contains 
non-Go code that can't be inspected for further dependencies:
/go/pkg/mod/golang.org/x/sys@v0.15.0/unix/asm_linux_amd64.s
+ go-licenses csv github.com/apache/beam/sdks/v2/java/container
+ tee /output/licenses/list.csv

> Task :sdks:java:container:java8:copyJavaThirdPartyLicenses

> Task :sdks:java:container:downloadCloudProfilerAgent
  % Total% Received % Xferd  Average Speed   TimeTime Time  Current
 Dload  Upload   Total   SpentLeft  Speed
  0 00 00 0

Build failed in Jenkins: beam_PostCommit_Python311 #1155

[Apache Jenkins Server]

See 


Changes:


--
[...truncated 10.01 MB...]
}
message: "SDK Harness waiting for in-flight requests to complete"
log_location: 
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:289"
thread: "MainThread"

INFO:root:severity: INFO
timestamp {
  seconds: 1706138218
  nanos: 907072067
}
message: "Closing all cached grpc data channels."
log_location: 
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/data_plane.py:820"
thread: "MainThread"

INFO:root:severity: INFO
timestamp {
  seconds: 1706138218
  nanos: 907138109
}
message: "Closing all cached gRPC state handlers."
log_location: 
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:929"
thread: "MainThread"

INFO:root:severity: INFO
timestamp {
  seconds: 1706138218
  nanos: 908039093
}
message: "Done consuming work."
log_location: 
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:301"
thread: "MainThread"

INFO:root:severity: INFO
timestamp {
  seconds: 1706138218
  nanos: 908141851
}
message: "Python sdk harness exiting."
log_location: 
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker_main.py:213"
thread: "MainThread"

INFO:apache_beam.runners.portability.local_job_service:Completed job in 
28.065586805343628 seconds with state DONE.
INFO:root:Completed job in 28.065586805343628 seconds with state DONE.
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE

> Task :sdks:python:test-suites:portable:py311:portableWordCountSparkRunnerBatch
INFO:apache_beam.runners.worker.worker_pool_main:Listening for workers at 
localhost:44677
INFO:apache_beam.runners.portability.fn_api_runner.translations:
  
INFO:apache_beam.runners.portability.fn_api_runner.translations:
  
INFO:apache_beam.runners.portability.fn_api_runner.translations:
  
INFO:apache_beam.utils.subprocess_server:Starting service with ('java' '-jar' 
'
 '--spark-master-url' 'local[4]' '--artifacts-dir' 
'/tmp/beam-temp32vwj911/artifactsb_v784c1' '--job-port' '57805' 
'--artifact-port' '0' '--expansion-port' '0')
INFO:apache_beam.utils.subprocess_server:24/01/24 23:17:09 WARN 
software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to 
retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:24/01/24 23:17:09 INFO 
org.apache.beam.runners.jobsubmission.JobServerDriver: ArtifactStagingService 
started on localhost:38881
INFO:apache_beam.utils.subprocess_server:24/01/24 23:17:09 INFO 
org.apache.beam.runners.jobsubmission.JobServerDriver: Java ExpansionService 
started on localhost:45385
INFO:apache_beam.utils.subprocess_server:24/01/24 23:17:09 INFO 
org.apache.beam.runners.jobsubmission.JobServerDriver: JobService started on 
localhost:57805
INFO:apache_beam.utils.subprocess_server:24/01/24 23:17:09 INFO 
org.apache.beam.runners.jobsubmission.JobServerDriver: Job server now running, 
terminate with Ctrl+C
WARNING:root:Waiting for grpc channel to be ready at localhost:57805.
WARNING:root:Waiting for grpc channel to be ready at localhost:57805.
INFO:apache_beam.utils.subprocess_server:24/01/24 23:17:13 INFO 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Staging 
artifacts for job_92d9aba6-7997-4a5a-8b7c-7ff2c03261b6.
INFO:apache_beam.utils.subprocess_server:24/01/24 23:17:13 INFO 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Resolving 
artifacts for 
job_92d9aba6-7997-4a5a-8b7c-7ff2c03261b6.0:ref_Environment_default_environment_1.
INFO:apache_beam.utils.subprocess_server:24/01/24 23:17:13 INFO 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Getting 1 
artifacts for job_92d9aba6-7997-4a5a-8b7c-7ff2c03261b6.null.
INFO:apache_beam.utils.subprocess_server:24/01/24 23:17:13 INFO 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Artifacts 
fully staged for job_92d9aba6-7997-4a5a-8b7c-7ff2c03261b6.
INFO:apache_beam.utils.subprocess_server:24/01/24 23:17:13 INFO 
org.apache.beam.runners.spark.SparkJobInvoker: Invoking job 
BeamApp-jenkins-0124231713-c8ae0832_e7855f4b-b8a1-42d7-a704-dbf1b02eadaf
INFO:apache_beam.utils.subprocess_server:24/01/24 23:17:13 INFO 
org.apache.beam.runners.jobsubmission.JobInvocation: Starting job invocation 
BeamApp-jenkins-0124231713-c8ae0832_e7855f4b-b8a1-42d7-a704-dbf1b02eadaf
INFO:apache_beam.runners.portability.portable_runner:Environment "LOOPBACK" has 
started a component necessary for the execution. Be sure to run the pipeline 
using
  with Pipeline() as p:
p.apply(..)
This ensures that the pipeline 

Build failed in Jenkins: beam_PostCommit_XVR_Direct #5094

[Apache Jenkins Server]

See 


Changes:


--
[...truncated 1.79 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:spanner_insert_or_update:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@152aa092
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:spanner_delete:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@44a7bfbc
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:spanner_read:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4ef37659
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:kafka_read_with_metadata:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@776b83cc
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:kafka_read_without_metadata:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@37858383
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:kafka_write:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e268090
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:external:java:generate_sequence:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1bb266b3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:bigquery_read:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@306cf3ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:bigquery_write:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2beee7ff
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:pubsub_read:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5136d012
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:pubsub_write:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5939a379
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:pubsub_write:v2: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@e1de817
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:combine_globally:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@52102734
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:combine_grouped_values:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3541cb24
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:combine_per_key:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2177849e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:create_view:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@40cb8df7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:flatten:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@13b13b5d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:group_by_key:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2892dae4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:group_into_batches:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@355ce81c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:group_into_batches_with_sharded_key:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@29647f75
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:impulse:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3315d2d7
INFO 

Build failed in Jenkins: beam_PostCommit_Java_ValidatesRunner_Flink_Java11 #5464

[Apache Jenkins Server]

See 


Changes:


--
[...truncated 3.20 KB...]
Gradle Enterprise plugins resolution: https://plugins.gradle.org/m2
Enforcing Gradle Enterprise: https://ge.apache.org, allowUntrustedServer: false
> Task :buildSrc:compileJava NO-SOURCE
> Task :buildSrc:compileGroovy FROM-CACHE
> Task :buildSrc:pluginDescriptors
> Task :buildSrc:processResources
> Task :buildSrc:classes
> Task :buildSrc:jar
> Task :runners:java-fn-execution:createCheckerFrameworkManifest
> Task :model:pipeline:createCheckerFrameworkManifest
> Task :model:job-management:createCheckerFrameworkManifest
> Task :sdks:java:harness:createCheckerFrameworkManifest
> Task :sdks:java:core:createCheckerFrameworkManifest
> Task :sdks:java:transform-service:launcher:createCheckerFrameworkManifest
> Task :runners:java-fn-execution:processResources NO-SOURCE
> Task :sdks:java:harness:processResources NO-SOURCE
> Task :sdks:java:extensions:avro:createCheckerFrameworkManifest
> Task :runners:java-job-service:createCheckerFrameworkManifest
> Task :sdks:java:extensions:avro:generateAvroProtocol NO-SOURCE
> Task :runners:core-construction-java:createCheckerFrameworkManifest
> Task 
> :sdks:java:extensions:google-cloud-platform-core:createCheckerFrameworkManifest
> Task :sdks:java:expansion-service:createCheckerFrameworkManifest
> Task :sdks:java:fn-execution:createCheckerFrameworkManifest
> Task :runners:core-construction-java:processResources NO-SOURCE
> Task :sdks:java:extensions:google-cloud-platform-core:processResources 
> NO-SOURCE
> Task :runners:java-job-service:processResources NO-SOURCE
> Task :sdks:java:fn-execution:processResources NO-SOURCE
> Task :sdks:java:extensions:avro:generateAvroJava NO-SOURCE
> Task :sdks:java:build-tools:createCheckerFrameworkManifest
> Task :sdks:java:expansion-service:processResources NO-SOURCE
> Task :runners:core-java:createCheckerFrameworkManifest
> Task :model:job-management:extractProto
> Task :runners:core-java:processResources NO-SOURCE
> Task :sdks:java:extensions:avro:processResources NO-SOURCE
> Task :model:fn-execution:createCheckerFrameworkManifest
> Task :sdks:java:core:generateGrammarSource FROM-CACHE
> Task :runners:core-java:processTestResources NO-SOURCE
> Task :sdks:java:extensions:protobuf:createCheckerFrameworkManifest
> Task :sdks:java:extensions:arrow:createCheckerFrameworkManifest
> Task :runners:flink:1.15:copySourceOverrides
> Task :sdks:java:extensions:arrow:processResources NO-SOURCE
> Task :model:fn-execution:extractProto
> Task :sdks:java:io:google-cloud-platform:createCheckerFrameworkManifest
> Task :sdks:java:io:google-cloud-platform:processResources NO-SOURCE
> Task :sdks:java:extensions:protobuf:extractProto
> Task :model:job-management:processResources
> Task :runners:flink:1.15:createCheckerFrameworkManifest
> Task :sdks:java:extensions:protobuf:processResources NO-SOURCE
> Task :runners:flink:1.15:copyResourcesOverrides NO-SOURCE
> Task :runners:flink:1.15:processResources
> Task :model:fn-execution:processResources
> Task :sdks:java:core:processResources
> Task :sdks:java:core:generateTestGrammarSource NO-SOURCE
> Task :runners:flink:1.15:copyTestSourceOverrides
> Task :runners:flink:1.15:copyTestResourcesOverrides NO-SOURCE
> Task :sdks:java:core:processTestResources
> Task :runners:flink:1.15:processTestResources
> Task :sdks:java:build-tools:compileJava FROM-CACHE
> Task :sdks:java:transform-service:launcher:compileJava FROM-CACHE
> Task :sdks:java:transform-service:launcher:processResources
> Task :sdks:java:transform-service:launcher:classes
> Task :sdks:java:build-tools:processResources
> Task :sdks:java:build-tools:classes
> Task :sdks:java:transform-service:launcher:jar
> Task :sdks:java:build-tools:jar
> Task :sdks:java:transform-service:launcher:shadowJar FROM-CACHE
> Task :model:pipeline:extractIncludeProto
> Task :model:pipeline:extractProto
> Task :model:pipeline:generateProto FROM-CACHE
> Task :model:pipeline:compileJava FROM-CACHE
> Task :model:pipeline:processResources
> Task :model:pipeline:classes
> Task :model:pipeline:jar
> Task :model:pipeline:shadowJar FROM-CACHE
> Task :model:fn-execution:extractIncludeProto
> Task :model:job-management:extractIncludeProto
> Task :model:job-management:generateProto FROM-CACHE
> Task :model:fn-execution:generateProto FROM-CACHE
> Task :model:job-management:compileJava FROM-CACHE
> Task :model:fn-execution:compileJava FROM-CACHE
> Task :model:fn-execution:classes
> Task :model:job-management:classes
> Task :model:job-management:shadowJar FROM-CACHE
> Task :model:fn-execution:shadowJar FROM-CACHE
> Task :sdks:java:core:compileJava FROM-CACHE
> Task :sdks:java:core:classes
> Task :sdks:java:core:shadowJar FROM-CACHE
> Task :sdks:java:extensions:arrow:compileJava FROM-CACHE
> Task :sdks:java:extensions:arrow:classes UP-TO-DATE
> Task :sdks:java:extensions:arrow:jar
> Task 

Build failed in Jenkins: beam_PostCommit_Python310 #1817

[Apache Jenkins Server]

See 


Changes:


--
[...truncated 6.06 MB...]
thread: "MainThread"

INFO:root:severity: INFO
timestamp {
  seconds: 1706131838
  nanos: 421093702
}
message: "SDK Harness waiting for in-flight requests to complete"
log_location: 
"/usr/local/lib/python3.10/site-packages/apache_beam/runners/worker/sdk_worker.py:289"
thread: "MainThread"

INFO:root:severity: INFO
timestamp {
  seconds: 1706131838
  nanos: 421184301
}
message: "Closing all cached grpc data channels."
log_location: 
"/usr/local/lib/python3.10/site-packages/apache_beam/runners/worker/data_plane.py:820"
thread: "MainThread"

INFO:root:severity: INFO
timestamp {
  seconds: 1706131838
  nanos: 421257734
}
message: "Closing all cached gRPC state handlers."
log_location: 
"/usr/local/lib/python3.10/site-packages/apache_beam/runners/worker/sdk_worker.py:929"
thread: "MainThread"

INFO:root:severity: INFO
timestamp {
  seconds: 1706131838
  nanos: 421497821
}
message: "Done consuming work."
log_location: 
"/usr/local/lib/python3.10/site-packages/apache_beam/runners/worker/sdk_worker.py:301"
thread: "MainThread"

INFO:root:severity: INFO
timestamp {
  seconds: 1706131838
  nanos: 421566009
}
message: "Python sdk harness exiting."
log_location: 
"/usr/local/lib/python3.10/site-packages/apache_beam/runners/worker/sdk_worker_main.py:213"
thread: "MainThread"

INFO:apache_beam.runners.portability.local_job_service:Completed job in 
30.123375415802002 seconds with state DONE.
INFO:root:Completed job in 30.123375415802002 seconds with state DONE.
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE

> Task :sdks:python:test-suites:portable:py310:portableWordCountSparkRunnerBatch
INFO:apache_beam.runners.worker.worker_pool_main:Listening for workers at 
localhost:33995
INFO:apache_beam.runners.portability.fn_api_runner.translations:
  
INFO:apache_beam.runners.portability.fn_api_runner.translations:
  
INFO:apache_beam.runners.portability.fn_api_runner.translations:
  
INFO:apache_beam.utils.subprocess_server:Starting service with ('java' '-jar' 
'
 '--spark-master-url' 'local[4]' '--artifacts-dir' 
'/tmp/beam-tempkqk4aa1p/artifacts4khpjtob' '--job-port' '37363' 
'--artifact-port' '0' '--expansion-port' '0')
INFO:apache_beam.utils.subprocess_server:24/01/24 21:30:51 WARN 
software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to 
retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:24/01/24 21:30:51 INFO 
org.apache.beam.runners.jobsubmission.JobServerDriver: ArtifactStagingService 
started on localhost:36363
INFO:apache_beam.utils.subprocess_server:24/01/24 21:30:51 INFO 
org.apache.beam.runners.jobsubmission.JobServerDriver: Java ExpansionService 
started on localhost:32855
INFO:apache_beam.utils.subprocess_server:24/01/24 21:30:51 INFO 
org.apache.beam.runners.jobsubmission.JobServerDriver: JobService started on 
localhost:37363
INFO:apache_beam.utils.subprocess_server:24/01/24 21:30:51 INFO 
org.apache.beam.runners.jobsubmission.JobServerDriver: Job server now running, 
terminate with Ctrl+C
WARNING:root:Waiting for grpc channel to be ready at localhost:37363.
INFO:apache_beam.utils.subprocess_server:24/01/24 21:30:53 INFO 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Staging 
artifacts for job_82cbb052-39be-431b-8faa-0d9279c9898d.
INFO:apache_beam.utils.subprocess_server:24/01/24 21:30:53 INFO 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Resolving 
artifacts for 
job_82cbb052-39be-431b-8faa-0d9279c9898d.0:ref_Environment_default_environment_1.
INFO:apache_beam.utils.subprocess_server:24/01/24 21:30:53 INFO 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Getting 1 
artifacts for job_82cbb052-39be-431b-8faa-0d9279c9898d.null.
INFO:apache_beam.utils.subprocess_server:24/01/24 21:30:53 INFO 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Artifacts 
fully staged for job_82cbb052-39be-431b-8faa-0d9279c9898d.
INFO:apache_beam.utils.subprocess_server:24/01/24 21:30:53 INFO 
org.apache.beam.runners.spark.SparkJobInvoker: Invoking job 
BeamApp-jenkins-0124213053-375fc40e_c9cdb37f-3528-4235-89eb-eb69d753716c
INFO:apache_beam.utils.subprocess_server:24/01/24 21:30:53 INFO 
org.apache.beam.runners.jobsubmission.JobInvocation: Starting job invocation 
BeamApp-jenkins-0124213053-375fc40e_c9cdb37f-3528-4235-89eb-eb69d753716c
INFO:apache_beam.runners.portability.portable_runner:Environment "LOOPBACK" has 
started a component necessary for the execution. Be sure to run the pipeline 
using
  with Pipeline() as p:
p.apply(..)

Build failed in Jenkins: beam_PostCommit_Python38 #5083

[Apache Jenkins Server]

See 


Changes:


--
[...truncated 6.01 MB...]
log_location: 
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker_main.py:213"
thread: "MainThread"

INFO:apache_beam.runners.portability.local_job_service:Completed job in 
28.657422065734863 seconds with state DONE.
INFO:root:Completed job in 28.657422065734863 seconds with state DONE.
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE

> Task :sdks:python:test-suites:portable:py38:portableWordCountSparkRunnerBatch
INFO:apache_beam.runners.worker.worker_pool_main:Listening for workers at 
localhost:45063
INFO:apache_beam.runners.portability.fn_api_runner.translations:
  
INFO:apache_beam.runners.portability.fn_api_runner.translations:
  
INFO:apache_beam.runners.portability.fn_api_runner.translations:
  
INFO:apache_beam.utils.subprocess_server:Starting service with ('java' '-jar' 
'
 '--spark-master-url' 'local[4]' '--artifacts-dir' 
'/tmp/beam-temp_sr3vy3u/artifactsc0ud9imz' '--job-port' '56923' 
'--artifact-port' '0' '--expansion-port' '0')
INFO:apache_beam.utils.subprocess_server:24/01/24 20:48:12 WARN 
software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to 
retrieve the requested metadata.
WARNING:root:Waiting for grpc channel to be ready at localhost:56923.
INFO:apache_beam.utils.subprocess_server:24/01/24 20:48:13 INFO 
org.apache.beam.runners.jobsubmission.JobServerDriver: ArtifactStagingService 
started on localhost:33259
INFO:apache_beam.utils.subprocess_server:24/01/24 20:48:13 INFO 
org.apache.beam.runners.jobsubmission.JobServerDriver: Java ExpansionService 
started on localhost:35839
INFO:apache_beam.utils.subprocess_server:24/01/24 20:48:13 INFO 
org.apache.beam.runners.jobsubmission.JobServerDriver: JobService started on 
localhost:56923
INFO:apache_beam.utils.subprocess_server:24/01/24 20:48:13 INFO 
org.apache.beam.runners.jobsubmission.JobServerDriver: Job server now running, 
terminate with Ctrl+C
WARNING:root:Waiting for grpc channel to be ready at localhost:56923.
WARNING:root:Waiting for grpc channel to be ready at localhost:56923.
WARNING:root:Waiting for grpc channel to be ready at localhost:56923.
INFO:apache_beam.utils.subprocess_server:24/01/24 20:48:18 INFO 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Staging 
artifacts for job_37916988-3865-4cff-887b-04b10debecd1.
INFO:apache_beam.utils.subprocess_server:24/01/24 20:48:18 INFO 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Resolving 
artifacts for 
job_37916988-3865-4cff-887b-04b10debecd1.0:ref_Environment_default_environment_1.
INFO:apache_beam.utils.subprocess_server:24/01/24 20:48:18 INFO 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Getting 1 
artifacts for job_37916988-3865-4cff-887b-04b10debecd1.null.
INFO:apache_beam.utils.subprocess_server:24/01/24 20:48:18 INFO 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Artifacts 
fully staged for job_37916988-3865-4cff-887b-04b10debecd1.
INFO:apache_beam.utils.subprocess_server:24/01/24 20:48:18 INFO 
org.apache.beam.runners.spark.SparkJobInvoker: Invoking job 
BeamApp-jenkins-0124204818-6ec86e_3629a79f-79d3-4b08-bd66-aa3ea3d688e0
INFO:apache_beam.utils.subprocess_server:24/01/24 20:48:18 INFO 
org.apache.beam.runners.jobsubmission.JobInvocation: Starting job invocation 
BeamApp-jenkins-0124204818-6ec86e_3629a79f-79d3-4b08-bd66-aa3ea3d688e0
INFO:apache_beam.runners.portability.portable_runner:Environment "LOOPBACK" has 
started a component necessary for the execution. Be sure to run the pipeline 
using
  with Pipeline() as p:
p.apply(..)
This ensures that the pipeline finishes before this program exits.
INFO:apache_beam.runners.portability.portable_runner:Job state changed to 
STOPPED
INFO:apache_beam.runners.portability.portable_runner:Job state changed to 
STARTING
INFO:apache_beam.runners.portability.portable_runner:Job state changed to 
RUNNING
INFO:apache_beam.utils.subprocess_server:24/01/24 20:48:19 INFO 
org.apache.beam.runners.spark.translation.SparkContextFactory: Creating a brand 
new Spark Context.
INFO:apache_beam.utils.subprocess_server:24/01/24 20:48:19 WARN 
org.apache.hadoop.util.NativeCodeLoader: Unable to load native-hadoop library 
for your platform... using builtin-java classes where applicable
INFO:apache_beam.utils.subprocess_server:24/01/24 20:48:21 INFO 
org.sparkproject.jetty.util.log: Logging initialized @13820ms to 
org.sparkproject.jetty.util.log.Slf4jLog
INFO:apache_beam.utils.subprocess_server:24/01/24 20:48:22 INFO 

Build failed in Jenkins: beam_PostCommit_Java_ValidatesRunner_Flink #12788

[Apache Jenkins Server]

See 


Changes:


--
Started by timer
Running as SYSTEM
[EnvInject] - Loading node environment variables.
Building remotely on apache-beam-jenkins-13 (beam) in workspace 

The recommended git tool is: NONE
No credentials specified
Wiping out workspace first.
Cloning the remote Git repository
Using shallow clone with depth 1
Avoid fetching tags
Cloning repository https://github.com/apache/beam.git
 > git init 
 > 
 >  # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
 > git --version # timeout=10
 > git --version # 'git version 2.25.1'
 > git fetch --no-tags --force --progress --depth=1 -- 
 > https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* # 
 > timeout=10
 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # 
 > timeout=10
 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Using shallow fetch with depth 1
Fetching upstream changes from https://github.com/apache/beam.git
 > git fetch --no-tags --force --progress --depth=1 -- 
 > https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* 
 > +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* # 
 > timeout=10
 > git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 674fe77df47cadca16196af0d9d759592d9ef04f (origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 674fe77df47cadca16196af0d9d759592d9ef04f # timeout=10
Commit message: "[Python] Add an option to retain timestamp returned from the 
BigTable row (#30088)"
 > git rev-list --no-walk 11646ca7da22374baa5a7936069f7ca578f5d28e # timeout=10
First time build. Skipping changelog.
No emails were triggered.
[EnvInject] - Executing scripts and injecting environment variables after the 
SCM step.
[EnvInject] - Injecting as environment variables the properties content 
SETUPTOOLS_USE_DISTUTILS=stdlib
SPARK_LOCAL_IP=127.0.0.1

[EnvInject] - Variables injected successfully.
[Gradle] - Launching build.
[src] $ 

 --continue --max-workers=8 -Dorg.gradle.jvmargs=-Xms2g 
-Dorg.gradle.jvmargs=-Xmx6g -Dorg.gradle.vfs.watch=false -Pdocker-pull-licenses 
:runners:flink:1.15:validatesRunner
To honour the JVM settings for this build a single-use Daemon process will be 
forked. For more on this, please refer to 
https://docs.gradle.org/8.4/userguide/gradle_daemon.html#sec:disabling_the_daemon
 in the Gradle documentation.
Daemon will be stopped at the end of the build 
Configuration on demand is an incubating feature.
Gradle Enterprise plugins resolution: https://plugins.gradle.org/m2
Enforcing Gradle Enterprise: https://ge.apache.org, allowUntrustedServer: false
> Task :buildSrc:compileJava NO-SOURCE
> Task :buildSrc:compileGroovy FROM-CACHE
> Task :buildSrc:pluginDescriptors
> Task :buildSrc:processResources
> Task :buildSrc:classes
> Task :buildSrc:jar
> Task :sdks:java:transform-service:launcher:createCheckerFrameworkManifest
> Task :model:fn-execution:createCheckerFrameworkManifest
> Task :sdks:java:extensions:avro:createCheckerFrameworkManifest
> Task :model:job-management:createCheckerFrameworkManifest
> Task :sdks:java:extensions:avro:generateAvroProtocol NO-SOURCE
> Task :sdks:java:extensions:avro:generateAvroJava NO-SOURCE
> Task :sdks:java:extensions:avro:processResources NO-SOURCE
> Task :model:job-management:extractProto
> Task :model:fn-execution:extractProto
> Task :sdks:java:fn-execution:createCheckerFrameworkManifest
> Task :sdks:java:core:createCheckerFrameworkManifest
> Task :runners:core-java:createCheckerFrameworkManifest
> Task :model:pipeline:createCheckerFrameworkManifest
> Task :runners:core-construction-java:createCheckerFrameworkManifest
> Task :runners:core-java:processResources NO-SOURCE
> Task :sdks:java:fn-execution:processResources NO-SOURCE
> Task :runners:core-construction-java:processResources NO-SOURCE
> Task :model:job-management:processResources
> Task :sdks:java:harness:createCheckerFrameworkManifest
> Task :runners:java-job-service:createCheckerFrameworkManifest
> Task :runners:java-fn-execution:createCheckerFrameworkManifest
> Task :runners:java-job-service:processResources NO-SOURCE
> Task :sdks:java:harness:processResources NO-SOURCE
> Task :runners:java-fn-execution:processResources NO-SOURCE
> Task :sdks:java:expansion-service:createCheckerFrameworkManifest
> Task :sdks:java:core:generateGrammarSource FROM-CACHE
> Task :model:fn-execution:processResources
> Task :sdks:java:expansion-service:processResources NO-SOURCE
> Task 

Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #2620

[Apache Jenkins Server]

See 


Changes:


--
[...truncated 1.17 MB...]
"workerPools": [
  {
"autoscalingSettings": {},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 1,
"packages": [
  {
"location": 
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test21001/go-2-1706128706493531820/worker",
"name": "worker"
  },
  {
"location": 
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test21001/go-2-1706128706493531820/xlang/beam-sdks-java-io-google-cloud-platform-expansion-service-2.54.0-SNAPSHOT-xMwvAP7QME3MIQNg8WKk1xE0uHxq27z6QL2kvpqfTlA.jar",
"name": 
"beam-sdks-java-io-google-cloud-platform-expansion-service-2.54.0-SNAPSHOT-xMwvAP7QME3MIQNg8WKk1xE0uHxq27z6QL2kvpqfTlA.jar"
  }
],
"sdkHarnessContainerImages": [
  {
"capabilities": [
  "beam:protocol:progress_reporting:v1",
  "beam:protocol:multi_core_bundle_processing:v1",
  "beam:transform:sdf_truncate_sized_restrictions:v1",
  "beam:protocol:worker_status:v1",
  "beam:protocol:monitoring_info_short_ids:v1",
  "beam:version:sdk_base:go:apache/beam_go_sdk:2.54.0.dev",
  "beam:transform:to_string:v1",
  "beam:protocol:data_sampling:v1",
  "beam:coder:bytes:v1",
  "beam:coder:bool:v1",
  "beam:coder:varint:v1",
  "beam:coder:double:v1",
  "beam:coder:string_utf8:v1",
  "beam:coder:length_prefix:v1",
  "beam:coder:kv:v1",
  "beam:coder:iterable:v1",
  "beam:coder:state_backed_iterable:v1",
  "beam:coder:windowed_value:v1",
  "beam:coder:global_window:v1",
  "beam:coder:interval_window:v1",
  "beam:coder:row:v1",
  "beam:coder:nullable:v1",
  "beam:coder:timer:v1"
],
"containerImage": 
"us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20240124-203215",
"environmentId": "go"
  },
  {
"capabilities": [
  "beam:coder:bytes:v1",
  "beam:coder:bool:v1",
  "beam:coder:varint:v1",
  "beam:coder:string_utf8:v1",
  "beam:coder:iterable:v1",
  "beam:coder:timer:v1",
  "beam:coder:kv:v1",
  "beam:coder:length_prefix:v1",
  "beam:coder:global_window:v1",
  "beam:coder:interval_window:v1",
  "beam:coder:custom_window:v1",
  "beam:coder:windowed_value:v1",
  "beam:coder:double:v1",
  "beam:coder:row:v1",
  "beam:coder:param_windowed_value:v1",
  "beam:coder:state_backed_iterable:v1",
  "beam:coder:sharded_key:v1",
  "beam:coder:nullable:v1",
  "beam:protocol:multi_core_bundle_processing:v1",
  "beam:protocol:progress_reporting:v1",
  "beam:protocol:harness_monitoring_infos:v1",
  "beam:protocol:control_request_elements_embedding:v1",
  "beam:protocol:state_caching:v1",
  "beam:version:sdk_base:apache/beam_java8_sdk:2.54.0.dev",
  "beam:transform:sdf_truncate_sized_restrictions:v1",
  "beam:transform:to_string:v1",
  "beam:protocol:data_sampling:v1"
],
"containerImage": 
"us.gcr.io/apache-beam-testing/java-postcommit-it/java:20240124202042",
"environmentId": "joljWotBwEbeam:env:docker:v1"
  }
],
"workerHarnessContainerImage": 
"us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20240124-203215"
  }
]
  },
  "name": "go-testbigtableio_basicwriteread-777",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2024/01/24 20:38:37 Submitted job: 2024-01-24_12_38_36-4693879975896131642
2024/01/24 20:38:37 Console: 
https://console.cloud.google.com/dataflow/jobs/us-central1/2024-01-24_12_38_36-4693879975896131642?project=apache-beam-testing
2024/01/24 20:38:37 Logs: 
https://console.cloud.google.com/logs/viewer?project=apache-beam-testing=dataflow_step%2Fjob_id%2F2024-01-24_12_38_36-4693879975896131642
2024/01/24 20:38:37 Job state: JOB_STATE_PENDING ...
2024/01/24 20:39:07 Job still running ...
2024/01/24 20:39:37 Job still running ...
2024/01/24 20:40:07 Job still running ...
2024/01/24 20:40:37 Job still running ...
2024/01/24 20:41:07 Job still running ...
2024/01/24 20:41:37 Job still running ...
2024/01/24 20:42:07 Job still running ...
2024/01/24 20:42:37 Job still running ...
2024/01/24 20:43:07 Job still running ...
2024/01/24 20:43:37 Job 2024-01-24_12_38_36-4693879975896131642 succeeded!
--- PASS: 

Build failed in Jenkins: beam_PostCommit_Python39 #2804

[Apache Jenkins Server]

See 


Changes:


--
[...truncated 12.52 MB...]
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/io/gcp/bigquery_tools.py",
 line 1022, in perform_load_job
return self._insert_load_job(
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/utils/retry.py",
 line 298, in wrapper
return fun(*args, **kwargs)
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/io/gcp/bigquery_tools.py",
 line 559, in _insert_load_job
return self._start_job(request, stream=source_stream).jobReference
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/io/gcp/bigquery_tools.py",
 line 578, in _start_job
response = self.client.jobs.Insert(request, upload=upload)
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/io/gcp/internal/clients/bigquery/bigquery_v2_client.py",
 line 356, in Insert
return self._RunMethod(
  File "/usr/local/lib/python3.9/site-packages/apitools/base/py/base_api.py", 
line 731, in _RunMethod
return self.ProcessHttpResponse(method_config, http_response, request)
  File "/usr/local/lib/python3.9/site-packages/apitools/base/py/base_api.py", 
line 737, in ProcessHttpResponse
self.__ProcessHttpResponse(method_config, http_response, request))
  File "/usr/local/lib/python3.9/site-packages/apitools/base/py/base_api.py", 
line 603, in __ProcessHttpResponse
raise exceptions.HttpError.FromResponse(
apitools.base.py.exceptions.HttpBadRequestError: HttpError accessing 
:
 response: <{'vary': 'Origin, X-Origin, Referer', 'content-type': 
'application/json; charset=UTF-8', 'date': 'Wed, 24 Jan 2024 18:30:39 GMT', 
'server': 'ESF', 'cache-control': 'private', 'x-xss-protection': '0', 
'x-frame-options': 'SAMEORIGIN', 'x-content-type-options': 'nosniff', 
'transfer-encoding': 'chunked', 'status': '400', 'content-length': '318', 
'-content-encoding': 'gzip'}>, content <{
  "error": {
"code": 400,
"message": "Load configuration must specify at least one source URI",
"errors": [
  {
"message": "Load configuration must specify at least one source URI",
"domain": "global",
"reason": "invalid"
  }
],
"status": "INVALID_ARGUMENT"
  }
}
>

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/runners/worker/sdk_worker.py",
 line 311, in _execute
response = task()
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/runners/worker/sdk_worker.py",
 line 386, in 
lambda: self.create_worker().do_instruction(request), request)
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/runners/worker/sdk_worker.py",
 line 650, in do_instruction
return getattr(self, request_type)(
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/runners/worker/sdk_worker.py",
 line 688, in process_bundle
bundle_processor.process_bundle(instruction_id))
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/runners/worker/bundle_processor.py",
 line 1113, in process_bundle
input_op_by_transform_id[element.transform_id].process_encoded(
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/runners/worker/bundle_processor.py",
 line 237, in process_encoded
self.output(decoded_value)
  File "apache_beam/runners/worker/operations.py", line 570, in 
apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 572, in 
apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 263, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 266, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 953, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/worker/operations.py", line 954, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/common.py", line 1437, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 1526, in 
apache_beam.runners.common.DoFnRunner._reraise_augmented
  File "apache_beam/runners/common.py", line 1435, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", 

Build failed in Jenkins: beam_PostCommit_Python311 #1154

[Apache Jenkins Server]

See 


Changes:


--
[...truncated 11.93 MB...]
  File "apache_beam/runners/common.py", line 1547, in 
apache_beam.runners.common.DoFnRunner._reraise_augmented
  File "apache_beam/runners/common.py", line 1435, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 851, in 
apache_beam.runners.common.PerWindowInvoker.invoke_process
  File "apache_beam/runners/common.py", line 995, in 
apache_beam.runners.common.PerWindowInvoker._invoke_process_per_window
  File "apache_beam/runners/common.py", line 1611, in 
apache_beam.runners.common._OutputHandler.handle_process_outputs
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.11/site-packages/apache_beam/io/gcp/bigquery_file_loads.py",
 line 750, in process
job_reference = self.bq_wrapper.perform_load_job(
^
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.11/site-packages/apache_beam/io/gcp/bigquery_tools.py",
 line 1022, in perform_load_job
return self._insert_load_job(
   ^^
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.11/site-packages/apache_beam/utils/retry.py",
 line 298, in wrapper
return fun(*args, **kwargs)
   
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.11/site-packages/apache_beam/io/gcp/bigquery_tools.py",
 line 559, in _insert_load_job
return self._start_job(request, stream=source_stream).jobReference
   ^^
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.11/site-packages/apache_beam/io/gcp/bigquery_tools.py",
 line 578, in _start_job
response = self.client.jobs.Insert(request, upload=upload)
   ^^^
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.11/site-packages/apache_beam/io/gcp/internal/clients/bigquery/bigquery_v2_client.py",
 line 356, in Insert
return self._RunMethod(
   
  File "/usr/local/lib/python3.11/site-packages/apitools/base/py/base_api.py", 
line 731, in _RunMethod
return self.ProcessHttpResponse(method_config, http_response, request)
   ^^^
  File "/usr/local/lib/python3.11/site-packages/apitools/base/py/base_api.py", 
line 737, in ProcessHttpResponse
self.__ProcessHttpResponse(method_config, http_response, request))
^
  File "/usr/local/lib/python3.11/site-packages/apitools/base/py/base_api.py", 
line 603, in __ProcessHttpResponse
raise exceptions.HttpError.FromResponse(
RuntimeError: apitools.base.py.exceptions.HttpBadRequestError: HttpError 
accessing 
:
 response: <{'vary': 'Origin, X-Origin, Referer', 'content-type': 
'application/json; charset=UTF-8', 'date': 'Wed, 24 Jan 2024 17:06:43 GMT', 
'server': 'ESF', 'cache-control': 'private', 'x-xss-protection': '0', 
'x-frame-options': 'SAMEORIGIN', 'x-content-type-options': 'nosniff', 
'transfer-encoding': 'chunked', 'status': '400', 'content-length': '318', 
'-content-encoding': 'gzip'}>, content <{
  "error": {
"code": 400,
"message": "Load configuration must specify at least one source URI",
"errors": [
  {
"message": "Load configuration must specify at least one source URI",
"domain": "global",
"reason": "invalid"
  }
],
"status": "INVALID_ARGUMENT"
  }
}
> [while running 
> 'WriteWithMultipleDestsFreely/BigQueryBatchFileLoads/TriggerLoadJobsWithTempTables/ParDo(TriggerLoadJobs)-ptransform-71']

  Worker ID: beamapp-jenkins-012417030-01240903-xf0p-harness-kkjp
INFO 
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:201 
2024-01-24T17:06:44.848Z: JOB_MESSAGE_BASIC: Executing operation 
WriteWithMultipleDests/BigQueryBatchFileLoads/GroupFilesByTableDestinations/Read+WriteWithMultipleDests/BigQueryBatchFileLoads/ParDo(PartitionFiles)/ParDo(PartitionFiles)+WriteWithMultipleDests/BigQueryBatchFileLoads/FlattenPartitions+WriteWithMultipleDests/BigQueryBatchFileLoads/TriggerLoadJobsWithTempTables/ParDo(TriggerLoadJobs)+WriteWithMultipleDests/BigQueryBatchFileLoads/MapTuple()+WriteWithMultipleDests/BigQueryBatchFileLoads/ParDo(UpdateDestinationSchema)+WriteWithMultipleDests/BigQueryBatchFileLoads/GroupByKey/Write
INFO 
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:201 
2024-01-24T17:06:44.922Z: JOB_MESSAGE_BASIC: Finished operation 

Build failed in Jenkins: beam_PostCommit_XVR_Direct #5093

[Apache Jenkins Server]

See 


Changes:


--
[...truncated 1.44 MB...]

apache_beam/runners/portability/portable_runner.py:576: RuntimeError
-- Captured log call ---
INFO apache_beam.utils.subprocess_server:subprocess_server.py:339 Using 
pre-built snapshot at 

INFO root:external.py:1017 Starting a JAR-based expansion service from JAR 

 
INFO apache_beam.utils.subprocess_server:subprocess_server.py:203 Starting 
service with ['java' '-jar' 
'
 '37499' 
'--filesToStage=
 '--alsoStartLoopbackWorker']
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Starting 
expansion service at localhost:37499
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 24, 
2024 5:47:39 PM org.apache.beam.sdk.expansion.service.ExpansionService 
loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: 
Registering external transforms: [beam:external:java:sql:v1, 
beam:transform:org.apache.beam:pubsub_read:v1, 
beam:transform:org.apache.beam:pubsub_write:v1, 
beam:transform:org.apache.beam:pubsublite_write:v1, 
beam:transform:org.apache.beam:pubsublite_read:v1, 
beam:transform:org.apache.beam:spanner_insert:v1, 
beam:transform:org.apache.beam:spanner_update:v1, 
beam:transform:org.apache.beam:spanner_replace:v1, 
beam:transform:org.apache.beam:spanner_insert_or_update:v1, 
beam:transform:org.apache.beam:spanner_delete:v1, 
beam:transform:org.apache.beam:spanner_read:v1, 
beam:transform:org.apache.beam:kafka_read_with_metadata:v1, 
beam:transform:org.apache.beam:kafka_read_without_metadata:v1, 
beam:transform:org.apache.beam:kafka_write:v1, 
beam:external:java:generate_sequence:v1, 
beam:transform:org.apache.beam:bigquery_read:v1, 
beam:transform:org.apache.beam:bigquery_write:v1, 
beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, 
beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, 
beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, 
beam:transform:create_view:v1, beam:transform:flatten:v1, 
beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, 
beam:transform:group_into_batches_with_sharded_key:v1, 
beam:transform:impulse:v1, beam:transform:reshuffle:v1, 
beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, 
beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 
Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:external:java:sql:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6c779568
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:pubsub_read:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@f381794
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:pubsub_write:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2cdd0d4b
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:pubsublite_write:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7e9131d5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:pubsublite_read:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2e1d27ba
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:spanner_insert:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@61d6015a
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:spanner_update:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2525ff7e
INFO 

Build failed in Jenkins: beam_PostCommit_Java_DataflowV2 #4026

[Apache Jenkins Server]

See 


Changes:


--
[...truncated 41.08 KB...]
> Task :sdks:java:harness:jar
> Task :runners:java-fn-execution:compileJava FROM-CACHE
> Task :runners:java-fn-execution:classes UP-TO-DATE
> Task :runners:java-fn-execution:jar
> Task :sdks:java:extensions:google-cloud-platform-core:compileTestJava 
> FROM-CACHE
> Task :sdks:java:extensions:avro:compileTestJava FROM-CACHE
> Task :sdks:java:extensions:avro:testClasses UP-TO-DATE
> Task :sdks:java:expansion-service:compileJava FROM-CACHE
> Task :sdks:java:expansion-service:classes UP-TO-DATE
> Task :sdks:java:expansion-service:jar
> Task :sdks:java:extensions:avro:testJar
> Task :runners:core-java:compileTestJava FROM-CACHE
> Task :runners:core-java:testClasses UP-TO-DATE
> Task :runners:direct-java:compileJava FROM-CACHE
> Task :runners:direct-java:classes UP-TO-DATE
> Task :runners:core-java:testJar
> Task :sdks:java:extensions:google-cloud-platform-core:testClasses UP-TO-DATE
> Task :sdks:java:extensions:google-cloud-platform-core:testJar
> Task :sdks:java:io:kafka:compileJava FROM-CACHE
> Task :sdks:java:io:kafka:classes UP-TO-DATE
> Task :sdks:java:io:kafka:jar
> Task :sdks:java:harness:shadowJar FROM-CACHE
> Task :sdks:java:container:java8:copyDockerfileDependencies
> Task :runners:direct-java:shadowJar FROM-CACHE
> Task :runners:direct-java:compileTestJava FROM-CACHE
> Task :runners:direct-java:testClasses UP-TO-DATE
> Task :sdks:java:extensions:protobuf:extractIncludeTestProto
> Task :sdks:java:extensions:protobuf:generateTestProto FROM-CACHE
> Task :sdks:java:extensions:protobuf:compileTestJava FROM-CACHE
> Task :sdks:java:extensions:protobuf:testClasses
> Task :sdks:java:extensions:protobuf:testJar
> Task :runners:direct-java:shadowTestJar FROM-CACHE
> Task :sdks:java:io:google-cloud-platform:compileJava FROM-CACHE
> Task :sdks:java:io:google-cloud-platform:classes UP-TO-DATE
> Task :sdks:java:io:google-cloud-platform:jar
> Task :runners:google-cloud-dataflow-java:compileJava FROM-CACHE
> Task :runners:google-cloud-dataflow-java:classes
> Task :runners:google-cloud-dataflow-java:jar

> Task :sdks:java:container:pullLicenses
Collecting pip
  Using cached pip-23.3.2-py3-none-any.whl (2.1 MB)

> Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE
> Task :sdks:java:io:google-cloud-platform:testClasses

> Task :release:go-licenses:java:dockerRun
go: downloading github.com/golang/protobuf v1.5.3
go: downloading google.golang.org/grpc v1.59.0
go: downloading google.golang.org/protobuf v1.31.0
go: downloading golang.org/x/sys v0.15.0
go: downloading google.golang.org/genproto/googleapis/rpc 
v0.0.0-20231120223509-83a465c0220f
go: downloading golang.org/x/net v0.19.0
go: downloading google.golang.org/genproto v0.0.0-20231106174013-bbf56f31fb17

> Task :sdks:java:io:google-cloud-platform:testJar

> Task :sdks:java:container:pullLicenses
Collecting setuptools
  Using cached setuptools-69.0.3-py3-none-any.whl (819 kB)
Collecting wheel
  Using cached wheel-0.42.0-py3-none-any.whl (65 kB)
Installing collected packages: pip, setuptools, wheel
  Attempting uninstall: pip
Found existing installation: pip 20.0.2
Uninstalling pip-20.0.2:
  Successfully uninstalled pip-20.0.2
  Attempting uninstall: setuptools
Found existing installation: setuptools 44.0.0
Uninstalling setuptools-44.0.0:
  Successfully uninstalled setuptools-44.0.0
Successfully installed pip-23.3.2 setuptools-69.0.3 wheel-0.42.0
Collecting beautifulsoup4<5.0,>=4.9.0 (from -r 
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Java_DataflowV2/src/sdks/java/container/license_scripts/requirement.txt
 (line 19))
  Using cached beautifulsoup4-4.12.3-py3-none-any.whl.metadata (3.8 kB)
Collecting pyyaml<7,>=6.0.1 (from -r 
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Java_DataflowV2/src/sdks/java/container/license_scripts/requirement.txt
 (line 20))
  Using cached 
PyYAML-6.0.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata 
(2.1 kB)
Collecting tenacity<9.0,>=6.1.0 (from -r 
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Java_DataflowV2/src/sdks/java/container/license_scripts/requirement.txt
 (line 21))
  Using cached tenacity-8.2.3-py3-none-any.whl.metadata (1.0 kB)
Collecting soupsieve>1.2 (from beautifulsoup4<5.0,>=4.9.0->-r 
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Java_DataflowV2/src/sdks/java/container/license_scripts/requirement.txt
 (line 19))
  Using cached soupsieve-2.5-py3-none-any.whl.metadata (4.7 kB)
Using cached beautifulsoup4-4.12.3-py3-none-any.whl (147 kB)
Using cached 
PyYAML-6.0.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (736 kB)
Using cached tenacity-8.2.3-py3-none-any.whl (24 kB)
Using cached soupsieve-2.5-py3-none-any.whl (36 kB)
Installing collected packages: tenacity, soupsieve, pyyaml, beautifulsoup4
Successfully installed beautifulsoup4-4.12.3 

Build failed in Jenkins: beam_PostCommit_Java_ValidatesRunner_Flink_Java11 #5463

[Apache Jenkins Server]

See 


Changes:


--
[...truncated 1.37 KB...]
Fetching upstream changes from https://github.com/apache/beam.git
 > git fetch --no-tags --force --progress --depth=1 -- 
 > https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* 
 > +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* # 
 > timeout=10
 > git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 98a86b11cc767774dcbc7a92e03bd19a9656d7b7 (origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 98a86b11cc767774dcbc7a92e03bd19a9656d7b7 # timeout=10
Commit message: "[MLTransform]Throw an error when specifiend columns are not 
present in the input data (#30085)"
 > git rev-list --no-walk 11646ca7da22374baa5a7936069f7ca578f5d28e # timeout=10
First time build. Skipping changelog.
No emails were triggered.
[EnvInject] - Executing scripts and injecting environment variables after the 
SCM step.
[EnvInject] - Injecting as environment variables the properties content 
SETUPTOOLS_USE_DISTUTILS=stdlib
SPARK_LOCAL_IP=127.0.0.1

[EnvInject] - Variables injected successfully.
[Gradle] - Launching build.
[src] $ 

 -Dorg.gradle.java.home=/usr/lib/jvm/java-8-openjdk-amd64 
:runners:flink:1.15:jar :runners:flink:1.15:testJar
To honour the JVM settings for this build a single-use Daemon process will be 
forked. For more on this, please refer to 
https://docs.gradle.org/8.4/userguide/gradle_daemon.html#sec:disabling_the_daemon
 in the Gradle documentation.
Daemon will be stopped at the end of the build 
Configuration on demand is an incubating feature.
Gradle Enterprise plugins resolution: https://plugins.gradle.org/m2
Enforcing Gradle Enterprise: https://ge.apache.org, allowUntrustedServer: false
> Task :buildSrc:compileJava NO-SOURCE
> Task :buildSrc:compileGroovy FROM-CACHE
> Task :buildSrc:pluginDescriptors
> Task :buildSrc:processResources
> Task :buildSrc:classes
> Task :buildSrc:jar
> Task :sdks:java:extensions:avro:createCheckerFrameworkManifest
> Task :sdks:java:core:createCheckerFrameworkManifest
> Task :sdks:java:extensions:avro:generateAvroProtocol NO-SOURCE
> Task :runners:core-construction-java:createCheckerFrameworkManifest
> Task :sdks:java:extensions:avro:generateAvroJava NO-SOURCE
> Task :runners:core-construction-java:processResources NO-SOURCE
> Task :model:pipeline:createCheckerFrameworkManifest
> Task :model:job-management:createCheckerFrameworkManifest
> Task :sdks:java:harness:createCheckerFrameworkManifest
> Task :sdks:java:extensions:avro:processResources NO-SOURCE
> Task :sdks:java:fn-execution:createCheckerFrameworkManifest
> Task :runners:java-fn-execution:createCheckerFrameworkManifest
> Task :runners:java-job-service:createCheckerFrameworkManifest
> Task :sdks:java:harness:processResources NO-SOURCE
> Task :sdks:java:transform-service:launcher:createCheckerFrameworkManifest
> Task :sdks:java:fn-execution:processResources NO-SOURCE
> Task :runners:core-java:createCheckerFrameworkManifest
> Task :model:fn-execution:createCheckerFrameworkManifest
> Task 
> :sdks:java:extensions:google-cloud-platform-core:createCheckerFrameworkManifest
> Task :sdks:java:expansion-service:createCheckerFrameworkManifest
> Task :sdks:java:build-tools:createCheckerFrameworkManifest
> Task :runners:java-fn-execution:processResources NO-SOURCE
> Task :runners:java-job-service:processResources NO-SOURCE
> Task :runners:core-java:processResources NO-SOURCE
> Task :sdks:java:extensions:google-cloud-platform-core:processResources 
> NO-SOURCE
> Task :sdks:java:expansion-service:processResources NO-SOURCE
> Task :runners:flink:1.15:copySourceOverrides
> Task :runners:core-java:processTestResources NO-SOURCE
> Task :model:job-management:extractProto
> Task :sdks:java:core:generateGrammarSource FROM-CACHE
> Task :sdks:java:extensions:arrow:createCheckerFrameworkManifest
> Task :sdks:java:extensions:protobuf:createCheckerFrameworkManifest
> Task :sdks:java:extensions:arrow:processResources NO-SOURCE
> Task :sdks:java:io:google-cloud-platform:createCheckerFrameworkManifest
> Task :model:fn-execution:extractProto
> Task :runners:flink:1.15:createCheckerFrameworkManifest
> Task :sdks:java:extensions:protobuf:extractProto
> Task :runners:flink:1.15:copyResourcesOverrides NO-SOURCE
> Task :sdks:java:io:google-cloud-platform:processResources NO-SOURCE
> Task :model:job-management:processResources
> Task :sdks:java:extensions:protobuf:processResources NO-SOURCE
> Task :runners:flink:1.15:processResources
> Task :model:fn-execution:processResources
> Task :runners:flink:1.15:copyTestSourceOverrides
> Task :runners:flink:1.15:copyTestResourcesOverrides NO-SOURCE
> Task :sdks:java:core:processResources
> Task :sdks:java:core:generateTestGrammarSource NO-SOURCE
> Task 

Build failed in Jenkins: beam_PostCommit_Python310 #1816

[Apache Jenkins Server]

See 


Changes:


--
[...truncated 11.73 MB...]
  File "apache_beam/runners/worker/operations.py", line 572, in 
apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 263, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 266, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 953, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/worker/operations.py", line 954, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/common.py", line 1437, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 1526, in 
apache_beam.runners.common.DoFnRunner._reraise_augmented
  File "apache_beam/runners/common.py", line 1435, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 636, in 
apache_beam.runners.common.SimpleInvoker.invoke_process
  File "apache_beam/runners/common.py", line 1621, in 
apache_beam.runners.common._OutputHandler.handle_process_outputs
  File "apache_beam/runners/common.py", line 1736, in 
apache_beam.runners.common._OutputHandler._write_value_to_tag
  File "apache_beam/runners/worker/operations.py", line 263, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 266, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 1351, in 
apache_beam.runners.worker.operations.FlattenOperation.process
  File "apache_beam/runners/worker/operations.py", line 1354, in 
apache_beam.runners.worker.operations.FlattenOperation.process
  File "apache_beam/runners/worker/operations.py", line 572, in 
apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 263, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 266, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 953, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/worker/operations.py", line 954, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/common.py", line 1437, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 1547, in 
apache_beam.runners.common.DoFnRunner._reraise_augmented
  File "apache_beam/runners/common.py", line 1435, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 851, in 
apache_beam.runners.common.PerWindowInvoker.invoke_process
  File "apache_beam/runners/common.py", line 995, in 
apache_beam.runners.common.PerWindowInvoker._invoke_process_per_window
  File "apache_beam/runners/common.py", line 1611, in 
apache_beam.runners.common._OutputHandler.handle_process_outputs
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/io/gcp/bigquery_file_loads.py",
 line 750, in process
job_reference = self.bq_wrapper.perform_load_job(
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/io/gcp/bigquery_tools.py",
 line 1022, in perform_load_job
return self._insert_load_job(
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/utils/retry.py",
 line 298, in wrapper
return fun(*args, **kwargs)
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/io/gcp/bigquery_tools.py",
 line 559, in _insert_load_job
return self._start_job(request, stream=source_stream).jobReference
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/io/gcp/bigquery_tools.py",
 line 578, in _start_job
response = self.client.jobs.Insert(request, upload=upload)
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/io/gcp/internal/clients/bigquery/bigquery_v2_client.py",
 line 356, in Insert
return self._RunMethod(
  File "/usr/local/lib/python3.10/site-packages/apitools/base/py/base_api.py", 
line 731, in _RunMethod
return self.ProcessHttpResponse(method_config, http_response, request)
  File "/usr/local/lib/python3.10/site-packages/apitools/base/py/base_api.py", 
line 737, in ProcessHttpResponse
self.__ProcessHttpResponse(method_config, http_response, request))
  File "/usr/local/lib/python3.10/site-packages/apitools/base/py/base_api.py", 
line 603, in 

Build failed in Jenkins: beam_PostCommit_Python38 #5082

[Apache Jenkins Server]

See 


Changes:


--
[...truncated 4.60 MB...]

> Task :sdks:python:test-suites:dataflow:py38:vertexAIInferenceTest

[gw3] PASSED 
apache_beam/ml/inference/vertex_ai_inference_it_test.py::VertexAIInference::test_vertex_ai_run_llm_text_classification
 
> Task 
> :sdks:python:test-suites:portable:py38:portableLocalRunnerTestWithRequirementsFile
f53cf2316966cb9dc12f56f0ca8bf7144582d2b417cacfb6243479f512a6482d
INFO:apache_beam.runners.portability.local_job_service:Completed job in 
27.652703762054443 seconds with state DONE.
INFO:root:Completed job in 27.652703762054443 seconds with state DONE.
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE

> Task :sdks:python:test-suites:portable:py38:portableWordCountSparkRunnerBatch
INFO:apache_beam.runners.worker.worker_pool_main:Listening for workers at 
localhost:38445
INFO:apache_beam.runners.portability.fn_api_runner.translations:
  
INFO:apache_beam.runners.portability.fn_api_runner.translations:
  
INFO:apache_beam.runners.portability.fn_api_runner.translations:
  
INFO:apache_beam.utils.subprocess_server:Starting service with ('java' '-jar' 
'
 '--spark-master-url' 'local[4]' '--artifacts-dir' 
'/tmp/beam-tempqizr3jno/artifactskzriwzky' '--job-port' '34953' 
'--artifact-port' '0' '--expansion-port' '0')
INFO:apache_beam.utils.subprocess_server:24/01/24 14:45:51 WARN 
software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to 
retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:24/01/24 14:45:52 INFO 
org.apache.beam.runners.jobsubmission.JobServerDriver: ArtifactStagingService 
started on localhost:43551
INFO:apache_beam.utils.subprocess_server:24/01/24 14:45:52 INFO 
org.apache.beam.runners.jobsubmission.JobServerDriver: Java ExpansionService 
started on localhost:32781
INFO:apache_beam.utils.subprocess_server:24/01/24 14:45:52 INFO 
org.apache.beam.runners.jobsubmission.JobServerDriver: JobService started on 
localhost:34953
INFO:apache_beam.utils.subprocess_server:24/01/24 14:45:52 INFO 
org.apache.beam.runners.jobsubmission.JobServerDriver: Job server now running, 
terminate with Ctrl+C
WARNING:root:Waiting for grpc channel to be ready at localhost:34953.
INFO:apache_beam.utils.subprocess_server:24/01/24 14:45:54 INFO 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Staging 
artifacts for job_bc75978b-6080-4211-ab4f-0caafb519640.
INFO:apache_beam.utils.subprocess_server:24/01/24 14:45:54 INFO 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Resolving 
artifacts for 
job_bc75978b-6080-4211-ab4f-0caafb519640.0:ref_Environment_default_environment_1.
INFO:apache_beam.utils.subprocess_server:24/01/24 14:45:54 INFO 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Getting 1 
artifacts for job_bc75978b-6080-4211-ab4f-0caafb519640.null.
INFO:apache_beam.utils.subprocess_server:24/01/24 14:45:54 INFO 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Artifacts 
fully staged for job_bc75978b-6080-4211-ab4f-0caafb519640.
INFO:apache_beam.utils.subprocess_server:24/01/24 14:45:54 INFO 
org.apache.beam.runners.spark.SparkJobInvoker: Invoking job 
BeamApp-jenkins-0124144554-21b55e8b_5820c0c0-3bb6-4945-aace-019771eb02a6
INFO:apache_beam.utils.subprocess_server:24/01/24 14:45:54 INFO 
org.apache.beam.runners.jobsubmission.JobInvocation: Starting job invocation 
BeamApp-jenkins-0124144554-21b55e8b_5820c0c0-3bb6-4945-aace-019771eb02a6
INFO:apache_beam.runners.portability.portable_runner:Environment "LOOPBACK" has 
started a component necessary for the execution. Be sure to run the pipeline 
using
  with Pipeline() as p:
p.apply(..)
This ensures that the pipeline finishes before this program exits.
INFO:apache_beam.runners.portability.portable_runner:Job state changed to 
STOPPED
INFO:apache_beam.runners.portability.portable_runner:Job state changed to 
STARTING
INFO:apache_beam.runners.portability.portable_runner:Job state changed to 
RUNNING
INFO:apache_beam.utils.subprocess_server:24/01/24 14:45:55 INFO 
org.apache.beam.runners.spark.translation.SparkContextFactory: Creating a brand 
new Spark Context.
INFO:apache_beam.utils.subprocess_server:24/01/24 14:45:55 WARN 
org.apache.hadoop.util.NativeCodeLoader: Unable to load native-hadoop library 
for your platform... using builtin-java classes where applicable
INFO:apache_beam.utils.subprocess_server:24/01/24 14:45:56 INFO 
org.sparkproject.jetty.util.log: Logging initialized @8445ms to 
org.sparkproject.jetty.util.log.Slf4jLog
INFO:apache_beam.utils.subprocess_server:24/01/24 

Jenkins build is back to normal : beam_PostCommit_Java_ValidatesRunner_Flink #12787

[Apache Jenkins Server]

See 



-
To unsubscribe, e-mail: builds-unsubscr...@beam.apache.org
For additional commands, e-mail: builds-h...@beam.apache.org

Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #2619

[Apache Jenkins Server]

See 


Changes:


--
[...truncated 1.52 MB...]
"workerPools": [
  {
"autoscalingSettings": {},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 1,
"packages": [
  {
"location": 
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test196/go-2-1706106991486595994/worker",
"name": "worker"
  },
  {
"location": 
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test196/go-2-1706106991486595994/xlang/beam-sdks-java-io-google-cloud-platform-expansion-service-2.54.0-SNAPSHOT-_iJ1XimTrMyxceNH1XE1AZWUTKI7gwY3vVJpTxJlXCs.jar",
"name": 
"beam-sdks-java-io-google-cloud-platform-expansion-service-2.54.0-SNAPSHOT-_iJ1XimTrMyxceNH1XE1AZWUTKI7gwY3vVJpTxJlXCs.jar"
  }
],
"sdkHarnessContainerImages": [
  {
"capabilities": [
  "beam:protocol:progress_reporting:v1",
  "beam:protocol:multi_core_bundle_processing:v1",
  "beam:transform:sdf_truncate_sized_restrictions:v1",
  "beam:protocol:worker_status:v1",
  "beam:protocol:monitoring_info_short_ids:v1",
  "beam:version:sdk_base:go:apache/beam_go_sdk:2.54.0.dev",
  "beam:transform:to_string:v1",
  "beam:protocol:data_sampling:v1",
  "beam:coder:bytes:v1",
  "beam:coder:bool:v1",
  "beam:coder:varint:v1",
  "beam:coder:double:v1",
  "beam:coder:string_utf8:v1",
  "beam:coder:length_prefix:v1",
  "beam:coder:kv:v1",
  "beam:coder:iterable:v1",
  "beam:coder:state_backed_iterable:v1",
  "beam:coder:windowed_value:v1",
  "beam:coder:global_window:v1",
  "beam:coder:interval_window:v1",
  "beam:coder:row:v1",
  "beam:coder:nullable:v1",
  "beam:coder:timer:v1"
],
"containerImage": 
"us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20240124-143115",
"environmentId": "go"
  },
  {
"capabilities": [
  "beam:coder:bytes:v1",
  "beam:coder:bool:v1",
  "beam:coder:varint:v1",
  "beam:coder:string_utf8:v1",
  "beam:coder:iterable:v1",
  "beam:coder:timer:v1",
  "beam:coder:kv:v1",
  "beam:coder:length_prefix:v1",
  "beam:coder:global_window:v1",
  "beam:coder:interval_window:v1",
  "beam:coder:custom_window:v1",
  "beam:coder:windowed_value:v1",
  "beam:coder:double:v1",
  "beam:coder:row:v1",
  "beam:coder:param_windowed_value:v1",
  "beam:coder:state_backed_iterable:v1",
  "beam:coder:sharded_key:v1",
  "beam:coder:nullable:v1",
  "beam:protocol:multi_core_bundle_processing:v1",
  "beam:protocol:progress_reporting:v1",
  "beam:protocol:harness_monitoring_infos:v1",
  "beam:protocol:control_request_elements_embedding:v1",
  "beam:protocol:state_caching:v1",
  "beam:version:sdk_base:apache/beam_java8_sdk:2.54.0.dev",
  "beam:transform:sdf_truncate_sized_restrictions:v1",
  "beam:transform:to_string:v1",
  "beam:protocol:data_sampling:v1"
],
"containerImage": 
"us.gcr.io/apache-beam-testing/java-postcommit-it/java:20240124142042",
"environmentId": "aJyZOojHbvbeam:env:docker:v1"
  }
],
"workerHarnessContainerImage": 
"us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20240124-143115"
  }
]
  },
  "name": "go-testbigtableio_basicwriteread-677",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2024/01/24 14:36:41 Submitted job: 2024-01-24_06_36_40-1031720777385846616
2024/01/24 14:36:41 Console: 
https://console.cloud.google.com/dataflow/jobs/us-central1/2024-01-24_06_36_40-1031720777385846616?project=apache-beam-testing
2024/01/24 14:36:41 Logs: 
https://console.cloud.google.com/logs/viewer?project=apache-beam-testing=dataflow_step%2Fjob_id%2F2024-01-24_06_36_40-1031720777385846616
2024/01/24 14:36:41 Job state: JOB_STATE_PENDING ...
2024/01/24 14:37:11 Job still running ...
2024/01/24 14:37:41 Job still running ...
2024/01/24 14:38:11 Job still running ...
2024/01/24 14:38:41 Job still running ...
2024/01/24 14:39:11 Job still running ...
2024/01/24 14:39:41 Job still running ...
2024/01/24 14:40:11 Job still running ...
2024/01/24 14:40:41 Job still running ...
2024/01/24 14:41:11 Job still running ...
2024/01/24 14:41:41 Job 2024-01-24_06_36_40-1031720777385846616 succeeded!
--- PASS: 

Build failed in Jenkins: beam_PostCommit_Python39 #2803

[Apache Jenkins Server]

See 


Changes:

[noreply] Merge pull request #30059 [YAML] Require numStreams for unbounded


--
[...truncated 11.83 MB...]
input_op_by_transform_id[element.transform_id].process_encoded(
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/runners/worker/bundle_processor.py",
 line 237, in process_encoded
self.output(decoded_value)
  File "apache_beam/runners/worker/operations.py", line 570, in 
apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 572, in 
apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 263, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 266, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 953, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/worker/operations.py", line 954, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/common.py", line 1437, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 1526, in 
apache_beam.runners.common.DoFnRunner._reraise_augmented
  File "apache_beam/runners/common.py", line 1435, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 636, in 
apache_beam.runners.common.SimpleInvoker.invoke_process
  File "apache_beam/runners/common.py", line 1621, in 
apache_beam.runners.common._OutputHandler.handle_process_outputs
  File "apache_beam/runners/common.py", line 1736, in 
apache_beam.runners.common._OutputHandler._write_value_to_tag
  File "apache_beam/runners/worker/operations.py", line 263, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 266, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 1351, in 
apache_beam.runners.worker.operations.FlattenOperation.process
  File "apache_beam/runners/worker/operations.py", line 1354, in 
apache_beam.runners.worker.operations.FlattenOperation.process
  File "apache_beam/runners/worker/operations.py", line 572, in 
apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 263, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 266, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 953, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/worker/operations.py", line 954, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/common.py", line 1437, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 1547, in 
apache_beam.runners.common.DoFnRunner._reraise_augmented
  File "apache_beam/runners/common.py", line 1435, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 851, in 
apache_beam.runners.common.PerWindowInvoker.invoke_process
  File "apache_beam/runners/common.py", line 995, in 
apache_beam.runners.common.PerWindowInvoker._invoke_process_per_window
  File "apache_beam/runners/common.py", line 1611, in 
apache_beam.runners.common._OutputHandler.handle_process_outputs
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/io/gcp/bigquery_file_loads.py",
 line 750, in process
job_reference = self.bq_wrapper.perform_load_job(
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/io/gcp/bigquery_tools.py",
 line 1022, in perform_load_job
return self._insert_load_job(
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/utils/retry.py",
 line 298, in wrapper
return fun(*args, **kwargs)
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/io/gcp/bigquery_tools.py",
 line 559, in _insert_load_job
return self._start_job(request, stream=source_stream).jobReference
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/io/gcp/bigquery_tools.py",
 line 578, in _start_job
response = self.client.jobs.Insert(request, upload=upload)
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/io/gcp/internal/clients/bigquery/bigquery_v2_client.py",
 line 356, in Insert
return self._RunMethod(
  

Build failed in Jenkins: beam_PostCommit_Java_DataflowV2 #4025

[Apache Jenkins Server]

See 


Changes:

[noreply] Merge pull request #30059 [YAML] Require numStreams for unbounded


--
[...truncated 49.07 KB...]
> Task :sdks:java:container:pullLicenses
Collecting setuptools
  Using cached setuptools-69.0.3-py3-none-any.whl (819 kB)
Collecting wheel
  Using cached wheel-0.42.0-py3-none-any.whl (65 kB)
Installing collected packages: pip, setuptools, wheel
  Attempting uninstall: pip
Found existing installation: pip 20.0.2
Uninstalling pip-20.0.2:
  Successfully uninstalled pip-20.0.2
  Attempting uninstall: setuptools
Found existing installation: setuptools 44.0.0
Uninstalling setuptools-44.0.0:
  Successfully uninstalled setuptools-44.0.0
Successfully installed pip-23.3.2 setuptools-69.0.3 wheel-0.42.0
Collecting beautifulsoup4<5.0,>=4.9.0 (from -r 

 (line 19))
  Using cached beautifulsoup4-4.12.3-py3-none-any.whl.metadata (3.8 kB)
Collecting pyyaml<7,>=6.0.1 (from -r 

 (line 20))
  Using cached 
PyYAML-6.0.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata 
(2.1 kB)
Collecting tenacity<9.0,>=6.1.0 (from -r 

 (line 21))
  Using cached tenacity-8.2.3-py3-none-any.whl.metadata (1.0 kB)
Collecting soupsieve>1.2 (from beautifulsoup4<5.0,>=4.9.0->-r 

 (line 19))
  Using cached soupsieve-2.5-py3-none-any.whl.metadata (4.7 kB)
Using cached beautifulsoup4-4.12.3-py3-none-any.whl (147 kB)
Using cached 
PyYAML-6.0.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (736 kB)
Using cached tenacity-8.2.3-py3-none-any.whl (24 kB)
Using cached soupsieve-2.5-py3-none-any.whl (36 kB)
Installing collected packages: tenacity, soupsieve, pyyaml, beautifulsoup4
Successfully installed beautifulsoup4-4.12.3 pyyaml-6.0.1 soupsieve-2.5 
tenacity-8.2.3
Executing python 

 
--license_index=

--output_dir=

--dep_url_yaml=

--manual_license_path=
INFO:root:Pulling license for 129 dependencies using 16 threads.
INFO:root:Replaced local file URL with 
file://
 for xz-1.5
INFO:root:pull_licenses_java.py succeed. It took 1.633419 seconds with 16 
threads.
Copying licenses from 

 to 

Finished license_scripts.sh

> Task :sdks:java:testing:test-utils:compileJava
> Task :sdks:java:testing:test-utils:classes

> Task :release:go-licenses:java:dockerRun
go: downloading github.com/golang/protobuf v1.5.3
go: downloading google.golang.org/grpc v1.59.0
go: downloading golang.org/x/sys v0.15.0
go: downloading google.golang.org/protobuf v1.31.0
go: downloading google.golang.org/genproto/googleapis/rpc 
v0.0.0-20231120223509-83a465c0220f
go: downloading golang.org/x/net v0.19.0
go: downloading google.golang.org/genproto v0.0.0-20231106174013-bbf56f31fb17
go: downloading golang.org/x/text v0.14.0
go: added github.com/apache/beam/sdks/v2 v2.53.0
go: added github.com/golang/protobuf v1.5.3
go: added golang.org/x/net v0.19.0
go: added golang.org/x/sys v0.15.0
go: added golang.org/x/text v0.14.0
go: added google.golang.org/genproto/googleapis/rpc 
v0.0.0-20231120223509-83a465c0220f
go: added google.golang.org/grpc v1.59.0
go: added google.golang.org/protobuf v1.31.0
+ go-licenses save github.com/apache/beam/sdks/v2/java/container 
--save_path=/output/licenses
W0124 09:57:57.854392  36 library.go:101] "golang.org/x/sys/unix" contains 
non-Go code that can't be inspected for further dependencies:

beam_PostCommit_XVR_Direct - Build # 5092 - Aborted!

[Apache Jenkins Server]

beam_PostCommit_XVR_Direct - Build # 5092 - Aborted:

Check console output at 
https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/5092/ to view the 
results.

-
To unsubscribe, e-mail: builds-unsubscr...@beam.apache.org
For additional commands, e-mail: builds-h...@beam.apache.org

Build failed in Jenkins: beam_PostCommit_Python311 #1153

[Apache Jenkins Server]

See 


Changes:

[noreply] Merge pull request #30059 [YAML] Require numStreams for unbounded


--
[...truncated 4.94 MB...]
  nanos: 612756252
}
message: "SDK Harness waiting for in-flight requests to complete"
log_location: 
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:289"
thread: "MainThread"

INFO:root:severity: INFO
timestamp {
  seconds: 1706094918
  nanos: 612830400
}
message: "Closing all cached grpc data channels."
log_location: 
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/data_plane.py:820"
thread: "MainThread"

INFO:root:severity: INFO
timestamp {
  seconds: 1706094918
  nanos: 612891674
}
message: "Closing all cached gRPC state handlers."
log_location: 
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:929"
thread: "MainThread"

INFO:root:severity: INFO
timestamp {
  seconds: 1706094918
  nanos: 614019632
}
message: "Done consuming work."
log_location: 
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:301"
thread: "MainThread"

INFO:root:severity: INFO
timestamp {
  seconds: 1706094918
  nanos: 614110469
}
message: "Python sdk harness exiting."
log_location: 
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker_main.py:213"
thread: "MainThread"

INFO:apache_beam.runners.portability.local_job_service:Completed job in 
22.39385175704956 seconds with state DONE.
INFO:root:Completed job in 22.39385175704956 seconds with state DONE.
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE

> Task :sdks:python:test-suites:portable:py311:portableWordCountSparkRunnerBatch
INFO:apache_beam.runners.worker.worker_pool_main:Listening for workers at 
localhost:36005
INFO:apache_beam.runners.portability.fn_api_runner.translations:
  
INFO:apache_beam.runners.portability.fn_api_runner.translations:
  
INFO:apache_beam.runners.portability.fn_api_runner.translations:
  
INFO:apache_beam.utils.subprocess_server:Starting service with ('java' '-jar' 
'
 '--spark-master-url' 'local[4]' '--artifacts-dir' 
'/tmp/beam-templuedgrxg/artifactscazwj6r5' '--job-port' '45005' 
'--artifact-port' '0' '--expansion-port' '0')
INFO:apache_beam.utils.subprocess_server:24/01/24 11:15:26 WARN 
software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to 
retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:24/01/24 11:15:26 INFO 
org.apache.beam.runners.jobsubmission.JobServerDriver: ArtifactStagingService 
started on localhost:36455
INFO:apache_beam.utils.subprocess_server:24/01/24 11:15:26 INFO 
org.apache.beam.runners.jobsubmission.JobServerDriver: Java ExpansionService 
started on localhost:38515
INFO:apache_beam.utils.subprocess_server:24/01/24 11:15:26 INFO 
org.apache.beam.runners.jobsubmission.JobServerDriver: JobService started on 
localhost:45005
INFO:apache_beam.utils.subprocess_server:24/01/24 11:15:26 INFO 
org.apache.beam.runners.jobsubmission.JobServerDriver: Job server now running, 
terminate with Ctrl+C
WARNING:root:Waiting for grpc channel to be ready at localhost:45005.
INFO:apache_beam.utils.subprocess_server:24/01/24 11:15:28 INFO 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Staging 
artifacts for job_01e2071e-1712-4c86-b871-e110f7aef55c.
INFO:apache_beam.utils.subprocess_server:24/01/24 11:15:28 INFO 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Resolving 
artifacts for 
job_01e2071e-1712-4c86-b871-e110f7aef55c.0:ref_Environment_default_environment_1.
INFO:apache_beam.utils.subprocess_server:24/01/24 11:15:28 INFO 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Getting 1 
artifacts for job_01e2071e-1712-4c86-b871-e110f7aef55c.null.
INFO:apache_beam.utils.subprocess_server:24/01/24 11:15:29 INFO 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Artifacts 
fully staged for job_01e2071e-1712-4c86-b871-e110f7aef55c.
INFO:apache_beam.utils.subprocess_server:24/01/24 11:15:29 INFO 
org.apache.beam.runners.spark.SparkJobInvoker: Invoking job 
BeamApp-jenkins-0124111529-731c2e8a_20fd3ca0-ddd8-499d-ac2e-e82162f918d0
INFO:apache_beam.utils.subprocess_server:24/01/24 11:15:29 INFO 
org.apache.beam.runners.jobsubmission.JobInvocation: Starting job invocation 
BeamApp-jenkins-0124111529-731c2e8a_20fd3ca0-ddd8-499d-ac2e-e82162f918d0
INFO:apache_beam.runners.portability.portable_runner:Environment "LOOPBACK" has 
started a component necessary for the execution. Be sure to run the pipeline 
using
  with Pipeline() as p:

Build failed in Jenkins: beam_PostCommit_Python310 #1815

[Apache Jenkins Server]

See 


Changes:

[noreply] Merge pull request #30059 [YAML] Require numStreams for unbounded


--
[...truncated 12.08 MB...]
  File "apache_beam/runners/worker/operations.py", line 572, in 
apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 263, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 266, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 953, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/worker/operations.py", line 954, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/common.py", line 1437, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 1526, in 
apache_beam.runners.common.DoFnRunner._reraise_augmented
  File "apache_beam/runners/common.py", line 1435, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 636, in 
apache_beam.runners.common.SimpleInvoker.invoke_process
  File "apache_beam/runners/common.py", line 1621, in 
apache_beam.runners.common._OutputHandler.handle_process_outputs
  File "apache_beam/runners/common.py", line 1736, in 
apache_beam.runners.common._OutputHandler._write_value_to_tag
  File "apache_beam/runners/worker/operations.py", line 263, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 266, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 1351, in 
apache_beam.runners.worker.operations.FlattenOperation.process
  File "apache_beam/runners/worker/operations.py", line 1354, in 
apache_beam.runners.worker.operations.FlattenOperation.process
  File "apache_beam/runners/worker/operations.py", line 572, in 
apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 263, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 266, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 953, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/worker/operations.py", line 954, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/common.py", line 1437, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 1547, in 
apache_beam.runners.common.DoFnRunner._reraise_augmented
  File "apache_beam/runners/common.py", line 1435, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 851, in 
apache_beam.runners.common.PerWindowInvoker.invoke_process
  File "apache_beam/runners/common.py", line 995, in 
apache_beam.runners.common.PerWindowInvoker._invoke_process_per_window
  File "apache_beam/runners/common.py", line 1611, in 
apache_beam.runners.common._OutputHandler.handle_process_outputs
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/io/gcp/bigquery_file_loads.py",
 line 750, in process
job_reference = self.bq_wrapper.perform_load_job(
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/io/gcp/bigquery_tools.py",
 line 1022, in perform_load_job
return self._insert_load_job(
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/utils/retry.py",
 line 298, in wrapper
return fun(*args, **kwargs)
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/io/gcp/bigquery_tools.py",
 line 559, in _insert_load_job
return self._start_job(request, stream=source_stream).jobReference
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/io/gcp/bigquery_tools.py",
 line 578, in _start_job
response = self.client.jobs.Insert(request, upload=upload)
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/io/gcp/internal/clients/bigquery/bigquery_v2_client.py",
 line 356, in Insert
return self._RunMethod(
  File "/usr/local/lib/python3.10/site-packages/apitools/base/py/base_api.py", 
line 731, in _RunMethod
return self.ProcessHttpResponse(method_config, http_response, request)
  File "/usr/local/lib/python3.10/site-packages/apitools/base/py/base_api.py", 
line 737, in ProcessHttpResponse
self.__ProcessHttpResponse(method_config, http_response, request))
  File 

Build failed in Jenkins: beam_PostCommit_Python38 #5081

[Apache Jenkins Server]

See 


Changes:

[noreply] Merge pull request #30059 [YAML] Require numStreams for unbounded


--
[...truncated 4.67 MB...]
  nanos: 321168184
}
message: "Python sdk harness exiting."
log_location: 
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker_main.py:213"
thread: "MainThread"

INFO:apache_beam.runners.portability.local_job_service:Completed job in 
26.56325078010559 seconds with state DONE.
INFO:root:Completed job in 26.56325078010559 seconds with state DONE.
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE

> Task :sdks:python:test-suites:portable:py38:portableWordCountSparkRunnerBatch
INFO:apache_beam.runners.worker.worker_pool_main:Listening for workers at 
localhost:39973
INFO:apache_beam.runners.portability.fn_api_runner.translations:
  
INFO:apache_beam.runners.portability.fn_api_runner.translations:
  
INFO:apache_beam.runners.portability.fn_api_runner.translations:
  
INFO:apache_beam.utils.subprocess_server:Starting service with ('java' '-jar' 
'
 '--spark-master-url' 'local[4]' '--artifacts-dir' 
'/tmp/beam-temp87g1wpyv/artifactssv367ed9' '--job-port' '47111' 
'--artifact-port' '0' '--expansion-port' '0')
INFO:apache_beam.utils.subprocess_server:24/01/24 08:49:06 WARN 
software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to 
retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:24/01/24 08:49:06 INFO 
org.apache.beam.runners.jobsubmission.JobServerDriver: ArtifactStagingService 
started on localhost:39533
INFO:apache_beam.utils.subprocess_server:24/01/24 08:49:07 INFO 
org.apache.beam.runners.jobsubmission.JobServerDriver: Java ExpansionService 
started on localhost:36473
INFO:apache_beam.utils.subprocess_server:24/01/24 08:49:07 INFO 
org.apache.beam.runners.jobsubmission.JobServerDriver: JobService started on 
localhost:47111
INFO:apache_beam.utils.subprocess_server:24/01/24 08:49:07 INFO 
org.apache.beam.runners.jobsubmission.JobServerDriver: Job server now running, 
terminate with Ctrl+C
WARNING:root:Waiting for grpc channel to be ready at localhost:47111.
INFO:apache_beam.utils.subprocess_server:24/01/24 08:49:08 INFO 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Staging 
artifacts for job_4d533d36-f842-4a7d-af57-9fb5ccfe2311.
INFO:apache_beam.utils.subprocess_server:24/01/24 08:49:08 INFO 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Resolving 
artifacts for 
job_4d533d36-f842-4a7d-af57-9fb5ccfe2311.0:ref_Environment_default_environment_1.
INFO:apache_beam.utils.subprocess_server:24/01/24 08:49:08 INFO 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Getting 1 
artifacts for job_4d533d36-f842-4a7d-af57-9fb5ccfe2311.null.
INFO:apache_beam.utils.subprocess_server:24/01/24 08:49:08 INFO 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Artifacts 
fully staged for job_4d533d36-f842-4a7d-af57-9fb5ccfe2311.
INFO:apache_beam.utils.subprocess_server:24/01/24 08:49:08 INFO 
org.apache.beam.runners.spark.SparkJobInvoker: Invoking job 
BeamApp-jenkins-0124084908-2d0c01d1_fd73e34c-ee73-4f0c-b54f-f04cfab0ebc2
INFO:apache_beam.utils.subprocess_server:24/01/24 08:49:09 INFO 
org.apache.beam.runners.jobsubmission.JobInvocation: Starting job invocation 
BeamApp-jenkins-0124084908-2d0c01d1_fd73e34c-ee73-4f0c-b54f-f04cfab0ebc2
INFO:apache_beam.runners.portability.portable_runner:Environment "LOOPBACK" has 
started a component necessary for the execution. Be sure to run the pipeline 
using
  with Pipeline() as p:
p.apply(..)
This ensures that the pipeline finishes before this program exits.
INFO:apache_beam.runners.portability.portable_runner:Job state changed to 
STOPPED
INFO:apache_beam.runners.portability.portable_runner:Job state changed to 
STARTING
INFO:apache_beam.runners.portability.portable_runner:Job state changed to 
RUNNING
INFO:apache_beam.utils.subprocess_server:24/01/24 08:49:09 INFO 
org.apache.beam.runners.spark.translation.SparkContextFactory: Creating a brand 
new Spark Context.
INFO:apache_beam.utils.subprocess_server:24/01/24 08:49:10 WARN 
org.apache.hadoop.util.NativeCodeLoader: Unable to load native-hadoop library 
for your platform... using builtin-java classes where applicable
INFO:apache_beam.utils.subprocess_server:24/01/24 08:49:11 INFO 
org.sparkproject.jetty.util.log: Logging initialized @9096ms to 
org.sparkproject.jetty.util.log.Slf4jLog
INFO:apache_beam.utils.subprocess_server:24/01/24 08:49:12 INFO 
org.sparkproject.jetty.server.Server: jetty-9.4.44.v20210927; built: 

Build failed in Jenkins: beam_PostCommit_Java_ValidatesRunner_Flink #12786

[Apache Jenkins Server]

See 


Changes:

[noreply] Merge pull request #30059 [YAML] Require numStreams for unbounded


--
Started by timer
Running as SYSTEM
[EnvInject] - Loading node environment variables.
Building remotely on apache-beam-jenkins-14 (beam) in workspace 

The recommended git tool is: NONE
No credentials specified
Wiping out workspace first.
Cloning the remote Git repository
Using shallow clone with depth 1
Avoid fetching tags
Cloning repository https://github.com/apache/beam.git
 > git init 
 > 
 >  # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
 > git --version # timeout=10
 > git --version # 'git version 2.25.1'
 > git fetch --no-tags --force --progress --depth=1 -- 
 > https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* # 
 > timeout=10
 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # 
 > timeout=10
 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Using shallow fetch with depth 1
Fetching upstream changes from https://github.com/apache/beam.git
 > git fetch --no-tags --force --progress --depth=1 -- 
 > https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* 
 > +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* # 
 > timeout=10
 > git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 11646ca7da22374baa5a7936069f7ca578f5d28e (origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 11646ca7da22374baa5a7936069f7ca578f5d28e # timeout=10
Commit message: "Merge pull request #30059 [YAML] Require numStreams for 
unbounded BigQueryStorageWrite"
 > git rev-list --no-walk 7ff25d896250508570b27683bc76523ac2fe3210 # timeout=10
No emails were triggered.
[EnvInject] - Executing scripts and injecting environment variables after the 
SCM step.
[EnvInject] - Injecting as environment variables the properties content 
SETUPTOOLS_USE_DISTUTILS=stdlib
SPARK_LOCAL_IP=127.0.0.1

[EnvInject] - Variables injected successfully.
[Gradle] - Launching build.
[src] $ 

 --continue --max-workers=8 -Dorg.gradle.jvmargs=-Xms2g 
-Dorg.gradle.jvmargs=-Xmx6g -Dorg.gradle.vfs.watch=false -Pdocker-pull-licenses 
:runners:flink:1.15:validatesRunner
To honour the JVM settings for this build a single-use Daemon process will be 
forked. For more on this, please refer to 
https://docs.gradle.org/8.4/userguide/gradle_daemon.html#sec:disabling_the_daemon
 in the Gradle documentation.
Daemon will be stopped at the end of the build 
Configuration on demand is an incubating feature.
Gradle Enterprise plugins resolution: https://plugins.gradle.org/m2
Enforcing Gradle Enterprise: https://ge.apache.org, allowUntrustedServer: false
> Task :buildSrc:compileJava NO-SOURCE
> Task :buildSrc:compileGroovy FROM-CACHE
> Task :buildSrc:pluginDescriptors
> Task :buildSrc:processResources
> Task :buildSrc:classes
> Task :buildSrc:jar
> Task :model:fn-execution:createCheckerFrameworkManifest
> Task :model:job-management:createCheckerFrameworkManifest
> Task :sdks:java:fn-execution:createCheckerFrameworkManifest
> Task :sdks:java:transform-service:launcher:createCheckerFrameworkManifest
> Task :sdks:java:fn-execution:processResources NO-SOURCE
> Task :model:fn-execution:extractProto
> Task :model:job-management:extractProto
> Task :model:pipeline:createCheckerFrameworkManifest
> Task :runners:core-java:createCheckerFrameworkManifest
> Task :sdks:java:extensions:avro:createCheckerFrameworkManifest
> Task :sdks:java:core:createCheckerFrameworkManifest
> Task :runners:core-construction-java:createCheckerFrameworkManifest
> Task :sdks:java:extensions:avro:generateAvroProtocol NO-SOURCE
> Task :runners:core-java:processResources NO-SOURCE
> Task :runners:core-construction-java:processResources NO-SOURCE
> Task :sdks:java:extensions:avro:generateAvroJava NO-SOURCE
> Task :sdks:java:harness:createCheckerFrameworkManifest
> Task :sdks:java:extensions:avro:processResources NO-SOURCE
> Task :model:job-management:processResources
> Task :sdks:java:harness:processResources NO-SOURCE
> Task :model:fn-execution:processResources
> Task :runners:java-fn-execution:createCheckerFrameworkManifest
> Task :runners:java-fn-execution:processResources NO-SOURCE
> Task :runners:java-job-service:createCheckerFrameworkManifest
> Task :sdks:java:expansion-service:createCheckerFrameworkManifest
> Task :runners:java-job-service:processResources NO-SOURCE
> Task :sdks:java:core:generateGrammarSource FROM-CACHE
> Task 

Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #2618

[Apache Jenkins Server]

See 


Changes:

[noreply] Merge pull request #30059 [YAML] Require numStreams for unbounded


--
[...truncated 817.80 KB...]
  {
"autoscalingSettings": {},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 1,
"packages": [
  {
"location": 
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test6871/go-2-1706085432531365400/worker",
"name": "worker"
  },
  {
"location": 
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test6871/go-2-1706085432531365400/xlang/beam-sdks-java-io-google-cloud-platform-expansion-service-2.54.0-SNAPSHOT-_iJ1XimTrMyxceNH1XE1AZWUTKI7gwY3vVJpTxJlXCs.jar",
"name": 
"beam-sdks-java-io-google-cloud-platform-expansion-service-2.54.0-SNAPSHOT-_iJ1XimTrMyxceNH1XE1AZWUTKI7gwY3vVJpTxJlXCs.jar"
  }
],
"sdkHarnessContainerImages": [
  {
"capabilities": [
  "beam:protocol:progress_reporting:v1",
  "beam:protocol:multi_core_bundle_processing:v1",
  "beam:transform:sdf_truncate_sized_restrictions:v1",
  "beam:protocol:worker_status:v1",
  "beam:protocol:monitoring_info_short_ids:v1",
  "beam:version:sdk_base:go:apache/beam_go_sdk:2.54.0.dev",
  "beam:transform:to_string:v1",
  "beam:protocol:data_sampling:v1",
  "beam:coder:bytes:v1",
  "beam:coder:bool:v1",
  "beam:coder:varint:v1",
  "beam:coder:double:v1",
  "beam:coder:string_utf8:v1",
  "beam:coder:length_prefix:v1",
  "beam:coder:kv:v1",
  "beam:coder:iterable:v1",
  "beam:coder:state_backed_iterable:v1",
  "beam:coder:windowed_value:v1",
  "beam:coder:global_window:v1",
  "beam:coder:interval_window:v1",
  "beam:coder:row:v1",
  "beam:coder:nullable:v1",
  "beam:coder:timer:v1"
],
"containerImage": 
"us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20240124-083159",
"environmentId": "go"
  },
  {
"capabilities": [
  "beam:coder:bytes:v1",
  "beam:coder:bool:v1",
  "beam:coder:varint:v1",
  "beam:coder:string_utf8:v1",
  "beam:coder:iterable:v1",
  "beam:coder:timer:v1",
  "beam:coder:kv:v1",
  "beam:coder:length_prefix:v1",
  "beam:coder:global_window:v1",
  "beam:coder:interval_window:v1",
  "beam:coder:custom_window:v1",
  "beam:coder:windowed_value:v1",
  "beam:coder:double:v1",
  "beam:coder:row:v1",
  "beam:coder:param_windowed_value:v1",
  "beam:coder:state_backed_iterable:v1",
  "beam:coder:sharded_key:v1",
  "beam:coder:nullable:v1",
  "beam:protocol:multi_core_bundle_processing:v1",
  "beam:protocol:progress_reporting:v1",
  "beam:protocol:harness_monitoring_infos:v1",
  "beam:protocol:control_request_elements_embedding:v1",
  "beam:protocol:state_caching:v1",
  "beam:version:sdk_base:apache/beam_java8_sdk:2.54.0.dev",
  "beam:transform:sdf_truncate_sized_restrictions:v1",
  "beam:transform:to_string:v1",
  "beam:protocol:data_sampling:v1"
],
"containerImage": 
"us.gcr.io/apache-beam-testing/java-postcommit-it/java:20240124082041",
"environmentId": "cwUIwLjwOObeam:env:docker:v1"
  }
],
"workerHarnessContainerImage": 
"us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20240124-083159"
  }
]
  },
  "name": "go-testbigtableio_basicwriteread-694",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2024/01/24 08:37:22 Submitted job: 2024-01-24_00_37_22-9141051769298538911
2024/01/24 08:37:22 Console: 
https://console.cloud.google.com/dataflow/jobs/us-central1/2024-01-24_00_37_22-9141051769298538911?project=apache-beam-testing
2024/01/24 08:37:22 Logs: 
https://console.cloud.google.com/logs/viewer?project=apache-beam-testing=dataflow_step%2Fjob_id%2F2024-01-24_00_37_22-9141051769298538911
2024/01/24 08:37:22 Job state: JOB_STATE_PENDING ...
2024/01/24 08:37:52 Job still running ...
2024/01/24 08:38:22 Job still running ...
2024/01/24 08:38:52 Job still running ...
2024/01/24 08:39:22 Job still running ...
2024/01/24 08:39:52 Job still running ...
2024/01/24 08:40:22 Job still running ...
2024/01/24 08:40:53 Job still running ...
2024/01/24 08:41:23 Job still running ...
2024/01/24 08:41:53 Job still running ...
2024/01/24 08:42:23 

Build failed in Jenkins: beam_PostCommit_Python39 #2802

[Apache Jenkins Server]

See 


Changes:


--
[...truncated 12.43 MB...]
"code": 400,
"message": "Load configuration must specify at least one source URI",
"errors": [
  {
"message": "Load configuration must specify at least one source URI",
"domain": "global",
"reason": "invalid"
  }
],
"status": "INVALID_ARGUMENT"
  }
}
>

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/runners/worker/sdk_worker.py",
 line 311, in _execute
response = task()
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/runners/worker/sdk_worker.py",
 line 386, in 
lambda: self.create_worker().do_instruction(request), request)
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/runners/worker/sdk_worker.py",
 line 650, in do_instruction
return getattr(self, request_type)(
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/runners/worker/sdk_worker.py",
 line 688, in process_bundle
bundle_processor.process_bundle(instruction_id))
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/runners/worker/bundle_processor.py",
 line 1113, in process_bundle
input_op_by_transform_id[element.transform_id].process_encoded(
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/runners/worker/bundle_processor.py",
 line 237, in process_encoded
self.output(decoded_value)
  File "apache_beam/runners/worker/operations.py", line 570, in 
apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 572, in 
apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 263, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 266, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 953, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/worker/operations.py", line 954, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/common.py", line 1437, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 1526, in 
apache_beam.runners.common.DoFnRunner._reraise_augmented
  File "apache_beam/runners/common.py", line 1435, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 636, in 
apache_beam.runners.common.SimpleInvoker.invoke_process
  File "apache_beam/runners/common.py", line 1621, in 
apache_beam.runners.common._OutputHandler.handle_process_outputs
  File "apache_beam/runners/common.py", line 1736, in 
apache_beam.runners.common._OutputHandler._write_value_to_tag
  File "apache_beam/runners/worker/operations.py", line 263, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 266, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 1351, in 
apache_beam.runners.worker.operations.FlattenOperation.process
  File "apache_beam/runners/worker/operations.py", line 1354, in 
apache_beam.runners.worker.operations.FlattenOperation.process
  File "apache_beam/runners/worker/operations.py", line 572, in 
apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 263, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 266, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 953, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/worker/operations.py", line 954, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/common.py", line 1437, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 1547, in 
apache_beam.runners.common.DoFnRunner._reraise_augmented
  File "apache_beam/runners/common.py", line 1435, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 851, in 
apache_beam.runners.common.PerWindowInvoker.invoke_process
  File "apache_beam/runners/common.py", line 995, in 
apache_beam.runners.common.PerWindowInvoker._invoke_process_per_window
  File "apache_beam/runners/common.py", line 1611, in 

Jenkins build is back to normal : beam_PostCommit_Java_InfluxDbIO_IT #1529

[Apache Jenkins Server]

See 



-
To unsubscribe, e-mail: builds-unsubscr...@beam.apache.org
For additional commands, e-mail: builds-h...@beam.apache.org

Build failed in Jenkins: beam_PostCommit_Java_DataflowV2 #4024

[Apache Jenkins Server]

See 


Changes:


--
[...truncated 49.58 KB...]
  Attempting uninstall: setuptools
Found existing installation: setuptools 44.0.0
Uninstalling setuptools-44.0.0:
  Successfully uninstalled setuptools-44.0.0
Successfully installed pip-23.3.2 setuptools-69.0.3 wheel-0.42.0
Collecting beautifulsoup4<5.0,>=4.9.0 (from -r 

 (line 19))
  Using cached beautifulsoup4-4.12.3-py3-none-any.whl.metadata (3.8 kB)
Collecting pyyaml<7,>=6.0.1 (from -r 

 (line 20))
  Using cached 
PyYAML-6.0.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata 
(2.1 kB)
Collecting tenacity<9.0,>=6.1.0 (from -r 

 (line 21))
  Using cached tenacity-8.2.3-py3-none-any.whl.metadata (1.0 kB)
Collecting soupsieve>1.2 (from beautifulsoup4<5.0,>=4.9.0->-r 

 (line 19))
  Using cached soupsieve-2.5-py3-none-any.whl.metadata (4.7 kB)
Using cached beautifulsoup4-4.12.3-py3-none-any.whl (147 kB)
Using cached 
PyYAML-6.0.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (736 kB)
Using cached tenacity-8.2.3-py3-none-any.whl (24 kB)
Using cached soupsieve-2.5-py3-none-any.whl (36 kB)
Installing collected packages: tenacity, soupsieve, pyyaml, beautifulsoup4
Successfully installed beautifulsoup4-4.12.3 pyyaml-6.0.1 soupsieve-2.5 
tenacity-8.2.3
Executing python 

 
--license_index=

--output_dir=

--dep_url_yaml=

--manual_license_path=
INFO:root:Pulling license for 129 dependencies using 16 threads.
INFO:root:Replaced local file URL with 
file://
 for xz-1.5
INFO:root:pull_licenses_java.py succeed. It took 1.651004 seconds with 16 
threads.
Copying licenses from 

 to 

Finished license_scripts.sh

> Task :sdks:java:testing:test-utils:compileJava
> Task :sdks:java:testing:test-utils:classes
> Task :sdks:java:testing:test-utils:jar

> Task :release:go-licenses:java:dockerRun
go: downloading github.com/golang/protobuf v1.5.3
go: downloading google.golang.org/grpc v1.59.0
go: downloading google.golang.org/protobuf v1.31.0
go: downloading golang.org/x/sys v0.15.0
go: downloading google.golang.org/genproto/googleapis/rpc 
v0.0.0-20231120223509-83a465c0220f
go: downloading golang.org/x/net v0.19.0
go: downloading google.golang.org/genproto v0.0.0-20231106174013-bbf56f31fb17
go: downloading golang.org/x/text v0.14.0
go: added github.com/apache/beam/sdks/v2 v2.53.0
go: added github.com/golang/protobuf v1.5.3
go: added golang.org/x/net v0.19.0
go: added golang.org/x/sys v0.15.0
go: added golang.org/x/text v0.14.0
go: added google.golang.org/genproto/googleapis/rpc 
v0.0.0-20231120223509-83a465c0220f
go: added google.golang.org/grpc v1.59.0
go: added google.golang.org/protobuf v1.31.0
+ go-licenses save github.com/apache/beam/sdks/v2/java/container 
--save_path=/output/licenses
W0124 03:58:00.047955  32 library.go:101] "golang.org/x/sys/unix" contains 
non-Go code that can't be inspected for further dependencies:
/go/pkg/mod/golang.org/x/sys@v0.15.0/unix/asm_linux_amd64.s

> Task :sdks:java:testing:test-utils:compileTestJava FROM-CACHE
> Task :sdks:java:testing:test-utils:testClasses UP-TO-DATE
> Task :sdks:java:testing:test-utils:testJar
> Task :sdks:java:container:java8:copyJavaThirdPartyLicenses

> Task :sdks:java:container:downloadCloudProfilerAgent
  % Total% Received % Xferd  Average Speed   TimeTime Time  Current
 Dload  Upload 

Jenkins build is back to normal : beam_PostRelease_NightlySnapshot #2367

[Apache Jenkins Server]

See 



-
To unsubscribe, e-mail: builds-unsubscr...@beam.apache.org
For additional commands, e-mail: builds-h...@beam.apache.org

Build failed in Jenkins: beam_PostCommit_Python311 #1152

[Apache Jenkins Server]

See 


Changes:


--
[...truncated 8.39 MB...]
log_location: 
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:289"
thread: "MainThread"

INFO:root:severity: INFO
timestamp {
  seconds: 1706073391
  nanos: 866988182
}
message: "Closing all cached grpc data channels."
log_location: 
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/data_plane.py:820"
thread: "MainThread"

INFO:root:severity: INFO
timestamp {
  seconds: 1706073391
  nanos: 867060899
}
message: "Closing all cached gRPC state handlers."
log_location: 
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:929"
thread: "MainThread"

INFO:root:severity: INFO
timestamp {
  seconds: 1706073391
  nanos: 868487119
}
message: "Done consuming work."
log_location: 
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:301"
thread: "MainThread"

INFO:root:severity: INFO
timestamp {
  seconds: 1706073391
  nanos: 868598461
}
message: "Python sdk harness exiting."
log_location: 
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker_main.py:213"
thread: "MainThread"

INFO:apache_beam.runners.portability.local_job_service:Completed job in 
29.127021312713623 seconds with state DONE.
INFO:root:Completed job in 29.127021312713623 seconds with state DONE.
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE

> Task :sdks:python:test-suites:portable:py311:portableWordCountSparkRunnerBatch
INFO:apache_beam.runners.worker.worker_pool_main:Listening for workers at 
localhost:43105
INFO:apache_beam.runners.portability.fn_api_runner.translations:
  
INFO:apache_beam.runners.portability.fn_api_runner.translations:
  
INFO:apache_beam.runners.portability.fn_api_runner.translations:
  
INFO:apache_beam.utils.subprocess_server:Starting service with ('java' '-jar' 
'
 '--spark-master-url' 'local[4]' '--artifacts-dir' 
'/tmp/beam-tempz4km9sn9/artifactsu5__lki8' '--job-port' '48925' 
'--artifact-port' '0' '--expansion-port' '0')
WARNING:root:Waiting for grpc channel to be ready at localhost:48925.
INFO:apache_beam.utils.subprocess_server:24/01/24 05:16:41 WARN 
software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to 
retrieve the requested metadata.
WARNING:root:Waiting for grpc channel to be ready at localhost:48925.
INFO:apache_beam.utils.subprocess_server:24/01/24 05:16:43 INFO 
org.apache.beam.runners.jobsubmission.JobServerDriver: ArtifactStagingService 
started on localhost:38251
WARNING:root:Waiting for grpc channel to be ready at localhost:48925.
INFO:apache_beam.utils.subprocess_server:24/01/24 05:16:44 INFO 
org.apache.beam.runners.jobsubmission.JobServerDriver: Java ExpansionService 
started on localhost:33001
INFO:apache_beam.utils.subprocess_server:24/01/24 05:16:44 INFO 
org.apache.beam.runners.jobsubmission.JobServerDriver: JobService started on 
localhost:48925
INFO:apache_beam.utils.subprocess_server:24/01/24 05:16:44 INFO 
org.apache.beam.runners.jobsubmission.JobServerDriver: Job server now running, 
terminate with Ctrl+C
WARNING:root:Waiting for grpc channel to be ready at localhost:48925.
INFO:apache_beam.utils.subprocess_server:24/01/24 05:16:46 INFO 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Staging 
artifacts for job_837c0823-694c-4b66-b835-a8b6caed337f.
INFO:apache_beam.utils.subprocess_server:24/01/24 05:16:46 INFO 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Resolving 
artifacts for 
job_837c0823-694c-4b66-b835-a8b6caed337f.0:ref_Environment_default_environment_1.
INFO:apache_beam.utils.subprocess_server:24/01/24 05:16:46 INFO 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Getting 1 
artifacts for job_837c0823-694c-4b66-b835-a8b6caed337f.null.
INFO:apache_beam.utils.subprocess_server:24/01/24 05:16:46 INFO 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Artifacts 
fully staged for job_837c0823-694c-4b66-b835-a8b6caed337f.
INFO:apache_beam.utils.subprocess_server:24/01/24 05:16:47 INFO 
org.apache.beam.runners.spark.SparkJobInvoker: Invoking job 
BeamApp-jenkins-0124051647-43ebced9_da1b5d6d-f3a3-4949-aa90-2153cea065bd
INFO:apache_beam.utils.subprocess_server:24/01/24 05:16:48 INFO 
org.apache.beam.runners.jobsubmission.JobInvocation: Starting job invocation 
BeamApp-jenkins-0124051647-43ebced9_da1b5d6d-f3a3-4949-aa90-2153cea065bd
INFO:apache_beam.runners.portability.portable_runner:Environment "LOOPBACK" has 
started a component necessary for the execution. Be sure to run the pipeline 
using
 

Build failed in Jenkins: beam_PostCommit_XVR_Direct #5091

[Apache Jenkins Server]

See 


Changes:


--
[...truncated 1.73 MB...]
E   AttributeError: 'bytes' object has no attribute 'end'

apache_beam/runners/portability/portable_runner.py:576: RuntimeError
-- Captured log call ---
INFO apache_beam.utils.subprocess_server:subprocess_server.py:339 Using 
pre-built snapshot at 

INFO root:external.py:1017 Starting a JAR-based expansion service from JAR 

 
INFO apache_beam.utils.subprocess_server:subprocess_server.py:203 Starting 
service with ['java' '-jar' 
'
 '45883' 
'--filesToStage=
 '--alsoStartLoopbackWorker']
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Starting 
expansion service at localhost:45883
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 24, 
2024 5:44:36 AM org.apache.beam.sdk.expansion.service.ExpansionService 
loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: 
Registering external transforms: [beam:external:java:sql:v1, 
beam:transform:org.apache.beam:pubsub_read:v1, 
beam:transform:org.apache.beam:pubsub_write:v1, 
beam:transform:org.apache.beam:pubsublite_write:v1, 
beam:transform:org.apache.beam:pubsublite_read:v1, 
beam:transform:org.apache.beam:spanner_insert:v1, 
beam:transform:org.apache.beam:spanner_update:v1, 
beam:transform:org.apache.beam:spanner_replace:v1, 
beam:transform:org.apache.beam:spanner_insert_or_update:v1, 
beam:transform:org.apache.beam:spanner_delete:v1, 
beam:transform:org.apache.beam:spanner_read:v1, 
beam:transform:org.apache.beam:kafka_read_with_metadata:v1, 
beam:transform:org.apache.beam:kafka_read_without_metadata:v1, 
beam:transform:org.apache.beam:kafka_write:v1, 
beam:external:java:generate_sequence:v1, 
beam:transform:org.apache.beam:bigquery_read:v1, 
beam:transform:org.apache.beam:bigquery_write:v1, 
beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, 
beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, 
beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, 
beam:transform:create_view:v1, beam:transform:flatten:v1, 
beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, 
beam:transform:group_into_batches_with_sharded_key:v1, 
beam:transform:impulse:v1, beam:transform:reshuffle:v1, 
beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, 
beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 
Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:external:java:sql:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6c779568
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:pubsub_read:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@f381794
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:pubsub_write:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2cdd0d4b
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:pubsublite_write:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7e9131d5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:pubsublite_read:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2e1d27ba
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:spanner_insert:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@61d6015a
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:spanner_update:v1: 

Jenkins build is back to normal : beam_PostCommit_Java_ValidatesRunner_Flink_Java11 #5461

[Apache Jenkins Server]

See 



-
To unsubscribe, e-mail: builds-unsubscr...@beam.apache.org
For additional commands, e-mail: builds-h...@beam.apache.org

Build failed in Jenkins: beam_PostCommit_Python310 #1814

[Apache Jenkins Server]

See 


Changes:


--
[...truncated 11.70 MB...]
input_op_by_transform_id[element.transform_id].process_encoded(
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/runners/worker/bundle_processor.py",
 line 237, in process_encoded
self.output(decoded_value)
  File "apache_beam/runners/worker/operations.py", line 570, in 
apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 572, in 
apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 263, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 266, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 953, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/worker/operations.py", line 954, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/common.py", line 1437, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 1526, in 
apache_beam.runners.common.DoFnRunner._reraise_augmented
  File "apache_beam/runners/common.py", line 1435, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 636, in 
apache_beam.runners.common.SimpleInvoker.invoke_process
  File "apache_beam/runners/common.py", line 1621, in 
apache_beam.runners.common._OutputHandler.handle_process_outputs
  File "apache_beam/runners/common.py", line 1736, in 
apache_beam.runners.common._OutputHandler._write_value_to_tag
  File "apache_beam/runners/worker/operations.py", line 263, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 266, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 1351, in 
apache_beam.runners.worker.operations.FlattenOperation.process
  File "apache_beam/runners/worker/operations.py", line 1354, in 
apache_beam.runners.worker.operations.FlattenOperation.process
  File "apache_beam/runners/worker/operations.py", line 572, in 
apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 263, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 266, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 953, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/worker/operations.py", line 954, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/common.py", line 1437, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 1547, in 
apache_beam.runners.common.DoFnRunner._reraise_augmented
  File "apache_beam/runners/common.py", line 1435, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 851, in 
apache_beam.runners.common.PerWindowInvoker.invoke_process
  File "apache_beam/runners/common.py", line 995, in 
apache_beam.runners.common.PerWindowInvoker._invoke_process_per_window
  File "apache_beam/runners/common.py", line 1611, in 
apache_beam.runners.common._OutputHandler.handle_process_outputs
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/io/gcp/bigquery_file_loads.py",
 line 750, in process
job_reference = self.bq_wrapper.perform_load_job(
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/io/gcp/bigquery_tools.py",
 line 1022, in perform_load_job
return self._insert_load_job(
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/utils/retry.py",
 line 298, in wrapper
return fun(*args, **kwargs)
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/io/gcp/bigquery_tools.py",
 line 559, in _insert_load_job
return self._start_job(request, stream=source_stream).jobReference
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/io/gcp/bigquery_tools.py",
 line 578, in _start_job
response = self.client.jobs.Insert(request, upload=upload)
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/io/gcp/internal/clients/bigquery/bigquery_v2_client.py",
 line 356, in Insert
return self._RunMethod(
  File "/usr/local/lib/python3.10/site-packages/apitools/base/py/base_api.py", 
line 

Build failed in Jenkins: beam_PostCommit_Python38 #5080

[Apache Jenkins Server]

See 


Changes:


--
[...truncated 9.45 MB...]
return getattr(self, request_type)(
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py",
 line 688, in process_bundle
bundle_processor.process_bundle(instruction_id))
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py",
 line 1113, in process_bundle
input_op_by_transform_id[element.transform_id].process_encoded(
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py",
 line 237, in process_encoded
self.output(decoded_value)
  File "apache_beam/runners/worker/operations.py", line 570, in 
apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 572, in 
apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 263, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 266, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 953, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/worker/operations.py", line 954, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/common.py", line 1437, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 1526, in 
apache_beam.runners.common.DoFnRunner._reraise_augmented
  File "apache_beam/runners/common.py", line 1435, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 636, in 
apache_beam.runners.common.SimpleInvoker.invoke_process
  File "apache_beam/runners/common.py", line 1621, in 
apache_beam.runners.common._OutputHandler.handle_process_outputs
  File "apache_beam/runners/common.py", line 1736, in 
apache_beam.runners.common._OutputHandler._write_value_to_tag
  File "apache_beam/runners/worker/operations.py", line 263, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 266, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 1351, in 
apache_beam.runners.worker.operations.FlattenOperation.process
  File "apache_beam/runners/worker/operations.py", line 1354, in 
apache_beam.runners.worker.operations.FlattenOperation.process
  File "apache_beam/runners/worker/operations.py", line 572, in 
apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 263, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 266, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 953, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/worker/operations.py", line 954, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/common.py", line 1437, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 1547, in 
apache_beam.runners.common.DoFnRunner._reraise_augmented
  File "apache_beam/runners/common.py", line 1435, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 851, in 
apache_beam.runners.common.PerWindowInvoker.invoke_process
  File "apache_beam/runners/common.py", line 995, in 
apache_beam.runners.common.PerWindowInvoker._invoke_process_per_window
  File "apache_beam/runners/common.py", line 1611, in 
apache_beam.runners.common._OutputHandler.handle_process_outputs
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.8/site-packages/apache_beam/io/gcp/bigquery_file_loads.py",
 line 750, in process
job_reference = self.bq_wrapper.perform_load_job(
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.8/site-packages/apache_beam/io/gcp/bigquery_tools.py",
 line 1022, in perform_load_job
return self._insert_load_job(
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.8/site-packages/apache_beam/utils/retry.py",
 line 298, in wrapper
return fun(*args, **kwargs)
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.8/site-packages/apache_beam/io/gcp/bigquery_tools.py",
 line 559, in _insert_load_job
return self._start_job(request, stream=source_stream).jobReference
  File 

Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #2617

[Apache Jenkins Server]

See 


Changes:


--
[...truncated 1.53 MB...]
  "namespace": "go_options",
  "type": "STRING",
  "value": "{\"default_remote_logging\":null}"
},
{
  "key": "test.paniconexit0",
  "namespace": "go_options",
  "type": "STRING",
  "value": "true"
},
{
  "key": "test.timeout",
  "namespace": "go_options",
  "type": "STRING",
  "value": "3h0m0s"
},
{
  "key": "hookOrder",
  "namespace": "go_options",
  "type": "STRING",
  "value": "[\"default_remote_logging\"]"
},
{
  "key": "bq_dataset",
  "namespace": "go_options",
  "type": "STRING",
  "value": "apache-beam-testing.beam_bigquery_io_test_temp"
}
  ],
  "options": {
"experiments": [
  "beam_fn_api",
  "use_runner_v2",
  "use_unified_worker",
  "use_portable_job_submission"
],
"pipelineUrl": 
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test267/go-2-1706063897920473101/model",
"region": "us-central1",
"tempLocation": 
"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test267"
  },
  "beam:option:go_options:v1": {
"options": {
  "bq_dataset": "apache-beam-testing.beam_bigquery_io_test_temp",
  "bt_instance": "projects/apache-beam-testing/instances/beam-test",
  "expansion_addr": "[test:localhost:45963]",
  "expansion_jar": 
"[io:
 
schemaio:
 
debeziumio:
 
gcpio:
  "experiments": 
"beam_fn_api,use_runner_v2,use_unified_worker,use_portable_job_submission",
  "hookOrder": "[\"default_remote_logging\"]",
  "hooks": "{\"default_remote_logging\":null}",
  "kafka_jar": 
"
  "sdk_harness_container_image_override": 
"[.*java.*,us.gcr.io/apache-beam-testing/java-postcommit-it/java:20240124022044]",
  "temp_location": 
"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test267",
  "test.paniconexit0": "true",
  "test.timeout": "3h0m0s",
  "test.v": "true"
}
  }
},
"tempStoragePrefix": 
"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test267",
"userAgent": {
  "name": "Apache Beam SDK for Go",
  "version": "2.54.0.dev"
},
"version": {
  "job_type": "FNAPI_BATCH",
  "major": "6"
},
"workerPools": [
  {
"autoscalingSettings": {},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 1,
"packages": [
  {
"location": 
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test267/go-2-1706063897920473101/worker",
"name": "worker"
  },
  {
"location": 
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test267/go-2-1706063897920473101/xlang/beam-sdks-java-io-google-cloud-platform-expansion-service-2.54.0-SNAPSHOT-ooF79by2lpxJ3EnBHTyW_1MmdoNJ3mIfEoH8VYHsSSk.jar",
"name": 
"beam-sdks-java-io-google-cloud-platform-expansion-service-2.54.0-SNAPSHOT-ooF79by2lpxJ3EnBHTyW_1MmdoNJ3mIfEoH8VYHsSSk.jar"
  }
],
"sdkHarnessContainerImages": [
  {
"capabilities": [
  "beam:protocol:progress_reporting:v1",
  "beam:protocol:multi_core_bundle_processing:v1",
  "beam:transform:sdf_truncate_sized_restrictions:v1",
  "beam:protocol:worker_status:v1",
  "beam:protocol:monitoring_info_short_ids:v1",
  "beam:version:sdk_base:go:apache/beam_go_sdk:2.54.0.dev",
  "beam:transform:to_string:v1",
  "beam:protocol:data_sampling:v1",
 

Jenkins build is back to normal : beam_PostCommit_Python_Xlang_IO_Dataflow #614

[Apache Jenkins Server]

See 



-
To unsubscribe, e-mail: builds-unsubscr...@beam.apache.org
For additional commands, e-mail: builds-h...@beam.apache.org

Build failed in Jenkins: beam_PostCommit_Python39 #2801

[Apache Jenkins Server]

See 


Changes:


--
[...truncated 10.89 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.beam.vendor.grpc.v1p60p1.com.google.common.base.Preconditions.checkState(Preconditions.java:512)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.beam.vendor.grpc.v1p60p1.io.grpc.internal.ServerCallImpl.closeInternal(ServerCallImpl.java:213)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.beam.vendor.grpc.v1p60p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:208)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.beam.vendor.grpc.v1p60p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:395)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.beam.runners.fnexecution.state.GrpcStateService.close(GrpcStateService.java:63)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.beam.sdk.fn.server.GrpcFnServer.close(GrpcFnServer.java:156)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.$closeResource(DefaultJobBundleFactory.java:649)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.close(DefaultJobBundleFactory.java:649)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.unref(DefaultJobBundleFactory.java:665)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.access$400(DefaultJobBundleFactory.java:596)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.lambda$createEnvironmentCaches$3(DefaultJobBundleFactory.java:213)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.beam.vendor.guava.v32_1_2_jre.com.google.common.cache.LocalCache.processPendingNotifications(LocalCache.java:1850)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.beam.vendor.guava.v32_1_2_jre.com.google.common.cache.LocalCache$Segment.runUnlockedCleanup(LocalCache.java:3503)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.beam.vendor.guava.v32_1_2_jre.com.google.common.cache.LocalCache$Segment.postWriteCleanup(LocalCache.java:3479)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.beam.vendor.guava.v32_1_2_jre.com.google.common.cache.LocalCache$Segment.clear(LocalCache.java:3252)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.beam.vendor.guava.v32_1_2_jre.com.google.common.cache.LocalCache.clear(LocalCache.java:4343)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.beam.vendor.guava.v32_1_2_jre.com.google.common.cache.LocalCache$LocalManualCache.invalidateAll(LocalCache.java:4960)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.close(DefaultJobBundleFactory.java:326)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.beam.runners.fnexecution.control.DefaultExecutableStageContext.close(DefaultExecutableStageContext.java:43)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory$WrappedContext.closeActual(ReferenceCountingExecutableStageContextFactory.java:217)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory$WrappedContext.access$200(ReferenceCountingExecutableStageContextFactory.java:193)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory.release(ReferenceCountingExecutableStageContextFactory.java:182)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory.scheduleRelease(ReferenceCountingExecutableStageContextFactory.java:136)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 

Build failed in Jenkins: beam_PostCommit_Java_DataflowV2 #4023

[Apache Jenkins Server]

See 


Changes:


--
[...truncated 49.01 KB...]
  Successfully uninstalled pip-20.0.2
  Attempting uninstall: setuptools
Found existing installation: setuptools 44.0.0
Uninstalling setuptools-44.0.0:
  Successfully uninstalled setuptools-44.0.0
Successfully installed pip-23.3.2 setuptools-69.0.3 wheel-0.42.0
Collecting beautifulsoup4<5.0,>=4.9.0 (from -r 

 (line 19))
  Using cached beautifulsoup4-4.12.3-py3-none-any.whl.metadata (3.8 kB)
Collecting pyyaml<7,>=6.0.1 (from -r 

 (line 20))
  Using cached 
PyYAML-6.0.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata 
(2.1 kB)
Collecting tenacity<9.0,>=6.1.0 (from -r 

 (line 21))
  Using cached tenacity-8.2.3-py3-none-any.whl.metadata (1.0 kB)
Collecting soupsieve>1.2 (from beautifulsoup4<5.0,>=4.9.0->-r 

 (line 19))
  Using cached soupsieve-2.5-py3-none-any.whl.metadata (4.7 kB)
Using cached beautifulsoup4-4.12.3-py3-none-any.whl (147 kB)
Using cached 
PyYAML-6.0.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (736 kB)
Using cached tenacity-8.2.3-py3-none-any.whl (24 kB)
Using cached soupsieve-2.5-py3-none-any.whl (36 kB)
Installing collected packages: tenacity, soupsieve, pyyaml, beautifulsoup4
Successfully installed beautifulsoup4-4.12.3 pyyaml-6.0.1 soupsieve-2.5 
tenacity-8.2.3
Executing python 

 
--license_index=

--output_dir=

--dep_url_yaml=

--manual_license_path=
INFO:root:Pulling license for 129 dependencies using 16 threads.
INFO:root:Replaced local file URL with 
file://
 for xz-1.5
INFO:root:pull_licenses_java.py succeed. It took 1.771739 seconds with 16 
threads.
Copying licenses from 

 to 

Finished license_scripts.sh

> Task :release:go-licenses:java:dockerRun
go: downloading golang.org/x/net v0.19.0
go: downloading google.golang.org/genproto/googleapis/rpc 
v0.0.0-20231120223509-83a465c0220f
go: downloading google.golang.org/genproto v0.0.0-20231106174013-bbf56f31fb17
go: downloading golang.org/x/text v0.14.0
go: added github.com/apache/beam/sdks/v2 v2.53.0
go: added github.com/golang/protobuf v1.5.3
go: added golang.org/x/net v0.19.0
go: added golang.org/x/sys v0.15.0
go: added golang.org/x/text v0.14.0
go: added google.golang.org/genproto/googleapis/rpc 
v0.0.0-20231120223509-83a465c0220f
go: added google.golang.org/grpc v1.59.0
go: added google.golang.org/protobuf v1.31.0
+ go-licenses save github.com/apache/beam/sdks/v2/java/container 
--save_path=/output/licenses
W0123 21:58:07.488267  28 library.go:101] "golang.org/x/sys/unix" contains 
non-Go code that can't be inspected for further dependencies:
/go/pkg/mod/golang.org/x/sys@v0.15.0/unix/asm_linux_amd64.s
+ go-licenses csv github.com/apache/beam/sdks/v2/java/container
+ tee /output/licenses/list.csv
W0123 21:58:14.472010  70 library.go:101] "golang.org/x/sys/unix" contains 
non-Go code that can't be inspected for further dependencies:
/go/pkg/mod/golang.org/x/sys@v0.15.0/unix/asm_linux_amd64.s

> Task :sdks:java:container:java8:copyJavaThirdPartyLicenses

> Task :sdks:java:container:downloadCloudProfilerAgent
  % Total% Received % Xferd  Average Speed   TimeTime Time  Current
 Dload  Upload   Total   SpentLeft  Speed
  0 00 00 0  0  0 --:--:-- --:--:-- --:--:-- 
0version.txt
NOTICES
profiler_java_agent.so
 

Build failed in Jenkins: beam_PostCommit_Java_InfluxDbIO_IT #1528

[Apache Jenkins Server]

See 


Changes:


--
[...truncated 137.34 KB...]
Started Gradle worker daemon (0.464 secs) with fork options 
DaemonForkOptions{executable=/usr/lib/jvm/java-8-openjdk-amd64/bin/java, 
minHeapSize=null, maxHeapSize=null, 
jvmArgs=[-Xbootclasspath/p:/home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.errorprone/javac/9+181-r4173-1/bdf4c0aa7d540ee1f7bf14d47447aea4bbf450c5/javac-9+181-r4173-1.jar,
 
-Xbootclasspath/p:/home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.errorprone/javac/9+181-r4173-1/bdf4c0aa7d540ee1f7bf14d47447aea4bbf450c5/javac-9+181-r4173-1.jar],
 keepAliveMode=DAEMON}.
Compiling with JDK Java compiler API.

> Task :sdks:java:harness:compileJava FROM-CACHE
Custom actions are attached to task ':sdks:java:harness:compileJava'.
Build cache key for task ':sdks:java:harness:compileJava' is 
2e000d082c8ee7f7dc849666b2c0666e
Task ':sdks:java:harness:compileJava' is not up-to-date because:
  No history is available.
Loaded cache entry for task ':sdks:java:harness:compileJava' with cache key 
2e000d082c8ee7f7dc849666b2c0666e
Resolve mutations for :sdks:java:harness:classes (Thread[Execution worker 
Thread 4,5,main]) started.
:sdks:java:harness:classes (Thread[Execution worker Thread 4,5,main]) started.

> Task :sdks:java:harness:classes UP-TO-DATE
Skipping task ':sdks:java:harness:classes' as it has no actions.
Resolve mutations for :sdks:java:harness:jar (Thread[Execution worker Thread 
4,5,main]) started.
:sdks:java:harness:jar (Thread[Execution worker Thread 4,5,main]) started.

> Task :runners:core-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:core-java:compileTestJava'.
Build cache key for task ':runners:core-java:compileTestJava' is 
93edd74de219579963c5042a4ffd916b
Task ':runners:core-java:compileTestJava' is not up-to-date because:
  No history is available.
Loaded cache entry for task ':runners:core-java:compileTestJava' with cache key 
93edd74de219579963c5042a4ffd916b
Resolve mutations for :runners:core-java:testClasses (Thread[Execution worker 
Thread 2,5,main]) started.
:runners:core-java:testClasses (Thread[Execution worker Thread 2,5,main]) 
started.

> Task :runners:core-java:testClasses UP-TO-DATE
Skipping task ':runners:core-java:testClasses' as it has no actions.
Resolve mutations for :runners:core-java:testJar (Thread[Execution worker 
Thread 2,5,main]) started.
:runners:core-java:testJar (Thread[Execution worker Thread 2,5,main]) started.

> Task :sdks:java:harness:jar
Caching disabled for task ':sdks:java:harness:jar' because:
  Not worth caching
Task ':sdks:java:harness:jar' is not up-to-date because:
  No history is available.
file or directory 
'
 not found
work action resolve beam-sdks-java-harness-unshaded.jar (project 
:sdks:java:harness) (Thread[Execution worker Thread 4,5,main]) started.
Resolve mutations for :runners:java-fn-execution:compileJava (Thread[Execution 
worker Thread 4,5,main]) started.
:runners:java-fn-execution:compileJava (Thread[Execution worker Thread 
4,5,main]) started.

> Task :runners:core-java:testJar
Caching disabled for task ':runners:core-java:testJar' because:
  Not worth caching
Task ':runners:core-java:testJar' is not up-to-date because:
  No history is available.
file or directory 
'
 not found
work action resolve beam-runners-core-java-tests.jar (project 
:runners:core-java) (Thread[Execution worker Thread 2,5,main]) started.

> Task :sdks:java:extensions:avro:compileTestJava FROM-CACHE
Custom actions are attached to task 
':sdks:java:extensions:avro:compileTestJava'.
Build cache key for task ':sdks:java:extensions:avro:compileTestJava' is 
34d8fcb54cbbdadf6f2807f926263a33
Task ':sdks:java:extensions:avro:compileTestJava' is not up-to-date because:
  No history is available.
Loaded cache entry for task ':sdks:java:extensions:avro:compileTestJava' with 
cache key 34d8fcb54cbbdadf6f2807f926263a33
Resolve mutations for :sdks:java:extensions:avro:testClasses (Thread[Execution 
worker Thread 6,5,main]) started.
:sdks:java:extensions:avro:testClasses (Thread[Execution worker Thread 
6,5,main]) started.

> Task :sdks:java:extensions:avro:testClasses UP-TO-DATE
Skipping task ':sdks:java:extensions:avro:testClasses' as it has no actions.
Resolve mutations for :sdks:java:extensions:avro:testJar (Thread[Execution 
worker Thread 6,5,main]) started.
:sdks:java:extensions:avro:testJar (Thread[Execution worker Thread 6,5,main]) 
started.

> Task :sdks:java:extensions:avro:testJar
Caching disabled for task ':sdks:java:extensions:avro:testJar' because:
  Not worth caching
Task ':sdks:java:extensions:avro:testJar' is not up-to-date because:
  No history is 

Build failed in Jenkins: beam_PostCommit_Python311 #1151

[Apache Jenkins Server]

See 


Changes:


--
[...truncated 12.10 MB...]
  nanos: 178955793
}
message: "SDK Harness waiting for in-flight requests to complete"
log_location: 
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:289"
thread: "MainThread"

INFO:root:severity: INFO
timestamp {
  seconds: 1706051721
  nanos: 179010391
}
message: "Closing all cached grpc data channels."
log_location: 
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/data_plane.py:820"
thread: "MainThread"

INFO:root:severity: INFO
timestamp {
  seconds: 1706051721
  nanos: 179060459
}
message: "Closing all cached gRPC state handlers."
log_location: 
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:929"
thread: "MainThread"

INFO:root:severity: INFO
timestamp {
  seconds: 1706051721
  nanos: 180104255
}
message: "Done consuming work."
log_location: 
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:301"
thread: "MainThread"

INFO:root:severity: INFO
timestamp {
  seconds: 1706051721
  nanos: 180202484
}
message: "Python sdk harness exiting."
log_location: 
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker_main.py:213"
thread: "MainThread"

INFO:apache_beam.runners.portability.local_job_service:Completed job in 
30.785908937454224 seconds with state DONE.
INFO:root:Completed job in 30.785908937454224 seconds with state DONE.
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE

> Task :sdks:python:test-suites:portable:py311:portableWordCountSparkRunnerBatch
INFO:apache_beam.runners.worker.worker_pool_main:Listening for workers at 
localhost:46239
INFO:apache_beam.runners.portability.fn_api_runner.translations:
  
INFO:apache_beam.runners.portability.fn_api_runner.translations:
  
INFO:apache_beam.runners.portability.fn_api_runner.translations:
  
INFO:apache_beam.utils.subprocess_server:Starting service with ('java' '-jar' 
'
 '--spark-master-url' 'local[4]' '--artifacts-dir' 
'/tmp/beam-tempbuvl12kl/artifactsb4st592z' '--job-port' '47083' 
'--artifact-port' '0' '--expansion-port' '0')
INFO:apache_beam.utils.subprocess_server:24/01/23 23:15:32 WARN 
software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to 
retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:24/01/23 23:15:32 INFO 
org.apache.beam.runners.jobsubmission.JobServerDriver: ArtifactStagingService 
started on localhost:43149
INFO:apache_beam.utils.subprocess_server:24/01/23 23:15:32 INFO 
org.apache.beam.runners.jobsubmission.JobServerDriver: Java ExpansionService 
started on localhost:35391
INFO:apache_beam.utils.subprocess_server:24/01/23 23:15:32 INFO 
org.apache.beam.runners.jobsubmission.JobServerDriver: JobService started on 
localhost:47083
INFO:apache_beam.utils.subprocess_server:24/01/23 23:15:32 INFO 
org.apache.beam.runners.jobsubmission.JobServerDriver: Job server now running, 
terminate with Ctrl+C
WARNING:root:Waiting for grpc channel to be ready at localhost:47083.
INFO:apache_beam.utils.subprocess_server:24/01/23 23:15:35 INFO 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Staging 
artifacts for job_733c548a-73da-4e9b-afd6-4059224930c6.
INFO:apache_beam.utils.subprocess_server:24/01/23 23:15:35 INFO 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Resolving 
artifacts for 
job_733c548a-73da-4e9b-afd6-4059224930c6.0:ref_Environment_default_environment_1.
INFO:apache_beam.utils.subprocess_server:24/01/23 23:15:35 INFO 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Getting 1 
artifacts for job_733c548a-73da-4e9b-afd6-4059224930c6.null.
INFO:apache_beam.utils.subprocess_server:24/01/23 23:15:35 INFO 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Artifacts 
fully staged for job_733c548a-73da-4e9b-afd6-4059224930c6.
INFO:apache_beam.utils.subprocess_server:24/01/23 23:15:35 INFO 
org.apache.beam.runners.spark.SparkJobInvoker: Invoking job 
BeamApp-jenkins-0123231535-47681b24_6a60387f-a36c-4271-9dd4-81d045b92d52
INFO:apache_beam.utils.subprocess_server:24/01/23 23:15:35 INFO 
org.apache.beam.runners.jobsubmission.JobInvocation: Starting job invocation 
BeamApp-jenkins-0123231535-47681b24_6a60387f-a36c-4271-9dd4-81d045b92d52
INFO:apache_beam.runners.portability.portable_runner:Environment "LOOPBACK" has 
started a component necessary for the execution. Be sure to run the pipeline 
using
  with Pipeline() as p:
p.apply(..)
This ensures that the pipeline finishes before this program exits.

Build failed in Jenkins: beam_PostCommit_XVR_Direct #5090

[Apache Jenkins Server]

See 


Changes:


--
[...truncated 1.04 MB...]
  >
  component_coder_ids: "HyVSQosVbwVarIntCoder"
  component_coder_ids: "HyVSQosVbwIterableCoder"
>
  >
  coders: <
key: "HyVSQosVbwRowCoder"
value: <
  spec: <
urn: "beam:coder:row:v1"
payload: 
"\n\r\n\007role_id\032\002\020\004\022$f21e325f-2200-484f-825f-8454a13a12e8"
  >
>
  >
  coders: <
key: "HyVSQosVbwVarIntCoder"
value: <
  spec: <
urn: "beam:coders:javasdk:0.1"
payload: 
"\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\224\330\001\360<\254\355\000\005sr\000\300K2\332\251KVh\002\000\000xr\000\000\030AtomicC\001B8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000
 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
  >
>
  >
  coders: <
key: "HyVSQosVbwVoidCoder"
value: <
  spec: <
urn: "beam:coders:javasdk:0.1"
payload: 
"\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\221\326\001\350\254\355\000\005sr\000$org.apache.beam.sdk.coders.VoidCoder\271\277U\233\350\r\257U\002\000\000xr\000\000\030AtomicC\001@8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000
 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
  >
>
  >
  coders: <
key: "c0"
value: <
  spec: <
urn: "beam:coder:bytes:v1"
  >
>
  >
  coders: <
key: "c1"
value: <
  spec: <
urn: "beam:coder:global_window:v1"
  >
>
  >
  coders: <
key: "c2"
value: <
  spec: <
urn: "beam:coder:row:v1"
payload: 
"\n\r\n\007role_id\032\002\020\003\022$abc5e222-ab8f-4f6f-800a-a58bb0f45675"
  >
>
  >
  environments: <
key: "HyVSQosVbwbeam:env:docker:v1"
value: <
  urn: "beam:env:docker:v1"
  payload: "\n apache/beam_java8_sdk:2.54.0.dev"
  capabilities: "beam:coder:bytes:v1"
  capabilities: "beam:coder:bool:v1"
  capabilities: "beam:coder:varint:v1"
  capabilities: "beam:coder:string_utf8:v1"
  capabilities: "beam:coder:iterable:v1"
  capabilities: "beam:coder:timer:v1"
  capabilities: "beam:coder:kv:v1"
  capabilities: "beam:coder:length_prefix:v1"
  capabilities: "beam:coder:global_window:v1"
  capabilities: "beam:coder:interval_window:v1"
  capabilities: "beam:coder:custom_window:v1"
  capabilities: "beam:coder:windowed_value:v1"
  capabilities: "beam:coder:double:v1"
  capabilities: "beam:coder:row:v1"
  capabilities: "beam:coder:param_windowed_value:v1"
  capabilities: "beam:coder:state_backed_iterable:v1"
  capabilities: "beam:coder:sharded_key:v1"
  capabilities: "beam:coder:nullable:v1"
  capabilities: "beam:protocol:multi_core_bundle_processing:v1"
  capabilities: "beam:protocol:progress_reporting:v1"
  capabilities: "beam:protocol:harness_monitoring_infos:v1"
  capabilities: "beam:protocol:control_request_elements_embedding:v1"
  capabilities: "beam:protocol:state_caching:v1"
  capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.54.0.dev"
  capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
  capabilities: "beam:transform:to_string:v1"
  capabilities: "beam:protocol:data_sampling:v1"
  dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: 
"\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.54.0-SNAPSHOT-rXARW82fPWBjChVRxsPJd1QPMjeeOV_JR3dZVKv0NBI.jar\022@ad70115bcd9f3d60630a1551c6c3c977540f32379e395fc947775954abf43412"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: 
"\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.54.0-SNAPSHOT-rXARW82fPWBjChVRxsPJd1QPMjeeOV_JR3dZVKv0NBI.jar"
  >
>
  >
  environments: <
key: "go"
value: <
  urn: "beam:env:docker:v1"
  payload: "\n\026apache/beam_go_sdk:dev"
  capabilities: "beam:protocol:progress_reporting:v1"
  capabilities: "beam:protocol:multi_core_bundle_processing:v1"
  capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
  capabilities: "beam:protocol:worker_status:v1"
  capabilities: "beam:protocol:monitoring_info_short_ids:v1"
  capabilities: "beam:version:sdk_base:go:apache/beam_go_sdk:2.54.0.dev"
  capabilities: "beam:transform:to_string:v1"
  capabilities: "beam:protocol:data_sampling:v1"
  capabilities: "beam:coder:bytes:v1"
  capabilities: "beam:coder:bool:v1"
  capabilities: "beam:coder:varint:v1"
  capabilities: "beam:coder:double:v1"
  capabilities: "beam:coder:string_utf8:v1"
  capabilities: "beam:coder:length_prefix:v1"
  capabilities: "beam:coder:kv:v1"
  capabilities: "beam:coder:iterable:v1"
  capabilities: 

Build failed in Jenkins: beam_PostCommit_Python_Xlang_IO_Dataflow #613

[Apache Jenkins Server]

See 


Changes:


--
[...truncated 458.61 KB...]
 steps: []
 tempFiles: []
 type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)>
INFO 
apache_beam.runners.dataflow.internal.apiclient:apiclient.py:860 Created job 
with id: [2024-01-23_12_55_57-11400971046939635074]
INFO 
apache_beam.runners.dataflow.internal.apiclient:apiclient.py:861 Submitted job: 
2024-01-23_12_55_57-11400971046939635074
INFO 
apache_beam.runners.dataflow.internal.apiclient:apiclient.py:862 To access the 
Dataflow monitoring console, please navigate to 
https://console.cloud.google.com/dataflow/jobs/us-central1/2024-01-23_12_55_57-11400971046939635074?project=apache-beam-testing
INFO 
apache_beam.runners.dataflow.test_dataflow_runner:test_dataflow_runner.py:58 
Console log: 
INFO 
apache_beam.runners.dataflow.test_dataflow_runner:test_dataflow_runner.py:59 
https://console.cloud.google.com/dataflow/jobs/us-central1/2024-01-23_12_55_57-11400971046939635074?project=apache-beam-testing
INFO 
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:151 Job 
2024-01-23_12_55_57-11400971046939635074 is in state JOB_STATE_RUNNING
INFO 
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:201 
2024-01-23T20:56:00.898Z: JOB_MESSAGE_BASIC: Worker configuration: 
e2-standard-2 in us-central1-a.
INFO 
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:201 
2024-01-23T20:56:03.473Z: JOB_MESSAGE_BASIC: Executing operation 
Generate/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Create
INFO 
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:201 
2024-01-23T20:56:03.532Z: JOB_MESSAGE_BASIC: Starting 1 workers in 
us-central1-a...
INFO 
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:201 
2024-01-23T20:56:03.904Z: JOB_MESSAGE_BASIC: Finished operation 
Generate/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Create
INFO 
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:201 
2024-01-23T20:56:12.672Z: JOB_MESSAGE_BASIC: Executing operation 
Generate/Impulse+Generate/FlatMap()+Generate/MaybeReshuffle/Reshuffle/AddRandomKeys+Generate/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps)+Generate/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Reify+Generate/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Write
INFO 
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:201 
2024-01-23T20:56:22.388Z: JOB_MESSAGE_BASIC: Your project already contains 100 
Dataflow-created metric descriptors, so new user metrics of the form 
custom.googleapis.com/* will not be created. However, all user metrics are also 
available in the metric dataflow.googleapis.com/job/user_counter. If you rely 
on the custom metrics, you can delete old / unused metric descriptors. See 
https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list
 and 
https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
INFO 
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:201 
2024-01-23T22:10:52.237Z: JOB_MESSAGE_BASIC: Cancel request is committed for 
workflow job: 2024-01-23_12_55_57-11400971046939635074.
INFO 
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:201 
2024-01-23T22:10:52.258Z: JOB_MESSAGE_BASIC: Finished operation 
Generate/Impulse+Generate/FlatMap()+Generate/MaybeReshuffle/Reshuffle/AddRandomKeys+Generate/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps)+Generate/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Reify+Generate/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Write
INFO 
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:201 
2024-01-23T22:10:52.492Z: JOB_MESSAGE_BASIC: Stopping worker pool...
INFO 
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:151 Job 
2024-01-23_12_55_57-11400971046939635074 is in state JOB_STATE_CANCELLING
__ CrossLanguageKafkaIOTest.test_hosted_kafkaio_populated_key 
__

self = 

@pytest.mark.uses_io_java_expansion_service
@unittest.skipUnless(
os.environ.get('EXPANSION_PORT'),
"EXPANSION_PORT environment var is not provided.")
@unittest.skipUnless(
os.environ.get('KAFKA_BOOTSTRAP_SERVER'),
"KAFKA_BOOTSTRAP_SERVER environment var is not provided.")
def test_hosted_kafkaio_populated_key(self):
  kafka_topic = 'xlang_kafkaio_test_populated_key_{}'.format(uuid.uuid4())
  bootstrap_servers = os.environ.get('KAFKA_BOOTSTRAP_SERVER')
  pipeline_creator = CrossLanguageKafkaIO(
  bootstrap_servers,
  kafka_topic,
  False,
  

Build failed in Jenkins: beam_PostCommit_Java_ValidatesRunner_Flink_Java11 #5460

[Apache Jenkins Server]

See 


Changes:


--
[...truncated 2.40 KB...]
[src] $ 

 -Dorg.gradle.java.home=/usr/lib/jvm/java-8-openjdk-amd64 
:runners:flink:1.15:jar :runners:flink:1.15:testJar
To honour the JVM settings for this build a single-use Daemon process will be 
forked. For more on this, please refer to 
https://docs.gradle.org/8.4/userguide/gradle_daemon.html#sec:disabling_the_daemon
 in the Gradle documentation.
Daemon will be stopped at the end of the build 
Configuration on demand is an incubating feature.
Gradle Enterprise plugins resolution: https://plugins.gradle.org/m2
Enforcing Gradle Enterprise: https://ge.apache.org, allowUntrustedServer: false
> Task :buildSrc:compileJava NO-SOURCE
> Task :buildSrc:compileGroovy FROM-CACHE
> Task :buildSrc:pluginDescriptors
> Task :buildSrc:processResources
> Task :buildSrc:classes
> Task :buildSrc:jar
> Task :model:job-management:createCheckerFrameworkManifest
> Task :sdks:java:build-tools:createCheckerFrameworkManifest
> Task :sdks:java:fn-execution:createCheckerFrameworkManifest
> Task :sdks:java:extensions:avro:createCheckerFrameworkManifest
> Task :runners:core-construction-java:createCheckerFrameworkManifest
> Task :sdks:java:core:createCheckerFrameworkManifest
> Task :runners:core-java:createCheckerFrameworkManifest
> Task :sdks:java:expansion-service:createCheckerFrameworkManifest
> Task :sdks:java:harness:createCheckerFrameworkManifest
> Task :sdks:java:transform-service:launcher:createCheckerFrameworkManifest
> Task :sdks:java:extensions:avro:generateAvroProtocol NO-SOURCE
> Task :runners:core-java:processResources NO-SOURCE
> Task :sdks:java:fn-execution:processResources NO-SOURCE
> Task :runners:core-construction-java:processResources NO-SOURCE
> Task :sdks:java:harness:processResources NO-SOURCE
> Task :model:fn-execution:createCheckerFrameworkManifest
> Task :model:pipeline:createCheckerFrameworkManifest
> Task :sdks:java:extensions:avro:generateAvroJava NO-SOURCE
> Task :runners:java-fn-execution:createCheckerFrameworkManifest
> Task :sdks:java:expansion-service:processResources NO-SOURCE
> Task :runners:core-java:processTestResources NO-SOURCE
> Task :runners:java-job-service:createCheckerFrameworkManifest
> Task :sdks:java:extensions:avro:processResources NO-SOURCE
> Task :runners:java-fn-execution:processResources NO-SOURCE
> Task 
> :sdks:java:extensions:google-cloud-platform-core:createCheckerFrameworkManifest
> Task :runners:java-job-service:processResources NO-SOURCE
> Task :runners:flink:1.15:copySourceOverrides
> Task :sdks:java:extensions:google-cloud-platform-core:processResources 
> NO-SOURCE
> Task :model:job-management:extractProto
> Task :model:fn-execution:extractProto
> Task :sdks:java:extensions:protobuf:createCheckerFrameworkManifest
> Task :sdks:java:io:google-cloud-platform:createCheckerFrameworkManifest
> Task :sdks:java:extensions:arrow:createCheckerFrameworkManifest
> Task :runners:flink:1.15:createCheckerFrameworkManifest
> Task :sdks:java:core:generateGrammarSource FROM-CACHE
> Task :runners:flink:1.15:copyResourcesOverrides NO-SOURCE
> Task :sdks:java:io:google-cloud-platform:processResources NO-SOURCE
> Task :sdks:java:extensions:protobuf:extractProto
> Task :sdks:java:extensions:arrow:processResources NO-SOURCE
> Task :sdks:java:extensions:protobuf:processResources NO-SOURCE
> Task :model:job-management:processResources
> Task :runners:flink:1.15:processResources
> Task :model:fn-execution:processResources
> Task :runners:flink:1.15:copyTestSourceOverrides
> Task :runners:flink:1.15:copyTestResourcesOverrides NO-SOURCE
> Task :sdks:java:core:processResources
> Task :sdks:java:core:generateTestGrammarSource NO-SOURCE
> Task :runners:flink:1.15:processTestResources
> Task :sdks:java:core:processTestResources
> Task :sdks:java:transform-service:launcher:compileJava FROM-CACHE
> Task :sdks:java:build-tools:compileJava FROM-CACHE
> Task :sdks:java:transform-service:launcher:processResources
> Task :sdks:java:transform-service:launcher:classes
> Task :sdks:java:build-tools:processResources
> Task :sdks:java:build-tools:classes
> Task :sdks:java:transform-service:launcher:jar
> Task :sdks:java:build-tools:jar
> Task :sdks:java:transform-service:launcher:shadowJar FROM-CACHE
> Task :model:pipeline:extractIncludeProto
> Task :model:pipeline:extractProto
> Task :model:pipeline:generateProto FROM-CACHE
> Task :model:pipeline:compileJava FROM-CACHE
> Task :model:pipeline:processResources
> Task :model:pipeline:classes
> Task :model:pipeline:jar
> Task :model:pipeline:shadowJar FROM-CACHE
> Task :model:fn-execution:extractIncludeProto
> Task :model:job-management:extractIncludeProto
> Task :model:fn-execution:generateProto FROM-CACHE
> Task :model:job-management:generateProto FROM-CACHE
> Task 

Build failed in Jenkins: beam_PostCommit_Python310 #1813

[Apache Jenkins Server]

See 


Changes:


--
[...truncated 12.27 MB...]
  File "apache_beam/runners/worker/operations.py", line 572, in 
apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 263, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 266, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 953, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/worker/operations.py", line 954, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/common.py", line 1437, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 1526, in 
apache_beam.runners.common.DoFnRunner._reraise_augmented
  File "apache_beam/runners/common.py", line 1435, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 636, in 
apache_beam.runners.common.SimpleInvoker.invoke_process
  File "apache_beam/runners/common.py", line 1621, in 
apache_beam.runners.common._OutputHandler.handle_process_outputs
  File "apache_beam/runners/common.py", line 1736, in 
apache_beam.runners.common._OutputHandler._write_value_to_tag
  File "apache_beam/runners/worker/operations.py", line 263, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 266, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 1351, in 
apache_beam.runners.worker.operations.FlattenOperation.process
  File "apache_beam/runners/worker/operations.py", line 1354, in 
apache_beam.runners.worker.operations.FlattenOperation.process
  File "apache_beam/runners/worker/operations.py", line 572, in 
apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 263, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 266, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 953, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/worker/operations.py", line 954, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/common.py", line 1437, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 1547, in 
apache_beam.runners.common.DoFnRunner._reraise_augmented
  File "apache_beam/runners/common.py", line 1435, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 851, in 
apache_beam.runners.common.PerWindowInvoker.invoke_process
  File "apache_beam/runners/common.py", line 995, in 
apache_beam.runners.common.PerWindowInvoker._invoke_process_per_window
  File "apache_beam/runners/common.py", line 1611, in 
apache_beam.runners.common._OutputHandler.handle_process_outputs
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/io/gcp/bigquery_file_loads.py",
 line 750, in process
job_reference = self.bq_wrapper.perform_load_job(
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/io/gcp/bigquery_tools.py",
 line 1022, in perform_load_job
return self._insert_load_job(
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/utils/retry.py",
 line 298, in wrapper
return fun(*args, **kwargs)
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/io/gcp/bigquery_tools.py",
 line 559, in _insert_load_job
return self._start_job(request, stream=source_stream).jobReference
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/io/gcp/bigquery_tools.py",
 line 578, in _start_job
response = self.client.jobs.Insert(request, upload=upload)
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/io/gcp/internal/clients/bigquery/bigquery_v2_client.py",
 line 356, in Insert
return self._RunMethod(
  File "/usr/local/lib/python3.10/site-packages/apitools/base/py/base_api.py", 
line 731, in _RunMethod
return self.ProcessHttpResponse(method_config, http_response, request)
  File "/usr/local/lib/python3.10/site-packages/apitools/base/py/base_api.py", 
line 737, in ProcessHttpResponse
self.__ProcessHttpResponse(method_config, http_response, request))
  File "/usr/local/lib/python3.10/site-packages/apitools/base/py/base_api.py", 
line 603, in 

Jenkins build is back to normal : beam_PostCommit_Python_Examples_Flink #2823

[Apache Jenkins Server]

See 



-
To unsubscribe, e-mail: builds-unsubscr...@beam.apache.org
For additional commands, e-mail: builds-h...@beam.apache.org

Jenkins build is back to normal : beam_PostCommit_Java_ValidatesRunner_Flink #12784

[Apache Jenkins Server]

See 



-
To unsubscribe, e-mail: builds-unsubscr...@beam.apache.org
For additional commands, e-mail: builds-h...@beam.apache.org

Build failed in Jenkins: beam_PostCommit_Python39 #2800

[Apache Jenkins Server]

See 


Changes:


--
[...truncated 11.72 MB...]
  seconds: 1706035138
  nanos: 662112951
}
message: "SDK Harness waiting for in-flight requests to complete"
log_location: 
"/usr/local/lib/python3.9/site-packages/apache_beam/runners/worker/sdk_worker.py:289"
thread: "MainThread"

INFO:root:severity: INFO
timestamp {
  seconds: 1706035138
  nanos: 662215471
}
message: "Closing all cached grpc data channels."
log_location: 
"/usr/local/lib/python3.9/site-packages/apache_beam/runners/worker/data_plane.py:820"
thread: "MainThread"

INFO:root:severity: INFO
timestamp {
  seconds: 1706035138
  nanos: 662307977
}
message: "Closing all cached gRPC state handlers."
log_location: 
"/usr/local/lib/python3.9/site-packages/apache_beam/runners/worker/sdk_worker.py:929"
thread: "MainThread"

INFO:root:severity: INFO
timestamp {
  seconds: 1706035138
  nanos: 662584066
}
message: "Done consuming work."
log_location: 
"/usr/local/lib/python3.9/site-packages/apache_beam/runners/worker/sdk_worker.py:301"
thread: "MainThread"

INFO:root:severity: INFO
timestamp {
  seconds: 1706035138
  nanos: 662683725
}
message: "Python sdk harness exiting."
log_location: 
"/usr/local/lib/python3.9/site-packages/apache_beam/runners/worker/sdk_worker_main.py:213"
thread: "MainThread"

c3947c3066ab8959aff1bf6908d8567c0b859a42a285bb5013f6719897d54a20
INFO:apache_beam.runners.portability.local_job_service:Completed job in 
28.019731044769287 seconds with state DONE.
INFO:root:Completed job in 28.019731044769287 seconds with state DONE.
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE

> Task :sdks:python:test-suites:portable:py39:portableWordCountSparkRunnerBatch
INFO:apache_beam.runners.worker.worker_pool_main:Listening for workers at 
localhost:34511
INFO:apache_beam.runners.portability.fn_api_runner.translations:
  
INFO:apache_beam.runners.portability.fn_api_runner.translations:
  
INFO:apache_beam.runners.portability.fn_api_runner.translations:
  
INFO:apache_beam.utils.subprocess_server:Starting service with ('java' '-jar' 
'
 '--spark-master-url' 'local[4]' '--artifacts-dir' 
'/tmp/beam-tempcawayi0i/artifactscibtmg17' '--job-port' '32905' 
'--artifact-port' '0' '--expansion-port' '0')
INFO:apache_beam.utils.subprocess_server:24/01/23 18:39:10 WARN 
software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to 
retrieve the requested metadata.
WARNING:root:Waiting for grpc channel to be ready at localhost:32905.
INFO:apache_beam.utils.subprocess_server:24/01/23 18:39:11 INFO 
org.apache.beam.runners.jobsubmission.JobServerDriver: ArtifactStagingService 
started on localhost:34513
WARNING:root:Waiting for grpc channel to be ready at localhost:32905.
INFO:apache_beam.utils.subprocess_server:24/01/23 18:39:12 INFO 
org.apache.beam.runners.jobsubmission.JobServerDriver: Java ExpansionService 
started on localhost:46507
INFO:apache_beam.utils.subprocess_server:24/01/23 18:39:12 INFO 
org.apache.beam.runners.jobsubmission.JobServerDriver: JobService started on 
localhost:32905
INFO:apache_beam.utils.subprocess_server:24/01/23 18:39:12 INFO 
org.apache.beam.runners.jobsubmission.JobServerDriver: Job server now running, 
terminate with Ctrl+C
WARNING:root:Waiting for grpc channel to be ready at localhost:32905.
WARNING:root:Waiting for grpc channel to be ready at localhost:32905.
INFO:apache_beam.utils.subprocess_server:24/01/23 18:39:15 INFO 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Staging 
artifacts for job_d5dcf937-e2e0-4dde-9979-0c5c19bea27f.
INFO:apache_beam.utils.subprocess_server:24/01/23 18:39:15 INFO 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Resolving 
artifacts for 
job_d5dcf937-e2e0-4dde-9979-0c5c19bea27f.0:ref_Environment_default_environment_1.
INFO:apache_beam.utils.subprocess_server:24/01/23 18:39:15 INFO 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Getting 1 
artifacts for job_d5dcf937-e2e0-4dde-9979-0c5c19bea27f.null.
INFO:apache_beam.utils.subprocess_server:24/01/23 18:39:15 INFO 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Artifacts 
fully staged for job_d5dcf937-e2e0-4dde-9979-0c5c19bea27f.
INFO:apache_beam.utils.subprocess_server:24/01/23 18:39:16 INFO 
org.apache.beam.runners.spark.SparkJobInvoker: Invoking job 
BeamApp-jenkins-0123183916-cd540e27_cc9952f6-b42d-4a51-9cc3-1c5008c9ab54
INFO:apache_beam.utils.subprocess_server:24/01/23 18:39:16 INFO 
org.apache.beam.runners.jobsubmission.JobInvocation: Starting job invocation 

Build failed in Jenkins: beam_PostCommit_Python311 #1150

[Apache Jenkins Server]

See 


Changes:


--
[...truncated 6.01 MB...]
message: "SDK Harness waiting for in-flight requests to complete"
log_location: 
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:289"
thread: "MainThread"

INFO:root:severity: INFO
timestamp {
  seconds: 1706032184
  nanos: 723361015
}
message: "Closing all cached grpc data channels."
log_location: 
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/data_plane.py:820"
thread: "MainThread"

INFO:root:severity: INFO
timestamp {
  seconds: 1706032184
  nanos: 723417758
}
message: "Closing all cached gRPC state handlers."
log_location: 
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:929"
thread: "MainThread"

INFO:root:severity: INFO
timestamp {
  seconds: 1706032184
  nanos: 724076271
}
message: "Done consuming work."
log_location: 
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:301"
thread: "MainThread"

INFO:root:severity: INFO
timestamp {
  seconds: 1706032184
  nanos: 724208116
}
message: "Python sdk harness exiting."
log_location: 
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker_main.py:213"
thread: "MainThread"

INFO:apache_beam.runners.portability.local_job_service:Completed job in 
40.293893337249756 seconds with state DONE.
INFO:root:Completed job in 40.293893337249756 seconds with state DONE.
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE

> Task :sdks:python:test-suites:portable:py311:portableWordCountSparkRunnerBatch
INFO:apache_beam.runners.worker.worker_pool_main:Listening for workers at 
localhost:43625
INFO:apache_beam.runners.portability.fn_api_runner.translations:
  
INFO:apache_beam.runners.portability.fn_api_runner.translations:
  
INFO:apache_beam.runners.portability.fn_api_runner.translations:
  
INFO:apache_beam.utils.subprocess_server:Starting service with ('java' '-jar' 
'
 '--spark-master-url' 'local[4]' '--artifacts-dir' 
'/tmp/beam-tempe6htak9z/artifacts4sgrwb6p' '--job-port' '51545' 
'--artifact-port' '0' '--expansion-port' '0')
INFO:apache_beam.utils.subprocess_server:24/01/23 17:50:05 WARN 
software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to 
retrieve the requested metadata.
WARNING:root:Waiting for grpc channel to be ready at localhost:51545.
INFO:apache_beam.utils.subprocess_server:24/01/23 17:50:07 INFO 
org.apache.beam.runners.jobsubmission.JobServerDriver: ArtifactStagingService 
started on localhost:43131
WARNING:root:Waiting for grpc channel to be ready at localhost:51545.
INFO:apache_beam.utils.subprocess_server:24/01/23 17:50:07 INFO 
org.apache.beam.runners.jobsubmission.JobServerDriver: Java ExpansionService 
started on localhost:34171
INFO:apache_beam.utils.subprocess_server:24/01/23 17:50:07 INFO 
org.apache.beam.runners.jobsubmission.JobServerDriver: JobService started on 
localhost:51545
INFO:apache_beam.utils.subprocess_server:24/01/23 17:50:07 INFO 
org.apache.beam.runners.jobsubmission.JobServerDriver: Job server now running, 
terminate with Ctrl+C
WARNING:root:Waiting for grpc channel to be ready at localhost:51545.
INFO:apache_beam.utils.subprocess_server:24/01/23 17:50:10 INFO 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Staging 
artifacts for job_ce83549e-ad70-4a2b-aa07-b183a7c28d2f.
INFO:apache_beam.utils.subprocess_server:24/01/23 17:50:10 INFO 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Resolving 
artifacts for 
job_ce83549e-ad70-4a2b-aa07-b183a7c28d2f.0:ref_Environment_default_environment_1.
INFO:apache_beam.utils.subprocess_server:24/01/23 17:50:10 INFO 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Getting 1 
artifacts for job_ce83549e-ad70-4a2b-aa07-b183a7c28d2f.null.
INFO:apache_beam.utils.subprocess_server:24/01/23 17:50:10 INFO 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Artifacts 
fully staged for job_ce83549e-ad70-4a2b-aa07-b183a7c28d2f.
INFO:apache_beam.utils.subprocess_server:24/01/23 17:50:11 INFO 
org.apache.beam.runners.spark.SparkJobInvoker: Invoking job 
BeamApp-jenkins-0123175011-b099a522_d4f05a58-b961-4dfb-b08a-b467e3bc4146
INFO:apache_beam.utils.subprocess_server:24/01/23 17:50:11 INFO 
org.apache.beam.runners.jobsubmission.JobInvocation: Starting job invocation 
BeamApp-jenkins-0123175011-b099a522_d4f05a58-b961-4dfb-b08a-b467e3bc4146
INFO:apache_beam.runners.portability.portable_runner:Environment "LOOPBACK" has 
started a component necessary for the execution. Be sure to run the pipeline 
using
  

Build failed in Jenkins: beam_PostCommit_Python310 #1812

[Apache Jenkins Server]

See 


Changes:

[noreply] Plumbing remaining autoscaling metrics (#30070)


--
[...truncated 12.38 MB...]
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/io/gcp/bigquery_tools.py",
 line 1022, in perform_load_job
return self._insert_load_job(
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/utils/retry.py",
 line 298, in wrapper
return fun(*args, **kwargs)
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/io/gcp/bigquery_tools.py",
 line 559, in _insert_load_job
return self._start_job(request, stream=source_stream).jobReference
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/io/gcp/bigquery_tools.py",
 line 578, in _start_job
response = self.client.jobs.Insert(request, upload=upload)
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/io/gcp/internal/clients/bigquery/bigquery_v2_client.py",
 line 356, in Insert
return self._RunMethod(
  File "/usr/local/lib/python3.10/site-packages/apitools/base/py/base_api.py", 
line 731, in _RunMethod
return self.ProcessHttpResponse(method_config, http_response, request)
  File "/usr/local/lib/python3.10/site-packages/apitools/base/py/base_api.py", 
line 737, in ProcessHttpResponse
self.__ProcessHttpResponse(method_config, http_response, request))
  File "/usr/local/lib/python3.10/site-packages/apitools/base/py/base_api.py", 
line 603, in __ProcessHttpResponse
raise exceptions.HttpError.FromResponse(
apitools.base.py.exceptions.HttpBadRequestError: HttpError accessing 
:
 response: <{'vary': 'Origin, X-Origin, Referer', 'content-type': 
'application/json; charset=UTF-8', 'date': 'Tue, 23 Jan 2024 16:59:28 GMT', 
'server': 'ESF', 'cache-control': 'private', 'x-xss-protection': '0', 
'x-frame-options': 'SAMEORIGIN', 'x-content-type-options': 'nosniff', 
'transfer-encoding': 'chunked', 'status': '400', 'content-length': '318', 
'-content-encoding': 'gzip'}>, content <{
  "error": {
"code": 400,
"message": "Load configuration must specify at least one source URI",
"errors": [
  {
"message": "Load configuration must specify at least one source URI",
"domain": "global",
"reason": "invalid"
  }
],
"status": "INVALID_ARGUMENT"
  }
}
>

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/runners/worker/sdk_worker.py",
 line 311, in _execute
response = task()
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/runners/worker/sdk_worker.py",
 line 386, in 
lambda: self.create_worker().do_instruction(request), request)
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/runners/worker/sdk_worker.py",
 line 650, in do_instruction
return getattr(self, request_type)(
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/runners/worker/sdk_worker.py",
 line 688, in process_bundle
bundle_processor.process_bundle(instruction_id))
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/runners/worker/bundle_processor.py",
 line 1113, in process_bundle
input_op_by_transform_id[element.transform_id].process_encoded(
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/runners/worker/bundle_processor.py",
 line 237, in process_encoded
self.output(decoded_value)
  File "apache_beam/runners/worker/operations.py", line 570, in 
apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 572, in 
apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 263, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 266, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 953, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/worker/operations.py", line 954, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/common.py", line 1437, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 1526, in 
apache_beam.runners.common.DoFnRunner._reraise_augmented
  File "apache_beam/runners/common.py", line 1435, in 

Build failed in Jenkins: beam_PostCommit_XVR_Direct #5089

[Apache Jenkins Server]

See 


Changes:


--
[...truncated 1.04 MB...]
  coders: <
key: "oegwhlvaUaKvCoder"
value: <
  spec: <
urn: "beam:coder:kv:v1"
  >
  component_coder_ids: "oegwhlvaUaVarIntCoder"
  component_coder_ids: "oegwhlvaUaRowCoder"
>
  >
  coders: <
key: "oegwhlvaUaKvCoder1"
value: <
  spec: <
urn: "beam:coder:kv:v1"
  >
  component_coder_ids: "oegwhlvaUaVarIntCoder"
  component_coder_ids: "oegwhlvaUaCoder1"
>
  >
  coders: <
key: "oegwhlvaUaKvCoder2"
value: <
  spec: <
urn: "beam:coder:kv:v1"
  >
  component_coder_ids: "oegwhlvaUaVarIntCoder"
  component_coder_ids: "oegwhlvaUaIterableCoder"
>
  >
  coders: <
key: "oegwhlvaUaRowCoder"
value: <
  spec: <
urn: "beam:coder:row:v1"
payload: 
"\n\r\n\007role_id\032\002\020\004\022$c3aecc09-c8cc-4be7-8b4a-680f87728385"
  >
>
  >
  coders: <
key: "oegwhlvaUaVarIntCoder"
value: <
  spec: <
urn: "beam:coders:javasdk:0.1"
payload: 
"\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\224\330\001\360<\254\355\000\005sr\000\300K2\332\251KVh\002\000\000xr\000\000\030AtomicC\001B8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000
 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
  >
>
  >
  coders: <
key: "oegwhlvaUaVoidCoder"
value: <
  spec: <
urn: "beam:coders:javasdk:0.1"
payload: 
"\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\221\326\001\350\254\355\000\005sr\000$org.apache.beam.sdk.coders.VoidCoder\271\277U\233\350\r\257U\002\000\000xr\000\000\030AtomicC\001@8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000
 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
  >
>
  >
  environments: <
key: "go"
value: <
  urn: "beam:env:docker:v1"
  payload: "\n\026apache/beam_go_sdk:dev"
  capabilities: "beam:protocol:progress_reporting:v1"
  capabilities: "beam:protocol:multi_core_bundle_processing:v1"
  capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
  capabilities: "beam:protocol:worker_status:v1"
  capabilities: "beam:protocol:monitoring_info_short_ids:v1"
  capabilities: "beam:version:sdk_base:go:apache/beam_go_sdk:2.54.0.dev"
  capabilities: "beam:transform:to_string:v1"
  capabilities: "beam:protocol:data_sampling:v1"
  capabilities: "beam:coder:bytes:v1"
  capabilities: "beam:coder:bool:v1"
  capabilities: "beam:coder:varint:v1"
  capabilities: "beam:coder:double:v1"
  capabilities: "beam:coder:string_utf8:v1"
  capabilities: "beam:coder:length_prefix:v1"
  capabilities: "beam:coder:kv:v1"
  capabilities: "beam:coder:iterable:v1"
  capabilities: "beam:coder:state_backed_iterable:v1"
  capabilities: "beam:coder:windowed_value:v1"
  capabilities: "beam:coder:global_window:v1"
  capabilities: "beam:coder:interval_window:v1"
  capabilities: "beam:coder:row:v1"
  capabilities: "beam:coder:nullable:v1"
  capabilities: "beam:coder:timer:v1"
  dependencies: <
type_urn: "beam:artifact:type:file:v1"
role_urn: "beam:artifact:role:go_worker_binary:v1"
  >
>
  >
  environments: <
key: "oegwhlvaUabeam:env:docker:v1"
value: <
  urn: "beam:env:docker:v1"
  payload: "\n apache/beam_java8_sdk:2.54.0.dev"
  capabilities: "beam:coder:bytes:v1"
  capabilities: "beam:coder:bool:v1"
  capabilities: "beam:coder:varint:v1"
  capabilities: "beam:coder:string_utf8:v1"
  capabilities: "beam:coder:iterable:v1"
  capabilities: "beam:coder:timer:v1"
  capabilities: "beam:coder:kv:v1"
  capabilities: "beam:coder:length_prefix:v1"
  capabilities: "beam:coder:global_window:v1"
  capabilities: "beam:coder:interval_window:v1"
  capabilities: "beam:coder:custom_window:v1"
  capabilities: "beam:coder:windowed_value:v1"
  capabilities: "beam:coder:double:v1"
  capabilities: "beam:coder:row:v1"
  capabilities: "beam:coder:param_windowed_value:v1"
  capabilities: "beam:coder:state_backed_iterable:v1"
  capabilities: "beam:coder:sharded_key:v1"
  capabilities: "beam:coder:nullable:v1"
  capabilities: "beam:protocol:multi_core_bundle_processing:v1"
  capabilities: "beam:protocol:progress_reporting:v1"
  capabilities: "beam:protocol:harness_monitoring_infos:v1"
  capabilities: "beam:protocol:control_request_elements_embedding:v1"
  capabilities: "beam:protocol:state_caching:v1"
  capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.54.0.dev"
  capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
  capabilities: "beam:transform:to_string:v1"
 

Build failed in Jenkins: beam_PostCommit_Python39 #2799

[Apache Jenkins Server]

See 


Changes:


--
[...truncated 12.56 MB...]
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/io/gcp/bigquery_tools.py",
 line 1022, in perform_load_job
return self._insert_load_job(
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/utils/retry.py",
 line 298, in wrapper
return fun(*args, **kwargs)
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/io/gcp/bigquery_tools.py",
 line 559, in _insert_load_job
return self._start_job(request, stream=source_stream).jobReference
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/io/gcp/bigquery_tools.py",
 line 578, in _start_job
response = self.client.jobs.Insert(request, upload=upload)
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/io/gcp/internal/clients/bigquery/bigquery_v2_client.py",
 line 356, in Insert
return self._RunMethod(
  File "/usr/local/lib/python3.9/site-packages/apitools/base/py/base_api.py", 
line 731, in _RunMethod
return self.ProcessHttpResponse(method_config, http_response, request)
  File "/usr/local/lib/python3.9/site-packages/apitools/base/py/base_api.py", 
line 737, in ProcessHttpResponse
self.__ProcessHttpResponse(method_config, http_response, request))
  File "/usr/local/lib/python3.9/site-packages/apitools/base/py/base_api.py", 
line 603, in __ProcessHttpResponse
raise exceptions.HttpError.FromResponse(
apitools.base.py.exceptions.HttpBadRequestError: HttpError accessing 
:
 response: <{'vary': 'Origin, X-Origin, Referer', 'content-type': 
'application/json; charset=UTF-8', 'date': 'Tue, 23 Jan 2024 16:03:18 GMT', 
'server': 'ESF', 'cache-control': 'private', 'x-xss-protection': '0', 
'x-frame-options': 'SAMEORIGIN', 'x-content-type-options': 'nosniff', 
'transfer-encoding': 'chunked', 'status': '400', 'content-length': '318', 
'-content-encoding': 'gzip'}>, content <{
  "error": {
"code": 400,
"message": "Load configuration must specify at least one source URI",
"errors": [
  {
"message": "Load configuration must specify at least one source URI",
"domain": "global",
"reason": "invalid"
  }
],
"status": "INVALID_ARGUMENT"
  }
}
>

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/runners/worker/sdk_worker.py",
 line 311, in _execute
response = task()
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/runners/worker/sdk_worker.py",
 line 386, in 
lambda: self.create_worker().do_instruction(request), request)
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/runners/worker/sdk_worker.py",
 line 650, in do_instruction
return getattr(self, request_type)(
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/runners/worker/sdk_worker.py",
 line 688, in process_bundle
bundle_processor.process_bundle(instruction_id))
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/runners/worker/bundle_processor.py",
 line 1113, in process_bundle
input_op_by_transform_id[element.transform_id].process_encoded(
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/runners/worker/bundle_processor.py",
 line 237, in process_encoded
self.output(decoded_value)
  File "apache_beam/runners/worker/operations.py", line 570, in 
apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 572, in 
apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 263, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 266, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 953, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/worker/operations.py", line 954, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/common.py", line 1437, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 1526, in 
apache_beam.runners.common.DoFnRunner._reraise_augmented
  File "apache_beam/runners/common.py", line 1435, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", 

Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #2822

[Apache Jenkins Server]

See 


Changes:


--
[...truncated 48.62 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory$WrappedContext.closeActual(ReferenceCountingExecutableStageContextFactory.java:217)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory$WrappedContext.access$200(ReferenceCountingExecutableStageContextFactory.java:193)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory.release(ReferenceCountingExecutableStageContextFactory.java:182)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory.scheduleRelease(ReferenceCountingExecutableStageContextFactory.java:136)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory.access$300(ReferenceCountingExecutableStageContextFactory.java:48)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory$WrappedContext.close(ReferenceCountingExecutableStageContextFactory.java:213)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.$closeResource(FlinkExecutableStageFunction.java:269)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.close(FlinkExecutableStageFunction.java:374)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.flink.api.common.functions.util.FunctionUtils.closeFunction(FunctionUtils.java:41)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.flink.runtime.operators.BatchTask.run(BatchTask.java:519)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.flink.runtime.operators.BatchTask.invoke(BatchTask.java:357)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:935)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:914)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:728)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.flink.runtime.taskmanager.Task.run(Task.java:550)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
java.lang.Thread.run(Thread.java:750)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 
INFO apache_beam.runners.worker.statecache:statecache.py:234 Creating state 
cache with size 104857600
INFO apache_beam.runners.worker.sdk_worker:sdk_worker.py:189 Creating 
insecure control channel for localhost:33237.
INFO apache_beam.runners.worker.sdk_worker:sdk_worker.py:197 Control 
channel established.
INFO apache_beam.runners.worker.sdk_worker:sdk_worker.py:247 Initializing 
SDKHarness with unbounded number of workers.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 23, 
2024 4:58:10 PM 
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService 
control
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: 
Beam Fn Control client connected with id 5-1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 23, 
2024 4:58:10 PM 
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService 
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: 
getProcessBundleDescriptor request with id 5-6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 23, 
2024 4:58:10 PM 
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService 
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: 
getProcessBundleDescriptor request with id 5-8
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 23, 
2024 4:58:10 PM 
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService 
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: 
getProcessBundleDescriptor request with id 5-7
INFO 

Build failed in Jenkins: beam_PostCommit_Java_ValidatesRunner_Flink_Java11 #5459

[Apache Jenkins Server]

See 


Changes:


--
Started by timer
Running as SYSTEM
[EnvInject] - Loading node environment variables.
Building remotely on apache-beam-jenkins-13 (beam) in workspace 
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Java_ValidatesRunner_Flink_Java11
The recommended git tool is: NONE
No credentials specified
Wiping out workspace first.
Cloning the remote Git repository
Using shallow clone with depth 1
Avoid fetching tags
Cloning repository https://github.com/apache/beam.git
 > git init 
 > /home/jenkins/jenkins-slave/workspace/beam_PostCommit_Java_ValidatesRunner_Flink_Java11/src
 >  # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
 > git --version # timeout=10
 > git --version # 'git version 2.25.1'
 > git fetch --no-tags --force --progress --depth=1 -- 
 > https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* # 
 > timeout=10
 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # 
 > timeout=10
 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Using shallow fetch with depth 1
Fetching upstream changes from https://github.com/apache/beam.git
 > git fetch --no-tags --force --progress --depth=1 -- 
 > https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* 
 > +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* # 
 > timeout=10
ERROR: Timeout after 10 minutes
FATAL: hudson.remoting.Channel$OrderlyShutdown: Command Close created at
Command Close created at
at hudson.remoting.Command.(Command.java:70)
at hudson.remoting.Channel$CloseCommand.(Channel.java:1306)
at hudson.remoting.Channel.close(Channel.java:1480)
at hudson.remoting.Channel.close(Channel.java:1447)
at hudson.remoting.Channel$CloseCommand.execute(Channel.java:1312)
at hudson.remoting.Channel$1.handle(Channel.java:606)
at 
hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:81)
Caused: hudson.remoting.Channel$OrderlyShutdown
Also:   hudson.remoting.Channel$CallSiteStackTrace: Remote call to 
apache-beam-jenkins-13
at 
hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1784)
at hudson.remoting.Request.call(Request.java:199)
at hudson.remoting.Channel.call(Channel.java:999)
at 
org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:143)
at 
jdk.internal.reflect.GeneratedMethodAccessor884.invoke(Unknown Source)
at 
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at 
org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:129)
at com.sun.proxy.$Proxy179.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:1001)
at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1245)
at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1309)
at hudson.scm.SCM.checkout(SCM.java:540)
at 
hudson.model.AbstractProject.checkout(AbstractProject.java:1240)
at 
hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:649)
at 
jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:85)
at 
hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:521)
at hudson.model.Run.execute(Run.java:1900)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:44)
at 
hudson.model.ResourceController.execute(ResourceController.java:101)
at hudson.model.Executor.run(Executor.java:442)
Caused: hudson.remoting.RequestAbortedException
at hudson.remoting.Request.abort(Request.java:346)
at hudson.remoting.Channel.terminate(Channel.java:1080)
at hudson.remoting.Channel$CloseCommand.execute(Channel.java:1313)
at hudson.remoting.Channel$1.handle(Channel.java:606)
at 
hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:81)
ERROR: apache-beam-jenkins-13 is offline; cannot locate jdk_1.8_latest

-
To unsubscribe, e-mail: builds-unsubscr...@beam.apache.org
For additional commands, e-mail: builds-h...@beam.apache.org

Build failed in Jenkins: beam_PostRelease_NightlySnapshot #2366

[Apache Jenkins Server]

See 


Changes:


--
[...truncated 3.99 MB...]
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
Jan 23, 2024 5:08:53 PM 
org.apache.beam.sdk.extensions.gcp.util.RetryHttpRequestInitializer$LoggingHttpBackOffHandler
 handleIOException
WARNING: Request failed with IOException, performed 10 retries due to 
IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP 
framework says request cannot be retried, (caller responsible for retrying): 
https://dataflow.googleapis.com/v1b3/projects/apache-beam-testing/locations/us-central1/jobs/2024-01-23_08_52_58-742445148299835/messages
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
DELAY(342331, 1)
I'm falling behind!
.{timestamp_ms=1706029428000}
late data for: 
user12_ArmyGreenKookaburra,ArmyGreenKookaburra,18,1706029428000,2024-01-23 
09:09:31.118
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: 

Build failed in Jenkins: beam_PostCommit_Python38 #5079

[Apache Jenkins Server]

See 


Changes:


--
[...truncated 11.00 MB...]
  File "/usr/lib/python3.8/threading.py", line 890, in _bootstrap
self._bootstrap_inner()
  File "/usr/lib/python3.8/threading.py", line 932, in _bootstrap_inner
self.run()
  File 
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python38/src/sdks/python/apache_beam/utils/thread_pool_executor.py",
 line 57, in run
self._wake_semaphore.acquire()
  File "/usr/lib/python3.8/threading.py", line 433, in acquire
self._cond.wait(timeout)
  File "/usr/lib/python3.8/threading.py", line 302, in wait
waiter.acquire()

 Stack of Thread-1224 (140002679846656) 
  File "/usr/lib/python3.8/threading.py", line 890, in _bootstrap
self._bootstrap_inner()
  File "/usr/lib/python3.8/threading.py", line 932, in _bootstrap_inner
self.run()
  File 
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python38/src/sdks/python/apache_beam/utils/thread_pool_executor.py",
 line 57, in run
self._wake_semaphore.acquire()
  File "/usr/lib/python3.8/threading.py", line 433, in acquire
self._cond.wait(timeout)
  File "/usr/lib/python3.8/threading.py", line 302, in wait
waiter.acquire()

 Stack of Thread-1204 (140008996460288) 
  File "/usr/lib/python3.8/threading.py", line 890, in _bootstrap
self._bootstrap_inner()
  File "/usr/lib/python3.8/threading.py", line 932, in _bootstrap_inner
self.run()
  File "/usr/lib/python3.8/threading.py", line 870, in run
self._target(*self._args, **self._kwargs)
  File 
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python38/src/sdks/python/apache_beam/utils/subprocess_server.py",
 line 214, in log_stdout
line = process.stdout.readline()

 Stack of Thread-1191 (140006832187136) 
  File "/usr/lib/python3.8/threading.py", line 890, in _bootstrap
self._bootstrap_inner()
  File "/usr/lib/python3.8/threading.py", line 932, in _bootstrap_inner
self.run()
  File 
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python38/src/sdks/python/apache_beam/utils/thread_pool_executor.py",
 line 57, in run
self._wake_semaphore.acquire()
  File "/usr/lib/python3.8/threading.py", line 433, in acquire
self._cond.wait(timeout)
  File "/usr/lib/python3.8/threading.py", line 302, in wait
waiter.acquire()

 Stack of Thread-1189 (140007897536256) 
  File "/usr/lib/python3.8/threading.py", line 890, in _bootstrap
self._bootstrap_inner()
  File "/usr/lib/python3.8/threading.py", line 932, in _bootstrap_inner
self.run()
  File 
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python38/src/sdks/python/apache_beam/utils/thread_pool_executor.py",
 line 57, in run
self._wake_semaphore.acquire()
  File "/usr/lib/python3.8/threading.py", line 433, in acquire
self._cond.wait(timeout)
  File "/usr/lib/python3.8/threading.py", line 302, in wait
waiter.acquire()

 Stack of Thread-1167 (140008971278080) 
  File "/usr/lib/python3.8/threading.py", line 890, in _bootstrap
self._bootstrap_inner()
  File "/usr/lib/python3.8/threading.py", line 932, in _bootstrap_inner
self.run()
  File "/usr/lib/python3.8/threading.py", line 870, in run
self._target(*self._args, **self._kwargs)
  File 
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python38/src/sdks/python/apache_beam/utils/subprocess_server.py",
 line 214, in log_stdout
line = process.stdout.readline()

 Stack of Thread-1152 (140007411021568) 
  File "/usr/lib/python3.8/threading.py", line 890, in _bootstrap
self._bootstrap_inner()
  File "/usr/lib/python3.8/threading.py", line 932, in _bootstrap_inner
self.run()
  File 
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python38/src/sdks/python/apache_beam/utils/thread_pool_executor.py",
 line 57, in run
self._wake_semaphore.acquire()
  File "/usr/lib/python3.8/threading.py", line 433, in acquire
self._cond.wait(timeout)
  File "/usr/lib/python3.8/threading.py", line 302, in wait
waiter.acquire()

 Stack of Thread-1132 (140008988067584) 
  File "/usr/lib/python3.8/threading.py", line 890, in _bootstrap
self._bootstrap_inner()
  File "/usr/lib/python3.8/threading.py", line 932, in _bootstrap_inner
self.run()
  File "/usr/lib/python3.8/threading.py", line 870, in run
self._target(*self._args, **self._kwargs)
  File 
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python38/src/sdks/python/apache_beam/utils/subprocess_server.py",
 line 214, in log_stdout
line = process.stdout.readline()

 Stack of Thread-1123 (140011135547136) 
  File "/usr/lib/python3.8/threading.py", line 890, in 

Build failed in Jenkins: beam_PostCommit_XVR_Direct #5088

[Apache Jenkins Server]

See 


Changes:


--
[...truncated 1.67 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:spanner_insert:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@61d6015a
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:spanner_update:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2525ff7e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:spanner_replace:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@524d6d96
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:spanner_insert_or_update:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@152aa092
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:spanner_delete:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@44a7bfbc
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:spanner_read:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4ef37659
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:kafka_read_with_metadata:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@776b83cc
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:kafka_read_without_metadata:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@37858383
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:kafka_write:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e268090
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:external:java:generate_sequence:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1bb266b3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:bigquery_read:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@306cf3ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:bigquery_write:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2beee7ff
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:pubsub_read:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5136d012
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:pubsub_write:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5939a379
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:pubsub_write:v2: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@e1de817
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:combine_globally:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@52102734
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:combine_grouped_values:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3541cb24
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:combine_per_key:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2177849e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:create_view:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@40cb8df7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:flatten:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@13b13b5d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:group_by_key:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2892dae4
INFO 

Build failed in Jenkins: beam_PostCommit_Python311 #1149

[Apache Jenkins Server]

See 


Changes:

[noreply] Plumbing remaining autoscaling metrics (#30070)


--
[...truncated 12.16 MB...]
INFO:apache_beam.runners.worker.sdk_worker:State channel established.
INFO:apache_beam.runners.worker.data_plane:Creating client data channel for 
localhost:41757
INFO:apache_beam.utils.subprocess_server:24/01/23 16:17:13 INFO 
org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client 
connected.
INFO:apache_beam.utils.subprocess_server:24/01/23 16:17:13 INFO 
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: 
getProcessBundleDescriptor request with id 1-3
INFO:apache_beam.utils.subprocess_server:24/01/23 16:17:14 INFO 
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: 
getProcessBundleDescriptor request with id 1-4
INFO:apache_beam.utils.subprocess_server:24/01/23 16:17:14 INFO 
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: 
getProcessBundleDescriptor request with id 1-5
INFO:apache_beam.utils.subprocess_server:24/01/23 16:17:14 INFO 
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: 
getProcessBundleDescriptor request with id 1-8
INFO:apache_beam.utils.subprocess_server:24/01/23 16:17:14 INFO 
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: 
getProcessBundleDescriptor request with id 1-6
INFO:apache_beam.utils.subprocess_server:24/01/23 16:17:14 INFO 
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: 
getProcessBundleDescriptor request with id 1-7
INFO:apache_beam.utils.subprocess_server:24/01/23 16:17:14 INFO 
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: 
getProcessBundleDescriptor request with id 1-9
INFO:apache_beam.utils.subprocess_server:24/01/23 16:17:14 INFO 
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: 
getProcessBundleDescriptor request with id 1-10
INFO:apache_beam.utils.subprocess_server:24/01/23 16:17:14 INFO 
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: 
getProcessBundleDescriptor request with id 1-11
INFO:apache_beam.utils.subprocess_server:24/01/23 16:17:14 INFO 
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: 
getProcessBundleDescriptor request with id 1-13
INFO:apache_beam.utils.subprocess_server:24/01/23 16:17:14 INFO 
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: 
getProcessBundleDescriptor request with id 1-12
INFO:apache_beam.utils.subprocess_server:24/01/23 16:17:14 INFO 
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: 
getProcessBundleDescriptor request with id 1-14
INFO:apache_beam.utils.subprocess_server:24/01/23 16:17:14 INFO 
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: 
getProcessBundleDescriptor request with id 1-15
INFO:apache_beam.utils.subprocess_server:24/01/23 16:17:15 INFO 
org.apache.beam.runners.spark.SparkPipelineRunner: Job 
BeamApp-jenkins-0123161709-3b1576c_f545f3bf-9a58-4e10-bcc1-4f6047ab7abd: 
Pipeline translated successfully. Computing outputs
INFO:apache_beam.utils.subprocess_server:24/01/23 16:17:15 INFO 
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: 
getProcessBundleDescriptor request with id 1-16
INFO:apache_beam.io.filebasedsink:Starting finalize_write threads with 
num_shards: 4 (skipped: 0), batches: 4, num_threads: 4
INFO:apache_beam.io.filebasedsink:Renamed 4 shards in 0.01 seconds.
INFO:apache_beam.utils.subprocess_server:24/01/23 16:17:15 INFO 
org.apache.beam.runners.spark.SparkPipelineRunner: Job 
BeamApp-jenkins-0123161709-3b1576c_f545f3bf-9a58-4e10-bcc1-4f6047ab7abd 
finished.
INFO:apache_beam.utils.subprocess_server:24/01/23 16:17:15 INFO 
org.sparkproject.jetty.server.AbstractConnector: Stopped 
Spark@1a2f9fe5{HTTP/1.1, (http/1.1)}{127.0.0.1:4040}
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE
Exception in thread read_state:
Traceback (most recent call last):
  File "/usr/lib/python3.11/threading.py", line 1038, in _bootstrap_inner
Exception in thread run_worker_1-1:
Traceback (most recent call last):
  File "/usr/lib/python3.11/threading.py", line 1038, in _bootstrap_inner
self.run()
  File "/usr/lib/python3.11/threading.py", line 975, in run
self.run()
self._target(*self._args, **self._kwargs)
  File "/usr/lib/python3.11/threading.py", line 975, in run
  File 
"
 line 1060, in pull_responses
ERROR:apache_beam.runners.worker.data_plane:Failed to read inputs in the data 
plane.
Traceback (most recent call last):
  File 
"
 line 

Build failed in Jenkins: beam_PostCommit_Java_ValidatesRunner_Flink #12783

[Apache Jenkins Server]

See 


Changes:

[noreply] Plumbing remaining autoscaling metrics (#30070)


--
Started by timer
Started by timer
Running as SYSTEM
[EnvInject] - Loading node environment variables.
Building remotely on apache-beam-jenkins-13 (beam) in workspace 

The recommended git tool is: NONE
No credentials specified
Wiping out workspace first.
Cloning the remote Git repository
Using shallow clone with depth 1
Avoid fetching tags
Cloning repository https://github.com/apache/beam.git
 > git init 
 > 
 >  # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
 > git --version # timeout=10
 > git --version # 'git version 2.25.1'
 > git fetch --no-tags --force --progress --depth=1 -- 
 > https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* # 
 > timeout=10
 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # 
 > timeout=10
 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Using shallow fetch with depth 1
Fetching upstream changes from https://github.com/apache/beam.git
 > git fetch --no-tags --force --progress --depth=1 -- 
 > https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* 
 > +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* # 
 > timeout=10
 > git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 0a813b996572191bc179c724d3f31d535eb45e7d (origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 0a813b996572191bc179c724d3f31d535eb45e7d # timeout=10
Commit message: "Plumbing remaining autoscaling metrics (#30070)"
 > git rev-list --no-walk 821a1694c5c0910f3f4df79d52fa482499fb6667 # timeout=10
No emails were triggered.
[EnvInject] - Executing scripts and injecting environment variables after the 
SCM step.
[EnvInject] - Injecting as environment variables the properties content 
SETUPTOOLS_USE_DISTUTILS=stdlib
SPARK_LOCAL_IP=127.0.0.1

[EnvInject] - Variables injected successfully.
[Gradle] - Launching build.
[src] $ 

 --continue --max-workers=8 -Dorg.gradle.jvmargs=-Xms2g 
-Dorg.gradle.jvmargs=-Xmx6g -Dorg.gradle.vfs.watch=false -Pdocker-pull-licenses 
:runners:flink:1.15:validatesRunner
To honour the JVM settings for this build a single-use Daemon process will be 
forked. For more on this, please refer to 
https://docs.gradle.org/8.4/userguide/gradle_daemon.html#sec:disabling_the_daemon
 in the Gradle documentation.
Daemon will be stopped at the end of the build 
Configuration on demand is an incubating feature.
Gradle Enterprise plugins resolution: https://plugins.gradle.org/m2
Enforcing Gradle Enterprise: https://ge.apache.org, allowUntrustedServer: false
> Task :buildSrc:compileJava NO-SOURCE
> Task :buildSrc:compileGroovy FROM-CACHE
> Task :buildSrc:pluginDescriptors
> Task :buildSrc:processResources
> Task :buildSrc:classes
> Task :buildSrc:jar
> Task :model:fn-execution:createCheckerFrameworkManifest
> Task :model:job-management:createCheckerFrameworkManifest
> Task :runners:core-construction-java:createCheckerFrameworkManifest
> Task :model:fn-execution:extractProto
> Task :sdks:java:core:createCheckerFrameworkManifest
> Task :sdks:java:fn-execution:createCheckerFrameworkManifest
> Task :sdks:java:transform-service:launcher:createCheckerFrameworkManifest
> Task :model:pipeline:createCheckerFrameworkManifest
> Task :sdks:java:extensions:avro:createCheckerFrameworkManifest
> Task :sdks:java:extensions:avro:generateAvroProtocol NO-SOURCE
> Task :sdks:java:fn-execution:processResources NO-SOURCE
> Task :runners:core-construction-java:processResources NO-SOURCE
> Task :sdks:java:extensions:avro:generateAvroJava NO-SOURCE
> Task :sdks:java:extensions:avro:processResources NO-SOURCE
> Task :model:job-management:extractProto
> Task :runners:java-fn-execution:createCheckerFrameworkManifest
> Task :sdks:java:harness:createCheckerFrameworkManifest
> Task :runners:core-java:createCheckerFrameworkManifest
> Task :runners:core-java:processResources NO-SOURCE
> Task :runners:java-fn-execution:processResources NO-SOURCE
> Task :sdks:java:harness:processResources NO-SOURCE
> Task :sdks:java:core:generateGrammarSource FROM-CACHE
> Task :model:job-management:processResources
> Task :runners:java-job-service:createCheckerFrameworkManifest
> Task :runners:java-job-service:processResources NO-SOURCE
> Task :model:fn-execution:processResources
> Task :sdks:java:expansion-service:createCheckerFrameworkManifest
> Task :sdks:java:expansion-service:processResources NO-SOURCE
> Task 

Build failed in Jenkins: beam_PostCommit_Java_ValidatesRunner_Flink_Java11 #5458

[Apache Jenkins Server]

See 


Changes:


--
[...truncated 3.24 KB...]
Enforcing Gradle Enterprise: https://ge.apache.org, allowUntrustedServer: false
> Task :buildSrc:compileJava NO-SOURCE
> Task :buildSrc:compileGroovy FROM-CACHE
> Task :buildSrc:pluginDescriptors
> Task :buildSrc:processResources
> Task :buildSrc:classes
> Task :buildSrc:jar
> Task :sdks:java:fn-execution:createCheckerFrameworkManifest
> Task :sdks:java:extensions:avro:createCheckerFrameworkManifest
> Task :runners:core-construction-java:createCheckerFrameworkManifest
> Task 
> :sdks:java:extensions:google-cloud-platform-core:createCheckerFrameworkManifest
> Task :sdks:java:transform-service:launcher:createCheckerFrameworkManifest
> Task :sdks:java:extensions:avro:generateAvroProtocol NO-SOURCE
> Task :sdks:java:expansion-service:createCheckerFrameworkManifest
> Task :runners:core-construction-java:processResources NO-SOURCE
> Task :sdks:java:extensions:google-cloud-platform-core:processResources 
> NO-SOURCE
> Task :sdks:java:fn-execution:processResources NO-SOURCE
> Task :runners:java-fn-execution:createCheckerFrameworkManifest
> Task :sdks:java:extensions:avro:generateAvroJava NO-SOURCE
> Task :sdks:java:expansion-service:processResources NO-SOURCE
> Task :model:job-management:createCheckerFrameworkManifest
> Task :runners:java-job-service:createCheckerFrameworkManifest
> Task :model:pipeline:createCheckerFrameworkManifest
> Task :model:fn-execution:createCheckerFrameworkManifest
> Task :runners:core-java:createCheckerFrameworkManifest
> Task :sdks:java:extensions:avro:processResources NO-SOURCE
> Task :sdks:java:core:createCheckerFrameworkManifest
> Task :runners:java-fn-execution:processResources NO-SOURCE
> Task :runners:core-java:processResources NO-SOURCE
> Task :runners:java-job-service:processResources NO-SOURCE
> Task :sdks:java:build-tools:createCheckerFrameworkManifest
> Task :sdks:java:harness:createCheckerFrameworkManifest
> Task :runners:core-java:processTestResources NO-SOURCE
> Task :sdks:java:harness:processResources NO-SOURCE
> Task :runners:flink:1.15:copySourceOverrides
> Task :model:job-management:extractProto
> Task :sdks:java:io:google-cloud-platform:createCheckerFrameworkManifest
> Task :sdks:java:extensions:arrow:createCheckerFrameworkManifest
> Task :model:fn-execution:extractProto
> Task :sdks:java:extensions:protobuf:createCheckerFrameworkManifest
> Task :sdks:java:io:google-cloud-platform:processResources NO-SOURCE
> Task :sdks:java:extensions:arrow:processResources NO-SOURCE
> Task :runners:flink:1.15:createCheckerFrameworkManifest
> Task :runners:flink:1.15:copyResourcesOverrides NO-SOURCE
> Task :sdks:java:extensions:protobuf:extractProto
> Task :sdks:java:extensions:protobuf:processResources NO-SOURCE
> Task :model:job-management:processResources
> Task :runners:flink:1.15:processResources
> Task :model:fn-execution:processResources
> Task :runners:flink:1.15:copyTestSourceOverrides
> Task :runners:flink:1.15:copyTestResourcesOverrides NO-SOURCE
> Task :runners:flink:1.15:processTestResources
> Task :sdks:java:core:generateGrammarSource FROM-CACHE
> Task :sdks:java:core:processResources
> Task :sdks:java:core:generateTestGrammarSource NO-SOURCE
> Task :sdks:java:core:processTestResources
> Task :sdks:java:build-tools:compileJava FROM-CACHE
> Task :sdks:java:transform-service:launcher:compileJava FROM-CACHE
> Task :sdks:java:build-tools:processResources
> Task :sdks:java:build-tools:classes
> Task :sdks:java:transform-service:launcher:processResources
> Task :sdks:java:transform-service:launcher:classes
> Task :sdks:java:transform-service:launcher:jar
> Task :sdks:java:build-tools:jar
> Task :sdks:java:transform-service:launcher:shadowJar FROM-CACHE
> Task :model:pipeline:extractIncludeProto
> Task :model:pipeline:extractProto
> Task :model:pipeline:generateProto FROM-CACHE
> Task :model:pipeline:compileJava FROM-CACHE
> Task :model:pipeline:processResources
> Task :model:pipeline:classes
> Task :model:pipeline:jar
> Task :model:fn-execution:extractIncludeProto
> Task :model:job-management:extractIncludeProto
> Task :model:pipeline:shadowJar FROM-CACHE
> Task :model:job-management:generateProto FROM-CACHE
> Task :model:fn-execution:generateProto FROM-CACHE
> Task :model:job-management:compileJava FROM-CACHE
> Task :model:job-management:classes
> Task :model:fn-execution:compileJava FROM-CACHE
> Task :model:fn-execution:classes
> Task :model:job-management:shadowJar FROM-CACHE
> Task :model:fn-execution:shadowJar FROM-CACHE
> Task :sdks:java:core:compileJava FROM-CACHE
> Task :sdks:java:core:classes
> Task :sdks:java:core:shadowJar FROM-CACHE
> Task :sdks:java:fn-execution:compileJava FROM-CACHE
> Task :sdks:java:fn-execution:classes UP-TO-DATE
> Task :sdks:java:fn-execution:jar
> Task :sdks:java:extensions:avro:compileJava FROM-CACHE
> Task :sdks:java:extensions:avro:classes 

Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #2616

[Apache Jenkins Server]

See 


Changes:


--
[...truncated 1.25 MB...]
  "use_unified_worker",
  "use_portable_job_submission"
],
"pipelineUrl": 
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test3389/go-2-1706020801855234081/model",
"region": "us-central1",
"tempLocation": 
"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test3389"
  },
  "beam:option:go_options:v1": {
"options": {
  "bq_dataset": "apache-beam-testing.beam_bigquery_io_test_temp",
  "bt_instance": "projects/apache-beam-testing/instances/beam-test",
  "expansion_addr": "[test:localhost:38711]",
  "expansion_jar": 
"[io:
 
schemaio:
 
debeziumio:
 
gcpio:
  "experiments": 
"beam_fn_api,use_runner_v2,use_unified_worker,use_portable_job_submission",
  "hookOrder": "[\"default_remote_logging\"]",
  "hooks": "{\"default_remote_logging\":null}",
  "kafka_jar": 
"
  "sdk_harness_container_image_override": 
"[.*java.*,us.gcr.io/apache-beam-testing/java-postcommit-it/java:20240123142252]",
  "temp_location": 
"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test3389",
  "test.paniconexit0": "true",
  "test.timeout": "3h0m0s",
  "test.v": "true"
}
  }
},
"tempStoragePrefix": 
"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test3389",
"userAgent": {
  "name": "Apache Beam SDK for Go",
  "version": "2.54.0.dev"
},
"version": {
  "job_type": "FNAPI_BATCH",
  "major": "6"
},
"workerPools": [
  {
"autoscalingSettings": {},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 1,
"packages": [
  {
"location": 
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test3389/go-2-1706020801855234081/worker",
"name": "worker"
  },
  {
"location": 
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test3389/go-2-1706020801855234081/xlang/beam-sdks-java-io-google-cloud-platform-expansion-service-2.54.0-SNAPSHOT-Arr_yE72yoU8KfkB9phdSoAZkauDNartFzWD8VNbzZY.jar",
"name": 
"beam-sdks-java-io-google-cloud-platform-expansion-service-2.54.0-SNAPSHOT-Arr_yE72yoU8KfkB9phdSoAZkauDNartFzWD8VNbzZY.jar"
  }
],
"sdkHarnessContainerImages": [
  {
"capabilities": [
  "beam:protocol:progress_reporting:v1",
  "beam:protocol:multi_core_bundle_processing:v1",
  "beam:transform:sdf_truncate_sized_restrictions:v1",
  "beam:protocol:worker_status:v1",
  "beam:protocol:monitoring_info_short_ids:v1",
  "beam:version:sdk_base:go:apache/beam_go_sdk:2.54.0.dev",
  "beam:transform:to_string:v1",
  "beam:protocol:data_sampling:v1",
  "beam:coder:bytes:v1",
  "beam:coder:bool:v1",
  "beam:coder:varint:v1",
  "beam:coder:double:v1",
  "beam:coder:string_utf8:v1",
  "beam:coder:length_prefix:v1",
  "beam:coder:kv:v1",
  "beam:coder:iterable:v1",
  "beam:coder:state_backed_iterable:v1",
  "beam:coder:windowed_value:v1",
  "beam:coder:global_window:v1",
  "beam:coder:interval_window:v1",
  "beam:coder:row:v1",
  "beam:coder:nullable:v1",
  "beam:coder:timer:v1"
],
"containerImage": 
"us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20240123-143422",
"environmentId": "go"
  },
  {
"capabilities": [
  "beam:coder:bytes:v1",
  

Build failed in Jenkins: beam_PostCommit_Python38 #5078

[Apache Jenkins Server]

See 


Changes:


--
[...truncated 9.61 MB...]
"code": 400,
"message": "Load configuration must specify at least one source URI",
"errors": [
  {
"message": "Load configuration must specify at least one source URI",
"domain": "global",
"reason": "invalid"
  }
],
"status": "INVALID_ARGUMENT"
  }
}
>

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py",
 line 311, in _execute
response = task()
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py",
 line 386, in 
lambda: self.create_worker().do_instruction(request), request)
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py",
 line 650, in do_instruction
return getattr(self, request_type)(
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py",
 line 688, in process_bundle
bundle_processor.process_bundle(instruction_id))
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py",
 line 1113, in process_bundle
input_op_by_transform_id[element.transform_id].process_encoded(
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py",
 line 237, in process_encoded
self.output(decoded_value)
  File "apache_beam/runners/worker/operations.py", line 570, in 
apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 572, in 
apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 263, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 266, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 953, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/worker/operations.py", line 954, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/common.py", line 1437, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 1526, in 
apache_beam.runners.common.DoFnRunner._reraise_augmented
  File "apache_beam/runners/common.py", line 1435, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 636, in 
apache_beam.runners.common.SimpleInvoker.invoke_process
  File "apache_beam/runners/common.py", line 1621, in 
apache_beam.runners.common._OutputHandler.handle_process_outputs
  File "apache_beam/runners/common.py", line 1736, in 
apache_beam.runners.common._OutputHandler._write_value_to_tag
  File "apache_beam/runners/worker/operations.py", line 263, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 266, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 1351, in 
apache_beam.runners.worker.operations.FlattenOperation.process
  File "apache_beam/runners/worker/operations.py", line 1354, in 
apache_beam.runners.worker.operations.FlattenOperation.process
  File "apache_beam/runners/worker/operations.py", line 572, in 
apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 263, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 266, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 953, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/worker/operations.py", line 954, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/common.py", line 1437, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 1547, in 
apache_beam.runners.common.DoFnRunner._reraise_augmented
  File "apache_beam/runners/common.py", line 1435, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 851, in 
apache_beam.runners.common.PerWindowInvoker.invoke_process
  File "apache_beam/runners/common.py", line 995, in 
apache_beam.runners.common.PerWindowInvoker._invoke_process_per_window
  File "apache_beam/runners/common.py", line 1611, in 

Jenkins build is back to normal : beam_PostCommit_Java_InfluxDbIO_IT #1526

[Apache Jenkins Server]

See 



-
To unsubscribe, e-mail: builds-unsubscr...@beam.apache.org
For additional commands, e-mail: builds-h...@beam.apache.org

Build failed in Jenkins: beam_PostCommit_XVR_Direct #5087

[Apache Jenkins Server]

See 


Changes:


--
[...truncated 1.73 MB...]
E File 
"
 line 1376, in process_elements
E   if input_watermark > window.end + self.allowed_lateness:
E   AttributeError: 'bytes' object has no attribute 'end'

apache_beam/runners/portability/portable_runner.py:576: RuntimeError
-- Captured log call ---
INFO apache_beam.utils.subprocess_server:subprocess_server.py:339 Using 
pre-built snapshot at 

INFO root:external.py:1017 Starting a JAR-based expansion service from JAR 

 
INFO apache_beam.utils.subprocess_server:subprocess_server.py:203 Starting 
service with ['java' '-jar' 
'
 '54769' 
'--filesToStage=
 '--alsoStartLoopbackWorker']
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Starting 
expansion service at localhost:54769
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 23, 
2024 11:27:23 AM org.apache.beam.sdk.expansion.service.ExpansionService 
loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: 
Registering external transforms: [beam:external:java:sql:v1, 
beam:transform:org.apache.beam:pubsub_read:v1, 
beam:transform:org.apache.beam:pubsub_write:v1, 
beam:transform:org.apache.beam:pubsublite_write:v1, 
beam:transform:org.apache.beam:pubsublite_read:v1, 
beam:transform:org.apache.beam:spanner_insert:v1, 
beam:transform:org.apache.beam:spanner_update:v1, 
beam:transform:org.apache.beam:spanner_replace:v1, 
beam:transform:org.apache.beam:spanner_insert_or_update:v1, 
beam:transform:org.apache.beam:spanner_delete:v1, 
beam:transform:org.apache.beam:spanner_read:v1, 
beam:transform:org.apache.beam:kafka_read_with_metadata:v1, 
beam:transform:org.apache.beam:kafka_read_without_metadata:v1, 
beam:transform:org.apache.beam:kafka_write:v1, 
beam:external:java:generate_sequence:v1, 
beam:transform:org.apache.beam:bigquery_read:v1, 
beam:transform:org.apache.beam:bigquery_write:v1, 
beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, 
beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, 
beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, 
beam:transform:create_view:v1, beam:transform:flatten:v1, 
beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, 
beam:transform:group_into_batches_with_sharded_key:v1, 
beam:transform:impulse:v1, beam:transform:reshuffle:v1, 
beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, 
beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 
Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:external:java:sql:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6c779568
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:pubsub_read:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@f381794
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:pubsub_write:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2cdd0d4b
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:pubsublite_write:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7e9131d5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:pubsublite_read:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2e1d27ba
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:spanner_insert:v1: 

Build failed in Jenkins: beam_PostCommit_Python310 #1811

[Apache Jenkins Server]

See 


Changes:


--
[...truncated 11.83 MB...]
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/io/gcp/bigquery_tools.py",
 line 1022, in perform_load_job
return self._insert_load_job(
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/utils/retry.py",
 line 298, in wrapper
return fun(*args, **kwargs)
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/io/gcp/bigquery_tools.py",
 line 559, in _insert_load_job
return self._start_job(request, stream=source_stream).jobReference
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/io/gcp/bigquery_tools.py",
 line 578, in _start_job
response = self.client.jobs.Insert(request, upload=upload)
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/io/gcp/internal/clients/bigquery/bigquery_v2_client.py",
 line 356, in Insert
return self._RunMethod(
  File "/usr/local/lib/python3.10/site-packages/apitools/base/py/base_api.py", 
line 731, in _RunMethod
return self.ProcessHttpResponse(method_config, http_response, request)
  File "/usr/local/lib/python3.10/site-packages/apitools/base/py/base_api.py", 
line 737, in ProcessHttpResponse
self.__ProcessHttpResponse(method_config, http_response, request))
  File "/usr/local/lib/python3.10/site-packages/apitools/base/py/base_api.py", 
line 603, in __ProcessHttpResponse
raise exceptions.HttpError.FromResponse(
apitools.base.py.exceptions.HttpBadRequestError: HttpError accessing 
:
 response: <{'vary': 'Origin, X-Origin, Referer', 'content-type': 
'application/json; charset=UTF-8', 'date': 'Tue, 23 Jan 2024 09:24:38 GMT', 
'server': 'ESF', 'cache-control': 'private', 'x-xss-protection': '0', 
'x-frame-options': 'SAMEORIGIN', 'x-content-type-options': 'nosniff', 
'transfer-encoding': 'chunked', 'status': '400', 'content-length': '318', 
'-content-encoding': 'gzip'}>, content <{
  "error": {
"code": 400,
"message": "Load configuration must specify at least one source URI",
"errors": [
  {
"message": "Load configuration must specify at least one source URI",
"domain": "global",
"reason": "invalid"
  }
],
"status": "INVALID_ARGUMENT"
  }
}
>

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/runners/worker/sdk_worker.py",
 line 311, in _execute
response = task()
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/runners/worker/sdk_worker.py",
 line 386, in 
lambda: self.create_worker().do_instruction(request), request)
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/runners/worker/sdk_worker.py",
 line 650, in do_instruction
return getattr(self, request_type)(
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/runners/worker/sdk_worker.py",
 line 688, in process_bundle
bundle_processor.process_bundle(instruction_id))
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/runners/worker/bundle_processor.py",
 line 1113, in process_bundle
input_op_by_transform_id[element.transform_id].process_encoded(
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/runners/worker/bundle_processor.py",
 line 237, in process_encoded
self.output(decoded_value)
  File "apache_beam/runners/worker/operations.py", line 570, in 
apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 572, in 
apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 263, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 266, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 953, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/worker/operations.py", line 954, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/common.py", line 1437, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 1526, in 
apache_beam.runners.common.DoFnRunner._reraise_augmented
  File "apache_beam/runners/common.py", line 1435, in 
apache_beam.runners.common.DoFnRunner.process
  File 

Build failed in Jenkins: beam_PostCommit_Python311 #1148

[Apache Jenkins Server]

See 


Changes:

[noreply] Fix Cassandra Test (#30075)


--
[...truncated 12.16 MB...]
  File "apache_beam/runners/common.py", line 1437, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 1547, in 
apache_beam.runners.common.DoFnRunner._reraise_augmented
  File "apache_beam/runners/common.py", line 1435, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 851, in 
apache_beam.runners.common.PerWindowInvoker.invoke_process
  File "apache_beam/runners/common.py", line 995, in 
apache_beam.runners.common.PerWindowInvoker._invoke_process_per_window
  File "apache_beam/runners/common.py", line 1611, in 
apache_beam.runners.common._OutputHandler.handle_process_outputs
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.11/site-packages/apache_beam/io/gcp/bigquery_file_loads.py",
 line 750, in process
job_reference = self.bq_wrapper.perform_load_job(
^
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.11/site-packages/apache_beam/io/gcp/bigquery_tools.py",
 line 1022, in perform_load_job
return self._insert_load_job(
   ^^
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.11/site-packages/apache_beam/utils/retry.py",
 line 298, in wrapper
return fun(*args, **kwargs)
   
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.11/site-packages/apache_beam/io/gcp/bigquery_tools.py",
 line 559, in _insert_load_job
return self._start_job(request, stream=source_stream).jobReference
   ^^
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.11/site-packages/apache_beam/io/gcp/bigquery_tools.py",
 line 578, in _start_job
response = self.client.jobs.Insert(request, upload=upload)
   ^^^
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.11/site-packages/apache_beam/io/gcp/internal/clients/bigquery/bigquery_v2_client.py",
 line 356, in Insert
return self._RunMethod(
   
  File "/usr/local/lib/python3.11/site-packages/apitools/base/py/base_api.py", 
line 731, in _RunMethod
return self.ProcessHttpResponse(method_config, http_response, request)
   ^^^
  File "/usr/local/lib/python3.11/site-packages/apitools/base/py/base_api.py", 
line 737, in ProcessHttpResponse
self.__ProcessHttpResponse(method_config, http_response, request))
^
  File "/usr/local/lib/python3.11/site-packages/apitools/base/py/base_api.py", 
line 603, in __ProcessHttpResponse
raise exceptions.HttpError.FromResponse(
RuntimeError: apitools.base.py.exceptions.HttpBadRequestError: HttpError 
accessing 
:
 response: <{'vary': 'Origin, X-Origin, Referer', 'content-type': 
'application/json; charset=UTF-8', 'date': 'Tue, 23 Jan 2024 02:37:05 GMT', 
'server': 'ESF', 'cache-control': 'private', 'x-xss-protection': '0', 
'x-frame-options': 'SAMEORIGIN', 'x-content-type-options': 'nosniff', 
'transfer-encoding': 'chunked', 'status': '400', 'content-length': '318', 
'-content-encoding': 'gzip'}>, content <{
  "error": {
"code": 400,
"message": "Load configuration must specify at least one source URI",
"errors": [
  {
"message": "Load configuration must specify at least one source URI",
"domain": "global",
"reason": "invalid"
  }
],
"status": "INVALID_ARGUMENT"
  }
}
> [while running 
> 'WriteWithMultipleDestsFreely/BigQueryBatchFileLoads/TriggerLoadJobsWithTempTables/ParDo(TriggerLoadJobs)-ptransform-71']

  Worker ID: beamapp-jenkins-012302334-01221833-mwd0-harness-s99n
INFO 
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:201 
2024-01-23T02:37:07.225Z: JOB_MESSAGE_BASIC: Finished operation 
WriteWithMultipleDests/BigQueryBatchFileLoads/GroupFilesByTableDestinations/Close
INFO 
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:201 
2024-01-23T02:37:07.611Z: JOB_MESSAGE_BASIC: Stopping worker pool...
INFO 
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:201 
2024-01-23T02:39:12.757Z: JOB_MESSAGE_BASIC: Worker pool stopped.
INFO 
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:151 Job 
2024-01-22_18_33_47-9901902119311973873 is in state JOB_STATE_FAILED
ERROR    
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:777 Console 
URL: 

Jenkins build is back to normal : beam_PostCommit_Java_ValidatesRunner_Flink_Java11 #5457

[Apache Jenkins Server]

See 



-
To unsubscribe, e-mail: builds-unsubscr...@beam.apache.org
For additional commands, e-mail: builds-h...@beam.apache.org

Build failed in Jenkins: beam_PostCommit_Python39 #2798

[Apache Jenkins Server]

See 


Changes:

[noreply] split write rename and temp table deletion into to dofns with a 
shuffle


--
[...truncated 11.90 MB...]
  File "apache_beam/runners/worker/operations.py", line 572, in 
apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 263, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 266, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 953, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/worker/operations.py", line 954, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/common.py", line 1437, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 1526, in 
apache_beam.runners.common.DoFnRunner._reraise_augmented
  File "apache_beam/runners/common.py", line 1435, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 636, in 
apache_beam.runners.common.SimpleInvoker.invoke_process
  File "apache_beam/runners/common.py", line 1621, in 
apache_beam.runners.common._OutputHandler.handle_process_outputs
  File "apache_beam/runners/common.py", line 1736, in 
apache_beam.runners.common._OutputHandler._write_value_to_tag
  File "apache_beam/runners/worker/operations.py", line 263, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 266, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 1351, in 
apache_beam.runners.worker.operations.FlattenOperation.process
  File "apache_beam/runners/worker/operations.py", line 1354, in 
apache_beam.runners.worker.operations.FlattenOperation.process
  File "apache_beam/runners/worker/operations.py", line 572, in 
apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 263, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 266, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 953, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/worker/operations.py", line 954, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/common.py", line 1437, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 1547, in 
apache_beam.runners.common.DoFnRunner._reraise_augmented
  File "apache_beam/runners/common.py", line 1435, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 851, in 
apache_beam.runners.common.PerWindowInvoker.invoke_process
  File "apache_beam/runners/common.py", line 995, in 
apache_beam.runners.common.PerWindowInvoker._invoke_process_per_window
  File "apache_beam/runners/common.py", line 1611, in 
apache_beam.runners.common._OutputHandler.handle_process_outputs
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/io/gcp/bigquery_file_loads.py",
 line 750, in process
job_reference = self.bq_wrapper.perform_load_job(
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/io/gcp/bigquery_tools.py",
 line 1022, in perform_load_job
return self._insert_load_job(
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/utils/retry.py",
 line 298, in wrapper
return fun(*args, **kwargs)
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/io/gcp/bigquery_tools.py",
 line 559, in _insert_load_job
return self._start_job(request, stream=source_stream).jobReference
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/io/gcp/bigquery_tools.py",
 line 578, in _start_job
response = self.client.jobs.Insert(request, upload=upload)
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/io/gcp/internal/clients/bigquery/bigquery_v2_client.py",
 line 356, in Insert
return self._RunMethod(
  File "/usr/local/lib/python3.9/site-packages/apitools/base/py/base_api.py", 
line 731, in _RunMethod
return self.ProcessHttpResponse(method_config, http_response, request)
  File "/usr/local/lib/python3.9/site-packages/apitools/base/py/base_api.py", 
line 737, in ProcessHttpResponse
self.__ProcessHttpResponse(method_config, http_response, request))
  File 

Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #2615

[Apache Jenkins Server]

See 


Changes:

[noreply] Time at max threads fix (#30041)


--
[...truncated 1.39 MB...]
  "use_unified_worker",
  "use_portable_job_submission"
],
"pipelineUrl": 
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test14094/go-2-1705952900391990215/model",
"region": "us-central1",
"tempLocation": 
"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test14094"
  },
  "beam:option:go_options:v1": {
"options": {
  "bq_dataset": "apache-beam-testing.beam_bigquery_io_test_temp",
  "bt_instance": "projects/apache-beam-testing/instances/beam-test",
  "expansion_addr": "[test:localhost:34927]",
  "expansion_jar": 
"[io:
 
schemaio:
 
debeziumio:
 
gcpio:
  "experiments": 
"beam_fn_api,use_runner_v2,use_unified_worker,use_portable_job_submission",
  "hookOrder": "[\"default_remote_logging\"]",
  "hooks": "{\"default_remote_logging\":null}",
  "kafka_jar": 
"
  "sdk_harness_container_image_override": 
"[.*java.*,us.gcr.io/apache-beam-testing/java-postcommit-it/java:20240122193158]",
  "temp_location": 
"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test14094",
  "test.paniconexit0": "true",
  "test.timeout": "3h0m0s",
  "test.v": "true"
}
  }
},
"tempStoragePrefix": 
"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test14094",
"userAgent": {
  "name": "Apache Beam SDK for Go",
  "version": "2.54.0.dev"
},
"version": {
  "job_type": "FNAPI_BATCH",
  "major": "6"
},
"workerPools": [
  {
"autoscalingSettings": {},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 1,
"packages": [
  {
"location": 
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test14094/go-2-1705952900391990215/worker",
"name": "worker"
  },
  {
"location": 
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test14094/go-2-1705952900391990215/xlang/beam-sdks-java-io-google-cloud-platform-expansion-service-2.54.0-SNAPSHOT-1kPG59oxYHW3WHMJtxVFi84vwgxXXcAntu685ed1b5A.jar",
"name": 
"beam-sdks-java-io-google-cloud-platform-expansion-service-2.54.0-SNAPSHOT-1kPG59oxYHW3WHMJtxVFi84vwgxXXcAntu685ed1b5A.jar"
  }
],
"sdkHarnessContainerImages": [
  {
"capabilities": [
  "beam:protocol:progress_reporting:v1",
  "beam:protocol:multi_core_bundle_processing:v1",
  "beam:transform:sdf_truncate_sized_restrictions:v1",
  "beam:protocol:worker_status:v1",
  "beam:protocol:monitoring_info_short_ids:v1",
  "beam:version:sdk_base:go:apache/beam_go_sdk:2.54.0.dev",
  "beam:transform:to_string:v1",
  "beam:protocol:data_sampling:v1",
  "beam:coder:bytes:v1",
  "beam:coder:bool:v1",
  "beam:coder:varint:v1",
  "beam:coder:double:v1",
  "beam:coder:string_utf8:v1",
  "beam:coder:length_prefix:v1",
  "beam:coder:kv:v1",
  "beam:coder:iterable:v1",
  "beam:coder:state_backed_iterable:v1",
  "beam:coder:windowed_value:v1",
  "beam:coder:global_window:v1",
  "beam:coder:interval_window:v1",
  "beam:coder:row:v1",
  "beam:coder:nullable:v1",
  "beam:coder:timer:v1"
],
"containerImage": 
"us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20240122-194256",
"environmentId": "go"
  },
  {
"capabilities": 

Build failed in Jenkins: beam_PostCommit_Python38 #5077

[Apache Jenkins Server]

See 


Changes:

[noreply] Address Feedback from Beam Website Feedback Form. (#30064)


--
[...truncated 1.69 MB...]
  File "apache_beam/runners/common.py", line 1435, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 636, in 
apache_beam.runners.common.SimpleInvoker.invoke_process
  File "apache_beam/runners/common.py", line 1621, in 
apache_beam.runners.common._OutputHandler.handle_process_outputs
  File "apache_beam/runners/common.py", line 1736, in 
apache_beam.runners.common._OutputHandler._write_value_to_tag
  File "apache_beam/runners/worker/operations.py", line 263, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 266, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 1351, in 
apache_beam.runners.worker.operations.FlattenOperation.process
  File "apache_beam/runners/worker/operations.py", line 1354, in 
apache_beam.runners.worker.operations.FlattenOperation.process
  File "apache_beam/runners/worker/operations.py", line 572, in 
apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 263, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 266, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 953, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/worker/operations.py", line 954, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/common.py", line 1437, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 1547, in 
apache_beam.runners.common.DoFnRunner._reraise_augmented
  File "apache_beam/runners/common.py", line 1435, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 851, in 
apache_beam.runners.common.PerWindowInvoker.invoke_process
  File "apache_beam/runners/common.py", line 995, in 
apache_beam.runners.common.PerWindowInvoker._invoke_process_per_window
  File "apache_beam/runners/common.py", line 1611, in 
apache_beam.runners.common._OutputHandler.handle_process_outputs
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.8/site-packages/apache_beam/io/gcp/bigquery_file_loads.py",
 line 750, in process
job_reference = self.bq_wrapper.perform_load_job(
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.8/site-packages/apache_beam/io/gcp/bigquery_tools.py",
 line 1022, in perform_load_job
return self._insert_load_job(
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.8/site-packages/apache_beam/utils/retry.py",
 line 298, in wrapper
return fun(*args, **kwargs)
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.8/site-packages/apache_beam/io/gcp/bigquery_tools.py",
 line 559, in _insert_load_job
return self._start_job(request, stream=source_stream).jobReference
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.8/site-packages/apache_beam/io/gcp/bigquery_tools.py",
 line 578, in _start_job
response = self.client.jobs.Insert(request, upload=upload)
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.8/site-packages/apache_beam/io/gcp/internal/clients/bigquery/bigquery_v2_client.py",
 line 356, in Insert
return self._RunMethod(
  File "/usr/local/lib/python3.8/site-packages/apitools/base/py/base_api.py", 
line 731, in _RunMethod
return self.ProcessHttpResponse(method_config, http_response, request)
  File "/usr/local/lib/python3.8/site-packages/apitools/base/py/base_api.py", 
line 737, in ProcessHttpResponse
self.__ProcessHttpResponse(method_config, http_response, request))
  File "/usr/local/lib/python3.8/site-packages/apitools/base/py/base_api.py", 
line 603, in __ProcessHttpResponse
raise exceptions.HttpError.FromResponse(
RuntimeError: apitools.base.py.exceptions.HttpBadRequestError: HttpError 
accessing 
:
 response: <{'vary': 'Origin, X-Origin, Referer', 'content-type': 
'application/json; charset=UTF-8', 'date': 'Mon, 22 Jan 2024 18:04:40 GMT', 
'server': 'ESF', 'cache-control': 'private', 'x-xss-protection': '0', 
'x-frame-options': 'SAMEORIGIN', 'x-content-type-options': 'nosniff', 
'transfer-encoding': 'chunked', 'status': '400', 'content-length': '318', 
'-content-encoding': 'gzip'}>, content <{
  "error": {
"code": 400,
"message": "Load configuration must specify at least one source URI",
"errors": [
  {
"message": "Load 

Build failed in Jenkins: beam_PostCommit_Java_InfluxDbIO_IT #1525

[Apache Jenkins Server]

See 


Changes:

[noreply] Address Feedback from Beam Website Feedback Form. (#30064)


--
[...truncated 133.78 KB...]
work action resolve beam-runners-core-java.jar (project :runners:core-java) 
(Thread[Execution worker Thread 2,5,main]) started.
Resolve mutations for :sdks:java:harness:compileJava (Thread[Execution worker 
Thread 2,5,main]) started.
:sdks:java:harness:compileJava (Thread[Execution worker Thread 2,5,main]) 
started.

> Task :sdks:java:core:shadowTestJar FROM-CACHE
Build cache key for task ':sdks:java:core:shadowTestJar' is 
205855d85f661a30d18ec9df898a6719
Task ':sdks:java:core:shadowTestJar' is not up-to-date because:
  No history is available.
Loaded cache entry for task ':sdks:java:core:shadowTestJar' with cache key 
205855d85f661a30d18ec9df898a6719
work action resolve beam-sdks-java-core-tests.jar (project :sdks:java:core) 
(Thread[Execution worker Thread 4,5,main]) started.
Resolve mutations for :runners:core-java:compileTestJava (Thread[Execution 
worker Thread 4,5,main]) started.
Resolve mutations for :sdks:java:extensions:avro:compileTestJava 
(Thread[Execution worker Thread 3,5,main]) started.
:sdks:java:extensions:avro:compileTestJava (Thread[Execution worker Thread 
3,5,main]) started.
:runners:core-java:compileTestJava (Thread[Execution worker Thread 4,5,main]) 
started.

> Task :sdks:java:harness:compileJava FROM-CACHE
Custom actions are attached to task ':sdks:java:harness:compileJava'.
Build cache key for task ':sdks:java:harness:compileJava' is 
186ff4b9f7c5ab27fefa7144af8edfb3
Task ':sdks:java:harness:compileJava' is not up-to-date because:
  No history is available.
Loaded cache entry for task ':sdks:java:harness:compileJava' with cache key 
186ff4b9f7c5ab27fefa7144af8edfb3
Resolve mutations for :sdks:java:harness:classes (Thread[Execution worker 
Thread 2,5,main]) started.
:sdks:java:harness:classes (Thread[Execution worker Thread 2,5,main]) started.

> Task :sdks:java:harness:classes UP-TO-DATE
Skipping task ':sdks:java:harness:classes' as it has no actions.
Resolve mutations for :sdks:java:harness:jar (Thread[Execution worker Thread 
2,5,main]) started.
:sdks:java:harness:jar (Thread[Execution worker Thread 2,5,main]) started.

> Task :sdks:java:extensions:avro:compileTestJava FROM-CACHE
Custom actions are attached to task 
':sdks:java:extensions:avro:compileTestJava'.
Build cache key for task ':sdks:java:extensions:avro:compileTestJava' is 
856cb2b6f6a942f933517933f86444d4
Task ':sdks:java:extensions:avro:compileTestJava' is not up-to-date because:
  No history is available.
Loaded cache entry for task ':sdks:java:extensions:avro:compileTestJava' with 
cache key 856cb2b6f6a942f933517933f86444d4
Resolve mutations for :sdks:java:extensions:avro:testClasses (Thread[Execution 
worker Thread 3,5,main]) started.
:sdks:java:extensions:avro:testClasses (Thread[Execution worker Thread 
3,5,main]) started.

> Task :sdks:java:extensions:avro:testClasses UP-TO-DATE
Skipping task ':sdks:java:extensions:avro:testClasses' as it has no actions.
Resolve mutations for :sdks:java:extensions:avro:testJar (Thread[Execution 
worker Thread 3,5,main]) started.
:sdks:java:extensions:avro:testJar (Thread[Execution worker Thread 3,5,main]) 
started.

> Task :runners:core-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:core-java:compileTestJava'.
Build cache key for task ':runners:core-java:compileTestJava' is 
0e56e1bdfbd8c9eedb2f95d6153f2bc8
Task ':runners:core-java:compileTestJava' is not up-to-date because:
  No history is available.
Loaded cache entry for task ':runners:core-java:compileTestJava' with cache key 
0e56e1bdfbd8c9eedb2f95d6153f2bc8
Resolve mutations for :runners:core-java:testClasses (Thread[Execution worker 
Thread 4,5,main]) started.
:runners:core-java:testClasses (Thread[Execution worker Thread 4,5,main]) 
started.

> Task :runners:core-java:testClasses UP-TO-DATE
Skipping task ':runners:core-java:testClasses' as it has no actions.
Resolve mutations for :runners:core-java:testJar (Thread[Execution worker 
Thread 4,5,main]) started.
:runners:core-java:testJar (Thread[Execution worker Thread 4,5,main]) started.

> Task :sdks:java:extensions:avro:testJar
Caching disabled for task ':sdks:java:extensions:avro:testJar' because:
  Not worth caching
Task ':sdks:java:extensions:avro:testJar' is not up-to-date because:
  No history is available.
file or directory 
'
 not found
work action resolve beam-sdks-java-extensions-avro-tests.jar (project 
:sdks:java:extensions:avro) (Thread[Execution worker Thread 3,5,main]) started.

> Task :sdks:java:harness:jar
Caching disabled for task ':sdks:java:harness:jar' because:
  Not worth caching
Task ':sdks:java:harness:jar' is not up-to-date because:
  

Build failed in Jenkins: beam_PostCommit_XVR_Direct #5086

[Apache Jenkins Server]

See 


Changes:

[noreply] Address Feedback from Beam Website Feedback Form. (#30064)


--
[...truncated 1.04 MB...]
at 
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:348)
at 
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:275)
at 
org.apache.beam.fn.harness.BeamFnDataReadRunner.forwardElementToConsumer(BeamFnDataReadRunner.java:213)
at 
org.apache.beam.sdk.fn.data.BeamFnDataInboundObserver.multiplexElements(BeamFnDataInboundObserver.java:158)
at 
org.apache.beam.sdk.fn.data.BeamFnDataInboundObserver.awaitCompletion(BeamFnDataInboundObserver.java:123)
at 
org.apache.beam.fn.harness.control.ProcessBundleHandler.processBundle(ProcessBundleHandler.java:550)
at 
org.apache.beam.fn.harness.control.BeamFnControlClient.delegateOnInstructionRequestType(BeamFnControlClient.java:150)
at 
org.apache.beam.fn.harness.control.BeamFnControlClient$InboundObserver.lambda$onNext$0(BeamFnControlClient.java:115)
at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at 
org.apache.beam.sdk.util.UnboundedScheduledExecutorService$ScheduledFutureTask.run(UnboundedScheduledExecutorService.java:163)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Caused by: java.sql.SQLException: Cannot create PoolableConnectionFactory 
(Connection to localhost:33479 refused. Check that the hostname and port are 
correct and that the postmaster is accepting TCP/IP connections.)
at 
org.apache.commons.dbcp2.BasicDataSource.createPoolableConnectionFactory(BasicDataSource.java:653)
at 
org.apache.commons.dbcp2.BasicDataSource.createDataSource(BasicDataSource.java:531)
at 
org.apache.commons.dbcp2.BasicDataSource.getConnection(BasicDataSource.java:731)
at 
org.apache.beam.sdk.io.jdbc.JdbcIO$ReadFn.getConnection(JdbcIO.java:1524)
at 
org.apache.beam.sdk.io.jdbc.JdbcIO$ReadFn.processElement(JdbcIO.java:1537)
Caused by: org.postgresql.util.PSQLException: Connection to localhost:33479 
refused. Check that the hostname and port are correct and that the postmaster 
is accepting TCP/IP connections.
at 
org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:303)
at 
org.postgresql.core.ConnectionFactory.openConnection(ConnectionFactory.java:51)
at org.postgresql.jdbc.PgConnection.(PgConnection.java:225)
at org.postgresql.Driver.makeConnection(Driver.java:465)
at org.postgresql.Driver.connect(Driver.java:264)
at 
org.apache.commons.dbcp2.DriverConnectionFactory.createConnection(DriverConnectionFactory.java:52)
at 
org.apache.commons.dbcp2.PoolableConnectionFactory.makeObject(PoolableConnectionFactory.java:374)
at 
org.apache.commons.dbcp2.BasicDataSource.validateConnectionFactory(BasicDataSource.java:106)
at 
org.apache.commons.dbcp2.BasicDataSource.createPoolableConnectionFactory(BasicDataSource.java:649)
at 
org.apache.commons.dbcp2.BasicDataSource.createDataSource(BasicDataSource.java:531)
at 
org.apache.commons.dbcp2.BasicDataSource.getConnection(BasicDataSource.java:731)
at 
org.apache.beam.sdk.io.jdbc.JdbcIO$ReadFn.getConnection(JdbcIO.java:1524)
at 
org.apache.beam.sdk.io.jdbc.JdbcIO$ReadFn.processElement(JdbcIO.java:1537)
at 
org.apache.beam.sdk.io.jdbc.JdbcIO$ReadFn$DoFnInvoker.invokeProcessElement(Unknown
 Source)
at 
org.apache.beam.fn.harness.FnApiDoFnRunner.processElementForParDo(FnApiDoFnRunner.java:803)
at 
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:348)
at 
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:275)
at 
org.apache.beam.fn.harness.FnApiDoFnRunner.outputTo(FnApiDoFnRunner.java:1792)
at 
org.apache.beam.fn.harness.FnApiDoFnRunner.access$3000(FnApiDoFnRunner.java:143)
at 
org.apache.beam.fn.harness.FnApiDoFnRunner$NonWindowObservingProcessBundleContext.output(FnApiDoFnRunner.java:2650)
at 
org.apache.beam.sdk.transforms.MapElements$2.processElement(MapElements.java:151)
at 
org.apache.beam.sdk.transforms.MapElements$2$DoFnInvoker.invokeProcessElement(Unknown
 Source)
at 
org.apache.beam.fn.harness.FnApiDoFnRunner.processElementForParDo(FnApiDoFnRunner.java:803)
at