date:20240123

Build failed in Jenkins: beam_PostCommit_Python39 #2802

2024-01-23 Thread Apache Jenkins Server

See 


Changes:


--
[...truncated 12.43 MB...]
"code": 400,
"message": "Load configuration must specify at least one source URI",
"errors": [
  {
"message": "Load configuration must specify at least one source URI",
"domain": "global",
"reason": "invalid"
  }
],
"status": "INVALID_ARGUMENT"
  }
}
>

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/runners/worker/sdk_worker.py",
 line 311, in _execute
response = task()
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/runners/worker/sdk_worker.py",
 line 386, in 
lambda: self.create_worker().do_instruction(request), request)
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/runners/worker/sdk_worker.py",
 line 650, in do_instruction
return getattr(self, request_type)(
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/runners/worker/sdk_worker.py",
 line 688, in process_bundle
bundle_processor.process_bundle(instruction_id))
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/runners/worker/bundle_processor.py",
 line 1113, in process_bundle
input_op_by_transform_id[element.transform_id].process_encoded(
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/runners/worker/bundle_processor.py",
 line 237, in process_encoded
self.output(decoded_value)
  File "apache_beam/runners/worker/operations.py", line 570, in 
apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 572, in 
apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 263, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 266, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 953, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/worker/operations.py", line 954, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/common.py", line 1437, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 1526, in 
apache_beam.runners.common.DoFnRunner._reraise_augmented
  File "apache_beam/runners/common.py", line 1435, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 636, in 
apache_beam.runners.common.SimpleInvoker.invoke_process
  File "apache_beam/runners/common.py", line 1621, in 
apache_beam.runners.common._OutputHandler.handle_process_outputs
  File "apache_beam/runners/common.py", line 1736, in 
apache_beam.runners.common._OutputHandler._write_value_to_tag
  File "apache_beam/runners/worker/operations.py", line 263, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 266, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 1351, in 
apache_beam.runners.worker.operations.FlattenOperation.process
  File "apache_beam/runners/worker/operations.py", line 1354, in 
apache_beam.runners.worker.operations.FlattenOperation.process
  File "apache_beam/runners/worker/operations.py", line 572, in 
apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 263, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 266, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 953, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/worker/operations.py", line 954, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/common.py", line 1437, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 1547, in 
apache_beam.runners.common.DoFnRunner._reraise_augmented
  File "apache_beam/runners/common.py", line 1435, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 851, in 
apache_beam.runners.common.PerWindowInvoker.invoke_process
  File "apache_beam/runners/common.py", line 995, in 
apache_beam.runners.common.PerWindowInvoker._invoke_process_per_window
  File "apache_beam/runners/common.py", line 1611, in

Jenkins build is back to normal : beam_PostCommit_Java_InfluxDbIO_IT #1529

2024-01-23 Thread Apache Jenkins Server

See 



-
To unsubscribe, e-mail: builds-unsubscr...@beam.apache.org
For additional commands, e-mail: builds-h...@beam.apache.org

Build failed in Jenkins: beam_PostCommit_Java_DataflowV2 #4024

2024-01-23 Thread Apache Jenkins Server

See 


Changes:


--
[...truncated 49.58 KB...]
  Attempting uninstall: setuptools
Found existing installation: setuptools 44.0.0
Uninstalling setuptools-44.0.0:
  Successfully uninstalled setuptools-44.0.0
Successfully installed pip-23.3.2 setuptools-69.0.3 wheel-0.42.0
Collecting beautifulsoup4<5.0,>=4.9.0 (from -r 

 (line 19))
  Using cached beautifulsoup4-4.12.3-py3-none-any.whl.metadata (3.8 kB)
Collecting pyyaml<7,>=6.0.1 (from -r 

 (line 20))
  Using cached 
PyYAML-6.0.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata 
(2.1 kB)
Collecting tenacity<9.0,>=6.1.0 (from -r 

 (line 21))
  Using cached tenacity-8.2.3-py3-none-any.whl.metadata (1.0 kB)
Collecting soupsieve>1.2 (from beautifulsoup4<5.0,>=4.9.0->-r 

 (line 19))
  Using cached soupsieve-2.5-py3-none-any.whl.metadata (4.7 kB)
Using cached beautifulsoup4-4.12.3-py3-none-any.whl (147 kB)
Using cached 
PyYAML-6.0.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (736 kB)
Using cached tenacity-8.2.3-py3-none-any.whl (24 kB)
Using cached soupsieve-2.5-py3-none-any.whl (36 kB)
Installing collected packages: tenacity, soupsieve, pyyaml, beautifulsoup4
Successfully installed beautifulsoup4-4.12.3 pyyaml-6.0.1 soupsieve-2.5 
tenacity-8.2.3
Executing python 

 
--license_index=

--output_dir=

--dep_url_yaml=

--manual_license_path=
INFO:root:Pulling license for 129 dependencies using 16 threads.
INFO:root:Replaced local file URL with 
file://
 for xz-1.5
INFO:root:pull_licenses_java.py succeed. It took 1.651004 seconds with 16 
threads.
Copying licenses from 

 to 

Finished license_scripts.sh

> Task :sdks:java:testing:test-utils:compileJava
> Task :sdks:java:testing:test-utils:classes
> Task :sdks:java:testing:test-utils:jar

> Task :release:go-licenses:java:dockerRun
go: downloading github.com/golang/protobuf v1.5.3
go: downloading google.golang.org/grpc v1.59.0
go: downloading google.golang.org/protobuf v1.31.0
go: downloading golang.org/x/sys v0.15.0
go: downloading google.golang.org/genproto/googleapis/rpc 
v0.0.0-20231120223509-83a465c0220f
go: downloading golang.org/x/net v0.19.0
go: downloading google.golang.org/genproto v0.0.0-20231106174013-bbf56f31fb17
go: downloading golang.org/x/text v0.14.0
go: added github.com/apache/beam/sdks/v2 v2.53.0
go: added github.com/golang/protobuf v1.5.3
go: added golang.org/x/net v0.19.0
go: added golang.org/x/sys v0.15.0
go: added golang.org/x/text v0.14.0
go: added google.golang.org/genproto/googleapis/rpc 
v0.0.0-20231120223509-83a465c0220f
go: added google.golang.org/grpc v1.59.0
go: added google.golang.org/protobuf v1.31.0
+ go-licenses save github.com/apache/beam/sdks/v2/java/container 
--save_path=/output/licenses
W0124 03:58:00.047955  32 library.go:101] "golang.org/x/sys/unix" contains 
non-Go code that can't be inspected for further dependencies:
/go/pkg/mod/golang.org/x/sys@v0.15.0/unix/asm_linux_amd64.s

> Task :sdks:java:testing:test-utils:compileTestJava FROM-CACHE
> Task :sdks:java:testing:test-utils:testClasses UP-TO-DATE
> Task :sdks:java:testing:test-utils:testJar
> Task :sdks:java:container:java8:copyJavaThirdPartyLicenses

> Task :sdks:java:container:downloadCloudProfilerAgent
  % Total% Received % Xferd  Average Speed   TimeTime Time  Current
 Dload  Upload

Jenkins build is back to normal : beam_PostRelease_NightlySnapshot #2367

2024-01-23 Thread Apache Jenkins Server

See 



-
To unsubscribe, e-mail: builds-unsubscr...@beam.apache.org
For additional commands, e-mail: builds-h...@beam.apache.org

Build failed in Jenkins: beam_PostCommit_Python311 #1152

2024-01-23 Thread Apache Jenkins Server

See 


Changes:


--
[...truncated 8.39 MB...]
log_location: 
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:289"
thread: "MainThread"

INFO:root:severity: INFO
timestamp {
  seconds: 1706073391
  nanos: 866988182
}
message: "Closing all cached grpc data channels."
log_location: 
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/data_plane.py:820"
thread: "MainThread"

INFO:root:severity: INFO
timestamp {
  seconds: 1706073391
  nanos: 867060899
}
message: "Closing all cached gRPC state handlers."
log_location: 
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:929"
thread: "MainThread"

INFO:root:severity: INFO
timestamp {
  seconds: 1706073391
  nanos: 868487119
}
message: "Done consuming work."
log_location: 
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:301"
thread: "MainThread"

INFO:root:severity: INFO
timestamp {
  seconds: 1706073391
  nanos: 868598461
}
message: "Python sdk harness exiting."
log_location: 
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker_main.py:213"
thread: "MainThread"

INFO:apache_beam.runners.portability.local_job_service:Completed job in 
29.127021312713623 seconds with state DONE.
INFO:root:Completed job in 29.127021312713623 seconds with state DONE.
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE

> Task :sdks:python:test-suites:portable:py311:portableWordCountSparkRunnerBatch
INFO:apache_beam.runners.worker.worker_pool_main:Listening for workers at 
localhost:43105
INFO:apache_beam.runners.portability.fn_api_runner.translations:
  
INFO:apache_beam.runners.portability.fn_api_runner.translations:
  
INFO:apache_beam.runners.portability.fn_api_runner.translations:
  
INFO:apache_beam.utils.subprocess_server:Starting service with ('java' '-jar' 
'
 '--spark-master-url' 'local[4]' '--artifacts-dir' 
'/tmp/beam-tempz4km9sn9/artifactsu5__lki8' '--job-port' '48925' 
'--artifact-port' '0' '--expansion-port' '0')
WARNING:root:Waiting for grpc channel to be ready at localhost:48925.
INFO:apache_beam.utils.subprocess_server:24/01/24 05:16:41 WARN 
software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to 
retrieve the requested metadata.
WARNING:root:Waiting for grpc channel to be ready at localhost:48925.
INFO:apache_beam.utils.subprocess_server:24/01/24 05:16:43 INFO 
org.apache.beam.runners.jobsubmission.JobServerDriver: ArtifactStagingService 
started on localhost:38251
WARNING:root:Waiting for grpc channel to be ready at localhost:48925.
INFO:apache_beam.utils.subprocess_server:24/01/24 05:16:44 INFO 
org.apache.beam.runners.jobsubmission.JobServerDriver: Java ExpansionService 
started on localhost:33001
INFO:apache_beam.utils.subprocess_server:24/01/24 05:16:44 INFO 
org.apache.beam.runners.jobsubmission.JobServerDriver: JobService started on 
localhost:48925
INFO:apache_beam.utils.subprocess_server:24/01/24 05:16:44 INFO 
org.apache.beam.runners.jobsubmission.JobServerDriver: Job server now running, 
terminate with Ctrl+C
WARNING:root:Waiting for grpc channel to be ready at localhost:48925.
INFO:apache_beam.utils.subprocess_server:24/01/24 05:16:46 INFO 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Staging 
artifacts for job_837c0823-694c-4b66-b835-a8b6caed337f.
INFO:apache_beam.utils.subprocess_server:24/01/24 05:16:46 INFO 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Resolving 
artifacts for 
job_837c0823-694c-4b66-b835-a8b6caed337f.0:ref_Environment_default_environment_1.
INFO:apache_beam.utils.subprocess_server:24/01/24 05:16:46 INFO 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Getting 1 
artifacts for job_837c0823-694c-4b66-b835-a8b6caed337f.null.
INFO:apache_beam.utils.subprocess_server:24/01/24 05:16:46 INFO 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Artifacts 
fully staged for job_837c0823-694c-4b66-b835-a8b6caed337f.
INFO:apache_beam.utils.subprocess_server:24/01/24 05:16:47 INFO 
org.apache.beam.runners.spark.SparkJobInvoker: Invoking job 
BeamApp-jenkins-0124051647-43ebced9_da1b5d6d-f3a3-4949-aa90-2153cea065bd
INFO:apache_beam.utils.subprocess_server:24/01/24 05:16:48 INFO 
org.apache.beam.runners.jobsubmission.JobInvocation: Starting job invocation 
BeamApp-jenkins-0124051647-43ebced9_da1b5d6d-f3a3-4949-aa90-2153cea065bd
INFO:apache_beam.runners.portability.portable_runner:Environment "LOOPBACK" has 
started a component necessary for the execution. Be sure to run the pipeline 
using

Build failed in Jenkins: beam_PostCommit_XVR_Direct #5091

2024-01-23 Thread Apache Jenkins Server

See 


Changes:


--
[...truncated 1.73 MB...]
E   AttributeError: 'bytes' object has no attribute 'end'

apache_beam/runners/portability/portable_runner.py:576: RuntimeError
-- Captured log call ---
INFO apache_beam.utils.subprocess_server:subprocess_server.py:339 Using 
pre-built snapshot at 

INFO root:external.py:1017 Starting a JAR-based expansion service from JAR 

 
INFO apache_beam.utils.subprocess_server:subprocess_server.py:203 Starting 
service with ['java' '-jar' 
'
 '45883' 
'--filesToStage=
 '--alsoStartLoopbackWorker']
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Starting 
expansion service at localhost:45883
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 24, 
2024 5:44:36 AM org.apache.beam.sdk.expansion.service.ExpansionService 
loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: 
Registering external transforms: [beam:external:java:sql:v1, 
beam:transform:org.apache.beam:pubsub_read:v1, 
beam:transform:org.apache.beam:pubsub_write:v1, 
beam:transform:org.apache.beam:pubsublite_write:v1, 
beam:transform:org.apache.beam:pubsublite_read:v1, 
beam:transform:org.apache.beam:spanner_insert:v1, 
beam:transform:org.apache.beam:spanner_update:v1, 
beam:transform:org.apache.beam:spanner_replace:v1, 
beam:transform:org.apache.beam:spanner_insert_or_update:v1, 
beam:transform:org.apache.beam:spanner_delete:v1, 
beam:transform:org.apache.beam:spanner_read:v1, 
beam:transform:org.apache.beam:kafka_read_with_metadata:v1, 
beam:transform:org.apache.beam:kafka_read_without_metadata:v1, 
beam:transform:org.apache.beam:kafka_write:v1, 
beam:external:java:generate_sequence:v1, 
beam:transform:org.apache.beam:bigquery_read:v1, 
beam:transform:org.apache.beam:bigquery_write:v1, 
beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, 
beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, 
beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, 
beam:transform:create_view:v1, beam:transform:flatten:v1, 
beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, 
beam:transform:group_into_batches_with_sharded_key:v1, 
beam:transform:impulse:v1, beam:transform:reshuffle:v1, 
beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, 
beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 
Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:external:java:sql:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6c779568
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:pubsub_read:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@f381794
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:pubsub_write:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2cdd0d4b
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:pubsublite_write:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7e9131d5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:pubsublite_read:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2e1d27ba
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:spanner_insert:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@61d6015a
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:spanner_update:v1:

Jenkins build is back to normal : beam_PostCommit_Java_ValidatesRunner_Flink_Java11 #5461

2024-01-23 Thread Apache Jenkins Server

See 



-
To unsubscribe, e-mail: builds-unsubscr...@beam.apache.org
For additional commands, e-mail: builds-h...@beam.apache.org

Build failed in Jenkins: beam_PostCommit_Python310 #1814

2024-01-23 Thread Apache Jenkins Server

See 


Changes:


--
[...truncated 11.70 MB...]
input_op_by_transform_id[element.transform_id].process_encoded(
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/runners/worker/bundle_processor.py",
 line 237, in process_encoded
self.output(decoded_value)
  File "apache_beam/runners/worker/operations.py", line 570, in 
apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 572, in 
apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 263, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 266, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 953, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/worker/operations.py", line 954, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/common.py", line 1437, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 1526, in 
apache_beam.runners.common.DoFnRunner._reraise_augmented
  File "apache_beam/runners/common.py", line 1435, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 636, in 
apache_beam.runners.common.SimpleInvoker.invoke_process
  File "apache_beam/runners/common.py", line 1621, in 
apache_beam.runners.common._OutputHandler.handle_process_outputs
  File "apache_beam/runners/common.py", line 1736, in 
apache_beam.runners.common._OutputHandler._write_value_to_tag
  File "apache_beam/runners/worker/operations.py", line 263, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 266, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 1351, in 
apache_beam.runners.worker.operations.FlattenOperation.process
  File "apache_beam/runners/worker/operations.py", line 1354, in 
apache_beam.runners.worker.operations.FlattenOperation.process
  File "apache_beam/runners/worker/operations.py", line 572, in 
apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 263, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 266, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 953, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/worker/operations.py", line 954, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/common.py", line 1437, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 1547, in 
apache_beam.runners.common.DoFnRunner._reraise_augmented
  File "apache_beam/runners/common.py", line 1435, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 851, in 
apache_beam.runners.common.PerWindowInvoker.invoke_process
  File "apache_beam/runners/common.py", line 995, in 
apache_beam.runners.common.PerWindowInvoker._invoke_process_per_window
  File "apache_beam/runners/common.py", line 1611, in 
apache_beam.runners.common._OutputHandler.handle_process_outputs
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/io/gcp/bigquery_file_loads.py",
 line 750, in process
job_reference = self.bq_wrapper.perform_load_job(
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/io/gcp/bigquery_tools.py",
 line 1022, in perform_load_job
return self._insert_load_job(
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/utils/retry.py",
 line 298, in wrapper
return fun(*args, **kwargs)
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/io/gcp/bigquery_tools.py",
 line 559, in _insert_load_job
return self._start_job(request, stream=source_stream).jobReference
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/io/gcp/bigquery_tools.py",
 line 578, in _start_job
response = self.client.jobs.Insert(request, upload=upload)
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/io/gcp/internal/clients/bigquery/bigquery_v2_client.py",
 line 356, in Insert
return self._RunMethod(
  File "/usr/local/lib/python3.10/site-packages/apitools/base/py/base_api.py", 
line

Build failed in Jenkins: beam_PostCommit_Python38 #5080

2024-01-23 Thread Apache Jenkins Server

See 


Changes:


--
[...truncated 9.45 MB...]
return getattr(self, request_type)(
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py",
 line 688, in process_bundle
bundle_processor.process_bundle(instruction_id))
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py",
 line 1113, in process_bundle
input_op_by_transform_id[element.transform_id].process_encoded(
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py",
 line 237, in process_encoded
self.output(decoded_value)
  File "apache_beam/runners/worker/operations.py", line 570, in 
apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 572, in 
apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 263, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 266, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 953, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/worker/operations.py", line 954, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/common.py", line 1437, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 1526, in 
apache_beam.runners.common.DoFnRunner._reraise_augmented
  File "apache_beam/runners/common.py", line 1435, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 636, in 
apache_beam.runners.common.SimpleInvoker.invoke_process
  File "apache_beam/runners/common.py", line 1621, in 
apache_beam.runners.common._OutputHandler.handle_process_outputs
  File "apache_beam/runners/common.py", line 1736, in 
apache_beam.runners.common._OutputHandler._write_value_to_tag
  File "apache_beam/runners/worker/operations.py", line 263, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 266, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 1351, in 
apache_beam.runners.worker.operations.FlattenOperation.process
  File "apache_beam/runners/worker/operations.py", line 1354, in 
apache_beam.runners.worker.operations.FlattenOperation.process
  File "apache_beam/runners/worker/operations.py", line 572, in 
apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 263, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 266, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 953, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/worker/operations.py", line 954, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/common.py", line 1437, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 1547, in 
apache_beam.runners.common.DoFnRunner._reraise_augmented
  File "apache_beam/runners/common.py", line 1435, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 851, in 
apache_beam.runners.common.PerWindowInvoker.invoke_process
  File "apache_beam/runners/common.py", line 995, in 
apache_beam.runners.common.PerWindowInvoker._invoke_process_per_window
  File "apache_beam/runners/common.py", line 1611, in 
apache_beam.runners.common._OutputHandler.handle_process_outputs
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.8/site-packages/apache_beam/io/gcp/bigquery_file_loads.py",
 line 750, in process
job_reference = self.bq_wrapper.perform_load_job(
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.8/site-packages/apache_beam/io/gcp/bigquery_tools.py",
 line 1022, in perform_load_job
return self._insert_load_job(
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.8/site-packages/apache_beam/utils/retry.py",
 line 298, in wrapper
return fun(*args, **kwargs)
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.8/site-packages/apache_beam/io/gcp/bigquery_tools.py",
 line 559, in _insert_load_job
return self._start_job(request, stream=source_stream).jobReference
  File

Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #2617

2024-01-23 Thread Apache Jenkins Server

See 


Changes:


--
[...truncated 1.53 MB...]
  "namespace": "go_options",
  "type": "STRING",
  "value": "{\"default_remote_logging\":null}"
},
{
  "key": "test.paniconexit0",
  "namespace": "go_options",
  "type": "STRING",
  "value": "true"
},
{
  "key": "test.timeout",
  "namespace": "go_options",
  "type": "STRING",
  "value": "3h0m0s"
},
{
  "key": "hookOrder",
  "namespace": "go_options",
  "type": "STRING",
  "value": "[\"default_remote_logging\"]"
},
{
  "key": "bq_dataset",
  "namespace": "go_options",
  "type": "STRING",
  "value": "apache-beam-testing.beam_bigquery_io_test_temp"
}
  ],
  "options": {
"experiments": [
  "beam_fn_api",
  "use_runner_v2",
  "use_unified_worker",
  "use_portable_job_submission"
],
"pipelineUrl": 
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test267/go-2-1706063897920473101/model",
"region": "us-central1",
"tempLocation": 
"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test267"
  },
  "beam:option:go_options:v1": {
"options": {
  "bq_dataset": "apache-beam-testing.beam_bigquery_io_test_temp",
  "bt_instance": "projects/apache-beam-testing/instances/beam-test",
  "expansion_addr": "[test:localhost:45963]",
  "expansion_jar": 
"[io:
 
schemaio:
 
debeziumio:
 
gcpio:
  "experiments": 
"beam_fn_api,use_runner_v2,use_unified_worker,use_portable_job_submission",
  "hookOrder": "[\"default_remote_logging\"]",
  "hooks": "{\"default_remote_logging\":null}",
  "kafka_jar": 
"
  "sdk_harness_container_image_override": 
"[.*java.*,us.gcr.io/apache-beam-testing/java-postcommit-it/java:20240124022044]",
  "temp_location": 
"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test267",
  "test.paniconexit0": "true",
  "test.timeout": "3h0m0s",
  "test.v": "true"
}
  }
},
"tempStoragePrefix": 
"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test267",
"userAgent": {
  "name": "Apache Beam SDK for Go",
  "version": "2.54.0.dev"
},
"version": {
  "job_type": "FNAPI_BATCH",
  "major": "6"
},
"workerPools": [
  {
"autoscalingSettings": {},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 1,
"packages": [
  {
"location": 
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test267/go-2-1706063897920473101/worker",
"name": "worker"
  },
  {
"location": 
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test267/go-2-1706063897920473101/xlang/beam-sdks-java-io-google-cloud-platform-expansion-service-2.54.0-SNAPSHOT-ooF79by2lpxJ3EnBHTyW_1MmdoNJ3mIfEoH8VYHsSSk.jar",
"name": 
"beam-sdks-java-io-google-cloud-platform-expansion-service-2.54.0-SNAPSHOT-ooF79by2lpxJ3EnBHTyW_1MmdoNJ3mIfEoH8VYHsSSk.jar"
  }
],
"sdkHarnessContainerImages": [
  {
"capabilities": [
  "beam:protocol:progress_reporting:v1",
  "beam:protocol:multi_core_bundle_processing:v1",
  "beam:transform:sdf_truncate_sized_restrictions:v1",
  "beam:protocol:worker_status:v1",
  "beam:protocol:monitoring_info_short_ids:v1",
  "beam:version:sdk_base:go:apache/beam_go_sdk:2.54.0.dev",
  "beam:transform:to_string:v1",
  "beam:protocol:data_sampling:v1",

Jenkins build is back to normal : beam_PostCommit_Python_Xlang_IO_Dataflow #614

2024-01-23 Thread Apache Jenkins Server

See 



-
To unsubscribe, e-mail: builds-unsubscr...@beam.apache.org
For additional commands, e-mail: builds-h...@beam.apache.org

Build failed in Jenkins: beam_PostCommit_Python39 #2801

2024-01-23 Thread Apache Jenkins Server

See 


Changes:


--
[...truncated 10.89 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.beam.vendor.grpc.v1p60p1.com.google.common.base.Preconditions.checkState(Preconditions.java:512)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.beam.vendor.grpc.v1p60p1.io.grpc.internal.ServerCallImpl.closeInternal(ServerCallImpl.java:213)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.beam.vendor.grpc.v1p60p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:208)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.beam.vendor.grpc.v1p60p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:395)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.beam.runners.fnexecution.state.GrpcStateService.close(GrpcStateService.java:63)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.beam.sdk.fn.server.GrpcFnServer.close(GrpcFnServer.java:156)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.$closeResource(DefaultJobBundleFactory.java:649)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.close(DefaultJobBundleFactory.java:649)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.unref(DefaultJobBundleFactory.java:665)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.access$400(DefaultJobBundleFactory.java:596)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.lambda$createEnvironmentCaches$3(DefaultJobBundleFactory.java:213)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.beam.vendor.guava.v32_1_2_jre.com.google.common.cache.LocalCache.processPendingNotifications(LocalCache.java:1850)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.beam.vendor.guava.v32_1_2_jre.com.google.common.cache.LocalCache$Segment.runUnlockedCleanup(LocalCache.java:3503)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.beam.vendor.guava.v32_1_2_jre.com.google.common.cache.LocalCache$Segment.postWriteCleanup(LocalCache.java:3479)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.beam.vendor.guava.v32_1_2_jre.com.google.common.cache.LocalCache$Segment.clear(LocalCache.java:3252)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.beam.vendor.guava.v32_1_2_jre.com.google.common.cache.LocalCache.clear(LocalCache.java:4343)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.beam.vendor.guava.v32_1_2_jre.com.google.common.cache.LocalCache$LocalManualCache.invalidateAll(LocalCache.java:4960)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.close(DefaultJobBundleFactory.java:326)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.beam.runners.fnexecution.control.DefaultExecutableStageContext.close(DefaultExecutableStageContext.java:43)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory$WrappedContext.closeActual(ReferenceCountingExecutableStageContextFactory.java:217)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory$WrappedContext.access$200(ReferenceCountingExecutableStageContextFactory.java:193)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory.release(ReferenceCountingExecutableStageContextFactory.java:182)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory.scheduleRelease(ReferenceCountingExecutableStageContextFactory.java:136)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at

Build failed in Jenkins: beam_PostCommit_Java_DataflowV2 #4023

2024-01-23 Thread Apache Jenkins Server

See 


Changes:


--
[...truncated 49.01 KB...]
  Successfully uninstalled pip-20.0.2
  Attempting uninstall: setuptools
Found existing installation: setuptools 44.0.0
Uninstalling setuptools-44.0.0:
  Successfully uninstalled setuptools-44.0.0
Successfully installed pip-23.3.2 setuptools-69.0.3 wheel-0.42.0
Collecting beautifulsoup4<5.0,>=4.9.0 (from -r 

 (line 19))
  Using cached beautifulsoup4-4.12.3-py3-none-any.whl.metadata (3.8 kB)
Collecting pyyaml<7,>=6.0.1 (from -r 

 (line 20))
  Using cached 
PyYAML-6.0.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata 
(2.1 kB)
Collecting tenacity<9.0,>=6.1.0 (from -r 

 (line 21))
  Using cached tenacity-8.2.3-py3-none-any.whl.metadata (1.0 kB)
Collecting soupsieve>1.2 (from beautifulsoup4<5.0,>=4.9.0->-r 

 (line 19))
  Using cached soupsieve-2.5-py3-none-any.whl.metadata (4.7 kB)
Using cached beautifulsoup4-4.12.3-py3-none-any.whl (147 kB)
Using cached 
PyYAML-6.0.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (736 kB)
Using cached tenacity-8.2.3-py3-none-any.whl (24 kB)
Using cached soupsieve-2.5-py3-none-any.whl (36 kB)
Installing collected packages: tenacity, soupsieve, pyyaml, beautifulsoup4
Successfully installed beautifulsoup4-4.12.3 pyyaml-6.0.1 soupsieve-2.5 
tenacity-8.2.3
Executing python 

 
--license_index=

--output_dir=

--dep_url_yaml=

--manual_license_path=
INFO:root:Pulling license for 129 dependencies using 16 threads.
INFO:root:Replaced local file URL with 
file://
 for xz-1.5
INFO:root:pull_licenses_java.py succeed. It took 1.771739 seconds with 16 
threads.
Copying licenses from 

 to 

Finished license_scripts.sh

> Task :release:go-licenses:java:dockerRun
go: downloading golang.org/x/net v0.19.0
go: downloading google.golang.org/genproto/googleapis/rpc 
v0.0.0-20231120223509-83a465c0220f
go: downloading google.golang.org/genproto v0.0.0-20231106174013-bbf56f31fb17
go: downloading golang.org/x/text v0.14.0
go: added github.com/apache/beam/sdks/v2 v2.53.0
go: added github.com/golang/protobuf v1.5.3
go: added golang.org/x/net v0.19.0
go: added golang.org/x/sys v0.15.0
go: added golang.org/x/text v0.14.0
go: added google.golang.org/genproto/googleapis/rpc 
v0.0.0-20231120223509-83a465c0220f
go: added google.golang.org/grpc v1.59.0
go: added google.golang.org/protobuf v1.31.0
+ go-licenses save github.com/apache/beam/sdks/v2/java/container 
--save_path=/output/licenses
W0123 21:58:07.488267  28 library.go:101] "golang.org/x/sys/unix" contains 
non-Go code that can't be inspected for further dependencies:
/go/pkg/mod/golang.org/x/sys@v0.15.0/unix/asm_linux_amd64.s
+ go-licenses csv github.com/apache/beam/sdks/v2/java/container
+ tee /output/licenses/list.csv
W0123 21:58:14.472010  70 library.go:101] "golang.org/x/sys/unix" contains 
non-Go code that can't be inspected for further dependencies:
/go/pkg/mod/golang.org/x/sys@v0.15.0/unix/asm_linux_amd64.s

> Task :sdks:java:container:java8:copyJavaThirdPartyLicenses

> Task :sdks:java:container:downloadCloudProfilerAgent
  % Total% Received % Xferd  Average Speed   TimeTime Time  Current
 Dload  Upload   Total   SpentLeft  Speed
  0 00 00 0  0  0 --:--:-- --:--:-- --:--:-- 
0version.txt
NOTICES
profiler_java_agent.so

Build failed in Jenkins: beam_PostCommit_Java_InfluxDbIO_IT #1528

2024-01-23 Thread Apache Jenkins Server

See 


Changes:


--
[...truncated 137.34 KB...]
Started Gradle worker daemon (0.464 secs) with fork options 
DaemonForkOptions{executable=/usr/lib/jvm/java-8-openjdk-amd64/bin/java, 
minHeapSize=null, maxHeapSize=null, 
jvmArgs=[-Xbootclasspath/p:/home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.errorprone/javac/9+181-r4173-1/bdf4c0aa7d540ee1f7bf14d47447aea4bbf450c5/javac-9+181-r4173-1.jar,
 
-Xbootclasspath/p:/home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.errorprone/javac/9+181-r4173-1/bdf4c0aa7d540ee1f7bf14d47447aea4bbf450c5/javac-9+181-r4173-1.jar],
 keepAliveMode=DAEMON}.
Compiling with JDK Java compiler API.

> Task :sdks:java:harness:compileJava FROM-CACHE
Custom actions are attached to task ':sdks:java:harness:compileJava'.
Build cache key for task ':sdks:java:harness:compileJava' is 
2e000d082c8ee7f7dc849666b2c0666e
Task ':sdks:java:harness:compileJava' is not up-to-date because:
  No history is available.
Loaded cache entry for task ':sdks:java:harness:compileJava' with cache key 
2e000d082c8ee7f7dc849666b2c0666e
Resolve mutations for :sdks:java:harness:classes (Thread[Execution worker 
Thread 4,5,main]) started.
:sdks:java:harness:classes (Thread[Execution worker Thread 4,5,main]) started.

> Task :sdks:java:harness:classes UP-TO-DATE
Skipping task ':sdks:java:harness:classes' as it has no actions.
Resolve mutations for :sdks:java:harness:jar (Thread[Execution worker Thread 
4,5,main]) started.
:sdks:java:harness:jar (Thread[Execution worker Thread 4,5,main]) started.

> Task :runners:core-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:core-java:compileTestJava'.
Build cache key for task ':runners:core-java:compileTestJava' is 
93edd74de219579963c5042a4ffd916b
Task ':runners:core-java:compileTestJava' is not up-to-date because:
  No history is available.
Loaded cache entry for task ':runners:core-java:compileTestJava' with cache key 
93edd74de219579963c5042a4ffd916b
Resolve mutations for :runners:core-java:testClasses (Thread[Execution worker 
Thread 2,5,main]) started.
:runners:core-java:testClasses (Thread[Execution worker Thread 2,5,main]) 
started.

> Task :runners:core-java:testClasses UP-TO-DATE
Skipping task ':runners:core-java:testClasses' as it has no actions.
Resolve mutations for :runners:core-java:testJar (Thread[Execution worker 
Thread 2,5,main]) started.
:runners:core-java:testJar (Thread[Execution worker Thread 2,5,main]) started.

> Task :sdks:java:harness:jar
Caching disabled for task ':sdks:java:harness:jar' because:
  Not worth caching
Task ':sdks:java:harness:jar' is not up-to-date because:
  No history is available.
file or directory 
'
 not found
work action resolve beam-sdks-java-harness-unshaded.jar (project 
:sdks:java:harness) (Thread[Execution worker Thread 4,5,main]) started.
Resolve mutations for :runners:java-fn-execution:compileJava (Thread[Execution 
worker Thread 4,5,main]) started.
:runners:java-fn-execution:compileJava (Thread[Execution worker Thread 
4,5,main]) started.

> Task :runners:core-java:testJar
Caching disabled for task ':runners:core-java:testJar' because:
  Not worth caching
Task ':runners:core-java:testJar' is not up-to-date because:
  No history is available.
file or directory 
'
 not found
work action resolve beam-runners-core-java-tests.jar (project 
:runners:core-java) (Thread[Execution worker Thread 2,5,main]) started.

> Task :sdks:java:extensions:avro:compileTestJava FROM-CACHE
Custom actions are attached to task 
':sdks:java:extensions:avro:compileTestJava'.
Build cache key for task ':sdks:java:extensions:avro:compileTestJava' is 
34d8fcb54cbbdadf6f2807f926263a33
Task ':sdks:java:extensions:avro:compileTestJava' is not up-to-date because:
  No history is available.
Loaded cache entry for task ':sdks:java:extensions:avro:compileTestJava' with 
cache key 34d8fcb54cbbdadf6f2807f926263a33
Resolve mutations for :sdks:java:extensions:avro:testClasses (Thread[Execution 
worker Thread 6,5,main]) started.
:sdks:java:extensions:avro:testClasses (Thread[Execution worker Thread 
6,5,main]) started.

> Task :sdks:java:extensions:avro:testClasses UP-TO-DATE
Skipping task ':sdks:java:extensions:avro:testClasses' as it has no actions.
Resolve mutations for :sdks:java:extensions:avro:testJar (Thread[Execution 
worker Thread 6,5,main]) started.
:sdks:java:extensions:avro:testJar (Thread[Execution worker Thread 6,5,main]) 
started.

> Task :sdks:java:extensions:avro:testJar
Caching disabled for task ':sdks:java:extensions:avro:testJar' because:
  Not worth caching
Task ':sdks:java:extensions:avro:testJar' is not up-to-date because:
  No history is

Build failed in Jenkins: beam_PostCommit_Python311 #1151

2024-01-23 Thread Apache Jenkins Server

See 


Changes:


--
[...truncated 12.10 MB...]
  nanos: 178955793
}
message: "SDK Harness waiting for in-flight requests to complete"
log_location: 
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:289"
thread: "MainThread"

INFO:root:severity: INFO
timestamp {
  seconds: 1706051721
  nanos: 179010391
}
message: "Closing all cached grpc data channels."
log_location: 
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/data_plane.py:820"
thread: "MainThread"

INFO:root:severity: INFO
timestamp {
  seconds: 1706051721
  nanos: 179060459
}
message: "Closing all cached gRPC state handlers."
log_location: 
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:929"
thread: "MainThread"

INFO:root:severity: INFO
timestamp {
  seconds: 1706051721
  nanos: 180104255
}
message: "Done consuming work."
log_location: 
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:301"
thread: "MainThread"

INFO:root:severity: INFO
timestamp {
  seconds: 1706051721
  nanos: 180202484
}
message: "Python sdk harness exiting."
log_location: 
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker_main.py:213"
thread: "MainThread"

INFO:apache_beam.runners.portability.local_job_service:Completed job in 
30.785908937454224 seconds with state DONE.
INFO:root:Completed job in 30.785908937454224 seconds with state DONE.
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE

> Task :sdks:python:test-suites:portable:py311:portableWordCountSparkRunnerBatch
INFO:apache_beam.runners.worker.worker_pool_main:Listening for workers at 
localhost:46239
INFO:apache_beam.runners.portability.fn_api_runner.translations:
  
INFO:apache_beam.runners.portability.fn_api_runner.translations:
  
INFO:apache_beam.runners.portability.fn_api_runner.translations:
  
INFO:apache_beam.utils.subprocess_server:Starting service with ('java' '-jar' 
'
 '--spark-master-url' 'local[4]' '--artifacts-dir' 
'/tmp/beam-tempbuvl12kl/artifactsb4st592z' '--job-port' '47083' 
'--artifact-port' '0' '--expansion-port' '0')
INFO:apache_beam.utils.subprocess_server:24/01/23 23:15:32 WARN 
software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to 
retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:24/01/23 23:15:32 INFO 
org.apache.beam.runners.jobsubmission.JobServerDriver: ArtifactStagingService 
started on localhost:43149
INFO:apache_beam.utils.subprocess_server:24/01/23 23:15:32 INFO 
org.apache.beam.runners.jobsubmission.JobServerDriver: Java ExpansionService 
started on localhost:35391
INFO:apache_beam.utils.subprocess_server:24/01/23 23:15:32 INFO 
org.apache.beam.runners.jobsubmission.JobServerDriver: JobService started on 
localhost:47083
INFO:apache_beam.utils.subprocess_server:24/01/23 23:15:32 INFO 
org.apache.beam.runners.jobsubmission.JobServerDriver: Job server now running, 
terminate with Ctrl+C
WARNING:root:Waiting for grpc channel to be ready at localhost:47083.
INFO:apache_beam.utils.subprocess_server:24/01/23 23:15:35 INFO 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Staging 
artifacts for job_733c548a-73da-4e9b-afd6-4059224930c6.
INFO:apache_beam.utils.subprocess_server:24/01/23 23:15:35 INFO 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Resolving 
artifacts for 
job_733c548a-73da-4e9b-afd6-4059224930c6.0:ref_Environment_default_environment_1.
INFO:apache_beam.utils.subprocess_server:24/01/23 23:15:35 INFO 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Getting 1 
artifacts for job_733c548a-73da-4e9b-afd6-4059224930c6.null.
INFO:apache_beam.utils.subprocess_server:24/01/23 23:15:35 INFO 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Artifacts 
fully staged for job_733c548a-73da-4e9b-afd6-4059224930c6.
INFO:apache_beam.utils.subprocess_server:24/01/23 23:15:35 INFO 
org.apache.beam.runners.spark.SparkJobInvoker: Invoking job 
BeamApp-jenkins-0123231535-47681b24_6a60387f-a36c-4271-9dd4-81d045b92d52
INFO:apache_beam.utils.subprocess_server:24/01/23 23:15:35 INFO 
org.apache.beam.runners.jobsubmission.JobInvocation: Starting job invocation 
BeamApp-jenkins-0123231535-47681b24_6a60387f-a36c-4271-9dd4-81d045b92d52
INFO:apache_beam.runners.portability.portable_runner:Environment "LOOPBACK" has 
started a component necessary for the execution. Be sure to run the pipeline 
using
  with Pipeline() as p:
p.apply(..)
This ensures that the pipeline finishes before this program exits.

Build failed in Jenkins: beam_PostCommit_XVR_Direct #5090

2024-01-23 Thread Apache Jenkins Server

See 


Changes:


--
[...truncated 1.04 MB...]
  >
  component_coder_ids: "HyVSQosVbwVarIntCoder"
  component_coder_ids: "HyVSQosVbwIterableCoder"
>
  >
  coders: <
key: "HyVSQosVbwRowCoder"
value: <
  spec: <
urn: "beam:coder:row:v1"
payload: 
"\n\r\n\007role_id\032\002\020\004\022$f21e325f-2200-484f-825f-8454a13a12e8"
  >
>
  >
  coders: <
key: "HyVSQosVbwVarIntCoder"
value: <
  spec: <
urn: "beam:coders:javasdk:0.1"
payload: 
"\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\224\330\001\360<\254\355\000\005sr\000\300K2\332\251KVh\002\000\000xr\000\000\030AtomicC\001B8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000
 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
  >
>
  >
  coders: <
key: "HyVSQosVbwVoidCoder"
value: <
  spec: <
urn: "beam:coders:javasdk:0.1"
payload: 
"\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\221\326\001\350\254\355\000\005sr\000$org.apache.beam.sdk.coders.VoidCoder\271\277U\233\350\r\257U\002\000\000xr\000\000\030AtomicC\001@8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000
 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
  >
>
  >
  coders: <
key: "c0"
value: <
  spec: <
urn: "beam:coder:bytes:v1"
  >
>
  >
  coders: <
key: "c1"
value: <
  spec: <
urn: "beam:coder:global_window:v1"
  >
>
  >
  coders: <
key: "c2"
value: <
  spec: <
urn: "beam:coder:row:v1"
payload: 
"\n\r\n\007role_id\032\002\020\003\022$abc5e222-ab8f-4f6f-800a-a58bb0f45675"
  >
>
  >
  environments: <
key: "HyVSQosVbwbeam:env:docker:v1"
value: <
  urn: "beam:env:docker:v1"
  payload: "\n apache/beam_java8_sdk:2.54.0.dev"
  capabilities: "beam:coder:bytes:v1"
  capabilities: "beam:coder:bool:v1"
  capabilities: "beam:coder:varint:v1"
  capabilities: "beam:coder:string_utf8:v1"
  capabilities: "beam:coder:iterable:v1"
  capabilities: "beam:coder:timer:v1"
  capabilities: "beam:coder:kv:v1"
  capabilities: "beam:coder:length_prefix:v1"
  capabilities: "beam:coder:global_window:v1"
  capabilities: "beam:coder:interval_window:v1"
  capabilities: "beam:coder:custom_window:v1"
  capabilities: "beam:coder:windowed_value:v1"
  capabilities: "beam:coder:double:v1"
  capabilities: "beam:coder:row:v1"
  capabilities: "beam:coder:param_windowed_value:v1"
  capabilities: "beam:coder:state_backed_iterable:v1"
  capabilities: "beam:coder:sharded_key:v1"
  capabilities: "beam:coder:nullable:v1"
  capabilities: "beam:protocol:multi_core_bundle_processing:v1"
  capabilities: "beam:protocol:progress_reporting:v1"
  capabilities: "beam:protocol:harness_monitoring_infos:v1"
  capabilities: "beam:protocol:control_request_elements_embedding:v1"
  capabilities: "beam:protocol:state_caching:v1"
  capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.54.0.dev"
  capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
  capabilities: "beam:transform:to_string:v1"
  capabilities: "beam:protocol:data_sampling:v1"
  dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: 
"\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.54.0-SNAPSHOT-rXARW82fPWBjChVRxsPJd1QPMjeeOV_JR3dZVKv0NBI.jar\022@ad70115bcd9f3d60630a1551c6c3c977540f32379e395fc947775954abf43412"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: 
"\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.54.0-SNAPSHOT-rXARW82fPWBjChVRxsPJd1QPMjeeOV_JR3dZVKv0NBI.jar"
  >
>
  >
  environments: <
key: "go"
value: <
  urn: "beam:env:docker:v1"
  payload: "\n\026apache/beam_go_sdk:dev"
  capabilities: "beam:protocol:progress_reporting:v1"
  capabilities: "beam:protocol:multi_core_bundle_processing:v1"
  capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
  capabilities: "beam:protocol:worker_status:v1"
  capabilities: "beam:protocol:monitoring_info_short_ids:v1"
  capabilities: "beam:version:sdk_base:go:apache/beam_go_sdk:2.54.0.dev"
  capabilities: "beam:transform:to_string:v1"
  capabilities: "beam:protocol:data_sampling:v1"
  capabilities: "beam:coder:bytes:v1"
  capabilities: "beam:coder:bool:v1"
  capabilities: "beam:coder:varint:v1"
  capabilities: "beam:coder:double:v1"
  capabilities: "beam:coder:string_utf8:v1"
  capabilities: "beam:coder:length_prefix:v1"
  capabilities: "beam:coder:kv:v1"
  capabilities: "beam:coder:iterable:v1"
  capabilities:

Build failed in Jenkins: beam_PostCommit_Python_Xlang_IO_Dataflow #613

2024-01-23 Thread Apache Jenkins Server

See 


Changes:


--
[...truncated 458.61 KB...]
 steps: []
 tempFiles: []
 type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)>
[32mINFO[0m 
apache_beam.runners.dataflow.internal.apiclient:apiclient.py:860 Created job 
with id: [2024-01-23_12_55_57-11400971046939635074]
[32mINFO[0m 
apache_beam.runners.dataflow.internal.apiclient:apiclient.py:861 Submitted job: 
2024-01-23_12_55_57-11400971046939635074
[32mINFO[0m 
apache_beam.runners.dataflow.internal.apiclient:apiclient.py:862 To access the 
Dataflow monitoring console, please navigate to 
https://console.cloud.google.com/dataflow/jobs/us-central1/2024-01-23_12_55_57-11400971046939635074?project=apache-beam-testing
[32mINFO[0m 
apache_beam.runners.dataflow.test_dataflow_runner:test_dataflow_runner.py:58 
Console log: 
[32mINFO[0m 
apache_beam.runners.dataflow.test_dataflow_runner:test_dataflow_runner.py:59 
https://console.cloud.google.com/dataflow/jobs/us-central1/2024-01-23_12_55_57-11400971046939635074?project=apache-beam-testing
[32mINFO[0m 
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:151 Job 
2024-01-23_12_55_57-11400971046939635074 is in state JOB_STATE_RUNNING
[32mINFO[0m 
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:201 
2024-01-23T20:56:00.898Z: JOB_MESSAGE_BASIC: Worker configuration: 
e2-standard-2 in us-central1-a.
[32mINFO[0m 
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:201 
2024-01-23T20:56:03.473Z: JOB_MESSAGE_BASIC: Executing operation 
Generate/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Create
[32mINFO[0m 
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:201 
2024-01-23T20:56:03.532Z: JOB_MESSAGE_BASIC: Starting 1 workers in 
us-central1-a...
[32mINFO[0m 
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:201 
2024-01-23T20:56:03.904Z: JOB_MESSAGE_BASIC: Finished operation 
Generate/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Create
[32mINFO[0m 
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:201 
2024-01-23T20:56:12.672Z: JOB_MESSAGE_BASIC: Executing operation 
Generate/Impulse+Generate/FlatMap()+Generate/MaybeReshuffle/Reshuffle/AddRandomKeys+Generate/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps)+Generate/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Reify+Generate/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Write
[32mINFO[0m 
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:201 
2024-01-23T20:56:22.388Z: JOB_MESSAGE_BASIC: Your project already contains 100 
Dataflow-created metric descriptors, so new user metrics of the form 
custom.googleapis.com/* will not be created. However, all user metrics are also 
available in the metric dataflow.googleapis.com/job/user_counter. If you rely 
on the custom metrics, you can delete old / unused metric descriptors. See 
https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list
 and 
https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
[32mINFO[0m 
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:201 
2024-01-23T22:10:52.237Z: JOB_MESSAGE_BASIC: Cancel request is committed for 
workflow job: 2024-01-23_12_55_57-11400971046939635074.
[32mINFO[0m 
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:201 
2024-01-23T22:10:52.258Z: JOB_MESSAGE_BASIC: Finished operation 
Generate/Impulse+Generate/FlatMap()+Generate/MaybeReshuffle/Reshuffle/AddRandomKeys+Generate/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps)+Generate/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Reify+Generate/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Write
[32mINFO[0m 
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:201 
2024-01-23T22:10:52.492Z: JOB_MESSAGE_BASIC: Stopping worker pool...
[32mINFO[0m 
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:151 Job 
2024-01-23_12_55_57-11400971046939635074 is in state JOB_STATE_CANCELLING
[31m[1m__ CrossLanguageKafkaIOTest.test_hosted_kafkaio_populated_key 
__[0m

self = 

@pytest.mark.uses_io_java_expansion_service
@unittest.skipUnless(
os.environ.get('EXPANSION_PORT'),
"EXPANSION_PORT environment var is not provided.")
@unittest.skipUnless(
os.environ.get('KAFKA_BOOTSTRAP_SERVER'),
"KAFKA_BOOTSTRAP_SERVER environment var is not provided.")
def test_hosted_kafkaio_populated_key(self):
  kafka_topic = 'xlang_kafkaio_test_populated_key_{}'.format(uuid.uuid4())
  bootstrap_servers = os.environ.get('KAFKA_BOOTSTRAP_SERVER')
  pipeline_creator = CrossLanguageKafkaIO(
  bootstrap_servers,
  kafka_topic,
  False,

Build failed in Jenkins: beam_PostCommit_Java_ValidatesRunner_Flink_Java11 #5460

2024-01-23 Thread Apache Jenkins Server

See 


Changes:


--
[...truncated 2.40 KB...]
[src] $ 

 -Dorg.gradle.java.home=/usr/lib/jvm/java-8-openjdk-amd64 
:runners:flink:1.15:jar :runners:flink:1.15:testJar
To honour the JVM settings for this build a single-use Daemon process will be 
forked. For more on this, please refer to 
https://docs.gradle.org/8.4/userguide/gradle_daemon.html#sec:disabling_the_daemon
 in the Gradle documentation.
Daemon will be stopped at the end of the build 
Configuration on demand is an incubating feature.
Gradle Enterprise plugins resolution: https://plugins.gradle.org/m2
Enforcing Gradle Enterprise: https://ge.apache.org, allowUntrustedServer: false
> Task :buildSrc:compileJava NO-SOURCE
> Task :buildSrc:compileGroovy FROM-CACHE
> Task :buildSrc:pluginDescriptors
> Task :buildSrc:processResources
> Task :buildSrc:classes
> Task :buildSrc:jar
> Task :model:job-management:createCheckerFrameworkManifest
> Task :sdks:java:build-tools:createCheckerFrameworkManifest
> Task :sdks:java:fn-execution:createCheckerFrameworkManifest
> Task :sdks:java:extensions:avro:createCheckerFrameworkManifest
> Task :runners:core-construction-java:createCheckerFrameworkManifest
> Task :sdks:java:core:createCheckerFrameworkManifest
> Task :runners:core-java:createCheckerFrameworkManifest
> Task :sdks:java:expansion-service:createCheckerFrameworkManifest
> Task :sdks:java:harness:createCheckerFrameworkManifest
> Task :sdks:java:transform-service:launcher:createCheckerFrameworkManifest
> Task :sdks:java:extensions:avro:generateAvroProtocol NO-SOURCE
> Task :runners:core-java:processResources NO-SOURCE
> Task :sdks:java:fn-execution:processResources NO-SOURCE
> Task :runners:core-construction-java:processResources NO-SOURCE
> Task :sdks:java:harness:processResources NO-SOURCE
> Task :model:fn-execution:createCheckerFrameworkManifest
> Task :model:pipeline:createCheckerFrameworkManifest
> Task :sdks:java:extensions:avro:generateAvroJava NO-SOURCE
> Task :runners:java-fn-execution:createCheckerFrameworkManifest
> Task :sdks:java:expansion-service:processResources NO-SOURCE
> Task :runners:core-java:processTestResources NO-SOURCE
> Task :runners:java-job-service:createCheckerFrameworkManifest
> Task :sdks:java:extensions:avro:processResources NO-SOURCE
> Task :runners:java-fn-execution:processResources NO-SOURCE
> Task 
> :sdks:java:extensions:google-cloud-platform-core:createCheckerFrameworkManifest
> Task :runners:java-job-service:processResources NO-SOURCE
> Task :runners:flink:1.15:copySourceOverrides
> Task :sdks:java:extensions:google-cloud-platform-core:processResources 
> NO-SOURCE
> Task :model:job-management:extractProto
> Task :model:fn-execution:extractProto
> Task :sdks:java:extensions:protobuf:createCheckerFrameworkManifest
> Task :sdks:java:io:google-cloud-platform:createCheckerFrameworkManifest
> Task :sdks:java:extensions:arrow:createCheckerFrameworkManifest
> Task :runners:flink:1.15:createCheckerFrameworkManifest
> Task :sdks:java:core:generateGrammarSource FROM-CACHE
> Task :runners:flink:1.15:copyResourcesOverrides NO-SOURCE
> Task :sdks:java:io:google-cloud-platform:processResources NO-SOURCE
> Task :sdks:java:extensions:protobuf:extractProto
> Task :sdks:java:extensions:arrow:processResources NO-SOURCE
> Task :sdks:java:extensions:protobuf:processResources NO-SOURCE
> Task :model:job-management:processResources
> Task :runners:flink:1.15:processResources
> Task :model:fn-execution:processResources
> Task :runners:flink:1.15:copyTestSourceOverrides
> Task :runners:flink:1.15:copyTestResourcesOverrides NO-SOURCE
> Task :sdks:java:core:processResources
> Task :sdks:java:core:generateTestGrammarSource NO-SOURCE
> Task :runners:flink:1.15:processTestResources
> Task :sdks:java:core:processTestResources
> Task :sdks:java:transform-service:launcher:compileJava FROM-CACHE
> Task :sdks:java:build-tools:compileJava FROM-CACHE
> Task :sdks:java:transform-service:launcher:processResources
> Task :sdks:java:transform-service:launcher:classes
> Task :sdks:java:build-tools:processResources
> Task :sdks:java:build-tools:classes
> Task :sdks:java:transform-service:launcher:jar
> Task :sdks:java:build-tools:jar
> Task :sdks:java:transform-service:launcher:shadowJar FROM-CACHE
> Task :model:pipeline:extractIncludeProto
> Task :model:pipeline:extractProto
> Task :model:pipeline:generateProto FROM-CACHE
> Task :model:pipeline:compileJava FROM-CACHE
> Task :model:pipeline:processResources
> Task :model:pipeline:classes
> Task :model:pipeline:jar
> Task :model:pipeline:shadowJar FROM-CACHE
> Task :model:fn-execution:extractIncludeProto
> Task :model:job-management:extractIncludeProto
> Task :model:fn-execution:generateProto FROM-CACHE
> Task :model:job-management:generateProto FROM-CACHE
> Task

Build failed in Jenkins: beam_PostCommit_Python310 #1813

2024-01-23 Thread Apache Jenkins Server

See 


Changes:


--
[...truncated 12.27 MB...]
  File "apache_beam/runners/worker/operations.py", line 572, in 
apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 263, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 266, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 953, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/worker/operations.py", line 954, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/common.py", line 1437, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 1526, in 
apache_beam.runners.common.DoFnRunner._reraise_augmented
  File "apache_beam/runners/common.py", line 1435, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 636, in 
apache_beam.runners.common.SimpleInvoker.invoke_process
  File "apache_beam/runners/common.py", line 1621, in 
apache_beam.runners.common._OutputHandler.handle_process_outputs
  File "apache_beam/runners/common.py", line 1736, in 
apache_beam.runners.common._OutputHandler._write_value_to_tag
  File "apache_beam/runners/worker/operations.py", line 263, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 266, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 1351, in 
apache_beam.runners.worker.operations.FlattenOperation.process
  File "apache_beam/runners/worker/operations.py", line 1354, in 
apache_beam.runners.worker.operations.FlattenOperation.process
  File "apache_beam/runners/worker/operations.py", line 572, in 
apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 263, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 266, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 953, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/worker/operations.py", line 954, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/common.py", line 1437, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 1547, in 
apache_beam.runners.common.DoFnRunner._reraise_augmented
  File "apache_beam/runners/common.py", line 1435, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 851, in 
apache_beam.runners.common.PerWindowInvoker.invoke_process
  File "apache_beam/runners/common.py", line 995, in 
apache_beam.runners.common.PerWindowInvoker._invoke_process_per_window
  File "apache_beam/runners/common.py", line 1611, in 
apache_beam.runners.common._OutputHandler.handle_process_outputs
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/io/gcp/bigquery_file_loads.py",
 line 750, in process
job_reference = self.bq_wrapper.perform_load_job(
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/io/gcp/bigquery_tools.py",
 line 1022, in perform_load_job
return self._insert_load_job(
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/utils/retry.py",
 line 298, in wrapper
return fun(*args, **kwargs)
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/io/gcp/bigquery_tools.py",
 line 559, in _insert_load_job
return self._start_job(request, stream=source_stream).jobReference
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/io/gcp/bigquery_tools.py",
 line 578, in _start_job
response = self.client.jobs.Insert(request, upload=upload)
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/io/gcp/internal/clients/bigquery/bigquery_v2_client.py",
 line 356, in Insert
return self._RunMethod(
  File "/usr/local/lib/python3.10/site-packages/apitools/base/py/base_api.py", 
line 731, in _RunMethod
return self.ProcessHttpResponse(method_config, http_response, request)
  File "/usr/local/lib/python3.10/site-packages/apitools/base/py/base_api.py", 
line 737, in ProcessHttpResponse
self.__ProcessHttpResponse(method_config, http_response, request))
  File "/usr/local/lib/python3.10/site-packages/apitools/base/py/base_api.py", 
line 603, in

Jenkins build is back to normal : beam_PostCommit_Python_Examples_Flink #2823

2024-01-23 Thread Apache Jenkins Server

See 



-
To unsubscribe, e-mail: builds-unsubscr...@beam.apache.org
For additional commands, e-mail: builds-h...@beam.apache.org

Jenkins build is back to normal : beam_PostCommit_Java_ValidatesRunner_Flink #12784

2024-01-23 Thread Apache Jenkins Server

See 



-
To unsubscribe, e-mail: builds-unsubscr...@beam.apache.org
For additional commands, e-mail: builds-h...@beam.apache.org

Build failed in Jenkins: beam_PostCommit_Python39 #2800

2024-01-23 Thread Apache Jenkins Server

See 


Changes:


--
[...truncated 11.72 MB...]
  seconds: 1706035138
  nanos: 662112951
}
message: "SDK Harness waiting for in-flight requests to complete"
log_location: 
"/usr/local/lib/python3.9/site-packages/apache_beam/runners/worker/sdk_worker.py:289"
thread: "MainThread"

INFO:root:severity: INFO
timestamp {
  seconds: 1706035138
  nanos: 662215471
}
message: "Closing all cached grpc data channels."
log_location: 
"/usr/local/lib/python3.9/site-packages/apache_beam/runners/worker/data_plane.py:820"
thread: "MainThread"

INFO:root:severity: INFO
timestamp {
  seconds: 1706035138
  nanos: 662307977
}
message: "Closing all cached gRPC state handlers."
log_location: 
"/usr/local/lib/python3.9/site-packages/apache_beam/runners/worker/sdk_worker.py:929"
thread: "MainThread"

INFO:root:severity: INFO
timestamp {
  seconds: 1706035138
  nanos: 662584066
}
message: "Done consuming work."
log_location: 
"/usr/local/lib/python3.9/site-packages/apache_beam/runners/worker/sdk_worker.py:301"
thread: "MainThread"

INFO:root:severity: INFO
timestamp {
  seconds: 1706035138
  nanos: 662683725
}
message: "Python sdk harness exiting."
log_location: 
"/usr/local/lib/python3.9/site-packages/apache_beam/runners/worker/sdk_worker_main.py:213"
thread: "MainThread"

c3947c3066ab8959aff1bf6908d8567c0b859a42a285bb5013f6719897d54a20
INFO:apache_beam.runners.portability.local_job_service:Completed job in 
28.019731044769287 seconds with state DONE.
INFO:root:Completed job in 28.019731044769287 seconds with state DONE.
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE

> Task :sdks:python:test-suites:portable:py39:portableWordCountSparkRunnerBatch
INFO:apache_beam.runners.worker.worker_pool_main:Listening for workers at 
localhost:34511
INFO:apache_beam.runners.portability.fn_api_runner.translations:
  
INFO:apache_beam.runners.portability.fn_api_runner.translations:
  
INFO:apache_beam.runners.portability.fn_api_runner.translations:
  
INFO:apache_beam.utils.subprocess_server:Starting service with ('java' '-jar' 
'
 '--spark-master-url' 'local[4]' '--artifacts-dir' 
'/tmp/beam-tempcawayi0i/artifactscibtmg17' '--job-port' '32905' 
'--artifact-port' '0' '--expansion-port' '0')
INFO:apache_beam.utils.subprocess_server:24/01/23 18:39:10 WARN 
software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to 
retrieve the requested metadata.
WARNING:root:Waiting for grpc channel to be ready at localhost:32905.
INFO:apache_beam.utils.subprocess_server:24/01/23 18:39:11 INFO 
org.apache.beam.runners.jobsubmission.JobServerDriver: ArtifactStagingService 
started on localhost:34513
WARNING:root:Waiting for grpc channel to be ready at localhost:32905.
INFO:apache_beam.utils.subprocess_server:24/01/23 18:39:12 INFO 
org.apache.beam.runners.jobsubmission.JobServerDriver: Java ExpansionService 
started on localhost:46507
INFO:apache_beam.utils.subprocess_server:24/01/23 18:39:12 INFO 
org.apache.beam.runners.jobsubmission.JobServerDriver: JobService started on 
localhost:32905
INFO:apache_beam.utils.subprocess_server:24/01/23 18:39:12 INFO 
org.apache.beam.runners.jobsubmission.JobServerDriver: Job server now running, 
terminate with Ctrl+C
WARNING:root:Waiting for grpc channel to be ready at localhost:32905.
WARNING:root:Waiting for grpc channel to be ready at localhost:32905.
INFO:apache_beam.utils.subprocess_server:24/01/23 18:39:15 INFO 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Staging 
artifacts for job_d5dcf937-e2e0-4dde-9979-0c5c19bea27f.
INFO:apache_beam.utils.subprocess_server:24/01/23 18:39:15 INFO 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Resolving 
artifacts for 
job_d5dcf937-e2e0-4dde-9979-0c5c19bea27f.0:ref_Environment_default_environment_1.
INFO:apache_beam.utils.subprocess_server:24/01/23 18:39:15 INFO 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Getting 1 
artifacts for job_d5dcf937-e2e0-4dde-9979-0c5c19bea27f.null.
INFO:apache_beam.utils.subprocess_server:24/01/23 18:39:15 INFO 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Artifacts 
fully staged for job_d5dcf937-e2e0-4dde-9979-0c5c19bea27f.
INFO:apache_beam.utils.subprocess_server:24/01/23 18:39:16 INFO 
org.apache.beam.runners.spark.SparkJobInvoker: Invoking job 
BeamApp-jenkins-0123183916-cd540e27_cc9952f6-b42d-4a51-9cc3-1c5008c9ab54
INFO:apache_beam.utils.subprocess_server:24/01/23 18:39:16 INFO 
org.apache.beam.runners.jobsubmission.JobInvocation: Starting job invocation

Build failed in Jenkins: beam_PostCommit_Python311 #1150

2024-01-23 Thread Apache Jenkins Server

See 


Changes:


--
[...truncated 6.01 MB...]
message: "SDK Harness waiting for in-flight requests to complete"
log_location: 
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:289"
thread: "MainThread"

INFO:root:severity: INFO
timestamp {
  seconds: 1706032184
  nanos: 723361015
}
message: "Closing all cached grpc data channels."
log_location: 
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/data_plane.py:820"
thread: "MainThread"

INFO:root:severity: INFO
timestamp {
  seconds: 1706032184
  nanos: 723417758
}
message: "Closing all cached gRPC state handlers."
log_location: 
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:929"
thread: "MainThread"

INFO:root:severity: INFO
timestamp {
  seconds: 1706032184
  nanos: 724076271
}
message: "Done consuming work."
log_location: 
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:301"
thread: "MainThread"

INFO:root:severity: INFO
timestamp {
  seconds: 1706032184
  nanos: 724208116
}
message: "Python sdk harness exiting."
log_location: 
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker_main.py:213"
thread: "MainThread"

INFO:apache_beam.runners.portability.local_job_service:Completed job in 
40.293893337249756 seconds with state DONE.
INFO:root:Completed job in 40.293893337249756 seconds with state DONE.
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE

> Task :sdks:python:test-suites:portable:py311:portableWordCountSparkRunnerBatch
INFO:apache_beam.runners.worker.worker_pool_main:Listening for workers at 
localhost:43625
INFO:apache_beam.runners.portability.fn_api_runner.translations:
  
INFO:apache_beam.runners.portability.fn_api_runner.translations:
  
INFO:apache_beam.runners.portability.fn_api_runner.translations:
  
INFO:apache_beam.utils.subprocess_server:Starting service with ('java' '-jar' 
'
 '--spark-master-url' 'local[4]' '--artifacts-dir' 
'/tmp/beam-tempe6htak9z/artifacts4sgrwb6p' '--job-port' '51545' 
'--artifact-port' '0' '--expansion-port' '0')
INFO:apache_beam.utils.subprocess_server:24/01/23 17:50:05 WARN 
software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to 
retrieve the requested metadata.
WARNING:root:Waiting for grpc channel to be ready at localhost:51545.
INFO:apache_beam.utils.subprocess_server:24/01/23 17:50:07 INFO 
org.apache.beam.runners.jobsubmission.JobServerDriver: ArtifactStagingService 
started on localhost:43131
WARNING:root:Waiting for grpc channel to be ready at localhost:51545.
INFO:apache_beam.utils.subprocess_server:24/01/23 17:50:07 INFO 
org.apache.beam.runners.jobsubmission.JobServerDriver: Java ExpansionService 
started on localhost:34171
INFO:apache_beam.utils.subprocess_server:24/01/23 17:50:07 INFO 
org.apache.beam.runners.jobsubmission.JobServerDriver: JobService started on 
localhost:51545
INFO:apache_beam.utils.subprocess_server:24/01/23 17:50:07 INFO 
org.apache.beam.runners.jobsubmission.JobServerDriver: Job server now running, 
terminate with Ctrl+C
WARNING:root:Waiting for grpc channel to be ready at localhost:51545.
INFO:apache_beam.utils.subprocess_server:24/01/23 17:50:10 INFO 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Staging 
artifacts for job_ce83549e-ad70-4a2b-aa07-b183a7c28d2f.
INFO:apache_beam.utils.subprocess_server:24/01/23 17:50:10 INFO 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Resolving 
artifacts for 
job_ce83549e-ad70-4a2b-aa07-b183a7c28d2f.0:ref_Environment_default_environment_1.
INFO:apache_beam.utils.subprocess_server:24/01/23 17:50:10 INFO 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Getting 1 
artifacts for job_ce83549e-ad70-4a2b-aa07-b183a7c28d2f.null.
INFO:apache_beam.utils.subprocess_server:24/01/23 17:50:10 INFO 
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Artifacts 
fully staged for job_ce83549e-ad70-4a2b-aa07-b183a7c28d2f.
INFO:apache_beam.utils.subprocess_server:24/01/23 17:50:11 INFO 
org.apache.beam.runners.spark.SparkJobInvoker: Invoking job 
BeamApp-jenkins-0123175011-b099a522_d4f05a58-b961-4dfb-b08a-b467e3bc4146
INFO:apache_beam.utils.subprocess_server:24/01/23 17:50:11 INFO 
org.apache.beam.runners.jobsubmission.JobInvocation: Starting job invocation 
BeamApp-jenkins-0123175011-b099a522_d4f05a58-b961-4dfb-b08a-b467e3bc4146
INFO:apache_beam.runners.portability.portable_runner:Environment "LOOPBACK" has 
started a component necessary for the execution. Be sure to run the pipeline 
using

Build failed in Jenkins: beam_PostCommit_Python310 #1812

2024-01-23 Thread Apache Jenkins Server

See 


Changes:

[noreply] Plumbing remaining autoscaling metrics (#30070)


--
[...truncated 12.38 MB...]
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/io/gcp/bigquery_tools.py",
 line 1022, in perform_load_job
return self._insert_load_job(
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/utils/retry.py",
 line 298, in wrapper
return fun(*args, **kwargs)
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/io/gcp/bigquery_tools.py",
 line 559, in _insert_load_job
return self._start_job(request, stream=source_stream).jobReference
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/io/gcp/bigquery_tools.py",
 line 578, in _start_job
response = self.client.jobs.Insert(request, upload=upload)
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/io/gcp/internal/clients/bigquery/bigquery_v2_client.py",
 line 356, in Insert
return self._RunMethod(
  File "/usr/local/lib/python3.10/site-packages/apitools/base/py/base_api.py", 
line 731, in _RunMethod
return self.ProcessHttpResponse(method_config, http_response, request)
  File "/usr/local/lib/python3.10/site-packages/apitools/base/py/base_api.py", 
line 737, in ProcessHttpResponse
self.__ProcessHttpResponse(method_config, http_response, request))
  File "/usr/local/lib/python3.10/site-packages/apitools/base/py/base_api.py", 
line 603, in __ProcessHttpResponse
raise exceptions.HttpError.FromResponse(
apitools.base.py.exceptions.HttpBadRequestError: HttpError accessing 
:
 response: <{'vary': 'Origin, X-Origin, Referer', 'content-type': 
'application/json; charset=UTF-8', 'date': 'Tue, 23 Jan 2024 16:59:28 GMT', 
'server': 'ESF', 'cache-control': 'private', 'x-xss-protection': '0', 
'x-frame-options': 'SAMEORIGIN', 'x-content-type-options': 'nosniff', 
'transfer-encoding': 'chunked', 'status': '400', 'content-length': '318', 
'-content-encoding': 'gzip'}>, content <{
  "error": {
"code": 400,
"message": "Load configuration must specify at least one source URI",
"errors": [
  {
"message": "Load configuration must specify at least one source URI",
"domain": "global",
"reason": "invalid"
  }
],
"status": "INVALID_ARGUMENT"
  }
}
>

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/runners/worker/sdk_worker.py",
 line 311, in _execute
response = task()
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/runners/worker/sdk_worker.py",
 line 386, in 
lambda: self.create_worker().do_instruction(request), request)
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/runners/worker/sdk_worker.py",
 line 650, in do_instruction
return getattr(self, request_type)(
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/runners/worker/sdk_worker.py",
 line 688, in process_bundle
bundle_processor.process_bundle(instruction_id))
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/runners/worker/bundle_processor.py",
 line 1113, in process_bundle
input_op_by_transform_id[element.transform_id].process_encoded(
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/runners/worker/bundle_processor.py",
 line 237, in process_encoded
self.output(decoded_value)
  File "apache_beam/runners/worker/operations.py", line 570, in 
apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 572, in 
apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 263, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 266, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 953, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/worker/operations.py", line 954, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/common.py", line 1437, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 1526, in 
apache_beam.runners.common.DoFnRunner._reraise_augmented
  File "apache_beam/runners/common.py", line 1435, in

Build failed in Jenkins: beam_PostCommit_XVR_Direct #5089

2024-01-23 Thread Apache Jenkins Server

See 


Changes:


--
[...truncated 1.04 MB...]
  coders: <
key: "oegwhlvaUaKvCoder"
value: <
  spec: <
urn: "beam:coder:kv:v1"
  >
  component_coder_ids: "oegwhlvaUaVarIntCoder"
  component_coder_ids: "oegwhlvaUaRowCoder"
>
  >
  coders: <
key: "oegwhlvaUaKvCoder1"
value: <
  spec: <
urn: "beam:coder:kv:v1"
  >
  component_coder_ids: "oegwhlvaUaVarIntCoder"
  component_coder_ids: "oegwhlvaUaCoder1"
>
  >
  coders: <
key: "oegwhlvaUaKvCoder2"
value: <
  spec: <
urn: "beam:coder:kv:v1"
  >
  component_coder_ids: "oegwhlvaUaVarIntCoder"
  component_coder_ids: "oegwhlvaUaIterableCoder"
>
  >
  coders: <
key: "oegwhlvaUaRowCoder"
value: <
  spec: <
urn: "beam:coder:row:v1"
payload: 
"\n\r\n\007role_id\032\002\020\004\022$c3aecc09-c8cc-4be7-8b4a-680f87728385"
  >
>
  >
  coders: <
key: "oegwhlvaUaVarIntCoder"
value: <
  spec: <
urn: "beam:coders:javasdk:0.1"
payload: 
"\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\224\330\001\360<\254\355\000\005sr\000\300K2\332\251KVh\002\000\000xr\000\000\030AtomicC\001B8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000
 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
  >
>
  >
  coders: <
key: "oegwhlvaUaVoidCoder"
value: <
  spec: <
urn: "beam:coders:javasdk:0.1"
payload: 
"\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\221\326\001\350\254\355\000\005sr\000$org.apache.beam.sdk.coders.VoidCoder\271\277U\233\350\r\257U\002\000\000xr\000\000\030AtomicC\001@8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000
 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
  >
>
  >
  environments: <
key: "go"
value: <
  urn: "beam:env:docker:v1"
  payload: "\n\026apache/beam_go_sdk:dev"
  capabilities: "beam:protocol:progress_reporting:v1"
  capabilities: "beam:protocol:multi_core_bundle_processing:v1"
  capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
  capabilities: "beam:protocol:worker_status:v1"
  capabilities: "beam:protocol:monitoring_info_short_ids:v1"
  capabilities: "beam:version:sdk_base:go:apache/beam_go_sdk:2.54.0.dev"
  capabilities: "beam:transform:to_string:v1"
  capabilities: "beam:protocol:data_sampling:v1"
  capabilities: "beam:coder:bytes:v1"
  capabilities: "beam:coder:bool:v1"
  capabilities: "beam:coder:varint:v1"
  capabilities: "beam:coder:double:v1"
  capabilities: "beam:coder:string_utf8:v1"
  capabilities: "beam:coder:length_prefix:v1"
  capabilities: "beam:coder:kv:v1"
  capabilities: "beam:coder:iterable:v1"
  capabilities: "beam:coder:state_backed_iterable:v1"
  capabilities: "beam:coder:windowed_value:v1"
  capabilities: "beam:coder:global_window:v1"
  capabilities: "beam:coder:interval_window:v1"
  capabilities: "beam:coder:row:v1"
  capabilities: "beam:coder:nullable:v1"
  capabilities: "beam:coder:timer:v1"
  dependencies: <
type_urn: "beam:artifact:type:file:v1"
role_urn: "beam:artifact:role:go_worker_binary:v1"
  >
>
  >
  environments: <
key: "oegwhlvaUabeam:env:docker:v1"
value: <
  urn: "beam:env:docker:v1"
  payload: "\n apache/beam_java8_sdk:2.54.0.dev"
  capabilities: "beam:coder:bytes:v1"
  capabilities: "beam:coder:bool:v1"
  capabilities: "beam:coder:varint:v1"
  capabilities: "beam:coder:string_utf8:v1"
  capabilities: "beam:coder:iterable:v1"
  capabilities: "beam:coder:timer:v1"
  capabilities: "beam:coder:kv:v1"
  capabilities: "beam:coder:length_prefix:v1"
  capabilities: "beam:coder:global_window:v1"
  capabilities: "beam:coder:interval_window:v1"
  capabilities: "beam:coder:custom_window:v1"
  capabilities: "beam:coder:windowed_value:v1"
  capabilities: "beam:coder:double:v1"
  capabilities: "beam:coder:row:v1"
  capabilities: "beam:coder:param_windowed_value:v1"
  capabilities: "beam:coder:state_backed_iterable:v1"
  capabilities: "beam:coder:sharded_key:v1"
  capabilities: "beam:coder:nullable:v1"
  capabilities: "beam:protocol:multi_core_bundle_processing:v1"
  capabilities: "beam:protocol:progress_reporting:v1"
  capabilities: "beam:protocol:harness_monitoring_infos:v1"
  capabilities: "beam:protocol:control_request_elements_embedding:v1"
  capabilities: "beam:protocol:state_caching:v1"
  capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.54.0.dev"
  capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
  capabilities: "beam:transform:to_string:v1"

Build failed in Jenkins: beam_PostCommit_Python39 #2799

2024-01-23 Thread Apache Jenkins Server

See 


Changes:


--
[...truncated 12.56 MB...]
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/io/gcp/bigquery_tools.py",
 line 1022, in perform_load_job
return self._insert_load_job(
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/utils/retry.py",
 line 298, in wrapper
return fun(*args, **kwargs)
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/io/gcp/bigquery_tools.py",
 line 559, in _insert_load_job
return self._start_job(request, stream=source_stream).jobReference
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/io/gcp/bigquery_tools.py",
 line 578, in _start_job
response = self.client.jobs.Insert(request, upload=upload)
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/io/gcp/internal/clients/bigquery/bigquery_v2_client.py",
 line 356, in Insert
return self._RunMethod(
  File "/usr/local/lib/python3.9/site-packages/apitools/base/py/base_api.py", 
line 731, in _RunMethod
return self.ProcessHttpResponse(method_config, http_response, request)
  File "/usr/local/lib/python3.9/site-packages/apitools/base/py/base_api.py", 
line 737, in ProcessHttpResponse
self.__ProcessHttpResponse(method_config, http_response, request))
  File "/usr/local/lib/python3.9/site-packages/apitools/base/py/base_api.py", 
line 603, in __ProcessHttpResponse
raise exceptions.HttpError.FromResponse(
apitools.base.py.exceptions.HttpBadRequestError: HttpError accessing 
:
 response: <{'vary': 'Origin, X-Origin, Referer', 'content-type': 
'application/json; charset=UTF-8', 'date': 'Tue, 23 Jan 2024 16:03:18 GMT', 
'server': 'ESF', 'cache-control': 'private', 'x-xss-protection': '0', 
'x-frame-options': 'SAMEORIGIN', 'x-content-type-options': 'nosniff', 
'transfer-encoding': 'chunked', 'status': '400', 'content-length': '318', 
'-content-encoding': 'gzip'}>, content <{
  "error": {
"code": 400,
"message": "Load configuration must specify at least one source URI",
"errors": [
  {
"message": "Load configuration must specify at least one source URI",
"domain": "global",
"reason": "invalid"
  }
],
"status": "INVALID_ARGUMENT"
  }
}
>

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/runners/worker/sdk_worker.py",
 line 311, in _execute
response = task()
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/runners/worker/sdk_worker.py",
 line 386, in 
lambda: self.create_worker().do_instruction(request), request)
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/runners/worker/sdk_worker.py",
 line 650, in do_instruction
return getattr(self, request_type)(
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/runners/worker/sdk_worker.py",
 line 688, in process_bundle
bundle_processor.process_bundle(instruction_id))
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/runners/worker/bundle_processor.py",
 line 1113, in process_bundle
input_op_by_transform_id[element.transform_id].process_encoded(
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/runners/worker/bundle_processor.py",
 line 237, in process_encoded
self.output(decoded_value)
  File "apache_beam/runners/worker/operations.py", line 570, in 
apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 572, in 
apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 263, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 266, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 953, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/worker/operations.py", line 954, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/common.py", line 1437, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 1526, in 
apache_beam.runners.common.DoFnRunner._reraise_augmented
  File "apache_beam/runners/common.py", line 1435, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py",

Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #2822

2024-01-23 Thread Apache Jenkins Server

See 


Changes:


--
[...truncated 48.62 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory$WrappedContext.closeActual(ReferenceCountingExecutableStageContextFactory.java:217)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory$WrappedContext.access$200(ReferenceCountingExecutableStageContextFactory.java:193)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory.release(ReferenceCountingExecutableStageContextFactory.java:182)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory.scheduleRelease(ReferenceCountingExecutableStageContextFactory.java:136)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory.access$300(ReferenceCountingExecutableStageContextFactory.java:48)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory$WrappedContext.close(ReferenceCountingExecutableStageContextFactory.java:213)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.$closeResource(FlinkExecutableStageFunction.java:269)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.close(FlinkExecutableStageFunction.java:374)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.flink.api.common.functions.util.FunctionUtils.closeFunction(FunctionUtils.java:41)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.flink.runtime.operators.BatchTask.run(BatchTask.java:519)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.flink.runtime.operators.BatchTask.invoke(BatchTask.java:357)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:935)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:914)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:728)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
org.apache.flink.runtime.taskmanager.Task.run(Task.java:550)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   at 
java.lang.Thread.run(Thread.java:750)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 
INFO apache_beam.runners.worker.statecache:statecache.py:234 Creating state 
cache with size 104857600
INFO apache_beam.runners.worker.sdk_worker:sdk_worker.py:189 Creating 
insecure control channel for localhost:33237.
INFO apache_beam.runners.worker.sdk_worker:sdk_worker.py:197 Control 
channel established.
INFO apache_beam.runners.worker.sdk_worker:sdk_worker.py:247 Initializing 
SDKHarness with unbounded number of workers.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 23, 
2024 4:58:10 PM 
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService 
control
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: 
Beam Fn Control client connected with id 5-1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 23, 
2024 4:58:10 PM 
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService 
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: 
getProcessBundleDescriptor request with id 5-6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 23, 
2024 4:58:10 PM 
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService 
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: 
getProcessBundleDescriptor request with id 5-8
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 23, 
2024 4:58:10 PM 
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService 
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: 
getProcessBundleDescriptor request with id 5-7
INFO

Build failed in Jenkins: beam_PostCommit_Java_ValidatesRunner_Flink_Java11 #5459

2024-01-23 Thread Apache Jenkins Server

See 


Changes:


--
Started by timer
Running as SYSTEM
[EnvInject] - Loading node environment variables.
Building remotely on apache-beam-jenkins-13 (beam) in workspace 
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Java_ValidatesRunner_Flink_Java11
The recommended git tool is: NONE
No credentials specified
Wiping out workspace first.
Cloning the remote Git repository
Using shallow clone with depth 1
Avoid fetching tags
Cloning repository https://github.com/apache/beam.git
 > git init 
 > /home/jenkins/jenkins-slave/workspace/beam_PostCommit_Java_ValidatesRunner_Flink_Java11/src
 >  # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
 > git --version # timeout=10
 > git --version # 'git version 2.25.1'
 > git fetch --no-tags --force --progress --depth=1 -- 
 > https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* # 
 > timeout=10
 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # 
 > timeout=10
 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Using shallow fetch with depth 1
Fetching upstream changes from https://github.com/apache/beam.git
 > git fetch --no-tags --force --progress --depth=1 -- 
 > https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* 
 > +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* # 
 > timeout=10
ERROR: Timeout after 10 minutes
FATAL: hudson.remoting.Channel$OrderlyShutdown: Command Close created at
Command Close created at
at hudson.remoting.Command.(Command.java:70)
at hudson.remoting.Channel$CloseCommand.(Channel.java:1306)
at hudson.remoting.Channel.close(Channel.java:1480)
at hudson.remoting.Channel.close(Channel.java:1447)
at hudson.remoting.Channel$CloseCommand.execute(Channel.java:1312)
at hudson.remoting.Channel$1.handle(Channel.java:606)
at 
hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:81)
Caused: hudson.remoting.Channel$OrderlyShutdown
Also:   hudson.remoting.Channel$CallSiteStackTrace: Remote call to 
apache-beam-jenkins-13
at 
hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1784)
at hudson.remoting.Request.call(Request.java:199)
at hudson.remoting.Channel.call(Channel.java:999)
at 
org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:143)
at 
jdk.internal.reflect.GeneratedMethodAccessor884.invoke(Unknown Source)
at 
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at 
org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:129)
at com.sun.proxy.$Proxy179.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:1001)
at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1245)
at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1309)
at hudson.scm.SCM.checkout(SCM.java:540)
at 
hudson.model.AbstractProject.checkout(AbstractProject.java:1240)
at 
hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:649)
at 
jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:85)
at 
hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:521)
at hudson.model.Run.execute(Run.java:1900)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:44)
at 
hudson.model.ResourceController.execute(ResourceController.java:101)
at hudson.model.Executor.run(Executor.java:442)
Caused: hudson.remoting.RequestAbortedException
at hudson.remoting.Request.abort(Request.java:346)
at hudson.remoting.Channel.terminate(Channel.java:1080)
at hudson.remoting.Channel$CloseCommand.execute(Channel.java:1313)
at hudson.remoting.Channel$1.handle(Channel.java:606)
at 
hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:81)
ERROR: apache-beam-jenkins-13 is offline; cannot locate jdk_1.8_latest

-
To unsubscribe, e-mail: builds-unsubscr...@beam.apache.org
For additional commands, e-mail: builds-h...@beam.apache.org

Build failed in Jenkins: beam_PostRelease_NightlySnapshot #2366

2024-01-23 Thread Apache Jenkins Server

See 


Changes:


--
[...truncated 3.99 MB...]
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException: pubsub.googleapis.com
I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
Jan 23, 2024 5:08:53 PM 
org.apache.beam.sdk.extensions.gcp.util.RetryHttpRequestInitializer$LoggingHttpBackOffHandler
 handleIOException
WARNING: Request failed with IOException, performed 10 retries due to 
IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP 
framework says request cannot be retried, (caller responsible for retrying): 
https://dataflow.googleapis.com/v1b3/projects/apache-beam-testing/locations/us-central1/jobs/2024-01-23_08_52_58-742445148299835/messages
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
.I'm falling behind!
DELAY(342331, 1)
I'm falling behind!
.{timestamp_ms=1706029428000}
late data for: 
user12_ArmyGreenKookaburra,ArmyGreenKookaburra,18,1706029428000,2024-01-23 
09:09:31.118
java.net.UnknownHostException: pubsub.googleapis.com
java.net.UnknownHostException:

Build failed in Jenkins: beam_PostCommit_Python38 #5079

2024-01-23 Thread Apache Jenkins Server

See 


Changes:


--
[...truncated 11.00 MB...]
  File "/usr/lib/python3.8/threading.py", line 890, in _bootstrap
self._bootstrap_inner()
  File "/usr/lib/python3.8/threading.py", line 932, in _bootstrap_inner
self.run()
  File 
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python38/src/sdks/python/apache_beam/utils/thread_pool_executor.py",
 line 57, in run
self._wake_semaphore.acquire()
  File "/usr/lib/python3.8/threading.py", line 433, in acquire
self._cond.wait(timeout)
  File "/usr/lib/python3.8/threading.py", line 302, in wait
waiter.acquire()

 Stack of Thread-1224 (140002679846656) 
  File "/usr/lib/python3.8/threading.py", line 890, in _bootstrap
self._bootstrap_inner()
  File "/usr/lib/python3.8/threading.py", line 932, in _bootstrap_inner
self.run()
  File 
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python38/src/sdks/python/apache_beam/utils/thread_pool_executor.py",
 line 57, in run
self._wake_semaphore.acquire()
  File "/usr/lib/python3.8/threading.py", line 433, in acquire
self._cond.wait(timeout)
  File "/usr/lib/python3.8/threading.py", line 302, in wait
waiter.acquire()

 Stack of Thread-1204 (140008996460288) 
  File "/usr/lib/python3.8/threading.py", line 890, in _bootstrap
self._bootstrap_inner()
  File "/usr/lib/python3.8/threading.py", line 932, in _bootstrap_inner
self.run()
  File "/usr/lib/python3.8/threading.py", line 870, in run
self._target(*self._args, **self._kwargs)
  File 
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python38/src/sdks/python/apache_beam/utils/subprocess_server.py",
 line 214, in log_stdout
line = process.stdout.readline()

 Stack of Thread-1191 (140006832187136) 
  File "/usr/lib/python3.8/threading.py", line 890, in _bootstrap
self._bootstrap_inner()
  File "/usr/lib/python3.8/threading.py", line 932, in _bootstrap_inner
self.run()
  File 
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python38/src/sdks/python/apache_beam/utils/thread_pool_executor.py",
 line 57, in run
self._wake_semaphore.acquire()
  File "/usr/lib/python3.8/threading.py", line 433, in acquire
self._cond.wait(timeout)
  File "/usr/lib/python3.8/threading.py", line 302, in wait
waiter.acquire()

 Stack of Thread-1189 (140007897536256) 
  File "/usr/lib/python3.8/threading.py", line 890, in _bootstrap
self._bootstrap_inner()
  File "/usr/lib/python3.8/threading.py", line 932, in _bootstrap_inner
self.run()
  File 
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python38/src/sdks/python/apache_beam/utils/thread_pool_executor.py",
 line 57, in run
self._wake_semaphore.acquire()
  File "/usr/lib/python3.8/threading.py", line 433, in acquire
self._cond.wait(timeout)
  File "/usr/lib/python3.8/threading.py", line 302, in wait
waiter.acquire()

 Stack of Thread-1167 (140008971278080) 
  File "/usr/lib/python3.8/threading.py", line 890, in _bootstrap
self._bootstrap_inner()
  File "/usr/lib/python3.8/threading.py", line 932, in _bootstrap_inner
self.run()
  File "/usr/lib/python3.8/threading.py", line 870, in run
self._target(*self._args, **self._kwargs)
  File 
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python38/src/sdks/python/apache_beam/utils/subprocess_server.py",
 line 214, in log_stdout
line = process.stdout.readline()

 Stack of Thread-1152 (140007411021568) 
  File "/usr/lib/python3.8/threading.py", line 890, in _bootstrap
self._bootstrap_inner()
  File "/usr/lib/python3.8/threading.py", line 932, in _bootstrap_inner
self.run()
  File 
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python38/src/sdks/python/apache_beam/utils/thread_pool_executor.py",
 line 57, in run
self._wake_semaphore.acquire()
  File "/usr/lib/python3.8/threading.py", line 433, in acquire
self._cond.wait(timeout)
  File "/usr/lib/python3.8/threading.py", line 302, in wait
waiter.acquire()

 Stack of Thread-1132 (140008988067584) 
  File "/usr/lib/python3.8/threading.py", line 890, in _bootstrap
self._bootstrap_inner()
  File "/usr/lib/python3.8/threading.py", line 932, in _bootstrap_inner
self.run()
  File "/usr/lib/python3.8/threading.py", line 870, in run
self._target(*self._args, **self._kwargs)
  File 
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python38/src/sdks/python/apache_beam/utils/subprocess_server.py",
 line 214, in log_stdout
line = process.stdout.readline()

 Stack of Thread-1123 (140011135547136) 
  File "/usr/lib/python3.8/threading.py", line 890, in

Build failed in Jenkins: beam_PostCommit_XVR_Direct #5088

2024-01-23 Thread Apache Jenkins Server

See 


Changes:


--
[...truncated 1.67 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:spanner_insert:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@61d6015a
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:spanner_update:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2525ff7e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:spanner_replace:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@524d6d96
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:spanner_insert_or_update:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@152aa092
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:spanner_delete:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@44a7bfbc
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:spanner_read:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4ef37659
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:kafka_read_with_metadata:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@776b83cc
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:kafka_read_without_metadata:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@37858383
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:kafka_write:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e268090
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:external:java:generate_sequence:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1bb266b3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:bigquery_read:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@306cf3ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:bigquery_write:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2beee7ff
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:pubsub_read:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5136d012
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:pubsub_write:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5939a379
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:pubsub_write:v2: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@e1de817
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:combine_globally:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@52102734
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:combine_grouped_values:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3541cb24
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:combine_per_key:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2177849e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:create_view:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@40cb8df7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:flatten:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@13b13b5d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:group_by_key:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2892dae4
INFO

Build failed in Jenkins: beam_PostCommit_Python311 #1149

2024-01-23 Thread Apache Jenkins Server

See 


Changes:

[noreply] Plumbing remaining autoscaling metrics (#30070)


--
[...truncated 12.16 MB...]
INFO:apache_beam.runners.worker.sdk_worker:State channel established.
INFO:apache_beam.runners.worker.data_plane:Creating client data channel for 
localhost:41757
INFO:apache_beam.utils.subprocess_server:24/01/23 16:17:13 INFO 
org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client 
connected.
INFO:apache_beam.utils.subprocess_server:24/01/23 16:17:13 INFO 
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: 
getProcessBundleDescriptor request with id 1-3
INFO:apache_beam.utils.subprocess_server:24/01/23 16:17:14 INFO 
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: 
getProcessBundleDescriptor request with id 1-4
INFO:apache_beam.utils.subprocess_server:24/01/23 16:17:14 INFO 
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: 
getProcessBundleDescriptor request with id 1-5
INFO:apache_beam.utils.subprocess_server:24/01/23 16:17:14 INFO 
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: 
getProcessBundleDescriptor request with id 1-8
INFO:apache_beam.utils.subprocess_server:24/01/23 16:17:14 INFO 
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: 
getProcessBundleDescriptor request with id 1-6
INFO:apache_beam.utils.subprocess_server:24/01/23 16:17:14 INFO 
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: 
getProcessBundleDescriptor request with id 1-7
INFO:apache_beam.utils.subprocess_server:24/01/23 16:17:14 INFO 
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: 
getProcessBundleDescriptor request with id 1-9
INFO:apache_beam.utils.subprocess_server:24/01/23 16:17:14 INFO 
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: 
getProcessBundleDescriptor request with id 1-10
INFO:apache_beam.utils.subprocess_server:24/01/23 16:17:14 INFO 
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: 
getProcessBundleDescriptor request with id 1-11
INFO:apache_beam.utils.subprocess_server:24/01/23 16:17:14 INFO 
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: 
getProcessBundleDescriptor request with id 1-13
INFO:apache_beam.utils.subprocess_server:24/01/23 16:17:14 INFO 
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: 
getProcessBundleDescriptor request with id 1-12
INFO:apache_beam.utils.subprocess_server:24/01/23 16:17:14 INFO 
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: 
getProcessBundleDescriptor request with id 1-14
INFO:apache_beam.utils.subprocess_server:24/01/23 16:17:14 INFO 
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: 
getProcessBundleDescriptor request with id 1-15
INFO:apache_beam.utils.subprocess_server:24/01/23 16:17:15 INFO 
org.apache.beam.runners.spark.SparkPipelineRunner: Job 
BeamApp-jenkins-0123161709-3b1576c_f545f3bf-9a58-4e10-bcc1-4f6047ab7abd: 
Pipeline translated successfully. Computing outputs
INFO:apache_beam.utils.subprocess_server:24/01/23 16:17:15 INFO 
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: 
getProcessBundleDescriptor request with id 1-16
INFO:apache_beam.io.filebasedsink:Starting finalize_write threads with 
num_shards: 4 (skipped: 0), batches: 4, num_threads: 4
INFO:apache_beam.io.filebasedsink:Renamed 4 shards in 0.01 seconds.
INFO:apache_beam.utils.subprocess_server:24/01/23 16:17:15 INFO 
org.apache.beam.runners.spark.SparkPipelineRunner: Job 
BeamApp-jenkins-0123161709-3b1576c_f545f3bf-9a58-4e10-bcc1-4f6047ab7abd 
finished.
INFO:apache_beam.utils.subprocess_server:24/01/23 16:17:15 INFO 
org.sparkproject.jetty.server.AbstractConnector: Stopped 
Spark@1a2f9fe5{HTTP/1.1, (http/1.1)}{127.0.0.1:4040}
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE
Exception in thread read_state:
Traceback (most recent call last):
  File "/usr/lib/python3.11/threading.py", line 1038, in _bootstrap_inner
Exception in thread run_worker_1-1:
Traceback (most recent call last):
  File "/usr/lib/python3.11/threading.py", line 1038, in _bootstrap_inner
self.run()
  File "/usr/lib/python3.11/threading.py", line 975, in run
self.run()
self._target(*self._args, **self._kwargs)
  File "/usr/lib/python3.11/threading.py", line 975, in run
  File 
"
 line 1060, in pull_responses
ERROR:apache_beam.runners.worker.data_plane:Failed to read inputs in the data 
plane.
Traceback (most recent call last):
  File 
"
 line

Build failed in Jenkins: beam_PostCommit_Java_ValidatesRunner_Flink #12783

2024-01-23 Thread Apache Jenkins Server

See 


Changes:

[noreply] Plumbing remaining autoscaling metrics (#30070)


--
Started by timer
Started by timer
Running as SYSTEM
[EnvInject] - Loading node environment variables.
Building remotely on apache-beam-jenkins-13 (beam) in workspace 

The recommended git tool is: NONE
No credentials specified
Wiping out workspace first.
Cloning the remote Git repository
Using shallow clone with depth 1
Avoid fetching tags
Cloning repository https://github.com/apache/beam.git
 > git init 
 > 
 >  # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
 > git --version # timeout=10
 > git --version # 'git version 2.25.1'
 > git fetch --no-tags --force --progress --depth=1 -- 
 > https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* # 
 > timeout=10
 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # 
 > timeout=10
 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Using shallow fetch with depth 1
Fetching upstream changes from https://github.com/apache/beam.git
 > git fetch --no-tags --force --progress --depth=1 -- 
 > https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* 
 > +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* # 
 > timeout=10
 > git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 0a813b996572191bc179c724d3f31d535eb45e7d (origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 0a813b996572191bc179c724d3f31d535eb45e7d # timeout=10
Commit message: "Plumbing remaining autoscaling metrics (#30070)"
 > git rev-list --no-walk 821a1694c5c0910f3f4df79d52fa482499fb6667 # timeout=10
No emails were triggered.
[EnvInject] - Executing scripts and injecting environment variables after the 
SCM step.
[EnvInject] - Injecting as environment variables the properties content 
SETUPTOOLS_USE_DISTUTILS=stdlib
SPARK_LOCAL_IP=127.0.0.1

[EnvInject] - Variables injected successfully.
[Gradle] - Launching build.
[src] $ 

 --continue --max-workers=8 -Dorg.gradle.jvmargs=-Xms2g 
-Dorg.gradle.jvmargs=-Xmx6g -Dorg.gradle.vfs.watch=false -Pdocker-pull-licenses 
:runners:flink:1.15:validatesRunner
To honour the JVM settings for this build a single-use Daemon process will be 
forked. For more on this, please refer to 
https://docs.gradle.org/8.4/userguide/gradle_daemon.html#sec:disabling_the_daemon
 in the Gradle documentation.
Daemon will be stopped at the end of the build 
Configuration on demand is an incubating feature.
Gradle Enterprise plugins resolution: https://plugins.gradle.org/m2
Enforcing Gradle Enterprise: https://ge.apache.org, allowUntrustedServer: false
> Task :buildSrc:compileJava NO-SOURCE
> Task :buildSrc:compileGroovy FROM-CACHE
> Task :buildSrc:pluginDescriptors
> Task :buildSrc:processResources
> Task :buildSrc:classes
> Task :buildSrc:jar
> Task :model:fn-execution:createCheckerFrameworkManifest
> Task :model:job-management:createCheckerFrameworkManifest
> Task :runners:core-construction-java:createCheckerFrameworkManifest
> Task :model:fn-execution:extractProto
> Task :sdks:java:core:createCheckerFrameworkManifest
> Task :sdks:java:fn-execution:createCheckerFrameworkManifest
> Task :sdks:java:transform-service:launcher:createCheckerFrameworkManifest
> Task :model:pipeline:createCheckerFrameworkManifest
> Task :sdks:java:extensions:avro:createCheckerFrameworkManifest
> Task :sdks:java:extensions:avro:generateAvroProtocol NO-SOURCE
> Task :sdks:java:fn-execution:processResources NO-SOURCE
> Task :runners:core-construction-java:processResources NO-SOURCE
> Task :sdks:java:extensions:avro:generateAvroJava NO-SOURCE
> Task :sdks:java:extensions:avro:processResources NO-SOURCE
> Task :model:job-management:extractProto
> Task :runners:java-fn-execution:createCheckerFrameworkManifest
> Task :sdks:java:harness:createCheckerFrameworkManifest
> Task :runners:core-java:createCheckerFrameworkManifest
> Task :runners:core-java:processResources NO-SOURCE
> Task :runners:java-fn-execution:processResources NO-SOURCE
> Task :sdks:java:harness:processResources NO-SOURCE
> Task :sdks:java:core:generateGrammarSource FROM-CACHE
> Task :model:job-management:processResources
> Task :runners:java-job-service:createCheckerFrameworkManifest
> Task :runners:java-job-service:processResources NO-SOURCE
> Task :model:fn-execution:processResources
> Task :sdks:java:expansion-service:createCheckerFrameworkManifest
> Task :sdks:java:expansion-service:processResources NO-SOURCE
> Task

Build failed in Jenkins: beam_PostCommit_Java_ValidatesRunner_Flink_Java11 #5458

2024-01-23 Thread Apache Jenkins Server

See 


Changes:


--
[...truncated 3.24 KB...]
Enforcing Gradle Enterprise: https://ge.apache.org, allowUntrustedServer: false
> Task :buildSrc:compileJava NO-SOURCE
> Task :buildSrc:compileGroovy FROM-CACHE
> Task :buildSrc:pluginDescriptors
> Task :buildSrc:processResources
> Task :buildSrc:classes
> Task :buildSrc:jar
> Task :sdks:java:fn-execution:createCheckerFrameworkManifest
> Task :sdks:java:extensions:avro:createCheckerFrameworkManifest
> Task :runners:core-construction-java:createCheckerFrameworkManifest
> Task 
> :sdks:java:extensions:google-cloud-platform-core:createCheckerFrameworkManifest
> Task :sdks:java:transform-service:launcher:createCheckerFrameworkManifest
> Task :sdks:java:extensions:avro:generateAvroProtocol NO-SOURCE
> Task :sdks:java:expansion-service:createCheckerFrameworkManifest
> Task :runners:core-construction-java:processResources NO-SOURCE
> Task :sdks:java:extensions:google-cloud-platform-core:processResources 
> NO-SOURCE
> Task :sdks:java:fn-execution:processResources NO-SOURCE
> Task :runners:java-fn-execution:createCheckerFrameworkManifest
> Task :sdks:java:extensions:avro:generateAvroJava NO-SOURCE
> Task :sdks:java:expansion-service:processResources NO-SOURCE
> Task :model:job-management:createCheckerFrameworkManifest
> Task :runners:java-job-service:createCheckerFrameworkManifest
> Task :model:pipeline:createCheckerFrameworkManifest
> Task :model:fn-execution:createCheckerFrameworkManifest
> Task :runners:core-java:createCheckerFrameworkManifest
> Task :sdks:java:extensions:avro:processResources NO-SOURCE
> Task :sdks:java:core:createCheckerFrameworkManifest
> Task :runners:java-fn-execution:processResources NO-SOURCE
> Task :runners:core-java:processResources NO-SOURCE
> Task :runners:java-job-service:processResources NO-SOURCE
> Task :sdks:java:build-tools:createCheckerFrameworkManifest
> Task :sdks:java:harness:createCheckerFrameworkManifest
> Task :runners:core-java:processTestResources NO-SOURCE
> Task :sdks:java:harness:processResources NO-SOURCE
> Task :runners:flink:1.15:copySourceOverrides
> Task :model:job-management:extractProto
> Task :sdks:java:io:google-cloud-platform:createCheckerFrameworkManifest
> Task :sdks:java:extensions:arrow:createCheckerFrameworkManifest
> Task :model:fn-execution:extractProto
> Task :sdks:java:extensions:protobuf:createCheckerFrameworkManifest
> Task :sdks:java:io:google-cloud-platform:processResources NO-SOURCE
> Task :sdks:java:extensions:arrow:processResources NO-SOURCE
> Task :runners:flink:1.15:createCheckerFrameworkManifest
> Task :runners:flink:1.15:copyResourcesOverrides NO-SOURCE
> Task :sdks:java:extensions:protobuf:extractProto
> Task :sdks:java:extensions:protobuf:processResources NO-SOURCE
> Task :model:job-management:processResources
> Task :runners:flink:1.15:processResources
> Task :model:fn-execution:processResources
> Task :runners:flink:1.15:copyTestSourceOverrides
> Task :runners:flink:1.15:copyTestResourcesOverrides NO-SOURCE
> Task :runners:flink:1.15:processTestResources
> Task :sdks:java:core:generateGrammarSource FROM-CACHE
> Task :sdks:java:core:processResources
> Task :sdks:java:core:generateTestGrammarSource NO-SOURCE
> Task :sdks:java:core:processTestResources
> Task :sdks:java:build-tools:compileJava FROM-CACHE
> Task :sdks:java:transform-service:launcher:compileJava FROM-CACHE
> Task :sdks:java:build-tools:processResources
> Task :sdks:java:build-tools:classes
> Task :sdks:java:transform-service:launcher:processResources
> Task :sdks:java:transform-service:launcher:classes
> Task :sdks:java:transform-service:launcher:jar
> Task :sdks:java:build-tools:jar
> Task :sdks:java:transform-service:launcher:shadowJar FROM-CACHE
> Task :model:pipeline:extractIncludeProto
> Task :model:pipeline:extractProto
> Task :model:pipeline:generateProto FROM-CACHE
> Task :model:pipeline:compileJava FROM-CACHE
> Task :model:pipeline:processResources
> Task :model:pipeline:classes
> Task :model:pipeline:jar
> Task :model:fn-execution:extractIncludeProto
> Task :model:job-management:extractIncludeProto
> Task :model:pipeline:shadowJar FROM-CACHE
> Task :model:job-management:generateProto FROM-CACHE
> Task :model:fn-execution:generateProto FROM-CACHE
> Task :model:job-management:compileJava FROM-CACHE
> Task :model:job-management:classes
> Task :model:fn-execution:compileJava FROM-CACHE
> Task :model:fn-execution:classes
> Task :model:job-management:shadowJar FROM-CACHE
> Task :model:fn-execution:shadowJar FROM-CACHE
> Task :sdks:java:core:compileJava FROM-CACHE
> Task :sdks:java:core:classes
> Task :sdks:java:core:shadowJar FROM-CACHE
> Task :sdks:java:fn-execution:compileJava FROM-CACHE
> Task :sdks:java:fn-execution:classes UP-TO-DATE
> Task :sdks:java:fn-execution:jar
> Task :sdks:java:extensions:avro:compileJava FROM-CACHE
> Task :sdks:java:extensions:avro:classes

Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #2616

2024-01-23 Thread Apache Jenkins Server

See 
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/2616/display/redirect>

Changes:


--
[...truncated 1.25 MB...]
  "use_unified_worker",
  "use_portable_job_submission"
],
"pipelineUrl": 
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test3389/go-2-1706020801855234081/model",
"region": "us-central1",
"tempLocation": 
"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test3389"
  },
  "beam:option:go_options:v1": {
"options": {
  "bq_dataset": "apache-beam-testing.beam_bigquery_io_test_temp",
  "bt_instance": "projects/apache-beam-testing/instances/beam-test",
  "expansion_addr": "[test:localhost:38711]",
  "expansion_jar": 
"[io:<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/java/io/expansion-service/build/libs/beam-sdks-java-io-expansion-service-2.54.0-SNAPSHOT.jar>
 
schemaio:<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/java/extensions/schemaio-expansion-service/build/libs/beam-sdks-java-extensions-schemaio-expansion-service-2.54.0-SNAPSHOT.jar>
 
debeziumio:<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/java/io/debezium/expansion-service/build/libs/beam-sdks-java-io-debezium-expansion-service-2.54.0-SNAPSHOT.jar>
 
gcpio:<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/java/io/google-cloud-platform/expansion-service/build/libs/beam-sdks-java-io-google-cloud-platform-expansion-service-2.54.0-SNAPSHOT.jar];,>
  "experiments": 
"beam_fn_api,use_runner_v2,use_unified_worker,use_portable_job_submission",
  "hookOrder": "[\"default_remote_logging\"]",
  "hooks": "{\"default_remote_logging\":null}",
  "kafka_jar": 
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/java/testing/kafka-service/build/libs/beam-sdks-java-testing-kafka-service-testKafkaService-2.54.0-SNAPSHOT.jar;,>
  "sdk_harness_container_image_override": 
"[.*java.*,us.gcr.io/apache-beam-testing/java-postcommit-it/java:20240123142252]",
  "temp_location": 
"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test3389",
  "test.paniconexit0": "true",
  "test.timeout": "3h0m0s",
  "test.v": "true"
}
  }
},
"tempStoragePrefix": 
"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test3389",
"userAgent": {
  "name": "Apache Beam SDK for Go",
  "version": "2.54.0.dev"
},
"version": {
  "job_type": "FNAPI_BATCH",
  "major": "6"
},
"workerPools": [
  {
"autoscalingSettings": {},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 1,
"packages": [
  {
"location": 
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test3389/go-2-1706020801855234081/worker",
"name": "worker"
  },
  {
"location": 
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test3389/go-2-1706020801855234081/xlang/beam-sdks-java-io-google-cloud-platform-expansion-service-2.54.0-SNAPSHOT-Arr_yE72yoU8KfkB9phdSoAZkauDNartFzWD8VNbzZY.jar",
"name": 
"beam-sdks-java-io-google-cloud-platform-expansion-service-2.54.0-SNAPSHOT-Arr_yE72yoU8KfkB9phdSoAZkauDNartFzWD8VNbzZY.jar"
  }
],
"sdkHarnessContainerImages": [
  {
"capabilities": [
  "beam:protocol:progress_reporting:v1",
  "beam:protocol:multi_core_bundle_processing:v1",
  "beam:transform:sdf_truncate_sized_restrictions:v1",
  "beam:protocol:worker_status:v1",
  "beam:protocol:monitoring_info_short_ids:v1",
  "beam:version:sdk_base:go:apache/beam_go_sdk:2.54.0.dev",
  "beam:transform:to_string:v1",
  "beam:protocol:data_sampling:v1",
  "beam:coder:bytes:v1",
  &quo

Build failed in Jenkins: beam_PostCommit_Python38 #5078

2024-01-23 Thread Apache Jenkins Server

See 


Changes:


--
[...truncated 9.61 MB...]
"code": 400,
"message": "Load configuration must specify at least one source URI",
"errors": [
  {
"message": "Load configuration must specify at least one source URI",
"domain": "global",
"reason": "invalid"
  }
],
"status": "INVALID_ARGUMENT"
  }
}
>

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py",
 line 311, in _execute
response = task()
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py",
 line 386, in 
lambda: self.create_worker().do_instruction(request), request)
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py",
 line 650, in do_instruction
return getattr(self, request_type)(
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py",
 line 688, in process_bundle
bundle_processor.process_bundle(instruction_id))
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py",
 line 1113, in process_bundle
input_op_by_transform_id[element.transform_id].process_encoded(
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py",
 line 237, in process_encoded
self.output(decoded_value)
  File "apache_beam/runners/worker/operations.py", line 570, in 
apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 572, in 
apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 263, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 266, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 953, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/worker/operations.py", line 954, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/common.py", line 1437, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 1526, in 
apache_beam.runners.common.DoFnRunner._reraise_augmented
  File "apache_beam/runners/common.py", line 1435, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 636, in 
apache_beam.runners.common.SimpleInvoker.invoke_process
  File "apache_beam/runners/common.py", line 1621, in 
apache_beam.runners.common._OutputHandler.handle_process_outputs
  File "apache_beam/runners/common.py", line 1736, in 
apache_beam.runners.common._OutputHandler._write_value_to_tag
  File "apache_beam/runners/worker/operations.py", line 263, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 266, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 1351, in 
apache_beam.runners.worker.operations.FlattenOperation.process
  File "apache_beam/runners/worker/operations.py", line 1354, in 
apache_beam.runners.worker.operations.FlattenOperation.process
  File "apache_beam/runners/worker/operations.py", line 572, in 
apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 263, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 266, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 953, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/worker/operations.py", line 954, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/common.py", line 1437, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 1547, in 
apache_beam.runners.common.DoFnRunner._reraise_augmented
  File "apache_beam/runners/common.py", line 1435, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 851, in 
apache_beam.runners.common.PerWindowInvoker.invoke_process
  File "apache_beam/runners/common.py", line 995, in 
apache_beam.runners.common.PerWindowInvoker._invoke_process_per_window
  File "apache_beam/runners/common.py", line 1611, in

Jenkins build is back to normal : beam_PostCommit_Java_InfluxDbIO_IT #1526

2024-01-23 Thread Apache Jenkins Server

See 



-
To unsubscribe, e-mail: builds-unsubscr...@beam.apache.org
For additional commands, e-mail: builds-h...@beam.apache.org

Build failed in Jenkins: beam_PostCommit_XVR_Direct #5087

2024-01-23 Thread Apache Jenkins Server

See 


Changes:


--
[...truncated 1.73 MB...]
E File 
"
 line 1376, in process_elements
E   if input_watermark > window.end + self.allowed_lateness:
E   AttributeError: 'bytes' object has no attribute 'end'

apache_beam/runners/portability/portable_runner.py:576: RuntimeError
-- Captured log call ---
INFO apache_beam.utils.subprocess_server:subprocess_server.py:339 Using 
pre-built snapshot at 

INFO root:external.py:1017 Starting a JAR-based expansion service from JAR 

 
INFO apache_beam.utils.subprocess_server:subprocess_server.py:203 Starting 
service with ['java' '-jar' 
'
 '54769' 
'--filesToStage=
 '--alsoStartLoopbackWorker']
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Starting 
expansion service at localhost:54769
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 23, 
2024 11:27:23 AM org.apache.beam.sdk.expansion.service.ExpansionService 
loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: 
Registering external transforms: [beam:external:java:sql:v1, 
beam:transform:org.apache.beam:pubsub_read:v1, 
beam:transform:org.apache.beam:pubsub_write:v1, 
beam:transform:org.apache.beam:pubsublite_write:v1, 
beam:transform:org.apache.beam:pubsublite_read:v1, 
beam:transform:org.apache.beam:spanner_insert:v1, 
beam:transform:org.apache.beam:spanner_update:v1, 
beam:transform:org.apache.beam:spanner_replace:v1, 
beam:transform:org.apache.beam:spanner_insert_or_update:v1, 
beam:transform:org.apache.beam:spanner_delete:v1, 
beam:transform:org.apache.beam:spanner_read:v1, 
beam:transform:org.apache.beam:kafka_read_with_metadata:v1, 
beam:transform:org.apache.beam:kafka_read_without_metadata:v1, 
beam:transform:org.apache.beam:kafka_write:v1, 
beam:external:java:generate_sequence:v1, 
beam:transform:org.apache.beam:bigquery_read:v1, 
beam:transform:org.apache.beam:bigquery_write:v1, 
beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, 
beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, 
beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, 
beam:transform:create_view:v1, beam:transform:flatten:v1, 
beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, 
beam:transform:group_into_batches_with_sharded_key:v1, 
beam:transform:impulse:v1, beam:transform:reshuffle:v1, 
beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, 
beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 
Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:external:java:sql:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6c779568
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:pubsub_read:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@f381794
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:pubsub_write:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2cdd0d4b
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:pubsublite_write:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7e9131d5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:pubsublite_read:v1: 
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2e1d27ba
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213   
beam:transform:org.apache.beam:spanner_insert:v1:

Build failed in Jenkins: beam_PostCommit_Python310 #1811

2024-01-23 Thread Apache Jenkins Server

See 


Changes:


--
[...truncated 11.83 MB...]
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/io/gcp/bigquery_tools.py",
 line 1022, in perform_load_job
return self._insert_load_job(
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/utils/retry.py",
 line 298, in wrapper
return fun(*args, **kwargs)
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/io/gcp/bigquery_tools.py",
 line 559, in _insert_load_job
return self._start_job(request, stream=source_stream).jobReference
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/io/gcp/bigquery_tools.py",
 line 578, in _start_job
response = self.client.jobs.Insert(request, upload=upload)
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/io/gcp/internal/clients/bigquery/bigquery_v2_client.py",
 line 356, in Insert
return self._RunMethod(
  File "/usr/local/lib/python3.10/site-packages/apitools/base/py/base_api.py", 
line 731, in _RunMethod
return self.ProcessHttpResponse(method_config, http_response, request)
  File "/usr/local/lib/python3.10/site-packages/apitools/base/py/base_api.py", 
line 737, in ProcessHttpResponse
self.__ProcessHttpResponse(method_config, http_response, request))
  File "/usr/local/lib/python3.10/site-packages/apitools/base/py/base_api.py", 
line 603, in __ProcessHttpResponse
raise exceptions.HttpError.FromResponse(
apitools.base.py.exceptions.HttpBadRequestError: HttpError accessing 
:
 response: <{'vary': 'Origin, X-Origin, Referer', 'content-type': 
'application/json; charset=UTF-8', 'date': 'Tue, 23 Jan 2024 09:24:38 GMT', 
'server': 'ESF', 'cache-control': 'private', 'x-xss-protection': '0', 
'x-frame-options': 'SAMEORIGIN', 'x-content-type-options': 'nosniff', 
'transfer-encoding': 'chunked', 'status': '400', 'content-length': '318', 
'-content-encoding': 'gzip'}>, content <{
  "error": {
"code": 400,
"message": "Load configuration must specify at least one source URI",
"errors": [
  {
"message": "Load configuration must specify at least one source URI",
"domain": "global",
"reason": "invalid"
  }
],
"status": "INVALID_ARGUMENT"
  }
}
>

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/runners/worker/sdk_worker.py",
 line 311, in _execute
response = task()
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/runners/worker/sdk_worker.py",
 line 386, in 
lambda: self.create_worker().do_instruction(request), request)
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/runners/worker/sdk_worker.py",
 line 650, in do_instruction
return getattr(self, request_type)(
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/runners/worker/sdk_worker.py",
 line 688, in process_bundle
bundle_processor.process_bundle(instruction_id))
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/runners/worker/bundle_processor.py",
 line 1113, in process_bundle
input_op_by_transform_id[element.transform_id].process_encoded(
  File 
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/runners/worker/bundle_processor.py",
 line 237, in process_encoded
self.output(decoded_value)
  File "apache_beam/runners/worker/operations.py", line 570, in 
apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 572, in 
apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 263, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 266, in 
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 953, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/worker/operations.py", line 954, in 
apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/common.py", line 1437, in 
apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 1526, in 
apache_beam.runners.common.DoFnRunner._reraise_augmented
  File "apache_beam/runners/common.py", line 1435, in 
apache_beam.runners.common.DoFnRunner.process
  File

39 matches

Mail list logo