See <https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Json/3098/display/redirect?page=changes>
Changes: [daria.malkova] Support SCIO SDK via sbt projects [samuelw] [BEAM-11648] Share thread pool across RetryManager instances. [Pablo Estrada] Exclude per-key order tests on Twister2 runner [Heejong Lee] Fix Java SDK container image name for load-tests and nexmark [noreply] [BEAM-11936] Enable a few errorprone checks that were broken by pinned [noreply] [BEAM-13780] Add CONTRIBUTING.md pointing to main guide (#16666) [noreply] [BEAM-13777] Accept cache capacity as input parameter instead of default [noreply] [BEAM-13051][A] Enable pylint warnings [noreply] [BEAM-13779] Fix pr labeling (#16665) [noreply] Merge pull request #16581 from [BEAM-12164]: Add [noreply] Fix labeler trigger (#16674) [noreply] [BEAM-13781] Exclude grpc-netty-shaded from gax-grpc's dependency [noreply] [BEAM-13051] Fixed pylint warnings : raising-non-exception (E0710), [noreply] [BEAM-13740] Correctly install go before running tests (#16673) [noreply] [BEAM-12830] Update local Docker env Go version. (#16670) [noreply] [BEAM-13051][B] Enable pylint warnings [noreply] [BEAM-13430] Revert Spark libraries in Spark runner to provided (#16675) [noreply] [BEAM-12240] Add Java 17 support (#16568) [noreply] [BEAM-13760] Add random component to default python dataflow job name ------------------------------------------ Started by timer Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on apache-beam-jenkins-3 (beam) in workspace <https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Json/ws/> The recommended git tool is: NONE No credentials specified Wiping out workspace first. Cloning the remote Git repository Cloning repository https://github.com/apache/beam.git > git init > <https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Json/ws/src> > # timeout=10 Fetching upstream changes from https://github.com/apache/beam.git > git --version # timeout=10 > git --version # 'git version 2.25.1' > git fetch --tags --force --progress -- https://github.com/apache/beam.git > +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # > timeout=10 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10 Fetching upstream changes from https://github.com/apache/beam.git > git fetch --tags --force --progress -- https://github.com/apache/beam.git > +refs/heads/*:refs/remotes/origin/* > +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* # > timeout=10 > git rev-parse origin/master^{commit} # timeout=10 Checking out Revision 59b0b2a53140a149f06b3001505530173cbce9d8 (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f 59b0b2a53140a149f06b3001505530173cbce9d8 # timeout=10 Commit message: "[BEAM-13760] Add random component to default python dataflow job name (#16641)" > git rev-list --no-walk 43a5e5bea999c4937350a522b05fd76181bcf188 # timeout=10 No emails were triggered. [EnvInject] - Executing scripts and injecting environment variables after the SCM step. [EnvInject] - Injecting as environment variables the properties content SPARK_LOCAL_IP=127.0.0.1 SETUPTOOLS_USE_DISTUTILS=stdlib [EnvInject] - Variables injected successfully. [Gradle] - Launching build. [src] $ <https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Json/ws/src/gradlew> --continue --max-****s=12 -Dorg.gradle.jvmargs=-Xms2g -Dorg.gradle.jvmargs=-Xmx4g -Dorg.gradle.vfs.watch=false -Pdocker-pull-licenses --info -DintegrationTestPipelineOptions=["--project=apache-beam-testing","--tempLocation=gs://temp-storage-for-perf-tests/loadtests","--tempRoot=gs://temp-storage-for-perf-tests/loadtests","--writeMethod=FILE_LOADS","--writeFormat=JSON","--testBigQueryDataset=beam_performance","--testBigQueryTable=bqio_write_10GB_java_json_0201013106","--metricsBigQueryDataset=beam_performance","--metricsBigQueryTable=bqio_10GB_results_java_batch_json","--influxMeasurement=bqio_10GB_results_java_batch_json","--sourceOptions={\"numRecords\":\"10485760\",\"keySizeBytes\":\"1\",\"valueSizeBytes\":\"1024\"}","--runner=DataflowRunner","--maxNumWorkers=5","--numWorkers=5","--autoscalingAlgorithm=NONE","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086";] -DintegrationTestRunner=dataflow :sdks:java:io:bigquery-io-perf-tests:integrationTest --tests org.apache.beam.sdk.bigqueryioperftests.BigQueryIOIT Initialized native services in: /home/jenkins/.gradle/native Initialized jansi services in: /home/jenkins/.gradle/native Removing 0 daemon stop events from registry Starting a Gradle Daemon, 3 busy Daemons could not be reused, use --status for details Starting process 'Gradle build daemon'. Working directory: /home/jenkins/.gradle/daemon/7.3.2 Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -Xmx4g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -cp /home/jenkins/.gradle/wrapper/dists/gradle-7.3.2-bin/4k4cn06q0rruwh9dpndf9gmi8/gradle-7.3.2/lib/gradle-launcher-7.3.2.jar org.gradle.launcher.daemon.bootstrap.GradleDaemon 7.3.2 Successfully started process 'Gradle build daemon' An attempt to start the daemon took 3.981 secs. The client will now receive all logging from the daemon (pid: 2363556). The daemon log file: /home/jenkins/.gradle/daemon/7.3.2/daemon-2363556.out.log Starting build in new daemon [memory: 3.5 GiB] Closing daemon's stdin at end of input. The daemon will no longer process any standard input. Using 12 **** leases. Configuration on demand is an incubating feature. Watching the file system is configured to be disabled File system watching is inactive Starting Build Skipping Kotlin DSL script compilation (Settings/TopLevel/stage1) as it is up-to-date. Skipping Kotlin DSL script compilation (Settings/TopLevel/stage2) as it is up-to-date. Settings evaluated using settings file '<https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Json/ws/src/settings.gradle.kts'.> Using local directory build cache for the root build (location = /home/jenkins/.gradle/caches/build-cache-1, removeUnusedEntriesAfter = 7 days). Projects loaded. Root project using build file '<https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Json/ws/src/build.gradle.kts'.> Included projects: [root project 'beam', project ':beam-test-infra-metrics', project ':beam-test-jenkins', project ':beam-test-tools', project ':beam-validate-runner', project ':examples', project ':model', project ':playground', project ':release', project ':runners', project ':sdks', project ':vendor', project ':website', project ':examples:java', project ':examples:kotlin', project ':examples:multi-language', project ':model:fn-execution', project ':model:job-management', project ':model:pipeline', project ':playground:backend', project ':playground:frontend', project ':release:go-licenses', project ':runners:core-construction-java', project ':runners:core-java', project ':runners:direct-java', project ':runners:extensions-java', project ':runners:flink', project ':runners:google-cloud-dataflow-java', project ':runners:java-fn-execution', project ':runners:java-job-service', project ':runners:jet', project ':runners:local-java', project ':runners:portability', project ':runners:samza', project ':runners:spark', project ':runners:twister2', project ':sdks:go', project ':sdks:java', project ':sdks:python', project ':vendor:bytebuddy-1_11_0', project ':vendor:calcite-1_28_0', project ':vendor:grpc-1_43_2', project ':vendor:guava-26_0-jre', project ':examples:java:twitter', project ':playground:backend:containers', project ':release:go-licenses:go', project ':release:go-licenses:java', project ':release:go-licenses:py', project ':runners:extensions-java:metrics', project ':runners:flink:1.11', project ':runners:flink:1.12', project ':runners:flink:1.13', project ':runners:google-cloud-dataflow-java:examples', project ':runners:google-cloud-dataflow-java:examples-streaming', project ':runners:google-cloud-dataflow-java:****', project ':runners:portability:java', project ':runners:samza:job-server', project ':runners:spark:2', project ':runners:spark:3', project ':sdks:go:container', project ':sdks:go:examples', project ':sdks:go:test', project ':sdks:java:bom', project ':sdks:java:build-tools', project ':sdks:java:container', project ':sdks:java:core', project ':sdks:java:expansion-service', project ':sdks:java:extensions', project ':sdks:java:fn-execution', project ':sdks:java:harness', project ':sdks:java:io', project ':sdks:java:javadoc', project ':sdks:java:maven-archetypes', project ':sdks:java:testing', project ':sdks:python:apache_beam', project ':sdks:python:container', project ':sdks:python:test-suites', project ':playground:backend:containers:go', project ':playground:backend:containers:java', project ':playground:backend:containers:python', project ':playground:backend:containers:scio', project ':runners:flink:1.11:job-server', project ':runners:flink:1.11:job-server-container', project ':runners:flink:1.12:job-server', project ':runners:flink:1.12:job-server-container', project ':runners:flink:1.13:job-server', project ':runners:flink:1.13:job-server-container', project ':runners:google-cloud-dataflow-java:****:legacy-****', project ':runners:google-cloud-dataflow-java:****:windmill', project ':runners:spark:2:job-server', project ':runners:spark:3:job-server', project ':sdks:go:test:load', project ':sdks:java:bom:gcp', project ':sdks:java:container:java11', project ':sdks:java:container:java17', project ':sdks:java:container:java8', project ':sdks:java:expansion-service:app', project ':sdks:java:extensions:arrow', project ':sdks:java:extensions:euphoria', project ':sdks:java:extensions:google-cloud-platform-core', project ':sdks:java:extensions:jackson', project ':sdks:java:extensions:join-library', project ':sdks:java:extensions:kryo', project ':sdks:java:extensions:ml', project ':sdks:java:extensions:protobuf', project ':sdks:java:extensions:sbe', project ':sdks:java:extensions:schemaio-expansion-service', project ':sdks:java:extensions:sketching', project ':sdks:java:extensions:sorter', project ':sdks:java:extensions:sql', project ':sdks:java:extensions:zetasketch', project ':sdks:java:io:amazon-web-services', project ':sdks:java:io:amazon-web-services2', project ':sdks:java:io:amqp', project ':sdks:java:io:azure', project ':sdks:java:io:bigquery-io-perf-tests', project ':sdks:java:io:cassandra', project ':sdks:java:io:clickhouse', project ':sdks:java:io:common', project ':sdks:java:io:contextualtextio', project ':sdks:java:io:debezium', project ':sdks:java:io:elasticsearch', project ':sdks:java:io:elasticsearch-tests', project ':sdks:java:io:expansion-service', project ':sdks:java:io:file-based-io-tests', project ':sdks:java:io:google-cloud-platform', project ':sdks:java:io:hadoop-common', project ':sdks:java:io:hadoop-file-system', project ':sdks:java:io:hadoop-format', project ':sdks:java:io:hbase', project ':sdks:java:io:hcatalog', project ':sdks:java:io:influxdb', project ':sdks:java:io:jdbc', project ':sdks:java:io:jms', project ':sdks:java:io:kafka', project ':sdks:java:io:kinesis', project ':sdks:java:io:kudu', project ':sdks:java:io:mongodb', project ':sdks:java:io:mqtt', project ':sdks:java:io:parquet', project ':sdks:java:io:rabbitmq', project ':sdks:java:io:redis', project ':sdks:java:io:snowflake', project ':sdks:java:io:solr', project ':sdks:java:io:splunk', project ':sdks:java:io:synthetic', project ':sdks:java:io:thrift', project ':sdks:java:io:tika', project ':sdks:java:io:xml', project ':sdks:java:maven-archetypes:examples', project ':sdks:java:maven-archetypes:gcp-bom-examples', project ':sdks:java:maven-archetypes:starter', project ':sdks:java:testing:expansion-service', project ':sdks:java:testing:jpms-tests', project ':sdks:java:testing:kafka-service', project ':sdks:java:testing:load-tests', project ':sdks:java:testing:nexmark', project ':sdks:java:testing:test-utils', project ':sdks:java:testing:tpcds', project ':sdks:java:testing:watermarks', project ':sdks:python:apache_beam:testing', project ':sdks:python:container:py36', project ':sdks:python:container:py37', project ':sdks:python:container:py38', project ':sdks:python:test-suites:dataflow', project ':sdks:python:test-suites:direct', project ':sdks:python:test-suites:portable', project ':sdks:python:test-suites:tox', project ':runners:spark:2:job-server:container', project ':runners:spark:3:job-server:container', project ':sdks:java:extensions:sql:datacatalog', project ':sdks:java:extensions:sql:expansion-service', project ':sdks:java:extensions:sql:hcatalog', project ':sdks:java:extensions:sql:jdbc', project ':sdks:java:extensions:sql:payloads', project ':sdks:java:extensions:sql:perf-tests', project ':sdks:java:extensions:sql:shell', project ':sdks:java:extensions:sql:udf', project ':sdks:java:extensions:sql:udf-test-provider', project ':sdks:java:extensions:sql:zetasql', project ':sdks:java:io:debezium:expansion-service', project ':sdks:java:io:elasticsearch-tests:elasticsearch-tests-2', project ':sdks:java:io:elasticsearch-tests:elasticsearch-tests-5', project ':sdks:java:io:elasticsearch-tests:elasticsearch-tests-6', project ':sdks:java:io:elasticsearch-tests:elasticsearch-tests-7', project ':sdks:java:io:elasticsearch-tests:elasticsearch-tests-common', project ':sdks:java:io:google-cloud-platform:expansion-service', project ':sdks:java:io:kinesis:expansion-service', project ':sdks:java:io:snowflake:expansion-service', project ':sdks:python:apache_beam:testing:load_tests', project ':sdks:python:test-suites:dataflow:py36', project ':sdks:python:test-suites:dataflow:py37', project ':sdks:python:test-suites:dataflow:py38', project ':sdks:python:test-suites:direct:py36', project ':sdks:python:test-suites:direct:py37', project ':sdks:python:test-suites:direct:py38', project ':sdks:python:test-suites:direct:xlang', project ':sdks:python:test-suites:portable:py36', project ':sdks:python:test-suites:portable:py37', project ':sdks:python:test-suites:portable:py38', project ':sdks:python:test-suites:tox:py36', project ':sdks:python:test-suites:tox:py37', project ':sdks:python:test-suites:tox:py38', project ':sdks:python:test-suites:tox:pycommon'] > Configure project :buildSrc Evaluating project ':buildSrc' using build file '<https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Json/ws/src/buildSrc/build.gradle.kts'.> Invalidating in-memory cache of /home/jenkins/.gradle/caches/journal-1/file-access.bin Build cache key for Kotlin DSL plugin accessors for classpath '1331440f207a109aa79b23cc51a98546' is a83c873427fbccc6e997bfdaf6f08e57 Skipping Kotlin DSL plugin accessors for classpath '1331440f207a109aa79b23cc51a98546' as it is up-to-date. Build cache key for Kotlin DSL script compilation (Project/TopLevel/stage1) is 5d31f76450dc8edcf68fdeec007afdca Skipping Kotlin DSL script compilation (Project/TopLevel/stage1) as it is up-to-date. Build cache key for Kotlin DSL accessors for project ':buildSrc' is 4da4b0723b7c8d030b96881b71ab6f8b Skipping Kotlin DSL accessors for project ':buildSrc' as it is up-to-date. Build cache key for Kotlin DSL script compilation (Project/TopLevel/stage2) is a867e5fd2f35e34341a6ad0e447c049b Skipping Kotlin DSL script compilation (Project/TopLevel/stage2) as it is up-to-date. Selected primary task 'build' from project : :buildSrc:compileJava (Thread[Execution **** for ':buildSrc',5,main]) started. > Task :buildSrc:compileJava NO-SOURCE file or directory '<https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Json/ws/src/buildSrc/src/main/java',> not found Skipping task ':buildSrc:compileJava' as it has no source files and no previous output files. :buildSrc:compileJava (Thread[Execution **** for ':buildSrc',5,main]) completed. Took 0.207 secs. :buildSrc:compileGroovy (Thread[Execution **** for ':buildSrc' Thread 2,5,main]) started. > Task :buildSrc:compileGroovy Build cache key for task ':buildSrc:compileGroovy' is d7c94d640fdf2b10863e313e45cb568a Task ':buildSrc:compileGroovy' is not up-to-date because: No history is available. > Task :buildSrc:compileGroovy FAILED :buildSrc:compileGroovy (Thread[Execution **** for ':buildSrc' Thread 2,5,main]) completed. Took 1 mins 0.553 secs. :buildSrc:pluginDescriptors (Thread[Execution **** for ':buildSrc' Thread 6,5,main]) started. > Task :buildSrc:pluginDescriptors Caching disabled for task ':buildSrc:pluginDescriptors' because: Not worth caching Task ':buildSrc:pluginDescriptors' is not up-to-date because: No history is available. :buildSrc:pluginDescriptors (Thread[Execution **** for ':buildSrc' Thread 6,5,main]) completed. Took 0.818 secs. :buildSrc:processResources (Thread[Execution **** for ':buildSrc' Thread 2,5,main]) started. > Task :buildSrc:processResources file or directory '<https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Json/ws/src/buildSrc/src/main/resources',> not found Caching disabled for task ':buildSrc:processResources' because: Not worth caching Task ':buildSrc:processResources' is not up-to-date because: No history is available. file or directory '<https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Json/ws/src/buildSrc/src/main/resources',> not found :buildSrc:processResources (Thread[Execution **** for ':buildSrc' Thread 2,5,main]) completed. Took 0.135 secs. :buildSrc:spotlessGroovy (Thread[Execution **** for ':buildSrc' Thread 2,5,main]) started. > Task :buildSrc:spotlessGroovy file or directory '<https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Json/ws/src/buildSrc/src/test/groovy',> not found file or directory '<https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Json/ws/src/buildSrc/src/test/groovy',> not found Invalidating in-memory cache of /home/jenkins/.gradle/caches/journal-1/file-access.bin Build cache key for task ':buildSrc:spotlessGroovy' is ae8f745af02ff3bdbbdce47763b23781 Task ':buildSrc:spotlessGroovy' is not up-to-date because: No history is available. Invalidating in-memory cache of /home/jenkins/.gradle/caches/journal-1/file-access.bin Loaded cache entry for task ':buildSrc:spotlessGroovy' with cache key ae8f745af02ff3bdbbdce47763b23781 > Task :buildSrc:spotlessGroovy FROM-CACHE :buildSrc:spotlessGroovy (Thread[Execution **** for ':buildSrc' Thread 2,5,main]) completed. Took 35.658 secs. :buildSrc:spotlessGroovyCheck (Thread[Execution **** for ':buildSrc' Thread 6,5,main]) started. > Task :buildSrc:spotlessGroovyCheck UP-TO-DATE Caching disabled for task ':buildSrc:spotlessGroovyCheck' because: Caching has not been enabled for the task Task ':buildSrc:spotlessGroovyCheck' is not up-to-date because: Task has not declared any outputs despite executing actions. :buildSrc:spotlessGroovyCheck (Thread[Execution **** for ':buildSrc' Thread 6,5,main]) completed. Took 0.012 secs. :buildSrc:spotlessGroovyGradle (Thread[Execution **** for ':buildSrc' Thread 2,5,main]) started. > Task :buildSrc:spotlessGroovyGradle FROM-CACHE Build cache key for task ':buildSrc:spotlessGroovyGradle' is 4492d2e9ab6abfbdba67c84cbe6c0d91 Task ':buildSrc:spotlessGroovyGradle' is not up-to-date because: No history is available. Loaded cache entry for task ':buildSrc:spotlessGroovyGradle' with cache key 4492d2e9ab6abfbdba67c84cbe6c0d91 :buildSrc:spotlessGroovyGradle (Thread[Execution **** for ':buildSrc' Thread 2,5,main]) completed. Took 0.044 secs. :buildSrc:spotlessGroovyGradleCheck (Thread[Execution **** for ':buildSrc' Thread 6,5,main]) started. > Task :buildSrc:spotlessGroovyGradleCheck UP-TO-DATE Caching disabled for task ':buildSrc:spotlessGroovyGradleCheck' because: Caching has not been enabled for the task Task ':buildSrc:spotlessGroovyGradleCheck' is not up-to-date because: Task has not declared any outputs despite executing actions. :buildSrc:spotlessGroovyGradleCheck (Thread[Execution **** for ':buildSrc' Thread 6,5,main]) completed. Took 0.002 secs. :buildSrc:spotlessCheck (Thread[Execution **** for ':buildSrc' Thread 6,5,main]) started. > Task :buildSrc:spotlessCheck UP-TO-DATE Skipping task ':buildSrc:spotlessCheck' as it has no actions. :buildSrc:spotlessCheck (Thread[Execution **** for ':buildSrc' Thread 6,5,main]) completed. Took 0.0 secs. :buildSrc:processTestResources (Thread[Execution **** for ':buildSrc' Thread 6,5,main]) started. > Task :buildSrc:processTestResources NO-SOURCE file or directory '<https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Json/ws/src/buildSrc/src/test/resources',> not found Skipping task ':buildSrc:processTestResources' as it has no source files and no previous output files. :buildSrc:processTestResources (Thread[Execution **** for ':buildSrc' Thread 6,5,main]) completed. Took 0.002 secs. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':buildSrc:compileGroovy'. > Failed to load cache entry for task ':buildSrc:compileGroovy' * Try: > Run with --stacktrace option to get the stack trace. > Run with --debug option to get more log output. > Run with --scan to get full insights. * Get more help at https://help.gradle.org BUILD FAILED in 2m 6s 7 actionable tasks: 3 executed, 2 from cache, 2 up-to-date Publishing build scan... https://gradle.com/s/ncjv2tblaquxq Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
