See <https://ci-beam.apache.org/job/beam_PostCommit_Java_VR_Dataflow_V2/2/display/redirect?page=changes>
Changes: [Ismaël Mejía] [BEAM-10969] Upgrade Spark to version 2.4.7 [piotr.szuberski] Update proton-j 0.13.1 -> 0.16.0, update activemq 5.13.1 -> 5.14.5 [Robert Bradshaw] Cap number of partitions from above, not below. [Kenneth Knowles] Tighten visibility of DirectRunner classes now that Java ReferenceRunner [Ismaël Mejía] Enable UsesStrictTimerOrdering ValidatesRunner tests on Spark Classic [Robert Bradshaw] [BEAM-10988] Partition dataframes according to size estimates. [Robert Bradshaw] [BEAM-10988] Batch dataframes across partitions on the same worker. [piotr.szuberski] [BEAM-5589 BEAM-5590 BEAM-5591] Update Solr dependencies from 5.5.4 to [noreply] [BEAM-9196] Update testcontainers to 1.15.0-rc2 (#13031) [Kenneth Knowles] Add gradle target for ValidatesRunner against Dataflow forcing streaming [Kenneth Knowles] Add Jenkins job for ValidatesRunner against Dataflow forcing streaming [Kenneth Knowles] Remove DirectRunner dependency on deprecated CreatePCollectionView [Boyuan Zhang] Add unsupported BundleFinalizationHandler to portable batch Flink. [noreply] Delete unneeded PCollections in pipeline_from_stages() (#13014) [ningk] [BEAM-11045] Fix screendiff integration tests [Kenneth Knowles] Remove stability history from Dataflow streaming VR job [tysonjh] [BEAM-11053] Set projectId in BigQuery service. [Robert Bradshaw] [BEAM-9547] Implement covariance and correlation. [Robert Bradshaw] [BEAM-9547] Dataframe covariance and correlation. [Robert Bradshaw] Scalar apply method. [noreply] Revert "[BEAM-9196] Update testcontainers to 1.15.0-rc2 (#13031)" [Luke Cwik] [BEAM-11050] Duplicate accumulator if it appears in multiple windows. [noreply] [BEAM-11033] Updates Dataflow Metrics processor for portable job [pawel.pasterz] Update dependency [pawel.pasterz] Update dependency [pawel.pasterz] Linting [Luke Cwik] [BEAM-9309] Remove the READ urn/payload from the Java SDK harness. [noreply] Revert "Delete unneeded PCollections in pipeline_from_stages() (#13014)" [noreply] [BEAM-9196] Update testcontainers to 1.15.0-rc2 (#13071) [Steve Niemitz] [BEAM-11057] Make BigQueryIO.Read.withTestServices methods public [Robert Bradshaw] Introduce intermediate superclass for both Dataframe and Series. [noreply] Add Relative Path Sensitivity (#12955) [piotr.szuberski] [BEAM-10885] Add Avro support to Kafka table provider [piotr.szuberski] Remove booleans, use List of values [piotr.szuberski] Fixes after CR [piotr.szuberski] Change payloadFormat to format like in text table provider [piotr.szuberski] Fix checkstyle [piotr.szuberski] Use SimpleFunction instead of SerializableFunction [piotr.szuberski] Remove getSchema() and listFrom(), make abstract generateRow, add [piotr.szuberski] Remove generification of KafkaTestRecord [piotr.szuberski] Add missing close paren [piotr.szuberski] Get rid of getTable() and KafkaTestTable inheritance [piotr.szuberski] Fix comment [piotr.szuberski] Inline getRecordValueBytes [piotr.szuberski] Remove generification of generateProducerRecord [piotr.szuberski] Add full-stops to javadocs [piotr.szuberski] Move statistics tests to separate file [piotr.szuberski] Throw exception instead of returning null. [piotr.szuberski] Update create-external-table.md [piotr.szuberski] Update CHANGES.md [piotr.szuberski] Use ByteArraySerializer as kafka value serializer [Kenneth Knowles] Enable some supported ZetaSQL functions [noreply] [BEAM-11056] Fix warning message and rename old APIs (#13080) [rohde.samuel] Add ability for HotKeyLogger to log a key. [noreply] [BEAM-10861]Adds PubSub Runner API encoding to Read/Write transforms [noreply] [BEAM-8251] Add worker_region and worker_zone options (#13072) [noreply] [BEAM-10720] Finish implementing StringMethods (cat, repeat) (#12705) [noreply] [BEAM-10009] Document micros_instant (#12921) [noreply] Update CHANGES.md [noreply] Update [noreply] Update [noreply] Update [noreply] [BEAM-10987] Skip test_with_main_session on windows (#13099) [noreply] [BEAM-9616] Allow new RegisterDoFn behaviour to be disabled (#13103) [noreply] [BEAM-11020] Adding multi-window splitting to Go SDF. (#13070) ------------------------------------------ Started by timer Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on apache-beam-jenkins-7 (beam) in workspace <https://ci-beam.apache.org/job/beam_PostCommit_Java_VR_Dataflow_V2/ws/> No credentials specified Wiping out workspace first. Cloning the remote Git repository Cloning repository https://github.com/apache/beam.git > git init > <https://ci-beam.apache.org/job/beam_PostCommit_Java_VR_Dataflow_V2/ws/src> > # timeout=10 Fetching upstream changes from https://github.com/apache/beam.git > git --version # timeout=10 > git fetch --tags --progress https://github.com/apache/beam.git > +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # > timeout=10 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10 Fetching upstream changes from https://github.com/apache/beam.git > git fetch --tags --progress https://github.com/apache/beam.git > +refs/heads/*:refs/remotes/origin/* > +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* # > timeout=10 > git rev-parse origin/master^{commit} # timeout=10 Checking out Revision 7340bce95a26969abbf9702e342f0174a99f222a (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f 7340bce95a26969abbf9702e342f0174a99f222a # timeout=10 Commit message: "[BEAM-10885] Add Avro support to Kafka table provider (#12827)" > git rev-list --no-walk 571338b0cc96e2e80f23620fe86de5c92dffaccc # timeout=10 No emails were triggered. [EnvInject] - Executing scripts and injecting environment variables after the SCM step. [EnvInject] - Injecting as environment variables the properties content SPARK_LOCAL_IP=127.0.0.1 SETUPTOOLS_USE_DISTUTILS=stdlib [EnvInject] - Variables injected successfully. [Gradle] - Launching build. [src] $ <https://ci-beam.apache.org/job/beam_PostCommit_Java_VR_Dataflow_V2/ws/src/gradlew> --continue --max-workers=6 -Dorg.gradle.jvmargs=-Xms2g -Dorg.gradle.jvmargs=-Xmx4g -Pdocker-pull-licenses :runners:google-cloud-dataflow-java:validatesRunnerV2Test Starting a Gradle Daemon, 1 busy Daemon could not be reused, use --status for details > Task :buildSrc:compileJava NO-SOURCE > Task :buildSrc:compileGroovy FROM-CACHE > Task :buildSrc:pluginDescriptors > Task :buildSrc:processResources > Task :buildSrc:classes > Task :buildSrc:jar > Task :buildSrc:assemble > Task :buildSrc:spotlessGroovy FROM-CACHE > Task :buildSrc:spotlessGroovyCheck UP-TO-DATE > Task :buildSrc:spotlessGroovyGradle FROM-CACHE > Task :buildSrc:spotlessGroovyGradleCheck UP-TO-DATE > Task :buildSrc:spotlessCheck UP-TO-DATE > Task :buildSrc:pluginUnderTestMetadata > Task :buildSrc:compileTestJava NO-SOURCE > Task :buildSrc:compileTestGroovy NO-SOURCE > Task :buildSrc:processTestResources NO-SOURCE > Task :buildSrc:testClasses UP-TO-DATE > Task :buildSrc:test NO-SOURCE > Task :buildSrc:validatePlugins FROM-CACHE > Task :buildSrc:check UP-TO-DATE > Task :buildSrc:build Configuration on demand is an incubating feature. > Configure project :sdks:java:container Found go 1.12 in /usr/bin/go, use it. FAILURE: Build failed with an exception. * What went wrong: Task 'validatesRunnerV2Test' not found in project ':runners:google-cloud-dataflow-java'. * Try: Run gradlew tasks to get a list of available tasks. Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.6.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 27s Publishing build scan... https://gradle.com/s/5ymv5wlbeko42 Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
