See <https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_Java17/2/display/redirect?page=changes>
Changes: [sergey.kalinin] Initial add for dockerfiles and build scripts [sergey.kalinin] Initial add for terraform scripts for infra provision [sergey.kalinin] Add licenses [sergey.kalinin] Add fixes to docker plugin and also build arg for beam sdk image [sergey.kalinin] Remove wrongly added comments [sergey.kalinin] Add beam playground applications deploy [sergey.kalinin] Remove wrongly added log file [sergey.kalinin] Fix syntax [sergey.kalinin] Added default values [sergey.kalinin] Add default value to base image [Kyle Weaver] Update Beam website to release 2.34.0. [sergey.kalinin] Added Beam Version as build arg, also changed way of getting tags for [sergey.kalinin] Added readme file [sergey.kalinin] Add workflow to build backend application [sergey.kalinin] Add license [asottile] remove unused future / futures dependencies [sergey.kalinin] Add frontend workflow [brachipa] [BEAM-12737] error handling for sql calc error [brachipa] [BEAM-12737] error handling for sql calc error [brachipa] [BEAM-12737] error handling for sql calc error [brachipa] [BEAM-12737] add test [brachipa] [BEAM-12737] fix build [brachipa] [BEAM-12737] fix build [brachipa] revert [sergey.kalinin] Add license to README and added reader access to bucket [sergey.kalinin] Remove trailing whitespace [brachipa] [beam-12737] cr fix [mmack] [BEAM-13009] Bugfix: Prevent dataloss in DynamoDBIO write if [mmack] [BEAM-13009] Bugfix: Prevent dataloss in DynamoDBIO write if [relax] for existing tables, no need to set a schema [brachipa] [beam-12737] cr fixes [avilovpavel6] Fix environment_service_test.go [Alexey Romanenko] [BEAM-8727] Bump software.amazon.awssdk to 2.17.77 [sergey.kalinin] Remove comment from dockerfile [brachipa] [beam-12737] send errorTransformer to `buildPTransform` [brachipa] [beam-12737] send errorTransformer to `buildPTransform` [brachipa] [beam-12737] fix type `? extends POutput` [noreply] [BEAM-13190] Elide trailing nils (#15920) [noreply] [BEAM-13052] Increment protobuf version to 3.19.0 (#15883) [noreply] [BEAM-3304] refactoring trigger package in GoSDK (#15933) [noreply] [BEAM-13001] Hook to configure sampling period for DoFn metric [noreply] [BEAM-3293] Add MultiMap side input decomposition (#15934) [noreply] [BEAM-12651] Exclude packages from jacoco report (#15792) [noreply] [BEAM-13222] Skip spanner integration tests (#15942) [noreply] BEAM-13189 Python TextIO: add escapechar feature. (#15901) [noreply] [BEAM-12550] Parallelizable kurtosis Implementation (#15909) [noreply] [BEAM-13016] Remove avro-python3 dependency from Beam (#15900) [Robert Bradshaw] Make sure implicit inputs are noted in the portable graph. [Kyle Weaver] Prepare docs for 2.34.0 release. [noreply] [BEAM-13133] Loosen partitioning requirement for sample (#15818) [noreply] [BEAM-13228] fix data race in metrics.store (#15946) [noreply] [BEAM-3293] Add binding cases for MultiMap side inputs (#15943) [noreply] [BEAM-13222] Re-enable Spanner integration tests (#15948) [noreply] Merge pull request #15926 from [BEAM-13110][Playground] Playground [noreply] [BEAM-13025] Disable deduplicating messages, as Dedupe is broken on [noreply] [BEAM-13001] collect DoFn metrics for Combine (#15911) [aydar.zaynutdinov] [BEAM-13224][Playground] [Alexey Romanenko] [BEAM-4868] Bump com.amazonaws to 1.12.106 [aydar.zaynutdinov] [BEAM-13178][Playground] [noreply] [BEAM-13147] Fix nullability issues in aws (SDK v1 + v2) for AwsModule [noreply] [BEAM-3293] Add encoding of map/multimap side inputs into proto (#15960) [noreply] [BEAM-13052] Implement ProtoPlusCoder and add it to the default options [noreply] [BEAM-13193] Add elements field in ProcessBundleRequest and ProcessBu… [noreply] [BEAM-3304] Refactor trigger API (#15952) [noreply] [BEAM-3293] Add NewKeyedIterable function to SideInputAdapter interface [Robert Bradshaw] Fully resolve type variables after PTransform type inference. [Pablo Estrada] [BEAM-8033] Throwing an error if a dataSourceProviderFn is defined twice [noreply] [BEAM-13223] Documents two new features of cross-language transforms [brachipa] [beam-12737] add complex test, change error row type [noreply] [BEAM-13226] Batch metrics parsing errors (#15972) [noreply] [BEAM-13239] pass through io.EOF when decoding row (#15971) [noreply] [BEAM-5378] Register types & funcs for examples. (#15970) [Robert Bradshaw] Key-inferable type hints for CombinePerKey. [Robert Bradshaw] Implement type variable binding for union types. [Robert Bradshaw] Add comment about wildcard. [noreply] [BEAM-3293] Add initial MultiMap side input backing type (#15975) [Robert Bradshaw] Type inference deterministic coder fix for old Python versions. [Robert Bradshaw] Also implement type matching for union types. [noreply] [BEAM-13238] Bump all Dataflow Java VR timeouts (#15979) [noreply] Merge pull request #15978: [BEAM-8691] Upgrading Java deps compatible [noreply] [BEAM-13221] Don't drop last data. (#15939) [minherz] fix: update dlp dependency version range [noreply] [BEAM-3293] Finish E2E implementation of MultiMap side inputs, add [noreply] Merge pull request #15740 from [BEAM-12936][Playground] Code editor - [noreply] Merge pull request #15976 from [Playground][BEAM-12941][Bugfix] Fix [noreply] Merge pull request #15991 [BEAM-13251][Playground] [Bugfix] Lint Fails [noreply] Merge pull request #15990 from [BEAM-13177][Playground] Change using of [noreply] [BEAM-13262] Forward for metrics.SingleResult (#15993) [noreply] Generate Python container dependencies in an automated way. (#15927) [noreply] [BEAM-13264] Allow pyarrow up to 6.x (#15995) [noreply] Update the go get command with v2 (#15945) [noreply] Go Quickstart: switch to Spark 3 JobServer for better out-of-box [noreply] Golint fixes for recent Go SDK import (#15999) [noreply] Merge pull request #15997: [BEAM-8688] Upgrading gcsio library to latest [Robert Bradshaw] Allow wildcards for java class lookup transform providers. [Robert Bradshaw] Disallow getClass().forname(). [Robert Bradshaw] Docs, globbing, and a test. [Robert Bradshaw] Defer expansion service creation for easier testing. [Robert Bradshaw] Allow java jar service with classpath. [avilovpavel6] Support GO sdk [samuelw] [BEAM-12818] Write windowed file output to a consistent subdirectory [dpcollins] Fix race condition in Pub/Sub Lite SDF that causes it to error out when [dpcollins] edit [vitaly.ivanov] [BEAM-13269] Data exceeds database column capacity error while inserting [vitaly.ivanov] [BEAM-13269] Data exceeds database column capacity error while inserting [samuelw] [BEAM-13268] Change autosharding big query inserts to happen in parallel [noreply] [BEAM-3293] Add check for error on NewIterable call (#16006) [Brian Hulette] remove pkg_resources in run_generate_requirements.sh [Brian Hulette] Run generatePythonRequirementsAll for pyarrow 6 [noreply] Update dev container tags used by Dataflow runner with unreleased SDKs. [noreply] [BEAM-13265] Add withDeterministicRecordIdFn which allows for [noreply] [BEAM-13183] [BEAM-8152] Use venv instead of virtualenv to create Python [noreply] Merge pull request #15785 from Support for passing priority parameter in [dpcollins] Restructure processor to access beam types from downcall thread [dpcollins] Restructure processor to access beam types from downcall thread [noreply] [BEAM-13283] Skip apache beam dependency installation from [dpcollins] Restructure processor to access beam types from downcall thread [noreply] Merge pull request #15956 from [BEAM-13210] [Playground]: support [noreply] created quickstart guide for multi-language pipelines (Python) (#16001) [dpcollins] use interface in logger to work around likely SLF4J bug [dpcollins] revert logger class [noreply] Revert "Allow wildcards for java class lookup transform providers." [Valentyn Tymofieiev] Moving to 2.36.0-SNAPSHOT on master branch. [Valentyn Tymofieiev] Add future back to Beam containers. [noreply] [BEAM-13290] Handle disable_prime_runner_v2 flag (#16018) [noreply] [BEAM-11936] Add configuration parameter for suppressing unusedvariable [noreply] Merge pull request #15957 from [BEAM-13045][Playground] Implemented [noreply] [BEAM-13286] RowJson should expect ReadableInstant for DATETIME values [noreply] Merge pull request #16025 from [BEAM-13216] [Playground] Add client to [ningkang0957] Updated dep and goldens for Interactive Beam screen diff tests [ningkang0957] Removed Pillow from requirements of containers. [noreply] Merge pull request #16013 from [BEAM-13281] [playground] Update favicon [noreply] Merge pull request #15768 from [BEAM-13064] [Playground] Implement [noreply] Added go code coverage report with codecov (#16020) [kileysok] Increase timeout for Dataflow Streaming VR [benjamin.gonzalez] [BEAM-13003] Integration Test for DebeziumIO that connects to [noreply] Increase the timeout for LoadTest Jenkins jobs 4h->12h. [noreply] Merge pull request #16032 from [BEAM-13297][Playground][Bugfix] [noreply] Merge pull request #16031 from [BEAM-13296][Playground][Bugfix] remove [noreply] Merge pull request #16030 from [BEAM-13219][Playground] Initialise [noreply] Merge pull request #15996 from [BEAM-13156][Playground] Implement [noreply] [BEAM-13073] UseParallelGC on Java container [noreply] Merge pull request #16002 from [BEAM-13101] [Playground] load examples [noreply] Merge pull request #16016 from [BEAM-13089][Playground] Enable [noreply] Merge pull request #16046 from [BEAM-13295] [Playground] [Bugfix] [noreply] Merge pull request #16048 from [Beam-13256] [Playground] Implement an [noreply] Merge pull request #16026 from [BEAM-13208][Playground] Separate stderr [noreply] Append to state in chunks. (#15983) [Luke Cwik] [BEAM-13313] Fix WindowingStrategy proto to use snake case field names. [Luke Cwik] [BEAM-13015] Simplify [noreply] [BEAM-12829] Never copy .gogradle/** for Python. (#16059) [Luke Cwik] [BEAM-13015] Simplify DataStreamsDecoder by moving hasNext logic to next [Kyle Weaver] [BEAM-13220] Update release instructions. [noreply] Merge pull request #16074 from [BEAM-13323][Playground] [Bugfix] Fix CI [noreply] Merge pull request #16050 from [BEAM-13307][Playground] Support Python [noreply] Merge pull request #16071 from [BEAM-13306][Playground] Add using of [noreply] [BEAM-11943] Fix wrong Klio logo being displayed (#16078) [noreply] Merge pull request #15954 from [BEAM-960][BEAM-1675] Improvements to [noreply] [BEAM-13284] Respect expiration time for all Redis write methods. [noreply] [BEAM-12697] Add SBE module and initial classes (#15733) [noreply] [Playground][Beam-13316][Bugfix] Fix Playground Frontend Precommit [Kyle Weaver] [BEAM-13337] Periodically delete stale spanner databases. [noreply] [BEAM-13115][Playground] Security – Mock Storage (#16047) [noreply] [BEAM-13335] Use shorter, numerical indices for dataframe reads. [noreply] Be more conservative about rebatching. (#16058) [noreply] [BEAM-12587] Allow None in Python's Any logical type. (#16055) ------------------------------------------ Started by timer Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on apache-beam-jenkins-9 (beam) in workspace <https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_Java17/ws/> The recommended git tool is: NONE No credentials specified Wiping out workspace first. Cloning the remote Git repository Cloning repository https://github.com/apache/beam.git > git init > <https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_Java17/ws/src> > # timeout=10 Fetching upstream changes from https://github.com/apache/beam.git > git --version # timeout=10 > git --version # 'git version 2.7.4' > git fetch --tags --progress https://github.com/apache/beam.git > +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # > timeout=10 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10 Fetching upstream changes from https://github.com/apache/beam.git > git fetch --tags --progress https://github.com/apache/beam.git > +refs/heads/*:refs/remotes/origin/* > +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* # > timeout=10 > git rev-parse origin/master^{commit} # timeout=10 Checking out Revision 33bcdf6f7e7adffdddc193ea52f9551d5f526b33 (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f 33bcdf6f7e7adffdddc193ea52f9551d5f526b33 # timeout=10 Commit message: "[BEAM-12587] Allow None in Python's Any logical type. (#16055)" > git rev-list --no-walk 8da177f64d314cf72e89a51e51fb0915f706a784 # timeout=10 No emails were triggered. [EnvInject] - Executing scripts and injecting environment variables after the SCM step. [EnvInject] - Injecting as environment variables the properties content SPARK_LOCAL_IP=127.0.0.1 SETUPTOOLS_USE_DISTUTILS=stdlib [EnvInject] - Variables injected successfully. [Gradle] - Launching build. [src] $ <https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_Java17/ws/src/gradlew> --continue --max-workers=6 -Dorg.gradle.jvmargs=-Xms2g -Dorg.gradle.jvmargs=-Xmx4g -Dorg.gradle.vfs.watch=false -Pdocker-pull-licenses :runners:google-cloud-dataflow-java:examples:java17PostCommit Starting a Gradle Daemon, 1 busy Daemon could not be reused, use --status for details > Task :buildSrc:compileJava NO-SOURCE > Task :buildSrc:compileGroovy FROM-CACHE > Task :buildSrc:pluginDescriptors > Task :buildSrc:processResources > Task :buildSrc:classes > Task :buildSrc:jar > Task :buildSrc:assemble > Task :buildSrc:spotlessGroovy FROM-CACHE > Task :buildSrc:spotlessGroovyCheck UP-TO-DATE > Task :buildSrc:spotlessGroovyGradle FROM-CACHE > Task :buildSrc:spotlessGroovyGradleCheck UP-TO-DATE > Task :buildSrc:spotlessCheck UP-TO-DATE > Task :buildSrc:pluginUnderTestMetadata > Task :buildSrc:compileTestJava NO-SOURCE > Task :buildSrc:compileTestGroovy NO-SOURCE > Task :buildSrc:processTestResources NO-SOURCE > Task :buildSrc:testClasses UP-TO-DATE > Task :buildSrc:test NO-SOURCE > Task :buildSrc:validatePlugins FROM-CACHE > Task :buildSrc:check UP-TO-DATE > Task :buildSrc:build Configuration on demand is an incubating feature. FAILURE: Build failed with an exception. * What went wrong: Task 'java17PostCommit' not found in project ':runners:google-cloud-dataflow-java:examples'. Some candidates are: 'java11PostCommit'. * Try: Run gradlew tasks to get a list of available tasks. Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 1m 3s Publishing build scan... https://gradle.com/s/ojmilhfqhfay2 Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
