See <https://ci-beam.apache.org/job/beam_SeedJob/8991/display/redirect?page=changes>
Changes: [noreply] Add missing parentheses for Python test example [noreply] Update test input and imports [heejong] [BEAM-13021] Deduplicate Python artifact not only by hash but also by [heejong] add test [Kyle Weaver] [BEAM-12976] Add Java interfaces for projection pushdown. [Kyle Weaver] fix cast [Kyle Weaver] [BEAM-12976] Address review comments. [sergey.kalinin] Initial add for dockerfiles and build scripts [heejong] [BEAM-13092] Adding dummy external transform translators for Dataflow [heejong] rename variables [sergey.kalinin] Initial add for terraform scripts for infra provision [Kyle Weaver] Hard-code output tag instead of making it public. [Kyle Weaver] revert MAIN_OUTPUT_TAG to private [sergey.kalinin] Add licenses [stranniknm] [BEAM-13105] playground - add shorcut hint tooltip [sergey.kalinin] Add fixes to docker plugin and also build arg for beam sdk image [sergey.kalinin] Remove wrongly added comments [sergey.kalinin] Add beam playground applications deploy [sergey.kalinin] Remove wrongly added log file [sergey.kalinin] Fix syntax [sergey.kalinin] Added default values [sergey.kalinin] Add default value to base image [Kyle Weaver] Update Beam website to release 2.34.0. [mmack] [BEAM-11440] Add integration test for KinesisIO using Localstack on [mmack] Bump localstack container version for more robust version with respect [mmack] Bump localstack container version for DynamoDBIOTest to version used in [mmack] Apply format [mmack] Apply format [mmack] Use vendored guava deps [sergey.kalinin] Added Beam Version as build arg, also changed way of getting tags for [25622840+adude3141] [BEAM-13157] support hadoop configuration on ParquetIO.Parse [Luke Cwik] [BEAM-3811] Code clean-up of the CancelleableQueue to not throw [Kyle Weaver] Remove WITHOUT_FIELD_ORDERING. Field reordering will be a prerequisite [Pablo Estrada] JdbcIO has a single WriteFn underlying all implementations [sergey.kalinin] Added readme file [dmitrii_kuzin] [BEAM-12730] Python. Custom delimiter add corner case [msbukal] Minor HL7v2IO Fixes [sergey.kalinin] Add workflow to build backend application [sergey.kalinin] Add license [asottile] remove unused future / futures dependencies [sergey.kalinin] Add frontend workflow [dpcollins] Performance improvement to PubSubLiteIO to not use a streaming committer [noreply] Merge pull request #15854 from [BEAM-13046][Playground] protobuf [noreply] [BEAM-12550] Parallelizable skew Implementation (#15809) [noreply] Merge pull request #15782 from [BEAM-13034] [Playground] add semantics [aydar.zaynutdinov] [BEAM-13155][Playground] [hlagosperez] Use BigQuieryIO.loadProjectId in WriteRename class to create [noreply] [BEAM-13099] Use vendored Calcite 1.28.0 in SQL extensions (#15836) [Luke Cwik] [BEAM-13015] Use a network based channel instead of an inmemory one [Pablo Estrada] Addressing comments [noreply] Merge pull request #15839 from [BEAM-13041][Playground] Prepare files [noreply] [BEAM-13001] updated CHANGES.md to include msec counter for Go (#15872) [noreply] Add window mapping to CHANGES.md (#15871) [noreply] Merge pull request #15784 from [BEAM-8135] - Removing [noreply] [BEAM-13119] Subdirectory prefix tag for Go SDK (#15881) [heejong] rearrange comparison order [noreply] Merge pull request #15852 from [BEAM-13102] [Playground] update [Kyle Weaver] Fix typo: s/spark/twister2 [Luke Cwik] [BEAM-13164] Address most of a race condition between instantiation and [Robert Bradshaw] Defer filesToStage construction until after full jar resolution. [heejong] s/pathes/paths/ [noreply] Merge pull request #15835: [BEAM-11205] Google Libraries BOM 24.0.0 and [brachipa] [BEAM-12737] error handling for sql calc error [noreply] Merge pull request #15810: [BEAM-2791] Support low-latency StorageApi [dpcollins] Add detection of BundleFinalizers to DoFnSignatures [dpcollins] Add enable_prime to the unified worker experiment list. [dpcollins] Raise an exception before trying to launch a pipeline using [brachipa] [BEAM-12737] error handling for sql calc error [brachipa] [BEAM-12737] error handling for sql calc error [noreply] [BEAM-13081] Fixes a compatible issue of decoding null-value bitmap [dpcollins] Fix detection to properly null check. [noreply] [adhoc] Speedup slow tests for AWS IO modules (#15899) [noreply] [BEAM-12566] Implement set_axis for DataFrame and Series (#15773) [noreply] [BEAM-13192] Fix buggy retry tests for AWS SnsIO (#15910) [noreply] [BEAM-11217] Metrics Query filtering for DoFn metrics. (#15887) [noreply] [Go SDK] Go SDK Exits Experimental (#15894) [joseinigo] [BEAM-13080] Fix number of default keys [relax] remove log statement [joseinigo] [BEAM-13080] Fix number of default keys [25622840+adude3141] [BEAM-13157] add regression test for hadoop configuration on [brachipa] [BEAM-12737] add test [brachipa] [BEAM-12737] fix build [brachipa] [BEAM-12737] fix build [brachipa] revert [sergey.kalinin] Add license to README and added reader access to bucket [sergey.kalinin] Remove trailing whitespace [noreply] Merge pull request #15873 from [BEAM-13181] Remove Sharding from [noreply] Merge pull request #15813 from [BEAM-13071] [Playground] Update run code [Kyle Weaver] [BEAM-5172] Temporary ignore testSplit and testSizes tests waiting for a [Andrew Pilloud] [BEAM-13056] Expose FieldAccess in DoFnSchemaInformation [brachipa] [beam-12737] cr fix [noreply] [BEAM-11097] Create hook to enable cross-bundle side input caching [noreply] Merge pull request #15804 from [BEAM-13109][Playground] Add processing [noreply] Improve FhirIO LRO Counters + minor fixes (#15921) [mmack] [BEAM-13009] Bugfix: Prevent dataloss in DynamoDBIO write if [mmack] [BEAM-13009] Bugfix: Prevent dataloss in DynamoDBIO write if [noreply] Merge pull request #15771 from Enable BQ Standard SQL dialect style [noreply] [BEAM-11217] Metrics querying for Pcol metrics (#15923) [relax] for existing tables, no need to set a schema [brachipa] [beam-12737] cr fixes [avilovpavel6] Fix environment_service_test.go [Alexey Romanenko] [BEAM-8727] Bump software.amazon.awssdk to 2.17.77 [sergey.kalinin] Remove comment from dockerfile [brachipa] [beam-12737] send errorTransformer to `buildPTransform` [brachipa] [beam-12737] send errorTransformer to `buildPTransform` [brachipa] [beam-12737] fix type `? extends POutput` [noreply] [BEAM-13190] Elide trailing nils (#15920) [noreply] [BEAM-13052] Increment protobuf version to 3.19.0 (#15883) [noreply] [BEAM-3304] refactoring trigger package in GoSDK (#15933) [noreply] [BEAM-13001] Hook to configure sampling period for DoFn metric [noreply] [BEAM-3293] Add MultiMap side input decomposition (#15934) [noreply] [BEAM-12651] Exclude packages from jacoco report (#15792) [noreply] [BEAM-13222] Skip spanner integration tests (#15942) [noreply] BEAM-13189 Python TextIO: add escapechar feature. (#15901) [noreply] [BEAM-12550] Parallelizable kurtosis Implementation (#15909) [noreply] [BEAM-13016] Remove avro-python3 dependency from Beam (#15900) [fernando.morales] Java SDK 17 Harness docker image and addition of Nexmark tests [Robert Bradshaw] Make sure implicit inputs are noted in the portable graph. [Kyle Weaver] Prepare docs for 2.34.0 release. [noreply] [BEAM-13133] Loosen partitioning requirement for sample (#15818) [noreply] [BEAM-13228] fix data race in metrics.store (#15946) [noreply] [BEAM-3293] Add binding cases for MultiMap side inputs (#15943) [noreply] [BEAM-13222] Re-enable Spanner integration tests (#15948) [noreply] Merge pull request #15926 from [BEAM-13110][Playground] Playground [noreply] [BEAM-13025] Disable deduplicating messages, as Dedupe is broken on [noreply] [BEAM-13001] collect DoFn metrics for Combine (#15911) [aydar.zaynutdinov] [BEAM-13224][Playground] [Alexey Romanenko] [BEAM-4868] Bump com.amazonaws to 1.12.106 [aydar.zaynutdinov] [BEAM-13178][Playground] [noreply] [BEAM-13147] Fix nullability issues in aws (SDK v1 + v2) for AwsModule [noreply] [BEAM-3293] Add encoding of map/multimap side inputs into proto (#15960) [noreply] [BEAM-13052] Implement ProtoPlusCoder and add it to the default options [noreply] [BEAM-13193] Add elements field in ProcessBundleRequest and ProcessBu… [noreply] [BEAM-3304] Refactor trigger API (#15952) [noreply] [BEAM-3293] Add NewKeyedIterable function to SideInputAdapter interface [Robert Bradshaw] Fully resolve type variables after PTransform type inference. [Pablo Estrada] [BEAM-8033] Throwing an error if a dataSourceProviderFn is defined twice [noreply] [BEAM-13223] Documents two new features of cross-language transforms [brachipa] [beam-12737] add complex test, change error row type [mmack] [BEAM-11494][BEAM-11821] FileIO stops overwriting files on retries (AWS [noreply] [BEAM-13226] Batch metrics parsing errors (#15972) [noreply] [BEAM-13239] pass through io.EOF when decoding row (#15971) [noreply] [BEAM-5378] Register types & funcs for examples. (#15970) [Robert Bradshaw] Key-inferable type hints for CombinePerKey. [Robert Bradshaw] Implement type variable binding for union types. [Robert Bradshaw] Add comment about wildcard. [noreply] [BEAM-3293] Add initial MultiMap side input backing type (#15975) [Robert Bradshaw] Type inference deterministic coder fix for old Python versions. [Robert Bradshaw] Also implement type matching for union types. [noreply] [BEAM-13238] Bump all Dataflow Java VR timeouts (#15979) [noreply] Merge pull request #15978: [BEAM-8691] Upgrading Java deps compatible [noreply] [BEAM-13221] Don't drop last data. (#15939) [minherz] fix: update dlp dependency version range [noreply] [BEAM-3293] Finish E2E implementation of MultiMap side inputs, add [fernando.morales] Run Direct and Dataflow ValidatesRunner tests compiled with JDK8 and run [noreply] Merge pull request #15740 from [BEAM-12936][Playground] Code editor - [noreply] Merge pull request #15976 from [Playground][BEAM-12941][Bugfix] Fix [noreply] Merge pull request #15991 [BEAM-13251][Playground] [Bugfix] Lint Fails [noreply] Merge pull request #15990 from [BEAM-13177][Playground] Change using of [noreply] [BEAM-13262] Forward for metrics.SingleResult (#15993) [noreply] Generate Python container dependencies in an automated way. (#15927) [noreply] [BEAM-13264] Allow pyarrow up to 6.x (#15995) [noreply] Update the go get command with v2 (#15945) [noreply] Go Quickstart: switch to Spark 3 JobServer for better out-of-box [noreply] Golint fixes for recent Go SDK import (#15999) [noreply] Merge pull request #15997: [BEAM-8688] Upgrading gcsio library to latest [Robert Bradshaw] Allow wildcards for java class lookup transform providers. [Robert Bradshaw] Disallow getClass().forname(). [Robert Bradshaw] Docs, globbing, and a test. [Robert Bradshaw] Defer expansion service creation for easier testing. [Robert Bradshaw] Allow java jar service with classpath. [avilovpavel6] Support GO sdk [samuelw] [BEAM-12818] Write windowed file output to a consistent subdirectory [dpcollins] Fix race condition in Pub/Sub Lite SDF that causes it to error out when [dpcollins] edit [vitaly.ivanov] [BEAM-13269] Data exceeds database column capacity error while inserting [vitaly.ivanov] [BEAM-13269] Data exceeds database column capacity error while inserting [samuelw] [BEAM-13268] Change autosharding big query inserts to happen in parallel [noreply] [BEAM-3293] Add check for error on NewIterable call (#16006) [Brian Hulette] remove pkg_resources in run_generate_requirements.sh [Brian Hulette] Run generatePythonRequirementsAll for pyarrow 6 [noreply] Update dev container tags used by Dataflow runner with unreleased SDKs. [noreply] [BEAM-13265] Add withDeterministicRecordIdFn which allows for [noreply] [BEAM-13183] [BEAM-8152] Use venv instead of virtualenv to create Python [noreply] Merge pull request #15785 from Support for passing priority parameter in [dpcollins] Restructure processor to access beam types from downcall thread [dpcollins] Restructure processor to access beam types from downcall thread [noreply] [BEAM-13283] Skip apache beam dependency installation from [dpcollins] Restructure processor to access beam types from downcall thread [noreply] Merge pull request #15956 from [BEAM-13210] [Playground]: support [noreply] created quickstart guide for multi-language pipelines (Python) (#16001) [dpcollins] use interface in logger to work around likely SLF4J bug [dpcollins] revert logger class [noreply] Revert "Allow wildcards for java class lookup transform providers." [Valentyn Tymofieiev] Moving to 2.36.0-SNAPSHOT on master branch. [Valentyn Tymofieiev] Add future back to Beam containers. [noreply] [BEAM-13290] Handle disable_prime_runner_v2 flag (#16018) [noreply] [BEAM-11936] Add configuration parameter for suppressing unusedvariable [noreply] Merge pull request #15957 from [BEAM-13045][Playground] Implemented [noreply] [BEAM-13286] RowJson should expect ReadableInstant for DATETIME values [noreply] Merge pull request #16025 from [BEAM-13216] [Playground] Add client to [ningkang0957] Updated dep and goldens for Interactive Beam screen diff tests [ningkang0957] Removed Pillow from requirements of containers. [noreply] Merge pull request #16013 from [BEAM-13281] [playground] Update favicon [noreply] Merge pull request #15768 from [BEAM-13064] [Playground] Implement [noreply] Added go code coverage report with codecov (#16020) [kileysok] Increase timeout for Dataflow Streaming VR [benjamin.gonzalez] [BEAM-13003] Integration Test for DebeziumIO that connects to [noreply] Increase the timeout for LoadTest Jenkins jobs 4h->12h. [Robert Bradshaw] Revert "Revert "Allow wildcards for java class lookup transform [noreply] Merge pull request #16032 from [BEAM-13297][Playground][Bugfix] [noreply] Merge pull request #16031 from [BEAM-13296][Playground][Bugfix] remove [noreply] Merge pull request #16030 from [BEAM-13219][Playground] Initialise [noreply] Merge pull request #15996 from [BEAM-13156][Playground] Implement [noreply] [BEAM-13073] UseParallelGC on Java container [noreply] Merge pull request #16002 from [BEAM-13101] [Playground] load examples [noreply] Merge pull request #16016 from [BEAM-13089][Playground] Enable [noreply] Merge pull request #16046 from [BEAM-13295] [Playground] [Bugfix] [noreply] Merge pull request #16048 from [Beam-13256] [Playground] Implement an [noreply] Merge pull request #16026 from [BEAM-13208][Playground] Separate stderr [noreply] Append to state in chunks. (#15983) [Luke Cwik] [BEAM-13313] Fix WindowingStrategy proto to use snake case field names. [Luke Cwik] [BEAM-13015] Simplify [noreply] [BEAM-12829] Never copy .gogradle/** for Python. (#16059) [Luke Cwik] [BEAM-13015] Simplify DataStreamsDecoder by moving hasNext logic to next [Kyle Weaver] [BEAM-13220] Update release instructions. [Daniel Oliveira] Minor Gradle Fixups: Removing unneeded dependency in expansion service. [noreply] Merge pull request #16074 from [BEAM-13323][Playground] [Bugfix] Fix CI [noreply] Merge pull request #16050 from [BEAM-13307][Playground] Support Python [noreply] Merge pull request #16071 from [BEAM-13306][Playground] Add using of [noreply] [BEAM-11943] Fix wrong Klio logo being displayed (#16078) [noreply] Merge pull request #15954 from [BEAM-960][BEAM-1675] Improvements to [noreply] [BEAM-13284] Respect expiration time for all Redis write methods. [noreply] [BEAM-12697] Add SBE module and initial classes (#15733) [Robert Bradshaw] Move stand-alone expansion service jar into its own project. [noreply] [Playground][Beam-13316][Bugfix] Fix Playground Frontend Precommit [Kyle Weaver] [BEAM-13337] Periodically delete stale spanner databases. [noreply] [BEAM-13115][Playground] Security – Mock Storage (#16047) [noreply] [BEAM-13335] Use shorter, numerical indices for dataframe reads. [noreply] Be more conservative about rebatching. (#16058) [noreply] [BEAM-12587] Allow None in Python's Any logical type. (#16055) [Daniel Oliveira] [BEAM-13321] Pass TempLocation as pipeline option to Dataflow Go for [melissapa] [BEAM-11758] Update basics page: Trigger, State and timers [Pablo Estrada] [py] Supporting ignore_unknown_values for WriteToBigQuery [noreply] Merge pull request #16072 from [BEAM-13135][Playground] Add function to [noreply] Merge pull request #16084 from [BEAM-13347][Playground] [Bugfix] Backend [noreply] Merge pull request #15987 from [BEAM-13242] Allow values with smaller [noreply] [BEAM-11936] Fix errorprone UnusedVariable in Extensions (#16033) [noreply] Merge pull request #15936 from [BEAM-13351] FhirIO GetPatientEverything [avilovpavel6] Add fmt preparator for go sdk [noreply] Merge pull request #16073 from [BEAM-13267][Playground] Implement [ningkang0957] Updated screen diff test for Interactive Beam [noreply] [BEAM-13282][Playground] Create go dockerfile #16049 [noreply] Merge pull request #16085 from [Beam-13336][Playground] Refactor [noreply] [BEAM-11936] Fix errorprone UnusedVariable in Extensions-sql (#16034) [noreply] [BEAM-13193] Support [Robert Bradshaw] Require explicit designation of proxy partitioning specification. [Robert Bradshaw] Elementwise transforms preserve all partitionings. [noreply] Merge pull request #16090: [BEAM-13352] Add transient qualifier to [aydar.zaynutdinov] [BEAM-13329][Playground] [aydar.zaynutdinov] [BEAM-13329][Playground] [aydar.zaynutdinov] [BEAM-13360][Playground] [noreply] Merge pull request #16011 from [BEAM-12164] Add models for Spanner [noreply] [BEAM-13335] Use signed int64 range for DataFrame read unique indexes [iyi] Add test case for untriggered expansion with temp tables. [zyichi] Fix small typo in ProcessBundleHandlerTest.java [noreply] Merge pull request #16079 from [BEAM-13241] [Playground] Frontend [noreply] Ricardo Case Study (#16087) [noreply] Merge pull request #16086 from [BEAM-13258][Playground] Get and store [noreply] [BEAM-11936] Fix errorprone UnusedVariable in Runners (#16035) [noreply] [BEAM-8123] Add cloudpickle as optional library (#15472) [noreply] [BEAM-12572] Beam python examples continuously exercised on at least 2 [alexander.zhuravlev] [BEAM-13370] Deleted unused prints & strings [ilya.kozyrev] Fix pylint issues and apply yapf with Beam config [stranniknm] [BEAM-13112]: playground embedded version [aydar.zaynutdinov] [BEAM-13363][Playground] [ilya.kozyrev] fix white spaces [noreply] Don't pin a particular version of Tensorflow. (#16102) [noreply] [BEAM-12733] Fix failing integration tests for Java Recommendation AI [noreply] [BEAM-13288] improve logging for no rows present error (#16096) [aydar.zaynutdinov] [BEAM-13357][Playground] [thiagotnunes] [BEAM-12164] Add Spanner Change Stream DAOs [aydar.zaynutdinov] [BEAM-13357][Playground] [noreply] Merge pull request #16117 from [BEAM-13368][Playground][Bugfix] Fix CI [noreply] Run python SpannerIO IT with python 3.7 only to avoid overload spanner [noreply] Merge pull request #15378 from [RFC] Define and document per-key [noreply] Bump python containers to beam-master-20211202 (#16129) [Luke Cwik] [BEAM-13015] Simplify fake state API testing client and make it [noreply] [BEAM-13354, BEAM-13015, BEAM-12802, BEAM-12588] Support prefetch for [zyichi] Fix failing RecommendationAICatalogItemIT [Valentyn Tymofieiev] Clarify instructions on how to get contributor list. [noreply] [BEAM-11936] Fix errorprone UnusedVariable in IO (#16036) [zyichi] [BEAM-13380] Fix broken seedjob. [noreply] Merge pull request #16118 from [BEAM-13362][Playground] python ci cd [slebedev] [BEAM-13384] Re-exported the metrics subpackage in [aydar.zaynutdinov] [BEAM-13357][Playground] [noreply] Merge pull request #16137 from [BEAM-13381][Playground][Bugfix] Update [noreply] Merge pull request #16107 from [BEAM-13332] [Playground] Add logs output [noreply] Merge pull request #16109 from [BEAM-13330][Playground] Save Java logs [noreply] Merge pull request #16125 from [BEAM-13322][Playground] Support Java [zyichi] [BEAM-13388] Fix broken google cloud dlp test. [Robert Bradshaw] Better type hints for Count combiners. [melissapa] [BEAM-11758] Update basics page: Window, Watermark [relax] don't store unserializable DatasetService as a member variable [noreply] [BEAM-13236] Properly close kinesis producer on teardown (#15955) [noreply] Merge pull request #16150 from [BEAM-13396][Playground][Bugfix] Issues [noreply] Merge pull request #16148 from [BEAM-13394][Playground] [Bugfix] Fix [noreply] Avoid overriding explicit portable job submission disabling. (#16143) [noreply] Merge pull request #16151 from [BEAM-13350][Playground] Support running [zyichi] [BEAM-13373] Increase python post commit timeout to reduce chance of [zyichi] [BEAM-13401] Wait for worker start to reduce flakiness in [melissapa] [BEAM-11758] Final cleanup for Beam Basics doc content [msbukal] Exclude FhirIOPatientEverything from v2 dataflow runner intg test. [noreply] [BEAM-13371] Fix bug where DataFrame overview snippets don't show up [dpcollins] Add a workaround for https://github.com/googleapis/gax-java/issues/1577 [noreply] [BEAM-12976] Implement pipeline visitor to get global field access in… [noreply] [BEAM-13388] Use 3.0.0 as lower bound for google-cloud-dlp (#16164) [noreply] Merge pull request #16127 from [BEAM-13366] [Playground] Add support [stranniknm] fix playground frontend licences [noreply] Merge pull request #16167 from [BEAM-13409][Playground] [Bugfix] Change [noreply] Merge pull request #16136 from [BEAM-13365] [Playground] Add Pipelines [noreply] [BEAM-13244] Support STS Assume role credentials provider for AWS SDK v2 [noreply] [BEAM-11936] Fix errorprone UnusedVariable in core,examples,harness.. [noreply] [BEAM-11936] Remove suppressUnusedVariable flag (#16171) [fernando.morales] Adding java17PostCommit [zyichi] Fix pytest unknown markers warning. [noreply] [BEAM-13090] Adding SDK harness container overrides option to Java SDK [noreply] [BEAM-11936] Fix errorprone warnings (#15890) [Kyle Weaver] Include name of missing tag in error message. [noreply] [BEAM-13015] Start integrating a process wide cache. (#16130) [aydar.zaynutdinov] [BEAM-13424][Playground] [aydar.zaynutdinov] [BEAM-13424][Playground] [stranniknm] [BEAM-13426] clear log and output panels on example change [aydar.zaynutdinov] [BEAM-13428][Playground] [aydar.zaynutdinov] [BEAM-13424][Playground] [daria.malkova] add type of precompiled object [noreply] [BEAM-11936] Remove suppression in ReadFromKafkaDoFn (#16174) [noreply] [BEAM-12561] method truncate on series and dataframe (#15833) [noreply] [BEAM-13294] Widen key schema for all keys before use (#16158) [noreply] [BEAM-13171] Support for stopReadTime on KafkaIO SDF (#15951) [noreply] [BEAM-13399] Add functionality to download Beam JARs from Maven [noreply] [BEAM-13402] Add another workaround for [stranniknm] [BEAM-13423]: fix frontend failure if no examples [Alexey Romanenko] [BEAM-13171] Fix Duration ambiguity [daria.malkova] change return type of 2 methods [mmack] [BEAM-13441] Use quiet delete for S3 batch deletes. In quiet mode only [mmack] [BEAM-13410][BEAM-11788] Integration test for S3Filesystem using [Alexey Romanenko] [BEAM-13434] Bump up Apache log4j2 vulnerability to 2.15.0 [noreply] Merge pull request #16138 from [BEAM-13343][Playground] Support go unit [noreply] [BEAM-12560] Dataframe idxmin and idxmax implementation (#15827) [noreply] [BEAM-12565] Dataframe compare implementation (#16027) [noreply] [BEAM-12976] Use a map to pass all pushdown requests at once. (#16189) [noreply] Updating Grafana from v8.1.2 to v8.1.6 [noreply] [BEAM-12683] Fix failing integration tests for Python Recommendation AI [noreply] [BEAM-13015] Plumb the cache through contexts and transform executors. [daria.malkova] Docs for validators tests [daria.malkova] change context type [noreply] Merge pull request #16140 from [BEAM-13377][Playground] Update CI/CD [noreply] Merge pull request #16120 from [BEAM-13333][Playground] Save Python logs [noreply] Merge pull request #16185 from [BEAM-13425][Playground][Bugfix] Support [mmack] [BEAM-13445] Correctly set data limit when flushing S3 upload buffer and [noreply] Merge pull request #16121 from [BEAM-13334][Playground] Save Go logs to [aydar.zaynutdinov] [BEAM-13438][Playground] [noreply] Merge pull request #16179 from [BEAM-13344][Playground] support python [noreply] Merge pull request #16208 from [BEAM-13442][Playground] Filepath to log [stranniknm] [BEAM-13446]: fix incorrect tab symbol [noreply] [BEAM-13276] bump jackson-core to 2.13.0 for .test-infra (#16062) [noreply] Change Pub/Sub Lite PollResult to set explicit watermark (#16216) [fernando.morales] upgrading to support Gradle 7.3.1 [noreply] Removes the comment that seems no longer relevant. [fernando.morales] removing jcenter [noreply] [BEAM-13454] Fix and test dataframe read_fwf. (#16064) [Valentyn Tymofieiev] Update a few dependencies that may depend on log4j transitively. [fernando.morales] Revert "removing jcenter" [fernando.morales] Revert "upgrading to support Gradle 7.3.1" [noreply] [BEAM-12976] Pipeline visitor to discover pushdown opportunities. [noreply] [BEAM-13015] Allow decoding a set of elements until we hit the block [noreply] [BEAM-13159] Add Redis Stream (XADD) Write Support (#15858) [noreply] Merge pull request #15994: [BEAM-13263] Support OnWindowExpiration in [fernando.morales] Executing ValidatesRunner with Java 8 [noreply] Bump dataflow container version to beam-master-20211213 (#16213) [noreply] Merge pull request #16198 from [BEAM-13437][Playground] Add [noreply] Merge pull request #16195 from a[BEAM-13436][Playground] Add [noreply] [BEAM-13355] add Big Query parameter to enable users to specify load_… [noreply] Updated the base images to use debian:bullseye (#16221) [noreply] [BEAM-13434] Bump log4j to 2.16.0. (#16237) [mmack] [BEAM-13209] Fix DynamoDBIO.write to properly handle partial success [mmack] [BEAM-13209] Fix DynamoDBIO.write to properly handle partial success [noreply] [BEAM-13341] Serialize reflection parameter in AvroCoder cloud object [noreply] Update grafana from 8.1.6 to 8.1.8 [noreply] [BEAM-13015] Update FakeBeamFnStateClient to generate elements that stop [noreply] [BEAM-13218] Sickbay [noreply] [BEAM-13399] Add infrastructure to start JARs from Go functions (#16214) [noreply] Merge pull request #16061 from [BEAM-13428] [Playground] Integrate [fernando.morales] Adding Java toolchain [noreply] Clarify CoGroupByKey creates Iterable, not list. (#16099) [noreply] [BEAM-12931] Allow for DoFn#getAllowedTimestampSkew() when checking the [noreply] [BEAM-13467] Properly handle null argument types for logical types. [noreply] [BEAM-10277] Initial implementation for encoding position in Python [noreply] [BEAM-11545] State & timer for batched RPC calls pattern (#13643) [noreply] Automatically prune local images before building an RC. (#16238) [noreply] Add verbose error messages to container-related scripts. (#16056) [noreply] [BEAM-13456] Rollback #15890 to fix timeout in Java PostCommit (#16257) [noreply] [BEAM-13015] Add a state backed iterable that can be mutated under ------------------------------------------ GitHub pull request #13626 of commit 2b245a271922509608ce1fbdb7a342209f578831, no merge conflicts. Running as SYSTEM Setting status of 2b245a271922509608ce1fbdb7a342209f578831 to PENDING with url https://ci-beam.apache.org/job/beam_SeedJob/8991/ and message: 'Build started for merge commit.' Using context: Jenkins: Seed Job [EnvInject] - Loading node environment variables. Building remotely on apache-beam-jenkins-2 (beam) in workspace <https://ci-beam.apache.org/job/beam_SeedJob/ws/> The recommended git tool is: NONE No credentials specified > git rev-parse --resolve-git-dir > <https://ci-beam.apache.org/job/beam_SeedJob/ws/.git> # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url https://github.com/apache/beam.git # timeout=10 Fetching upstream changes from https://github.com/apache/beam.git > git --version # timeout=10 > git --version # 'git version 2.7.4' > git fetch --tags --progress https://github.com/apache/beam.git > +refs/heads/*:refs/remotes/origin/* > +refs/pull/13626/*:refs/remotes/origin/pr/13626/* # timeout=10 > git rev-parse refs/remotes/origin/pr/13626/merge^{commit} # timeout=10 Checking out Revision cf73631ccfea8b14e7e9afed5ce1d84de06be1d7 (refs/remotes/origin/pr/13626/merge) > git config core.sparsecheckout # timeout=10 > git checkout -f cf73631ccfea8b14e7e9afed5ce1d84de06be1d7 # timeout=10 Commit message: "Merge 2b245a271922509608ce1fbdb7a342209f578831 into a4cca44a387f1fa4b876aa4311abc2f3145185d7" > git rev-list --no-walk c60ce70d77f65af6e39d3b06235dc98e2966e4ee # timeout=10 Cleaning workspace > git rev-parse --verify HEAD # timeout=10 Resetting working tree > git reset --hard # timeout=10 > git clean -fdx # timeout=10 [beam_SeedJob] $ /bin/bash -xe /tmp/jenkins7462429618587450192.sh + cd .test-infra/jenkins/committers_list_generator + python3.8 -m venv ve3 + source ve3/bin/activate ++ deactivate nondestructive ++ '[' -n '' ']' ++ '[' -n '' ']' ++ '[' -n /bin/bash -o -n '' ']' ++ hash -r ++ '[' -n '' ']' ++ unset VIRTUAL_ENV ++ '[' '!' nondestructive = nondestructive ']' ++ VIRTUAL_ENV=<https://ci-beam.apache.org/job/beam_SeedJob/ws/.test-infra/jenkins/committers_list_generator/ve3> ++ export VIRTUAL_ENV ++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games ++ PATH=<https://ci-beam.apache.org/job/beam_SeedJob/ws/.test-infra/jenkins/committers_list_generator/ve3/bin>:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games ++ export PATH ++ '[' -n '' ']' ++ '[' -z '' ']' ++ _OLD_VIRTUAL_PS1= ++ '[' 'x(ve3) ' '!=' x ']' ++ PS1='(ve3) ' ++ export PS1 ++ '[' -n /bin/bash -o -n '' ']' ++ hash -r + pip install -r requirements.txt Processing /home/jenkins/.cache/pip/wheels/b9/f4/f3/6839efe1f8e18983226a3eeb44eec4982c1e0040fac10e4033/python_ldap-3.4.0-cp38-cp38-linux_x86_64.whl Collecting jinja2 Using cached Jinja2-3.0.3-py3-none-any.whl (133 kB) Collecting pyasn1>=0.3.7 Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB) Collecting pyasn1-modules>=0.1.5 Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB) Collecting MarkupSafe>=2.0 Using cached MarkupSafe-2.0.1-cp38-cp38-manylinux2010_x86_64.whl (30 kB) Installing collected packages: pyasn1, pyasn1-modules, python-ldap, MarkupSafe, jinja2 Successfully installed MarkupSafe-2.0.1 jinja2-3.0.3 pyasn1-0.4.8 pyasn1-modules-0.2.8 python-ldap-3.4.0 WARNING: You are using pip version 20.2.3; however, version 21.3.1 is available. You should consider upgrading via the '<https://ci-beam.apache.org/job/beam_SeedJob/ws/.test-infra/jenkins/committers_list_generator/ve3/bin/python3.8> -m pip install --upgrade pip' command. + python main.py -o .. INFO:root:Generating Committers.groovy INFO:root:77 committers' GitHub usernames fetched correctly INFO:root:Committers.groovy saved into .. + deactivate + '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games ']' + PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games + export PATH + unset _OLD_VIRTUAL_PATH + '[' -n '' ']' + '[' -n /bin/bash -o -n '' ']' + hash -r + '[' -n '' ']' + unset VIRTUAL_ENV + '[' '!' '' = nondestructive ']' + unset -f deactivate Processing DSL script .test-infra/jenkins/job_00_seed.groovy Processing DSL script .test-infra/jenkins/job_CancelStaleDataflowJobs.groovy Processing DSL script .test-infra/jenkins/job_Dependency_Check.groovy Processing DSL script .test-infra/jenkins/job_Inventory.groovy Processing DSL script .test-infra/jenkins/job_LoadTests_CoGBK_Dataflow_V2_Java11.groovy Processing DSL script .test-infra/jenkins/job_LoadTests_CoGBK_Dataflow_V2_Java17.groovy Processing DSL script .test-infra/jenkins/job_LoadTests_CoGBK_Java.groovy Processing DSL script .test-infra/jenkins/job_LoadTests_CoGBK_Java_spark_structured_streaming.groovy Processing DSL script .test-infra/jenkins/job_LoadTests_Combine_Flink_Go.groovy Processing DSL script .test-infra/jenkins/job_LoadTests_Combine_Flink_Python.groovy Processing DSL script .test-infra/jenkins/job_LoadTests_Combine_Go.groovy Processing DSL script .test-infra/jenkins/job_LoadTests_Combine_Java.groovy Processing DSL script .test-infra/jenkins/job_LoadTests_Combine_Java_Smoke.groovy Processing DSL script .test-infra/jenkins/job_LoadTests_Combine_Java_spark_structured_streaming.groovy Processing DSL script .test-infra/jenkins/job_LoadTests_Combine_Python.groovy Processing DSL script .test-infra/jenkins/job_LoadTests_FnApiRunner_Python.groovy Processing DSL script .test-infra/jenkins/job_LoadTests_GBK_Dataflow_V2_Java11.groovy Processing DSL script .test-infra/jenkins/job_LoadTests_GBK_Dataflow_V2_Java17.groovy Processing DSL script .test-infra/jenkins/job_LoadTests_GBK_Flink_Go.groovy Processing DSL script .test-infra/jenkins/job_LoadTests_GBK_Flink_Python.groovy Processing DSL script .test-infra/jenkins/job_LoadTests_GBK_Go.groovy Processing DSL script .test-infra/jenkins/job_LoadTests_GBK_Java.groovy Processing DSL script .test-infra/jenkins/job_LoadTests_GBK_Java_Smoke.groovy Processing DSL script .test-infra/jenkins/job_LoadTests_GBK_Java_spark_structured_streaming.groovy Processing DSL script .test-infra/jenkins/job_LoadTests_GBK_Python.groovy Processing DSL script .test-infra/jenkins/job_LoadTests_GBK_Python_reiterate.groovy Processing DSL script .test-infra/jenkins/job_LoadTests_ParDo_Dataflow_V2_Java11.groovy Processing DSL script .test-infra/jenkins/job_LoadTests_ParDo_Dataflow_V2_Java17.groovy Processing DSL script .test-infra/jenkins/job_LoadTests_ParDo_Flink_Go.groovy Processing DSL script .test-infra/jenkins/job_LoadTests_ParDo_Flink_Python.groovy Processing DSL script .test-infra/jenkins/job_LoadTests_ParDo_Go.groovy Processing DSL script .test-infra/jenkins/job_LoadTests_ParDo_Java.groovy Processing DSL script .test-infra/jenkins/job_LoadTests_ParDo_Java_spark_structured_streaming.groovy Processing DSL script .test-infra/jenkins/job_LoadTests_ParDo_Python.groovy Processing DSL script .test-infra/jenkins/job_LoadTests_Python_Smoke.groovy Processing DSL script .test-infra/jenkins/job_LoadTests_SideInput_Flink_Go.groovy Processing DSL script .test-infra/jenkins/job_LoadTests_SideInput_Go.groovy Processing DSL script .test-infra/jenkins/job_LoadTests_SideInput_Python.groovy Processing DSL script .test-infra/jenkins/job_LoadTests_coGBK_Flink_Go.groovy Processing DSL script .test-infra/jenkins/job_LoadTests_coGBK_Flink_Python.groovy Processing DSL script .test-infra/jenkins/job_LoadTests_coGBK_Go.groovy Processing DSL script .test-infra/jenkins/job_LoadTests_coGBK_Python.groovy Processing DSL script .test-infra/jenkins/job_Metrics_Report.groovy Processing DSL script .test-infra/jenkins/job_PerformanceTests_BigQueryIO_Java.groovy Processing DSL script .test-infra/jenkins/job_PerformanceTests_BigQueryIO_Python.groovy Processing DSL script .test-infra/jenkins/job_PerformanceTests_FileBasedIO_IT.groovy Processing DSL script .test-infra/jenkins/job_PerformanceTests_HadoopFormat.groovy Processing DSL script .test-infra/jenkins/job_PerformanceTests_InfluxDBIO_IT.groovy Processing DSL script .test-infra/jenkins/job_PerformanceTests_JDBC.groovy Processing DSL script .test-infra/jenkins/job_PerformanceTests_KafkaIO_IT.groovy Processing DSL script .test-infra/jenkins/job_PerformanceTests_MongoDBIO_IT.groovy Processing DSL script .test-infra/jenkins/job_PerformanceTests_PubsubIO_Python.groovy Processing DSL script .test-infra/jenkins/job_PerformanceTests_Python.groovy Processing DSL script .test-infra/jenkins/job_PerformanceTests_SQLIO_Java.groovy Processing DSL script .test-infra/jenkins/job_PerformanceTests_SpannerIO_Python.groovy Processing DSL script .test-infra/jenkins/job_PostCommit_BeamMetrics_Publish.groovy Processing DSL script .test-infra/jenkins/job_PostCommit_CommunityMetrics.groovy Processing DSL script .test-infra/jenkins/job_PostCommit_CrossLanguageValidatesRunner_Dataflow.groovy Processing DSL script .test-infra/jenkins/job_PostCommit_CrossLanguageValidatesRunner_Direct.groovy Processing DSL script .test-infra/jenkins/job_PostCommit_CrossLanguageValidatesRunner_Flink.groovy Processing DSL script .test-infra/jenkins/job_PostCommit_CrossLanguageValidatesRunner_Samza.groovy Processing DSL script .test-infra/jenkins/job_PostCommit_CrossLanguageValidatesRunner_Spark.groovy Processing DSL script .test-infra/jenkins/job_PostCommit_CrossLanguageValidatesRunner_Spark3.groovy Processing DSL script .test-infra/jenkins/job_PostCommit_Go.groovy Processing DSL script .test-infra/jenkins/job_PostCommit_Go_ValidatesRunner_Flink.groovy Processing DSL script .test-infra/jenkins/job_PostCommit_Go_ValidatesRunner_Samza.groovy Processing DSL script .test-infra/jenkins/job_PostCommit_Go_ValidatesRunner_Spark.groovy Processing DSL script .test-infra/jenkins/job_PostCommit_Java.groovy Processing DSL script .test-infra/jenkins/job_PostCommit_Java_Dataflow.groovy Processing DSL script .test-infra/jenkins/job_PostCommit_Java_DataflowV2.groovy Processing DSL script .test-infra/jenkins/job_PostCommit_Java_Dataflow_Examples_Java11.groovy Processing DSL script .test-infra/jenkins/job_PostCommit_Java_Dataflow_Examples_Java17.groovy Processing DSL script .test-infra/jenkins/job_PostCommit_Java_Examples_Dataflow_V2.groovy Processing DSL script .test-infra/jenkins/job_PostCommit_Java_Examples_Dataflow_V2_Java11.groovy Processing DSL script .test-infra/jenkins/job_PostCommit_Java_Examples_Dataflow_V2_Java17.groovy Processing DSL script .test-infra/jenkins/job_PostCommit_Java_Hadoop_Versions.groovy Processing DSL script .test-infra/jenkins/job_PostCommit_Java_Jpms_Dataflow_Java11.groovy Processing DSL script .test-infra/jenkins/job_PostCommit_Java_Jpms_Direct_Java11.groovy Processing DSL script .test-infra/jenkins/job_PostCommit_Java_Jpms_Flink_Java11.groovy Processing DSL script .test-infra/jenkins/job_PostCommit_Java_Jpms_Spark_Java11.groovy Processing DSL script .test-infra/jenkins/job_PostCommit_Java_Nexmark_Dataflow.groovy Processing DSL script .test-infra/jenkins/job_PostCommit_Java_Nexmark_Dataflow_V2.groovy Processing DSL script .test-infra/jenkins/job_PostCommit_Java_Nexmark_Dataflow_V2_Java11.groovy Processing DSL script .test-infra/jenkins/job_PostCommit_Java_Nexmark_Dataflow_V2_Java17.groovy Processing DSL script .test-infra/jenkins/job_PostCommit_Java_Nexmark_Direct.groovy Processing DSL script .test-infra/jenkins/job_PostCommit_Java_Nexmark_Flink.groovy Processing DSL script .test-infra/jenkins/job_PostCommit_Java_Nexmark_Spark.groovy Processing DSL script .test-infra/jenkins/job_PostCommit_Java_PortableValidatesRunner_Flink_Batch.groovy Processing DSL script .test-infra/jenkins/job_PostCommit_Java_PortableValidatesRunner_Flink_Streaming.groovy Processing DSL script .test-infra/jenkins/job_PostCommit_Java_PortableValidatesRunner_Samza.groovy Processing DSL script .test-infra/jenkins/job_PostCommit_Java_PortableValidatesRunner_Spark2_Streaming.groovy Processing DSL script .test-infra/jenkins/job_PostCommit_Java_PortableValidatesRunner_Spark3_Streaming.groovy Processing DSL script .test-infra/jenkins/job_PostCommit_Java_PortableValidatesRunner_Spark_Batch.groovy Processing DSL script .test-infra/jenkins/job_PostCommit_Java_ValidatesRunner_Dataflow.groovy Processing DSL script .test-infra/jenkins/job_PostCommit_Java_ValidatesRunner_Dataflow_Java11.groovy Processing DSL script .test-infra/jenkins/job_PostCommit_Java_ValidatesRunner_Dataflow_Java17.groovy ERROR: (job_PostCommit_Java_ValidatesRunner_Dataflow_Java17.groovy, line 29) No such property: javaToolchains for class: javaposse.jobdsl.dsl.jobs.FreeStyleJob Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
