See
<https://ci-beam.apache.org/job/beam_PerformanceTests_JDBC/6370/display/redirect?page=changes>
Changes:
[kevinsijo] Setting up a basic directory
[kevinsijo] Mirroring Python SDK's directory structure
[kerrydc] Adds initial tests
[kevinsijo] 'runners' is the correct directory name
[Pablo Estrada] sketching the core API for JS SDK
[jonathanlui] add .gitignore for node/ts project
[Robert Bradshaw] Worker directory.
[Robert Bradshaw] Fix complile errors with explicit any for callables.
[Robert Bradshaw] Add worker entry point.
[Robert Bradshaw] Add proto generation code.
[Robert Bradshaw] Add generated proto files.
[Robert Bradshaw] Attempts to get ts protos to compile.
[Robert Bradshaw] Exclude ts protos for now.
[Robert Bradshaw] More changes to get ts protos working.
[Robert Bradshaw] Update scripts and config to get protos compiling.
[Robert Bradshaw] Update geenrated files.
[jonathanlui] add build and clean script to compile ts
[Robert Bradshaw] Generate server for loopback worker.
[Robert Bradshaw] Generated grpc servers for loopback.
[Robert Bradshaw] Add typescript formatter.
[Robert Bradshaw] Loopback server (that does nothing).
[Robert Bradshaw] Working server.
[Pablo Estrada] Starting expansion of primitive transforms
[Pablo Estrada] Starting to implement and support standard coders
[Robert Bradshaw] Also generate grpc clients.
[Robert Bradshaw] Basic implementation of worker harness.
[Pablo Estrada] fix the build
[Robert Bradshaw] Add some missing files for worker harness.
[Robert Bradshaw] Refactor operators to use registration.
[jonathanlui] enable ts in mocha
[jonathanlui] update readme
[jonathanlui] --save-dev @types/mocha
[jonathanlui] translate core_test.js to typescript
[Robert Bradshaw] Encapsulate worker service in a class.
[Kenneth Knowles] Port standard_coders_test to typescript (superficially)
[Pablo Estrada] Starting the proto translation of Impulse, ParDo, GBK
[Robert Bradshaw] Add some tests for the worker code.
[Robert Bradshaw] Fixing old lock file error.
[Pablo Estrada] Adding transform names and fixing GBK coder issue
[Robert Bradshaw] npx tsfmt -r src/apache_beam/base.ts
src/apache_beam/transforms/core.ts
[Kenneth Knowles] switch to import style require() statements
[Kenneth Knowles] Add Coder interface using protobufjs classes
[Kenneth Knowles] BytesCoder with some failures
[noreply] Added GeneralObjectCoder and using it as coder for most transforms
(#9)
[Kenneth Knowles] Fix order of arguments to deepEqual
[Kenneth Knowles] Encode expected encoding as binary
[Robert Bradshaw] Refactor API to allow for composites.
[jrmccluskey] Initial setup for automated Java expansion startup
[jrmccluskey] Update exp_service.ts
[Kenneth Knowles] Fix up coder deserialization
[Robert Bradshaw] Simplify GBK coder computation.
[Robert Bradshaw] Remove top-level PValue.
[Pablo Estrada] Make tests green
[Robert Bradshaw] Rename PValueish to PValue.
[jonathanlui] node runner
[jonathanlui] whitespaces
[Robert Bradshaw] Make Runner.run async.
[jonathanlui] bson and fast-deep-equal should not be listed as devdependency
[jrmccluskey] Add basic Dockerfile that starts ExternalWorkerPool
[Robert Bradshaw] Direct runner.
[kevinsijo] Testing expansion service communication
[Robert Bradshaw] Added flatten, assertion checkers.
[Pablo Estrada] progress on basic coders
[Robert Bradshaw] Fixing the build.
[Robert Bradshaw] Cleanup, simplify access.
[Pablo Estrada] Adding limited support for KVCoder and IterableCoder
[Robert Bradshaw] Introduce PipelineContext.
[Robert Bradshaw] Add toProto to all coders.
[Robert Bradshaw] Some work with coders.
[Robert Bradshaw] Remove debug logging.
[Robert Bradshaw] Use coders over data channel.
[Kenneth Knowles] explicitly sequence sub-coder serializations
[Kenneth Knowles] no more need to extend FakeCoder
[Kenneth Knowles] actually advance reader
[Kenneth Knowles] autoformat
[Kenneth Knowles] protobufjs already can write and read signed varints
[Kenneth Knowles] with improved test harness, kv has many more failures
[Kenneth Knowles] read bytescoder from correct position
[Kenneth Knowles] no more fake coders
[Kenneth Knowles] varint examples all work
[Kenneth Knowles] simplify coder value parsing
[Kenneth Knowles] global window coder
[Kenneth Knowles] fix swapEndian32
[Robert Bradshaw] Add P(...) operator.
[kevinsijo] Implementing RowCoder encoding.
[jrmccluskey] remove unused container dir
[kevinsijo] Corrected sorting of encoded positions to reflect an argsort
instead.
[Robert Bradshaw] Populate environments.
[kevinsijo] Implementing RowCoder decoding.
[Kenneth Knowles] preliminary unbounded iterable coder
[Kenneth Knowles] friendlier description of standard coder test case
[Kenneth Knowles] fix test harness; iterable works
[jrmccluskey] first pass at boot.go
[jonathanlui] update package-lock.json
[jonathanlui] make NodeRunner a subclass of Runner
[jonathanlui] add waitUntilFinish interface member
[Pablo Estrada] Adding double coder
[Kenneth Knowles] scaffolding for windowed values
[Pablo Estrada] Adding type information to PColleciton and PTransform
[jonathanlui] fix direct runner
[Pablo Estrada] Adding typing information for DoFns
[Kenneth Knowles] add interval window
[Robert Bradshaw] Export PValue.
[Robert Bradshaw] Add CombineFn interface.
[Robert Bradshaw] Typed flatten.
[jonathanlui] add runAsync method to base.Runner
[Kenneth Knowles] add Long package
[Pablo Estrada] Adding more types. Making PValue typed
[Kenneth Knowles] instant coder draft
[Robert Bradshaw] Return job state from direct runner.
[Kenneth Knowles] type instant = long
[jonathanlui] implement NodeRunner.runPipeline
[Kenneth Knowles] autoformat
[kevinsijo] Completed implementation of basic row coder
[Kenneth Knowles] Fix IntervalWindowCoder, almost
[Kenneth Knowles] fix interval window coder
[Kenneth Knowles] autoformat
[Robert Bradshaw] loopback runner works
[Kenneth Knowles] move core element types into values.ts
[Kenneth Knowles] just build object directly to be cool
[Robert Bradshaw] GBK working on ULR.
[Robert Bradshaw] Async transforms.
[Robert Bradshaw] External transform grpah splicing.
[Kenneth Knowles] progress on windowed value: paneinfo encoding
[Robert Bradshaw] Fix merge.
[Robert Bradshaw] autoformat
[Kenneth Knowles] full windowed value coder
[kerrydc] Updates tests to use correct types, adds generics where needed to
DoFns
[Robert Bradshaw] Add serialization librarires.'
[Robert Bradshaw] Add Split() PTransform, for producing multiple outputs from a
single
[Robert Bradshaw] Schema-encoded external payloads.
[kevinsijo] Adding Schema inference from JSON
[Pablo Estrada] Removing unused directories
[Pablo Estrada] Support for finishBundle and improving typing annotations.
[Pablo Estrada] A base implementation of combiners with GBK/ParDo
[Robert Bradshaw] Fully propagate windowing information in both remote and
direct runner.
[Robert Bradshaw] Make args and kwargs optional for python external transform.
[Robert Bradshaw] Infer schema for external transforms.
[Pablo Estrada] Implementing a custom combine fn as an example. Small fixes
[Robert Bradshaw] Fix missing windowing information in combiners.
[Robert Bradshaw] PostShuffle needn't group by key as that's already done.
[Robert Bradshaw] Guard pre-combine for global window only.
[Robert Bradshaw] WindowInto
[Robert Bradshaw] Fix optional kwargs.
[Robert Bradshaw] A couple of tweaks for js + py
[Robert Bradshaw] Add windowing file.
[Robert Bradshaw] CombineBy transform, stand-alone WordCount.
[Robert Bradshaw] cleanup
[Robert Bradshaw] Actually fix optional external kwargs.
[Robert Bradshaw] Demo2, textio read.
[Robert Bradshaw] Add command lines for starting up the servers.
[Robert Bradshaw] Run prettier on the full codebase.
[Robert Bradshaw] Update deps.
[Pablo Estrada] Adding docstrings for core.ts. Prettier dependency
[Pablo Estrada] Documenting coder interfaces
[Pablo Estrada] Added documentation for a few standard coders
[Robert Bradshaw] Unified grouping and combining.
[Robert Bradshaw] Allow PCollection ids to be lazy.
[Robert Bradshaw] Reorganize module structure.
[Robert Bradshaw] A couple more renames.
[Robert Bradshaw] Simplify.
[Robert Bradshaw] Consolidation.
[Robert Bradshaw] Fix build.
[Robert Bradshaw] Add optional context to ParDo.
[Robert Bradshaw] fixup: iterable coder endian sign issue
[Robert Bradshaw] omit context for map(console.log)
[Robert Bradshaw] Fix ReadFromText coders.
[Robert Bradshaw] Flesh out README with overview and current state.
[noreply] Readme typo
[Robert Bradshaw] Two more TODOs.
[noreply] Add a pointer to the example wordcount to the readme.
[Pablo Estrada] Documenting coders and implementing unknown-length method
[Robert Bradshaw] UIID dependency.
[Robert Bradshaw] Artifact handling.
[Robert Bradshaw] Properly wait on data channel for bundle completion.
[Robert Bradshaw] Automatic java expansion service startup.
[Robert Bradshaw] Process promises.
[Robert Bradshaw] Implement side inputs.
[Robert Bradshaw] Cleanup.
[Robert Bradshaw] Put complex constext stuff in its own file.
[Robert Bradshaw] Rename BoundedWindow to just Window.
[Robert Bradshaw] Alternative splitter class.
[Pablo Estrada] Documenting internal functions
[Robert Bradshaw] Take a pass clarifying the TODOs.
[Robert Bradshaw] Sql transform wrapper.
[Robert Bradshaw] Incorporate some feedback into the TODOs.
[Robert Bradshaw] More TODOs.
[Robert Bradshaw] Remove app placeholder.
[Robert Bradshaw] Apache license headers.
[Robert Bradshaw] More TODOs
[jankuehle] Suggestions for TypeScript todos
[dannymccormick] Add actions for typescript sdk
[dannymccormick] Fix test command
[noreply] Add missing version
[dannymccormick] Fix codecovTest command
[noreply] Only do prettier check on linux
[noreply] Only get codecov on linux
[Robert Bradshaw] Resolve some comments.
[Robert Bradshaw] Fix compile errors.
[Robert Bradshaw] Prettier.
[Robert Bradshaw] Re-order expandInternal arguments pending unification.
[Robert Bradshaw] More consistent and stricter PTransform naming.
[Robert Bradshaw] Notes on explicit, if less idiomatic, use of classes.
[Robert Bradshaw] Let DoFn be an interface rather than a class.
[Robert Bradshaw] Provide DoFn context to start and finish bundle.
[Robert Bradshaw] Optional promise code simplification.
[Robert Bradshaw] Cleanup todos.
[Robert Bradshaw] Avoid any type where not needed.
[Robert Bradshaw] Apache RAT excludes for typescript.
[Robert Bradshaw] Remove empty READMEs.
[Robert Bradshaw] Add licences statement to readme files.
[Robert Bradshaw] More RAT fixes.
[Robert Bradshaw] Another unsupported coder.
[Robert Bradshaw] Remove debugging code.
[noreply] Fix automatic naming with code coverage.
[Robert Bradshaw] Coders cleanup.
[Robert Bradshaw] Add tests for RowCoder.
[Robert Bradshaw] Normalize capitalization, comments.
[Robert Bradshaw] Install typescript closure packages.
[Robert Bradshaw] npm audit fix
[Robert Bradshaw] Move more imports out of base.
[Robert Bradshaw] Changes needed to compile with ts closure plugin.
[Robert Bradshaw] Use ttsc and ts-closure-transform plugin.
[Robert Bradshaw] Serialization registration to actually get serialization
working.
[Robert Bradshaw] Container images working on local runner.
[Robert Bradshaw] Add a portable job server that proxies the Dataflow backend.
(#17189)
[Robert Bradshaw] Improvements to dataflow job service for non-Python jobs.
[Robert Bradshaw] Get dataflow working.
[Robert Bradshaw] User friendly pipeline options.
[Robert Bradshaw] Less classes, more functions.
[Robert Bradshaw] Add new nullable standard coder.
[Robert Bradshaw] Make Apache Rat happy.
[Robert Bradshaw] Disable broken codecov.
[Robert Bradshaw] Remove last uses of base.ts.
[Robert Bradshaw] Remove unneedd file.
[Robert Bradshaw] Remove more uneeded/unused files.
[Robert Bradshaw] Cleanup tests.
[Robert Bradshaw] Minor cleanups to coder tests.
[Robert Bradshaw] Addressing issues from the review.
[noreply] Apply suggestions from code review.
[Robert Bradshaw] Post-merge fixes.
[dannymccormick] Delete tags.go
[Robert Bradshaw] Update tests to use our actual serialization libraries.
[Robert Bradshaw] Another pass at TODOs, removing finished items.
[Heejong Lee] [BEAM-14146] Python Streaming job failing to drain with
BigQueryIO write
[Kenneth Knowles] Add parameter for service account impersonation in GCP
credentials
[noreply] Merge pull request #17490 from [BEAM-14370] [Website] Add new page
about
[noreply] [BEAM-14332] Refactored cluster management for Flink on Dataproc
[noreply] [BEAM-13988] Update mtime to use time.UnixMilli() calls (#17578)
------------------------------------------
[...truncated 345.27 KB...]
May 06, 2022 8:12:24 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:12:21.957Z: Fusing consumer
Combine.globally(Top(Natural))/Values/Values/Map into
Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/Combine.GroupedValues/Extract
May 06, 2022 8:12:24 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:12:21.985Z: Fusing consumer
Combine.globally(Top(Natural))/ProduceDefault into
Combine.globally(Top(Natural))/CreateVoid/Read(CreateSource)
May 06, 2022 8:12:24 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:12:22.004Z: Unzipping flatten s42-u187 for input
s44.org.apache.beam.sdk.values.PCollection.<init>:408#43d0369d0f0559b7-c185
May 06, 2022 8:12:24 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:12:22.056Z: Fusing unzipped copy of
PAssert$2/GroupGlobally/GroupByKey/Reify, through flatten
PAssert$2/GroupGlobally/Flatten.PCollections/Unzipped-1, into producer
PAssert$2/GroupGlobally/WithKeys/AddKeys/Map
May 06, 2022 8:12:24 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:12:22.091Z: Fusing consumer
PAssert$1/GroupGlobally/WithKeys/AddKeys/Map into
PAssert$1/GroupGlobally/Create.Values/Read(CreateSource)
May 06, 2022 8:12:24 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:12:22.114Z: Fusing consumer
PAssert$3/GroupGlobally/WithKeys/AddKeys/Map into
PAssert$3/GroupGlobally/Create.Values/Read(CreateSource)
May 06, 2022 8:12:24 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:12:22.146Z: Fusing consumer
PAssert$4/GroupGlobally/WithKeys/AddKeys/Map into
PAssert$4/GroupGlobally/Create.Values/Read(CreateSource)
May 06, 2022 8:12:24 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:12:22.171Z: Fusing consumer
PAssert$2/GroupGlobally/WithKeys/AddKeys/Map into
PAssert$2/GroupGlobally/Create.Values/Read(CreateSource)
May 06, 2022 8:12:24 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:12:22.200Z: Fusing consumer
PAssert$1/GroupGlobally/GroupByKey/Reify into
PAssert$1/GroupGlobally/WithKeys/AddKeys/Map
May 06, 2022 8:12:24 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:12:22.233Z: Fusing consumer
PAssert$3/GroupGlobally/GroupByKey/Reify into
PAssert$3/GroupGlobally/WithKeys/AddKeys/Map
May 06, 2022 8:12:24 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:12:22.267Z: Fusing consumer
PAssert$4/GroupGlobally/GroupByKey/Reify into
PAssert$4/GroupGlobally/WithKeys/AddKeys/Map
May 06, 2022 8:12:24 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:12:22.295Z: Fusing consumer
PAssert$2/GroupGlobally/GroupByKey/Reify into
PAssert$2/GroupGlobally/WithKeys/AddKeys/Map
May 06, 2022 8:12:24 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:12:22.818Z: Executing operation
JdbcIO.Read/Create.Values/Read(CreateSource)+JdbcIO.Read/JdbcIO.ReadAll/ParDo(Read)+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Consume/ParDo(Anonymous)+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)
May 06, 2022 8:12:24 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:12:22.895Z: Starting 5 ****s in us-central1-b...
May 06, 2022 8:12:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:12:36.399Z: Your project already contains 100
Dataflow-created metric descriptors, so new user metrics of the form
custom.googleapis.com/* will not be created. However, all user metrics are also
available in the metric dataflow.googleapis.com/job/user_counter. If you rely
on the custom metrics, you can delete old / unused metric descriptors. See
https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list
and
https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
May 06, 2022 8:12:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:12:44.542Z: Autoscaling: Raised the number of ****s to
5 based on the rate of progress in the currently running stage(s).
May 06, 2022 8:13:22 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:13:20.701Z: Workers have started successfully.
May 06, 2022 8:14:23 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:14:22.782Z: Finished operation
JdbcIO.Read/Create.Values/Read(CreateSource)+JdbcIO.Read/JdbcIO.ReadAll/ParDo(Read)+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Consume/ParDo(Anonymous)+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)
May 06, 2022 8:14:23 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:14:23.036Z: Executing operation
JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/View.AsIterable/CreateDataflowView
May 06, 2022 8:14:23 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:14:23.103Z: Finished operation
JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/View.AsIterable/CreateDataflowView
May 06, 2022 8:14:23 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:14:23.258Z: Executing operation
JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
May 06, 2022 8:14:23 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:14:23.729Z: Finished operation
JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
May 06, 2022 8:14:26 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:14:23.914Z: Executing operation
JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Identity+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Pair
with random
key+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
May 06, 2022 8:14:51 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:14:51.469Z: Finished operation
JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Identity+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Pair
with random
key+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
May 06, 2022 8:14:51 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:14:51.540Z: Executing operation
JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
May 06, 2022 8:14:51 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:14:51.593Z: Finished operation
JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
May 06, 2022 8:14:51 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:14:51.669Z: Executing operation
Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Create
May 06, 2022 8:14:51 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:14:51.734Z: Executing operation Hash row
contents/Combine.perKey(Hashing)/GroupByKey/Create
May 06, 2022 8:14:51 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:14:51.770Z: Executing operation
Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Create
May 06, 2022 8:14:51 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:14:51.804Z: Executing operation Count
All/Combine.perKey(Count)/GroupByKey/Create
May 06, 2022 8:14:51 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:14:51.843Z: Finished operation
Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Create
May 06, 2022 8:14:51 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:14:51.939Z: Finished operation Hash row
contents/Combine.perKey(Hashing)/GroupByKey/Create
May 06, 2022 8:14:53 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:14:51.991Z: Finished operation
Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Create
May 06, 2022 8:14:53 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:14:52.038Z: Finished operation Count
All/Combine.perKey(Count)/GroupByKey/Create
May 06, 2022 8:14:53 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:14:52.196Z: Executing operation
JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Values/Values/Map+ParDo(TimeMonitor)+Count
All/WithKeys/AddKeys/Map+ParDo(SelectName)+Combine.globally(Top(Reversed))/WithKeys/AddKeys/Map+Combine.globally(Top(Natural))/WithKeys/AddKeys/Map+Count
All/Combine.perKey(Count)/GroupByKey+Count
All/Combine.perKey(Count)/Combine.GroupedValues/Partial+Count
All/Combine.perKey(Count)/GroupByKey/Reify+Hash row
contents/WithKeys/AddKeys/Map+Hash row
contents/Combine.perKey(Hashing)/GroupByKey+Hash row
contents/Combine.perKey(Hashing)/Combine.GroupedValues/Partial+Hash row
contents/Combine.perKey(Hashing)/GroupByKey/Reify+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/Combine.GroupedValues/Partial+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Reify+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/Combine.GroupedValues/Partial+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Reify+Count
All/Combine.perKey(Count)/GroupByKey/Write+Hash row
contents/Combine.perKey(Hashing)/GroupByKey/Write+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Write+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Write
May 06, 2022 8:15:19 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:15:18.168Z: Finished operation
JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Values/Values/Map+ParDo(TimeMonitor)+Count
All/WithKeys/AddKeys/Map+ParDo(SelectName)+Combine.globally(Top(Reversed))/WithKeys/AddKeys/Map+Combine.globally(Top(Natural))/WithKeys/AddKeys/Map+Count
All/Combine.perKey(Count)/GroupByKey+Count
All/Combine.perKey(Count)/Combine.GroupedValues/Partial+Count
All/Combine.perKey(Count)/GroupByKey/Reify+Hash row
contents/WithKeys/AddKeys/Map+Hash row
contents/Combine.perKey(Hashing)/GroupByKey+Hash row
contents/Combine.perKey(Hashing)/Combine.GroupedValues/Partial+Hash row
contents/Combine.perKey(Hashing)/GroupByKey/Reify+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/Combine.GroupedValues/Partial+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Reify+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/Combine.GroupedValues/Partial+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Reify+Count
All/Combine.perKey(Count)/GroupByKey/Write+Hash row
contents/Combine.perKey(Hashing)/GroupByKey/Write+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Write+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Write
May 06, 2022 8:15:19 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:15:18.240Z: Executing operation Hash row
contents/Combine.perKey(Hashing)/GroupByKey/Close
May 06, 2022 8:15:19 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:15:18.286Z: Executing operation
Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Close
May 06, 2022 8:15:19 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:15:18.310Z: Finished operation Hash row
contents/Combine.perKey(Hashing)/GroupByKey/Close
May 06, 2022 8:15:19 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:15:18.324Z: Executing operation
Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Close
May 06, 2022 8:15:19 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:15:18.343Z: Finished operation
Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Close
May 06, 2022 8:15:19 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:15:18.359Z: Executing operation Count
All/Combine.perKey(Count)/GroupByKey/Close
May 06, 2022 8:15:19 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:15:18.384Z: Finished operation
Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Close
May 06, 2022 8:15:19 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:15:18.402Z: Executing operation
PAssert$2/GroupGlobally/GroupByKey/Create
May 06, 2022 8:15:19 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:15:18.413Z: Finished operation Count
All/Combine.perKey(Count)/GroupByKey/Close
May 06, 2022 8:15:19 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:15:18.446Z: Executing operation
PAssert$3/GroupGlobally/GroupByKey/Create
May 06, 2022 8:15:19 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:15:18.473Z: Executing operation
PAssert$4/GroupGlobally/GroupByKey/Create
May 06, 2022 8:15:19 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:15:18.525Z: Executing operation
PAssert$1/GroupGlobally/GroupByKey/Create
May 06, 2022 8:15:19 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:15:18.603Z: Finished operation
PAssert$2/GroupGlobally/GroupByKey/Create
May 06, 2022 8:15:19 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:15:18.614Z: Finished operation
PAssert$3/GroupGlobally/GroupByKey/Create
May 06, 2022 8:15:19 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:15:18.628Z: Finished operation
PAssert$4/GroupGlobally/GroupByKey/Create
May 06, 2022 8:15:19 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:15:18.703Z: Finished operation
PAssert$1/GroupGlobally/GroupByKey/Create
May 06, 2022 8:15:19 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:15:18.841Z: Executing operation
PAssert$2/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$2/GroupGlobally/WithKeys/AddKeys/Map+PAssert$2/GroupGlobally/GroupByKey/Reify+PAssert$2/GroupGlobally/GroupByKey/Write
May 06, 2022 8:15:19 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:15:18.879Z: Executing operation Hash row
contents/Combine.perKey(Hashing)/GroupByKey/Read+Hash row
contents/Combine.perKey(Hashing)/Combine.GroupedValues+Hash row
contents/Combine.perKey(Hashing)/Combine.GroupedValues/Extract+Hash row
contents/Values/Values/Map+PAssert$2/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$2/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$2/GroupGlobally/WithKeys/AddKeys/Map+PAssert$2/GroupGlobally/GroupByKey/Reify+PAssert$2/GroupGlobally/GroupByKey/Write
May 06, 2022 8:15:19 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:15:18.955Z: Executing operation
Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Read+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/Combine.GroupedValues+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/Combine.GroupedValues/Extract+Combine.globally(Top(Reversed))/Values/Values/Map+PAssert$3/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$3/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$3/GroupGlobally/WithKeys/AddKeys/Map+PAssert$3/GroupGlobally/GroupByKey/Reify+PAssert$3/GroupGlobally/GroupByKey/Write+Combine.globally(Top(Reversed))/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)
May 06, 2022 8:15:19 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:15:18.988Z: Executing operation
PAssert$3/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$3/GroupGlobally/WithKeys/AddKeys/Map+PAssert$3/GroupGlobally/GroupByKey/Reify+PAssert$3/GroupGlobally/GroupByKey/Write
May 06, 2022 8:15:19 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:15:19.028Z: Executing operation
Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Read+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/Combine.GroupedValues+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/Combine.GroupedValues/Extract+Combine.globally(Top(Natural))/Values/Values/Map+PAssert$4/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$4/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$4/GroupGlobally/WithKeys/AddKeys/Map+PAssert$4/GroupGlobally/GroupByKey/Reify+PAssert$4/GroupGlobally/GroupByKey/Write+Combine.globally(Top(Natural))/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)
May 06, 2022 8:15:19 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:15:19.076Z: Executing operation
PAssert$4/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$4/GroupGlobally/WithKeys/AddKeys/Map+PAssert$4/GroupGlobally/GroupByKey/Reify+PAssert$4/GroupGlobally/GroupByKey/Write
May 06, 2022 8:15:19 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:15:19.109Z: Executing operation Count
All/Combine.perKey(Count)/GroupByKey/Read+Count
All/Combine.perKey(Count)/Combine.GroupedValues+Count
All/Combine.perKey(Count)/Combine.GroupedValues/Extract+Count
All/Values/Values/Map+PAssert$1/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$1/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$1/GroupGlobally/WithKeys/AddKeys/Map+PAssert$1/GroupGlobally/GroupByKey/Reify+PAssert$1/GroupGlobally/GroupByKey/Write+Count
All/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)
May 06, 2022 8:15:19 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:15:19.142Z: Executing operation
PAssert$1/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$1/GroupGlobally/WithKeys/AddKeys/Map+PAssert$1/GroupGlobally/GroupByKey/Reify+PAssert$1/GroupGlobally/GroupByKey/Write
May 06, 2022 8:15:22 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:15:20.213Z: Finished operation Hash row
contents/Combine.perKey(Hashing)/GroupByKey/Read+Hash row
contents/Combine.perKey(Hashing)/Combine.GroupedValues+Hash row
contents/Combine.perKey(Hashing)/Combine.GroupedValues/Extract+Hash row
contents/Values/Values/Map+PAssert$2/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$2/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$2/GroupGlobally/WithKeys/AddKeys/Map+PAssert$2/GroupGlobally/GroupByKey/Reify+PAssert$2/GroupGlobally/GroupByKey/Write
May 06, 2022 8:15:22 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:15:20.213Z: Finished operation
PAssert$3/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$3/GroupGlobally/WithKeys/AddKeys/Map+PAssert$3/GroupGlobally/GroupByKey/Reify+PAssert$3/GroupGlobally/GroupByKey/Write
May 06, 2022 8:15:22 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:15:20.241Z: Finished operation
PAssert$2/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$2/GroupGlobally/WithKeys/AddKeys/Map+PAssert$2/GroupGlobally/GroupByKey/Reify+PAssert$2/GroupGlobally/GroupByKey/Write
May 06, 2022 8:15:22 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:15:20.267Z: Finished operation
PAssert$4/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$4/GroupGlobally/WithKeys/AddKeys/Map+PAssert$4/GroupGlobally/GroupByKey/Reify+PAssert$4/GroupGlobally/GroupByKey/Write
May 06, 2022 8:15:22 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:15:20.317Z: Executing operation
PAssert$2/GroupGlobally/GroupByKey/Close
May 06, 2022 8:15:22 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:15:20.353Z: Finished operation
PAssert$1/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$1/GroupGlobally/WithKeys/AddKeys/Map+PAssert$1/GroupGlobally/GroupByKey/Reify+PAssert$1/GroupGlobally/GroupByKey/Write
May 06, 2022 8:15:22 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:15:20.456Z: Finished operation
PAssert$2/GroupGlobally/GroupByKey/Close
May 06, 2022 8:15:22 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:15:20.543Z: Executing operation
PAssert$2/GroupGlobally/GroupByKey/Read+PAssert$2/GroupGlobally/GroupByKey/GroupByWindow+PAssert$2/GroupGlobally/Values/Values/Map+PAssert$2/GroupGlobally/ParDo(Concat)+PAssert$2/GetPane/Map+PAssert$2/RunChecks+PAssert$2/VerifyAssertions/ParDo(DefaultConclude)
May 06, 2022 8:15:22 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:15:21.090Z: Finished operation
PAssert$2/GroupGlobally/GroupByKey/Read+PAssert$2/GroupGlobally/GroupByKey/GroupByWindow+PAssert$2/GroupGlobally/Values/Values/Map+PAssert$2/GroupGlobally/ParDo(Concat)+PAssert$2/GetPane/Map+PAssert$2/RunChecks+PAssert$2/VerifyAssertions/ParDo(DefaultConclude)
May 06, 2022 8:15:22 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:15:21.203Z: Finished operation Count
All/Combine.perKey(Count)/GroupByKey/Read+Count
All/Combine.perKey(Count)/Combine.GroupedValues+Count
All/Combine.perKey(Count)/Combine.GroupedValues/Extract+Count
All/Values/Values/Map+PAssert$1/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$1/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$1/GroupGlobally/WithKeys/AddKeys/Map+PAssert$1/GroupGlobally/GroupByKey/Reify+PAssert$1/GroupGlobally/GroupByKey/Write+Count
All/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)
May 06, 2022 8:15:22 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:15:21.368Z: Executing operation Count
All/View.AsIterable/CreateDataflowView
May 06, 2022 8:15:22 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:15:21.419Z: Finished operation Count
All/View.AsIterable/CreateDataflowView
May 06, 2022 8:15:22 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:15:21.564Z: Executing operation Count
All/CreateVoid/Read(CreateSource)+Count
All/ProduceDefault+PAssert$1/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$1/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$1/GroupGlobally/WithKeys/AddKeys/Map+PAssert$1/GroupGlobally/GroupByKey/Reify+PAssert$1/GroupGlobally/GroupByKey/Write
May 06, 2022 8:15:23 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:15:22.387Z: Finished operation
Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Read+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/Combine.GroupedValues+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/Combine.GroupedValues/Extract+Combine.globally(Top(Reversed))/Values/Values/Map+PAssert$3/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$3/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$3/GroupGlobally/WithKeys/AddKeys/Map+PAssert$3/GroupGlobally/GroupByKey/Reify+PAssert$3/GroupGlobally/GroupByKey/Write+Combine.globally(Top(Reversed))/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)
May 06, 2022 8:15:23 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:15:22.544Z: Executing operation
Combine.globally(Top(Reversed))/View.AsIterable/CreateDataflowView
May 06, 2022 8:15:23 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:15:22.591Z: Finished operation
Combine.globally(Top(Reversed))/View.AsIterable/CreateDataflowView
May 06, 2022 8:15:23 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:15:22.761Z: Executing operation
Combine.globally(Top(Reversed))/CreateVoid/Read(CreateSource)+Combine.globally(Top(Reversed))/ProduceDefault+PAssert$3/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$3/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$3/GroupGlobally/WithKeys/AddKeys/Map+PAssert$3/GroupGlobally/GroupByKey/Reify+PAssert$3/GroupGlobally/GroupByKey/Write
May 06, 2022 8:15:23 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:15:22.894Z: Finished operation
Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Read+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/Combine.GroupedValues+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/Combine.GroupedValues/Extract+Combine.globally(Top(Natural))/Values/Values/Map+PAssert$4/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$4/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$4/GroupGlobally/WithKeys/AddKeys/Map+PAssert$4/GroupGlobally/GroupByKey/Reify+PAssert$4/GroupGlobally/GroupByKey/Write+Combine.globally(Top(Natural))/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)
May 06, 2022 8:15:23 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:15:23.080Z: Executing operation
Combine.globally(Top(Natural))/View.AsIterable/CreateDataflowView
May 06, 2022 8:15:23 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:15:23.125Z: Finished operation
Combine.globally(Top(Natural))/View.AsIterable/CreateDataflowView
May 06, 2022 8:15:23 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:15:23.294Z: Executing operation
Combine.globally(Top(Natural))/CreateVoid/Read(CreateSource)+Combine.globally(Top(Natural))/ProduceDefault+PAssert$4/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$4/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$4/GroupGlobally/WithKeys/AddKeys/Map+PAssert$4/GroupGlobally/GroupByKey/Reify+PAssert$4/GroupGlobally/GroupByKey/Write
May 06, 2022 8:15:25 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:15:23.818Z: Finished operation
Combine.globally(Top(Natural))/CreateVoid/Read(CreateSource)+Combine.globally(Top(Natural))/ProduceDefault+PAssert$4/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$4/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$4/GroupGlobally/WithKeys/AddKeys/Map+PAssert$4/GroupGlobally/GroupByKey/Reify+PAssert$4/GroupGlobally/GroupByKey/Write
May 06, 2022 8:15:25 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:15:23.903Z: Executing operation
PAssert$4/GroupGlobally/GroupByKey/Close
May 06, 2022 8:15:25 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:15:23.954Z: Finished operation Count
All/CreateVoid/Read(CreateSource)+Count
All/ProduceDefault+PAssert$1/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$1/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$1/GroupGlobally/WithKeys/AddKeys/Map+PAssert$1/GroupGlobally/GroupByKey/Reify+PAssert$1/GroupGlobally/GroupByKey/Write
May 06, 2022 8:15:25 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:15:23.971Z: Finished operation
PAssert$4/GroupGlobally/GroupByKey/Close
May 06, 2022 8:15:25 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:15:24.023Z: Executing operation
PAssert$1/GroupGlobally/GroupByKey/Close
May 06, 2022 8:15:25 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:15:24.081Z: Executing operation
PAssert$4/GroupGlobally/GroupByKey/Read+PAssert$4/GroupGlobally/GroupByKey/GroupByWindow+PAssert$4/GroupGlobally/Values/Values/Map+PAssert$4/GroupGlobally/ParDo(Concat)+PAssert$4/GetPane/Map+PAssert$4/RunChecks+PAssert$4/VerifyAssertions/ParDo(DefaultConclude)
May 06, 2022 8:15:25 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:15:24.084Z: Finished operation
PAssert$1/GroupGlobally/GroupByKey/Close
May 06, 2022 8:15:25 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:15:24.163Z: Executing operation
PAssert$1/GroupGlobally/GroupByKey/Read+PAssert$1/GroupGlobally/GroupByKey/GroupByWindow+PAssert$1/GroupGlobally/Values/Values/Map+PAssert$1/GroupGlobally/ParDo(Concat)+PAssert$1/GetPane/Map+PAssert$1/RunChecks+PAssert$1/VerifyAssertions/ParDo(DefaultConclude)
May 06, 2022 8:15:25 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:15:24.330Z: Finished operation
Combine.globally(Top(Reversed))/CreateVoid/Read(CreateSource)+Combine.globally(Top(Reversed))/ProduceDefault+PAssert$3/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$3/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$3/GroupGlobally/WithKeys/AddKeys/Map+PAssert$3/GroupGlobally/GroupByKey/Reify+PAssert$3/GroupGlobally/GroupByKey/Write
May 06, 2022 8:15:25 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:15:24.406Z: Executing operation
PAssert$3/GroupGlobally/GroupByKey/Close
May 06, 2022 8:15:25 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:15:24.461Z: Finished operation
PAssert$4/GroupGlobally/GroupByKey/Read+PAssert$4/GroupGlobally/GroupByKey/GroupByWindow+PAssert$4/GroupGlobally/Values/Values/Map+PAssert$4/GroupGlobally/ParDo(Concat)+PAssert$4/GetPane/Map+PAssert$4/RunChecks+PAssert$4/VerifyAssertions/ParDo(DefaultConclude)
May 06, 2022 8:15:25 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:15:24.478Z: Finished operation
PAssert$3/GroupGlobally/GroupByKey/Close
May 06, 2022 8:15:25 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:15:24.573Z: Executing operation
PAssert$3/GroupGlobally/GroupByKey/Read+PAssert$3/GroupGlobally/GroupByKey/GroupByWindow+PAssert$3/GroupGlobally/Values/Values/Map+PAssert$3/GroupGlobally/ParDo(Concat)+PAssert$3/GetPane/Map+PAssert$3/RunChecks+PAssert$3/VerifyAssertions/ParDo(DefaultConclude)
May 06, 2022 8:15:25 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:15:25.367Z: Finished operation
PAssert$1/GroupGlobally/GroupByKey/Read+PAssert$1/GroupGlobally/GroupByKey/GroupByWindow+PAssert$1/GroupGlobally/Values/Values/Map+PAssert$1/GroupGlobally/ParDo(Concat)+PAssert$1/GetPane/Map+PAssert$1/RunChecks+PAssert$1/VerifyAssertions/ParDo(DefaultConclude)
May 06, 2022 8:15:25 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:15:25.754Z: Finished operation
PAssert$3/GroupGlobally/GroupByKey/Read+PAssert$3/GroupGlobally/GroupByKey/GroupByWindow+PAssert$3/GroupGlobally/Values/Values/Map+PAssert$3/GroupGlobally/ParDo(Concat)+PAssert$3/GetPane/Map+PAssert$3/RunChecks+PAssert$3/VerifyAssertions/ParDo(DefaultConclude)
May 06, 2022 8:15:31 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:15:30.649Z: Cleaning up.
May 06, 2022 8:15:31 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:15:30.731Z: Stopping **** pool...
May 06, 2022 8:16:09 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:16:05.944Z: Autoscaling: Resized **** pool from 5 to 0.
May 06, 2022 8:16:09 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-06T20:16:05.993Z: Worker pool stopped.
May 06, 2022 8:16:28 PM
org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState
INFO: Job 2022-05-06_13_12_05-5162665361241867330 finished with status DONE.
org.apache.beam.sdk.io.jdbc.JdbcIOIT > testWriteThenRead STANDARD_OUT
Load test results for test (ID): 1883d2d8-5ac1-46d2-8064-dc75bb8df368 and
timestamp: 2022-05-06T20:16:28.082000000Z:
Metric: Value:
total_size 2.60857856E8
write_time 38.974
Load test results for test (ID): 1883d2d8-5ac1-46d2-8064-dc75bb8df368 and
timestamp: 2022-05-06T20:16:28.082000000Z:
Metric: Value:
read_time 24.187
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:jdbc:integrationTest FAILED
3 tests completed, 2 failed
Finished generating test XML results (0.035 secs) into:
<https://ci-beam.apache.org/job/beam_PerformanceTests_JDBC/ws/src/sdks/java/io/jdbc/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.038 secs) into:
<https://ci-beam.apache.org/job/beam_PerformanceTests_JDBC/ws/src/sdks/java/io/jdbc/build/reports/tests/integrationTest>
:sdks:java:io:jdbc:integrationTest (Thread[Execution **** for ':',5,main])
completed. Took 8 mins 2.333 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:jdbc:integrationTest'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PerformanceTests_JDBC/ws/src/sdks/java/io/jdbc/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 8m 28s
129 actionable tasks: 75 executed, 52 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/vlgylohsmbqrs
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
