See
<https://ci-beam.apache.org/job/beam_PerformanceTests_JDBC/6985/display/redirect?page=changes>
Changes:
[noreply] Support VR test including TestStream for Spark runner in streaming
mode
[noreply] Add cron job to trigger Java JMH micro-benchmarks weekly (#23388)
------------------------------------------
[...truncated 424.70 KB...]
Oct 01, 2022 2:25:44 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-01T02:25:43.441Z: Fusing consumer
JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify
into
JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign
Oct 01, 2022 2:25:44 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-01T02:25:43.467Z: Fusing consumer
JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
into
JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify
Oct 01, 2022 2:25:44 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-01T02:25:43.496Z: Fusing consumer
JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow
into
JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read
Oct 01, 2022 2:25:44 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-01T02:25:43.533Z: Fusing consumer
JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable
into
JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow
Oct 01, 2022 2:25:44 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-01T02:25:43.560Z: Fusing consumer
JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Values/Values/Map
into
JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable
Oct 01, 2022 2:25:44 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-01T02:25:43.591Z: Fusing consumer ParDo(TimeMonitor) into
JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Values/Values/Map
Oct 01, 2022 2:25:44 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-01T02:25:43.623Z: Fusing consumer Count
All/Combine.perKey(Count)/GroupByKey+Count
All/Combine.perKey(Count)/Combine.GroupedValues/Partial into Count
All/WithKeys/AddKeys/Map
Oct 01, 2022 2:25:44 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-01T02:25:43.656Z: Fusing consumer Count
All/Combine.perKey(Count)/GroupByKey/Reify into Count
All/Combine.perKey(Count)/GroupByKey+Count
All/Combine.perKey(Count)/Combine.GroupedValues/Partial
Oct 01, 2022 2:25:44 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-01T02:25:43.680Z: Fusing consumer Hash row
contents/WithKeys/AddKeys/Map into ParDo(SelectName)
Oct 01, 2022 2:25:44 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-01T02:25:43.714Z: Fusing consumer Hash row
contents/Combine.perKey(Hashing)/GroupByKey+Hash row
contents/Combine.perKey(Hashing)/Combine.GroupedValues/Partial into Hash row
contents/WithKeys/AddKeys/Map
Oct 01, 2022 2:25:44 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-01T02:25:43.748Z: Fusing consumer Hash row
contents/Combine.perKey(Hashing)/GroupByKey/Reify into Hash row
contents/Combine.perKey(Hashing)/GroupByKey+Hash row
contents/Combine.perKey(Hashing)/Combine.GroupedValues/Partial
Oct 01, 2022 2:25:44 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-01T02:25:43.785Z: Fusing consumer
Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/Combine.GroupedValues/Partial
into Combine.globally(Top(Reversed))/WithKeys/AddKeys/Map
Oct 01, 2022 2:25:44 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-01T02:25:43.815Z: Fusing consumer
Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Reify
into
Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/Combine.GroupedValues/Partial
Oct 01, 2022 2:25:44 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-01T02:25:43.850Z: Fusing consumer
Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/Combine.GroupedValues/Partial
into Combine.globally(Top(Natural))/WithKeys/AddKeys/Map
Oct 01, 2022 2:25:44 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-01T02:25:43.880Z: Fusing consumer
Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Reify
into
Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/Combine.GroupedValues/Partial
Oct 01, 2022 2:25:44 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-01T02:25:43.905Z: Fusing consumer Count
All/Combine.perKey(Count)/GroupByKey/Write into Count
All/Combine.perKey(Count)/GroupByKey/Reify
Oct 01, 2022 2:25:44 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-01T02:25:43.939Z: Fusing consumer Count
All/Combine.perKey(Count)/Combine.GroupedValues into Count
All/Combine.perKey(Count)/GroupByKey/Read
Oct 01, 2022 2:25:44 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-01T02:25:43.975Z: Fusing consumer Count
All/Combine.perKey(Count)/Combine.GroupedValues/Extract into Count
All/Combine.perKey(Count)/Combine.GroupedValues
Oct 01, 2022 2:25:44 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-01T02:25:44.010Z: Fusing consumer Count All/Values/Values/Map
into Count All/Combine.perKey(Count)/Combine.GroupedValues/Extract
Oct 01, 2022 2:25:44 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-01T02:25:44.046Z: Fusing consumer Count All/ProduceDefault
into Count All/CreateVoid/Read(CreateSource)
Oct 01, 2022 2:25:44 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-01T02:25:44.078Z: Fusing consumer Hash row
contents/Combine.perKey(Hashing)/GroupByKey/Write into Hash row
contents/Combine.perKey(Hashing)/GroupByKey/Reify
Oct 01, 2022 2:25:44 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-01T02:25:44.111Z: Fusing consumer Hash row
contents/Combine.perKey(Hashing)/Combine.GroupedValues into Hash row
contents/Combine.perKey(Hashing)/GroupByKey/Read
Oct 01, 2022 2:25:44 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-01T02:25:44.137Z: Fusing consumer Hash row
contents/Combine.perKey(Hashing)/Combine.GroupedValues/Extract into Hash row
contents/Combine.perKey(Hashing)/Combine.GroupedValues
Oct 01, 2022 2:25:44 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-01T02:25:44.174Z: Fusing consumer Hash row
contents/Values/Values/Map into Hash row
contents/Combine.perKey(Hashing)/Combine.GroupedValues/Extract
Oct 01, 2022 2:25:44 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-01T02:25:44.203Z: Fusing consumer
PAssert$2/GroupGlobally/Reify.Window/ParDo(Anonymous) into Hash row
contents/Values/Values/Map
Oct 01, 2022 2:25:44 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-01T02:25:44.240Z: Fusing consumer
PAssert$2/GroupGlobally/ParDo(ToSingletonIterables) into
PAssert$2/GroupGlobally/Reify.Window/ParDo(Anonymous)
Oct 01, 2022 2:25:44 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-01T02:25:44.269Z: Your project already contains 100
Dataflow-created metric descriptors, so new user metrics of the form
custom.googleapis.com/* will not be created. However, all user metrics are also
available in the metric dataflow.googleapis.com/job/user_counter. If you rely
on the custom metrics, you can delete old / unused metric descriptors. See
https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list
and
https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
Oct 01, 2022 2:25:44 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-01T02:25:44.277Z: Fusing consumer
PAssert$2/GroupGlobally/GroupByKey/Write into
PAssert$2/GroupGlobally/GroupByKey/Reify
Oct 01, 2022 2:25:44 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-01T02:25:44.312Z: Fusing consumer
PAssert$2/GroupGlobally/GroupByKey/GroupByWindow into
PAssert$2/GroupGlobally/GroupByKey/Read
Oct 01, 2022 2:25:44 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-01T02:25:44.347Z: Fusing consumer
PAssert$2/GroupGlobally/Values/Values/Map into
PAssert$2/GroupGlobally/GroupByKey/GroupByWindow
Oct 01, 2022 2:25:44 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-01T02:25:44.384Z: Fusing consumer
PAssert$2/GroupGlobally/ParDo(Concat) into
PAssert$2/GroupGlobally/Values/Values/Map
Oct 01, 2022 2:25:44 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-01T02:25:44.420Z: Fusing consumer PAssert$2/GetPane/Map into
PAssert$2/GroupGlobally/ParDo(Concat)
Oct 01, 2022 2:25:44 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-01T02:25:44.450Z: Fusing consumer PAssert$2/RunChecks into
PAssert$2/GetPane/Map
Oct 01, 2022 2:25:44 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-01T02:25:44.476Z: Fusing consumer
PAssert$2/VerifyAssertions/ParDo(DefaultConclude) into PAssert$2/RunChecks
Oct 01, 2022 2:25:44 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-01T02:25:44.505Z: Fusing consumer
Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Write
into
Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Reify
Oct 01, 2022 2:25:44 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-01T02:25:44.537Z: Fusing consumer
Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/Combine.GroupedValues
into
Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Read
Oct 01, 2022 2:25:44 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-01T02:25:44.562Z: Fusing consumer
Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/Combine.GroupedValues/Extract
into
Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/Combine.GroupedValues
Oct 01, 2022 2:25:44 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-01T02:25:44.588Z: Fusing consumer
Combine.globally(Top(Reversed))/Values/Values/Map into
Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/Combine.GroupedValues/Extract
Oct 01, 2022 2:25:44 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-01T02:25:44.620Z: Fusing consumer
Combine.globally(Top(Reversed))/ProduceDefault into
Combine.globally(Top(Reversed))/CreateVoid/Read(CreateSource)
Oct 01, 2022 2:25:44 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-01T02:25:44.655Z: Fusing consumer
Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Write
into
Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Reify
Oct 01, 2022 2:25:44 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-01T02:25:44.689Z: Fusing consumer
Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/Combine.GroupedValues
into
Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Read
Oct 01, 2022 2:25:44 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-01T02:25:44.723Z: Fusing consumer
Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/Combine.GroupedValues/Extract
into
Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/Combine.GroupedValues
Oct 01, 2022 2:25:44 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-01T02:25:44.755Z: Fusing consumer
Combine.globally(Top(Natural))/Values/Values/Map into
Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/Combine.GroupedValues/Extract
Oct 01, 2022 2:25:44 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-01T02:25:44.780Z: Fusing consumer
Combine.globally(Top(Natural))/ProduceDefault into
Combine.globally(Top(Natural))/CreateVoid/Read(CreateSource)
Oct 01, 2022 2:25:44 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-01T02:25:44.809Z: Unzipping flatten s42-u187 for input
s44.org.apache.beam.sdk.values.PCollection.<init>:405#9d175ab169cd3bcf-c185
Oct 01, 2022 2:25:44 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-01T02:25:44.833Z: Fusing unzipped copy of
PAssert$2/GroupGlobally/GroupByKey/Reify, through flatten
PAssert$2/GroupGlobally/Flatten.PCollections/Unzipped-1, into producer
PAssert$2/GroupGlobally/WithKeys/AddKeys/Map
Oct 01, 2022 2:25:44 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-01T02:25:44.859Z: Fusing consumer
PAssert$1/GroupGlobally/WithKeys/AddKeys/Map into
PAssert$1/GroupGlobally/Create.Values/Read(CreateSource)
Oct 01, 2022 2:25:44 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-01T02:25:44.881Z: Fusing consumer
PAssert$3/GroupGlobally/WithKeys/AddKeys/Map into
PAssert$3/GroupGlobally/Create.Values/Read(CreateSource)
Oct 01, 2022 2:25:47 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-01T02:25:44.906Z: Fusing consumer
PAssert$4/GroupGlobally/WithKeys/AddKeys/Map into
PAssert$4/GroupGlobally/Create.Values/Read(CreateSource)
Oct 01, 2022 2:25:47 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-01T02:25:44.936Z: Fusing consumer
PAssert$2/GroupGlobally/WithKeys/AddKeys/Map into
PAssert$2/GroupGlobally/Create.Values/Read(CreateSource)
Oct 01, 2022 2:25:47 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-01T02:25:44.964Z: Fusing consumer
PAssert$1/GroupGlobally/GroupByKey/Reify into
PAssert$1/GroupGlobally/WithKeys/AddKeys/Map
Oct 01, 2022 2:25:47 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-01T02:25:45.002Z: Fusing consumer
PAssert$3/GroupGlobally/GroupByKey/Reify into
PAssert$3/GroupGlobally/WithKeys/AddKeys/Map
Oct 01, 2022 2:25:47 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-01T02:25:45.036Z: Fusing consumer
PAssert$4/GroupGlobally/GroupByKey/Reify into
PAssert$4/GroupGlobally/WithKeys/AddKeys/Map
Oct 01, 2022 2:25:47 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-01T02:25:45.073Z: Fusing consumer
PAssert$2/GroupGlobally/GroupByKey/Reify into
PAssert$2/GroupGlobally/WithKeys/AddKeys/Map
Oct 01, 2022 2:25:47 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-01T02:25:45.492Z: Executing operation
JdbcIO.Read/Create.Values/Read(CreateSource)+JdbcIO.Read/JdbcIO.ReadAll/ParDo(Read)+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Consume/ParDo(Anonymous)+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)
Oct 01, 2022 2:25:47 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-01T02:25:45.579Z: Starting 5 ****s in us-central1-a...
Oct 01, 2022 2:26:28 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-01T02:26:27.739Z: Autoscaling: Raised the number of ****s to
5 based on the rate of progress in the currently running stage(s).
Oct 01, 2022 2:26:59 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-01T02:26:58.651Z: Workers have started successfully.
Oct 01, 2022 2:27:21 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2022-10-01T02:27:20.760Z: org.postgresql.util.PSQLException: ERROR:
relation "beamtest_it_2022_10_01_02_08_44_863" does not exist
Position: 21
at
org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2553)
at
org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:2285)
at
org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:323)
at org.postgresql.jdbc.PgStatement.executeInternal(PgStatement.java:473)
at org.postgresql.jdbc.PgStatement.execute(PgStatement.java:393)
at
org.postgresql.jdbc.PgPreparedStatement.executeWithFlags(PgPreparedStatement.java:164)
at
org.postgresql.jdbc.PgPreparedStatement.executeQuery(PgPreparedStatement.java:114)
at
org.apache.beam.sdk.io.jdbc.JdbcIO$ReadFn.processElement(JdbcIO.java:1381)
Oct 01, 2022 2:27:24 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2022-10-01T02:27:22.282Z: org.postgresql.util.PSQLException: ERROR:
relation "beamtest_it_2022_10_01_02_08_44_863" does not exist
Position: 21
at
org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2553)
at
org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:2285)
at
org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:323)
at org.postgresql.jdbc.PgStatement.executeInternal(PgStatement.java:473)
at org.postgresql.jdbc.PgStatement.execute(PgStatement.java:393)
at
org.postgresql.jdbc.PgPreparedStatement.executeWithFlags(PgPreparedStatement.java:164)
at
org.postgresql.jdbc.PgPreparedStatement.executeQuery(PgPreparedStatement.java:114)
at
org.apache.beam.sdk.io.jdbc.JdbcIO$ReadFn.processElement(JdbcIO.java:1381)
Oct 01, 2022 2:27:28 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2022-10-01T02:27:26.482Z: org.postgresql.util.PSQLException: ERROR:
relation "beamtest_it_2022_10_01_02_08_44_863" does not exist
Position: 21
at
org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2553)
at
org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:2285)
at
org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:323)
at org.postgresql.jdbc.PgStatement.executeInternal(PgStatement.java:473)
at org.postgresql.jdbc.PgStatement.execute(PgStatement.java:393)
at
org.postgresql.jdbc.PgPreparedStatement.executeWithFlags(PgPreparedStatement.java:164)
at
org.postgresql.jdbc.PgPreparedStatement.executeQuery(PgPreparedStatement.java:114)
at
org.apache.beam.sdk.io.jdbc.JdbcIO$ReadFn.processElement(JdbcIO.java:1381)
Oct 01, 2022 2:27:28 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2022-10-01T02:27:26.976Z: org.postgresql.util.PSQLException: ERROR:
relation "beamtest_it_2022_10_01_02_08_44_863" does not exist
Position: 21
at
org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2553)
at
org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:2285)
at
org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:323)
at org.postgresql.jdbc.PgStatement.executeInternal(PgStatement.java:473)
at org.postgresql.jdbc.PgStatement.execute(PgStatement.java:393)
at
org.postgresql.jdbc.PgPreparedStatement.executeWithFlags(PgPreparedStatement.java:164)
at
org.postgresql.jdbc.PgPreparedStatement.executeQuery(PgPreparedStatement.java:114)
at
org.apache.beam.sdk.io.jdbc.JdbcIO$ReadFn.processElement(JdbcIO.java:1381)
Oct 01, 2022 2:27:28 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-01T02:27:27.338Z: Finished operation
JdbcIO.Read/Create.Values/Read(CreateSource)+JdbcIO.Read/JdbcIO.ReadAll/ParDo(Read)+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Consume/ParDo(Anonymous)+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)
Oct 01, 2022 2:27:28 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2022-10-01T02:27:27.411Z: Workflow failed. Causes:
S01:JdbcIO.Read/Create.Values/Read(CreateSource)+JdbcIO.Read/JdbcIO.ReadAll/ParDo(Read)+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Consume/ParDo(Anonymous)+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)
failed., The job failed because a work item has failed 4 times. Look in
previous log entries for the cause of each one of the 4 failures. For more
information, see https://cloud.google.com/dataflow/docs/guides/common-errors.
The work item was attempted on these ****s:
jdbcioit0testwritethenrea-09301925-a6gz-harness-x1bh
Root cause: Work item failed.,
jdbcioit0testwritethenrea-09301925-a6gz-harness-x1bh
Root cause: Work item failed.,
jdbcioit0testwritethenrea-09301925-a6gz-harness-tjqh
Root cause: Work item failed.,
jdbcioit0testwritethenrea-09301925-a6gz-harness-tjqh
Root cause: Work item failed.
Oct 01, 2022 2:27:28 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-01T02:27:27.492Z: Cleaning up.
Oct 01, 2022 2:27:28 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-01T02:27:27.558Z: Stopping **** pool...
Oct 01, 2022 2:29:49 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-01T02:29:48.599Z: Autoscaling: Resized **** pool from 5 to 0.
Oct 01, 2022 2:29:49 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-01T02:29:48.675Z: Worker pool stopped.
Oct 01, 2022 2:30:25 AM
org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState
INFO: Job 2022-09-30_19_25_27-1280563677383239411 failed with status FAILED.
org.apache.beam.sdk.io.jdbc.JdbcIOIT > testWriteThenRead STANDARD_OUT
Load test results for test (ID): 21845f98-0c8b-434b-9a24-28ca3fa963ab and
timestamp: 2022-10-01T02:30:25.591000000Z:
Metric: Value:
write_time 39.397
Load test results for test (ID): 21845f98-0c8b-434b-9a24-28ca3fa963ab and
timestamp: 2022-10-01T02:30:25.591000000Z:
Metric: Value:
read_time 0.0
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:jdbc:integrationTest FAILED
org.apache.beam.sdk.io.jdbc.JdbcIOIT > testWriteThenRead FAILED
org.postgresql.util.PSQLException: ERROR: table
"beamtest_it_2022_10_01_02_08_44_863" does not exist
at
org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2553)
at
org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:2285)
at
org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:323)
at org.postgresql.jdbc.PgStatement.executeInternal(PgStatement.java:473)
at org.postgresql.jdbc.PgStatement.execute(PgStatement.java:393)
at
org.postgresql.jdbc.PgStatement.executeWithFlags(PgStatement.java:322)
at
org.postgresql.jdbc.PgStatement.executeCachedSql(PgStatement.java:308)
at
org.postgresql.jdbc.PgStatement.executeWithFlags(PgStatement.java:284)
at org.postgresql.jdbc.PgStatement.executeUpdate(PgStatement.java:258)
at
org.apache.beam.sdk.io.common.DatabaseTestHelper.deleteTable(DatabaseTestHelper.java:107)
at
org.apache.beam.sdk.io.jdbc.JdbcIOIT.testWriteThenRead(JdbcIOIT.java:147)
3 tests completed, 1 failed
Finished generating test XML results (0.028 secs) into:
<https://ci-beam.apache.org/job/beam_PerformanceTests_JDBC/ws/src/sdks/java/io/jdbc/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.034 secs) into:
<https://ci-beam.apache.org/job/beam_PerformanceTests_JDBC/ws/src/sdks/java/io/jdbc/build/reports/tests/integrationTest>
:sdks:java:io:jdbc:integrationTest (Thread[Execution **** Thread 6,5,main])
completed. Took 21 mins 46.288 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:jdbc:integrationTest'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PerformanceTests_JDBC/ws/src/sdks/java/io/jdbc/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 22m 15s
135 actionable tasks: 79 executed, 54 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/qvfe4i2vkxfog
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
