See
<https://ci-beam.apache.org/job/beam_PerformanceTests_JDBC/7275/display/redirect>
Changes:
------------------------------------------
[...truncated 536.24 KB...]
Jan 01, 2023 2:36:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-01T02:36:36.369Z: Fusing consumer
JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable
into
JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow
Jan 01, 2023 2:36:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-01T02:36:36.394Z: Fusing consumer
JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Values/Values/Map
into
JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable
Jan 01, 2023 2:36:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-01T02:36:36.426Z: Fusing consumer ParDo(TimeMonitor) into
JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Values/Values/Map
Jan 01, 2023 2:36:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-01T02:36:36.459Z: Fusing consumer Count
All/Combine.perKey(Count)/GroupByKey+Count
All/Combine.perKey(Count)/Combine.GroupedValues/Partial into Count
All/WithKeys/AddKeys/Map
Jan 01, 2023 2:36:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-01T02:36:36.493Z: Fusing consumer Count
All/Combine.perKey(Count)/GroupByKey/Reify into Count
All/Combine.perKey(Count)/GroupByKey+Count
All/Combine.perKey(Count)/Combine.GroupedValues/Partial
Jan 01, 2023 2:36:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-01T02:36:36.529Z: Fusing consumer Hash row
contents/WithKeys/AddKeys/Map into ParDo(SelectName)
Jan 01, 2023 2:36:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-01T02:36:36.561Z: Fusing consumer Hash row
contents/Combine.perKey(Hashing)/GroupByKey+Hash row
contents/Combine.perKey(Hashing)/Combine.GroupedValues/Partial into Hash row
contents/WithKeys/AddKeys/Map
Jan 01, 2023 2:36:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-01T02:36:36.599Z: Fusing consumer Hash row
contents/Combine.perKey(Hashing)/GroupByKey/Reify into Hash row
contents/Combine.perKey(Hashing)/GroupByKey+Hash row
contents/Combine.perKey(Hashing)/Combine.GroupedValues/Partial
Jan 01, 2023 2:36:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-01T02:36:36.634Z: Fusing consumer
Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/Combine.GroupedValues/Partial
into Combine.globally(Top(Reversed))/WithKeys/AddKeys/Map
Jan 01, 2023 2:36:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-01T02:36:36.667Z: Fusing consumer
Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Reify
into
Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/Combine.GroupedValues/Partial
Jan 01, 2023 2:36:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-01T02:36:36.701Z: Fusing consumer
Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/Combine.GroupedValues/Partial
into Combine.globally(Top(Natural))/WithKeys/AddKeys/Map
Jan 01, 2023 2:36:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-01T02:36:36.737Z: Fusing consumer
Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Reify
into
Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/Combine.GroupedValues/Partial
Jan 01, 2023 2:36:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-01T02:36:36.770Z: Fusing consumer Count
All/Combine.perKey(Count)/GroupByKey/Write into Count
All/Combine.perKey(Count)/GroupByKey/Reify
Jan 01, 2023 2:36:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-01T02:36:36.803Z: Fusing consumer Count
All/Combine.perKey(Count)/Combine.GroupedValues into Count
All/Combine.perKey(Count)/GroupByKey/Read
Jan 01, 2023 2:36:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-01T02:36:36.837Z: Fusing consumer Count
All/Combine.perKey(Count)/Combine.GroupedValues/Extract into Count
All/Combine.perKey(Count)/Combine.GroupedValues
Jan 01, 2023 2:36:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-01T02:36:36.870Z: Fusing consumer Count All/Values/Values/Map
into Count All/Combine.perKey(Count)/Combine.GroupedValues/Extract
Jan 01, 2023 2:36:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-01T02:36:36.905Z: Fusing consumer Count All/ProduceDefault
into Count All/CreateVoid/Read(CreateSource)
Jan 01, 2023 2:36:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-01T02:36:36.941Z: Fusing consumer Hash row
contents/Combine.perKey(Hashing)/GroupByKey/Write into Hash row
contents/Combine.perKey(Hashing)/GroupByKey/Reify
Jan 01, 2023 2:36:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-01T02:36:36.973Z: Fusing consumer Hash row
contents/Combine.perKey(Hashing)/Combine.GroupedValues into Hash row
contents/Combine.perKey(Hashing)/GroupByKey/Read
Jan 01, 2023 2:36:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-01T02:36:37.009Z: Fusing consumer Hash row
contents/Combine.perKey(Hashing)/Combine.GroupedValues/Extract into Hash row
contents/Combine.perKey(Hashing)/Combine.GroupedValues
Jan 01, 2023 2:36:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-01T02:36:37.041Z: Fusing consumer Hash row
contents/Values/Values/Map into Hash row
contents/Combine.perKey(Hashing)/Combine.GroupedValues/Extract
Jan 01, 2023 2:36:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-01T02:36:37.076Z: Fusing consumer
PAssert$2/GroupGlobally/Reify.Window/ParDo(Anonymous) into Hash row
contents/Values/Values/Map
Jan 01, 2023 2:36:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-01T02:36:37.122Z: Fusing consumer
PAssert$2/GroupGlobally/ParDo(ToSingletonIterables) into
PAssert$2/GroupGlobally/Reify.Window/ParDo(Anonymous)
Jan 01, 2023 2:36:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-01T02:36:37.156Z: Fusing consumer
PAssert$2/GroupGlobally/GroupByKey/Write into
PAssert$2/GroupGlobally/GroupByKey/Reify
Jan 01, 2023 2:36:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-01T02:36:37.179Z: Fusing consumer
PAssert$2/GroupGlobally/GroupByKey/GroupByWindow into
PAssert$2/GroupGlobally/GroupByKey/Read
Jan 01, 2023 2:36:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-01T02:36:37.202Z: Fusing consumer
PAssert$2/GroupGlobally/Values/Values/Map into
PAssert$2/GroupGlobally/GroupByKey/GroupByWindow
Jan 01, 2023 2:36:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-01T02:36:37.237Z: Fusing consumer
PAssert$2/GroupGlobally/ParDo(Concat) into
PAssert$2/GroupGlobally/Values/Values/Map
Jan 01, 2023 2:36:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-01T02:36:37.270Z: Fusing consumer PAssert$2/GetPane/Map into
PAssert$2/GroupGlobally/ParDo(Concat)
Jan 01, 2023 2:36:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-01T02:36:37.310Z: Fusing consumer PAssert$2/RunChecks into
PAssert$2/GetPane/Map
Jan 01, 2023 2:36:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-01T02:36:37.340Z: Fusing consumer
PAssert$2/VerifyAssertions/ParDo(DefaultConclude) into PAssert$2/RunChecks
Jan 01, 2023 2:36:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-01T02:36:37.353Z: Your project already contains 100
Dataflow-created metric descriptors, so new user metrics of the form
custom.googleapis.com/* will not be created. However, all user metrics are also
available in the metric dataflow.googleapis.com/job/user_counter. If you rely
on the custom metrics, you can delete old / unused metric descriptors. See
https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list
and
https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
Jan 01, 2023 2:36:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-01T02:36:37.374Z: Fusing consumer
Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Write
into
Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Reify
Jan 01, 2023 2:36:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-01T02:36:37.410Z: Fusing consumer
Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/Combine.GroupedValues
into
Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Read
Jan 01, 2023 2:36:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-01T02:36:37.438Z: Fusing consumer
Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/Combine.GroupedValues/Extract
into
Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/Combine.GroupedValues
Jan 01, 2023 2:36:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-01T02:36:37.469Z: Fusing consumer
Combine.globally(Top(Reversed))/Values/Values/Map into
Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/Combine.GroupedValues/Extract
Jan 01, 2023 2:36:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-01T02:36:37.494Z: Fusing consumer
Combine.globally(Top(Reversed))/ProduceDefault into
Combine.globally(Top(Reversed))/CreateVoid/Read(CreateSource)
Jan 01, 2023 2:36:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-01T02:36:37.526Z: Fusing consumer
Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Write
into
Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Reify
Jan 01, 2023 2:36:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-01T02:36:37.559Z: Fusing consumer
Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/Combine.GroupedValues
into
Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Read
Jan 01, 2023 2:36:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-01T02:36:37.594Z: Fusing consumer
Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/Combine.GroupedValues/Extract
into
Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/Combine.GroupedValues
Jan 01, 2023 2:36:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-01T02:36:37.630Z: Fusing consumer
Combine.globally(Top(Natural))/Values/Values/Map into
Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/Combine.GroupedValues/Extract
Jan 01, 2023 2:36:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-01T02:36:37.660Z: Fusing consumer
Combine.globally(Top(Natural))/ProduceDefault into
Combine.globally(Top(Natural))/CreateVoid/Read(CreateSource)
Jan 01, 2023 2:36:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-01T02:36:37.683Z: Unzipping flatten s42-u187 for input
s44.org.apache.beam.sdk.values.PCollection.<init>:405#556f4ebf84d9869b-c185
Jan 01, 2023 2:36:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-01T02:36:37.711Z: Fusing unzipped copy of
PAssert$2/GroupGlobally/GroupByKey/Reify, through flatten
PAssert$2/GroupGlobally/Flatten.PCollections/Unzipped-1, into producer
PAssert$2/GroupGlobally/WithKeys/AddKeys/Map
Jan 01, 2023 2:36:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-01T02:36:37.745Z: Fusing consumer
PAssert$1/GroupGlobally/WithKeys/AddKeys/Map into
PAssert$1/GroupGlobally/Create.Values/Read(CreateSource)
Jan 01, 2023 2:36:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-01T02:36:37.780Z: Fusing consumer
PAssert$3/GroupGlobally/WithKeys/AddKeys/Map into
PAssert$3/GroupGlobally/Create.Values/Read(CreateSource)
Jan 01, 2023 2:36:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-01T02:36:37.814Z: Fusing consumer
PAssert$4/GroupGlobally/WithKeys/AddKeys/Map into
PAssert$4/GroupGlobally/Create.Values/Read(CreateSource)
Jan 01, 2023 2:36:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-01T02:36:37.839Z: Fusing consumer
PAssert$2/GroupGlobally/WithKeys/AddKeys/Map into
PAssert$2/GroupGlobally/Create.Values/Read(CreateSource)
Jan 01, 2023 2:36:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-01T02:36:37.860Z: Fusing consumer
PAssert$1/GroupGlobally/GroupByKey/Reify into
PAssert$1/GroupGlobally/WithKeys/AddKeys/Map
Jan 01, 2023 2:36:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-01T02:36:37.892Z: Fusing consumer
PAssert$3/GroupGlobally/GroupByKey/Reify into
PAssert$3/GroupGlobally/WithKeys/AddKeys/Map
Jan 01, 2023 2:36:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-01T02:36:37.917Z: Fusing consumer
PAssert$4/GroupGlobally/GroupByKey/Reify into
PAssert$4/GroupGlobally/WithKeys/AddKeys/Map
Jan 01, 2023 2:36:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-01T02:36:37.938Z: Fusing consumer
PAssert$2/GroupGlobally/GroupByKey/Reify into
PAssert$2/GroupGlobally/WithKeys/AddKeys/Map
Jan 01, 2023 2:36:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-01T02:36:38.384Z: Executing operation
JdbcIO.Read/Create.Values/Read(CreateSource)+JdbcIO.Read/JdbcIO.ReadAll/ParDo(Read)+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Consume/ParDo(Anonymous)+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)
Jan 01, 2023 2:36:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-01T02:36:38.464Z: Starting 5 ****s in us-central1-f...
Jan 01, 2023 2:37:21 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-01T02:37:21.059Z: Autoscaling: Raised the number of ****s to
4 based on the rate of progress in the currently running stage(s).
Jan 01, 2023 2:37:21 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-01T02:37:21.091Z: Autoscaling: Resized **** pool to 4, though
goal was 5. This could be a quota issue.
Jan 01, 2023 2:37:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-01T02:37:30.819Z: Autoscaling: Raised the number of ****s to
5 based on the rate of progress in the currently running stage(s).
Jan 01, 2023 2:37:59 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-01T02:37:58.609Z: Workers have started successfully.
Jan 01, 2023 2:38:17 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-01T02:38:17.264Z: All ****s have finished the startup
processes and began to receive work requests.
Jan 01, 2023 2:38:22 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2023-01-01T02:38:21.632Z: org.postgresql.util.PSQLException: ERROR:
relation "beamtest_it_2023_01_01_02_08_43_128" does not exist
Position: 21
at
org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2553)
at
org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:2285)
at
org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:323)
at org.postgresql.jdbc.PgStatement.executeInternal(PgStatement.java:473)
at org.postgresql.jdbc.PgStatement.execute(PgStatement.java:393)
at
org.postgresql.jdbc.PgPreparedStatement.executeWithFlags(PgPreparedStatement.java:164)
at
org.postgresql.jdbc.PgPreparedStatement.executeQuery(PgPreparedStatement.java:114)
at
org.apache.beam.sdk.io.jdbc.JdbcIO$ReadFn.processElement(JdbcIO.java:1476)
Jan 01, 2023 2:38:23 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2023-01-01T02:38:23.221Z: org.postgresql.util.PSQLException: ERROR:
relation "beamtest_it_2023_01_01_02_08_43_128" does not exist
Position: 21
at
org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2553)
at
org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:2285)
at
org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:323)
at org.postgresql.jdbc.PgStatement.executeInternal(PgStatement.java:473)
at org.postgresql.jdbc.PgStatement.execute(PgStatement.java:393)
at
org.postgresql.jdbc.PgPreparedStatement.executeWithFlags(PgPreparedStatement.java:164)
at
org.postgresql.jdbc.PgPreparedStatement.executeQuery(PgPreparedStatement.java:114)
at
org.apache.beam.sdk.io.jdbc.JdbcIO$ReadFn.processElement(JdbcIO.java:1476)
Jan 01, 2023 2:38:29 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2023-01-01T02:38:27.621Z: org.postgresql.util.PSQLException: ERROR:
relation "beamtest_it_2023_01_01_02_08_43_128" does not exist
Position: 21
at
org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2553)
at
org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:2285)
at
org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:323)
at org.postgresql.jdbc.PgStatement.executeInternal(PgStatement.java:473)
at org.postgresql.jdbc.PgStatement.execute(PgStatement.java:393)
at
org.postgresql.jdbc.PgPreparedStatement.executeWithFlags(PgPreparedStatement.java:164)
at
org.postgresql.jdbc.PgPreparedStatement.executeQuery(PgPreparedStatement.java:114)
at
org.apache.beam.sdk.io.jdbc.JdbcIO$ReadFn.processElement(JdbcIO.java:1476)
Jan 01, 2023 2:38:29 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2023-01-01T02:38:29.139Z: org.postgresql.util.PSQLException: ERROR:
relation "beamtest_it_2023_01_01_02_08_43_128" does not exist
Position: 21
at
org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2553)
at
org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:2285)
at
org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:323)
at org.postgresql.jdbc.PgStatement.executeInternal(PgStatement.java:473)
at org.postgresql.jdbc.PgStatement.execute(PgStatement.java:393)
at
org.postgresql.jdbc.PgPreparedStatement.executeWithFlags(PgPreparedStatement.java:164)
at
org.postgresql.jdbc.PgPreparedStatement.executeQuery(PgPreparedStatement.java:114)
at
org.apache.beam.sdk.io.jdbc.JdbcIO$ReadFn.processElement(JdbcIO.java:1476)
Jan 01, 2023 2:38:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-01T02:38:29.578Z: Finished operation
JdbcIO.Read/Create.Values/Read(CreateSource)+JdbcIO.Read/JdbcIO.ReadAll/ParDo(Read)+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Consume/ParDo(Anonymous)+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)
Jan 01, 2023 2:38:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2023-01-01T02:38:29.680Z: Workflow failed. Causes:
S01:JdbcIO.Read/Create.Values/Read(CreateSource)+JdbcIO.Read/JdbcIO.ReadAll/ParDo(Read)+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Consume/ParDo(Anonymous)+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)
failed., The job failed because a work item has failed 4 times. Look in
previous log entries for the cause of each one of the 4 failures. If the logs
only contain generic timeout errors related to accessing external resources,
such as MongoDB, verify that the **** service account has permission to access
the resource's subnetwork. For more information, see
https://cloud.google.com/dataflow/docs/guides/common-errors. The work item was
attempted on these ****s:
jdbcioit0testwritethenrea-12311836-4m4c-harness-0c5l
Root cause: Work item failed.,
jdbcioit0testwritethenrea-12311836-4m4c-harness-0c5l
Root cause: Work item failed.,
jdbcioit0testwritethenrea-12311836-4m4c-harness-dm45
Root cause: Work item failed.,
jdbcioit0testwritethenrea-12311836-4m4c-harness-dm45
Root cause: Work item failed.
Jan 01, 2023 2:38:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-01T02:38:29.760Z: Cleaning up.
Jan 01, 2023 2:38:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-01T02:38:29.860Z: Stopping **** pool...
Jan 01, 2023 2:40:46 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-01T02:40:46.047Z: Autoscaling: Resized **** pool from 5 to 0.
Jan 01, 2023 2:40:46 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-01T02:40:46.121Z: Worker pool stopped.
Jan 01, 2023 2:41:24 AM
org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState
INFO: Job 2022-12-31_18_36_15-11423878943505062625 failed with status
FAILED.
org.apache.beam.sdk.io.jdbc.JdbcIOIT > testWriteThenRead STANDARD_OUT
Load test results for test (ID): 9516f11d-47f9-422d-92f7-7cee33c0df41 and
timestamp: 2023-01-01T02:41:24.190000000Z:
Metric: Value:
write_time 80.648
Load test results for test (ID): 9516f11d-47f9-422d-92f7-7cee33c0df41 and
timestamp: 2023-01-01T02:41:24.190000000Z:
Metric: Value:
read_time 0.0
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:jdbc:integrationTest FAILED
org.apache.beam.sdk.io.jdbc.JdbcIOIT > testWriteThenRead FAILED
org.postgresql.util.PSQLException: ERROR: table
"beamtest_it_2023_01_01_02_08_43_128" does not exist
at
org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2553)
at
org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:2285)
at
org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:323)
at org.postgresql.jdbc.PgStatement.executeInternal(PgStatement.java:473)
at org.postgresql.jdbc.PgStatement.execute(PgStatement.java:393)
at
org.postgresql.jdbc.PgStatement.executeWithFlags(PgStatement.java:322)
at
org.postgresql.jdbc.PgStatement.executeCachedSql(PgStatement.java:308)
at
org.postgresql.jdbc.PgStatement.executeWithFlags(PgStatement.java:284)
at org.postgresql.jdbc.PgStatement.executeUpdate(PgStatement.java:258)
at
org.apache.beam.sdk.io.common.DatabaseTestHelper.deleteTable(DatabaseTestHelper.java:143)
at
org.apache.beam.sdk.io.jdbc.JdbcIOIT.testWriteThenRead(JdbcIOIT.java:146)
3 tests completed, 2 failed
Finished generating test XML results (0.035 secs) into:
<https://ci-beam.apache.org/job/beam_PerformanceTests_JDBC/ws/src/sdks/java/io/jdbc/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.035 secs) into:
<https://ci-beam.apache.org/job/beam_PerformanceTests_JDBC/ws/src/sdks/java/io/jdbc/build/reports/tests/integrationTest>
:sdks:java:io:jdbc:integrationTest (Thread[Execution **** Thread 6,5,main])
completed. Took 32 mins 46.068 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:jdbc:integrationTest'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PerformanceTests_JDBC/ws/src/sdks/java/io/jdbc/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 33m 13s
135 actionable tasks: 79 executed, 54 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/72c6z5sm5iyjw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
