See
<https://ci-beam.apache.org/job/beam_PostCommit_Python36/4582/display/redirect?page=changes>
Changes:
[Andrew Pilloud] [BEAM-13056] Expose FieldAccess in DoFnSchemaInformation
[noreply] [BEAM-11097] Create hook to enable cross-bundle side input caching
[noreply] Merge pull request #15804 from [BEAM-13109][Playground] Add processing
------------------------------------------
[...truncated 36.24 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122
b'WARNING: Snapshot was interrupted before completion'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Snapshot - Final stage'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122
b'WARNING: Using configuration property "column.whitelist" is deprecated and
will be removed in future versions. Please use "column.include.list" instead.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122
b'WARNING: Using configuration property "column.blacklist" is deprecated and
will be removed in future versions. Please use "column.exclude.list" instead.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122
b'WARNING: Using configuration property "column.whitelist" is deprecated and
will be removed in future versions. Please use "column.include.list" instead.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122
b'WARNING: Using configuration property "column.blacklist" is deprecated and
will be removed in future versions. Please use "column.exclude.list" instead.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122
b'WARNING: Using configuration property "column.whitelist" is deprecated and
will be removed in future versions. Please use "column.include.list" instead.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122
b'WARNING: Using configuration property "column.blacklist" is deprecated and
will be removed in future versions. Please use "column.exclude.list" instead.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122
b'WARNING: Using configuration property "column.whitelist" is deprecated and
will be removed in future versions. Please use "column.include.list" instead.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122
b'WARNING: Using configuration property "column.blacklist" is deprecated and
will be removed in future versions. Please use "column.exclude.list" instead.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122
b'WARNING: Using configuration property "table.whitelist" is deprecated and
will be removed in future versions. Please use "table.include.list" instead.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122
b'WARNING: Using configuration property "table.blacklist" is deprecated and
will be removed in future versions. Please use "table.exclude.list" instead.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122
b'WARNING: Using configuration property "table.whitelist" is deprecated and
will be removed in future versions. Please use "table.include.list" instead.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122
b'WARNING: Using configuration property "table.blacklist" is deprecated and
will be removed in future versions. Please use "table.exclude.list" instead.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122
b'WARNING: Using configuration property "schema.whitelist" is deprecated and
will be removed in future versions. Please use "schema.include.list" instead.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122
b'WARNING: Using configuration property "schema.blacklist" is deprecated and
will be removed in future versions. Please use "schema.exclude.list" instead.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122
b'WARNING: Using configuration property "schema.whitelist" is deprecated and
will be removed in future versions. Please use "schema.include.list" instead.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122
b'WARNING: Using configuration property "schema.blacklist" is deprecated and
will be removed in future versions. Please use "schema.exclude.list" instead.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Starting PostgresConnectorTask with configuration:'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
connector.class = io.debezium.connector.postgresql.PostgresConnector'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
database.dbname = inventory'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
database.user = debezium'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
database.hostname = localhost'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
database.password = ********'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
beam.parent.instance = 1713279555'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
database.server.name = dbserver1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
database.history =
org.apache.beam.io.debezium.KafkaSourceConsumerFn$DebeziumSDFDatabaseHistory'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
include.schema.changes = false'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
database.include.list = inventory'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
database.port = 33113'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122
b'WARNING: Using configuration property "schema.whitelist" is deprecated and
will be removed in future versions. Please use "schema.include.list" instead.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122
b'WARNING: Using configuration property "schema.blacklist" is deprecated and
will be removed in future versions. Please use "schema.exclude.list" instead.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122
b'WARNING: Using configuration property "table.whitelist" is deprecated and
will be removed in future versions. Please use "table.include.list" instead.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122
b'WARNING: Using configuration property "table.blacklist" is deprecated and
will be removed in future versions. Please use "table.exclude.list" instead.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122
b'WARNING: Using configuration property "column.blacklist" is deprecated and
will be removed in future versions. Please use "column.exclude.list" instead.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122
b'WARNING: Using configuration property "schema.blacklist" is deprecated and
will be removed in future versions. Please use "schema.exclude.list" instead.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122
b'WARNING: Using configuration property "table.blacklist" is deprecated and
will be removed in future versions. Please use "table.exclude.list" instead.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122
b'WARNING: Using configuration property "table.whitelist" is deprecated and
will be removed in future versions. Please use "table.include.list" instead.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122
b'WARNING: Using configuration property "schema.whitelist" is deprecated and
will be removed in future versions. Please use "schema.include.list" instead.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122
b'WARNING: Using configuration property "column.whitelist" is deprecated and
will be removed in future versions. Please use "column.include.list" instead.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122
b'WARNING: Using configuration property "column.blacklist" is deprecated and
will be removed in future versions. Please use "column.exclude.list" instead.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122
b'WARNING: Using configuration property "schema.blacklist" is deprecated and
will be removed in future versions. Please use "schema.exclude.list" instead.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122
b'WARNING: Using configuration property "table.blacklist" is deprecated and
will be removed in future versions. Please use "table.exclude.list" instead.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122
b'WARNING: Using configuration property "table.whitelist" is deprecated and
will be removed in future versions. Please use "table.include.list" instead.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122
b'WARNING: Using configuration property "schema.whitelist" is deprecated and
will be removed in future versions. Please use "schema.include.list" instead.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122
b'WARNING: Using configuration property "column.whitelist" is deprecated and
will be removed in future versions. Please use "column.include.list" instead.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122
b'WARNING: Using configuration property "column.blacklist" is deprecated and
will be removed in future versions. Please use "column.exclude.list" instead.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
user 'debezium' connected to database 'inventory' on PostgreSQL 11.13 (Debian
11.13-1.pgdg90+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian
6.3.0-18+deb9u1) 6.3.0 20170516, 64-bit with roles:"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"\trole
'pg_read_all_settings' [superuser: false, replication: false, inherit: true,
create role: false, create db: false, can log in: false]"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"\trole
'pg_stat_scan_tables' [superuser: false, replication: false, inherit: true,
create role: false, create db: false, can log in: false]"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"\trole
'pg_write_server_files' [superuser: false, replication: false, inherit: true,
create role: false, create db: false, can log in: false]"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"\trole
'debezium' [superuser: true, replication: true, inherit: true, create role:
true, create db: true, can log in: true]"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"\trole
'pg_monitor' [superuser: false, replication: false, inherit: true, create role:
false, create db: false, can log in: false]"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"\trole
'pg_read_server_files' [superuser: false, replication: false, inherit: true,
create role: false, create db: false, can log in: false]"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"\trole
'pg_execute_server_program' [superuser: false, replication: false, inherit:
true, create role: false, create db: false, can log in: false]"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"\trole
'pg_read_all_stats' [superuser: false, replication: false, inherit: true,
create role: false, create db: false, can log in: false]"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"\trole
'pg_signal_backend' [superuser: false, replication: false, inherit: true,
create role: false, create db: false, can log in: false]"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Obtained valid replication slot ReplicationSlot [active=false,
latestFlushedLsn=LSN{0/20790F8}, catalogXmin=602]'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
No previous offset found'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Taking initial snapshot for new datasource'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Requested thread factory for connector PostgresConnector, id = dbserver1 named
= change-event-source-coordinator'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Creating thread
debezium-postgresconnector-dbserver1-change-event-source-coordinator'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Metrics registered'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Context created'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Taking initial snapshot for new datasource'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
According to the connector configuration data will be snapshotted'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Snapshot step 1 - Preparing'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Snapshot step 2 - Determining captured tables'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122
b'WARNING: Using configuration property "table.whitelist" is deprecated and
will be removed in future versions. Please use "table.include.list" instead.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Snapshot step 3 - Locking captured tables'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
Waiting a maximum of '10' seconds for each table lock"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Snapshot step 4 - Determining snapshot offset'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Creating initial offset context'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
Read xlogStart at 'LSN{0/207D0F8}' from transaction '604'"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
Read xlogStart at 'LSN{0/207D0F8}' from transaction '604'"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Snapshot step 5 - Reading structure of captured tables'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
Reading structure of schema 'inventory'"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Snapshot step 6 - Persisting schema history'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Snapshot step 7 - Snapshotting data'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
\t Exporting data from table 'inventory.customers'"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
\t For table \'inventory.customers\' using select statement: \'SELECT * FROM
"inventory"."customers"\''
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
\t Finished exporting 4 records for table 'inventory.customers'; total duration
'00:00:00.009'"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
\t Exporting data from table 'inventory.geom'"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
\t For table \'inventory.geom\' using select statement: \'SELECT * FROM
"inventory"."geom"\''
> Task :sdks:python:test-suites:dataflow:py36:postCommitIT
[gw3] [32mPASSED[0m
apache_beam/examples/complete/juliaset/juliaset/juliaset_test_it.py::JuliaSetTestIT::test_run_example_with_setup_file
apache_beam/io/gcp/big_query_query_to_table_it_test.py::BigQueryQueryToTableIT::test_big_query_legacy_sql
> Task :sdks:python:test-suites:portable:py36:postCommitPy36IT
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
\t Finished exporting 3 records for table 'inventory.geom'; total duration
'00:00:00.053'"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
\t Exporting data from table 'inventory.orders'"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
\t For table \'inventory.orders\' using select statement: \'SELECT * FROM
"inventory"."orders"\''
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
\t Finished exporting 4 records for table 'inventory.orders'; total duration
'00:00:00.012'"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
\t Exporting data from table 'inventory.products'"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
\t For table \'inventory.products\' using select statement: \'SELECT * FROM
"inventory"."products"\''
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
\t Finished exporting 9 records for table 'inventory.products'; total duration
'00:00:00.028'"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
\t Exporting data from table 'inventory.products_on_hand'"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
\t For table \'inventory.products_on_hand\' using select statement: \'SELECT *
FROM "inventory"."products_on_hand"\''
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
\t Finished exporting 9 records for table 'inventory.products_on_hand'; total
duration '00:00:00.006'"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
\t Exporting data from table 'inventory.spatial_ref_sys'"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
\t For table \'inventory.spatial_ref_sys\' using select statement: \'SELECT *
FROM "inventory"."spatial_ref_sys"\''
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Stopping down connector'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122
b'WARNING: Snapshot was interrupted before completion'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Snapshot - Final stage'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
getProcessBundleDescriptor request with id 1-10'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.flink.runtime.taskmanager.Task transitionState'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
[1]Read from
debezium/ExternalTransform(beam:transform:org.apache.beam:debezium_read:v1)/ParDo(KafkaSourceConsumer)/ParMultiDo(KafkaSourceConsumer)/ProcessSizedElementsAndRestrictions0
-> [5]{Read from debezium, assert_that} (13/16)#0
(b7e35404d22d12ad257a71eb8644fc2b) switched from RUNNING to FINISHED.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.flink.runtime.taskmanager.Task doRun'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Freeing task resources for [1]Read from
debezium/ExternalTransform(beam:transform:org.apache.beam:debezium_read:v1)/ParDo(KafkaSourceConsumer)/ParMultiDo(KafkaSourceConsumer)/ProcessSizedElementsAndRestrictions0
-> [5]{Read from debezium, assert_that} (13/16)#0
(b7e35404d22d12ad257a71eb8644fc2b).'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.flink.runtime.taskexecutor.TaskExecutor
unregisterTaskAndNotifyFinalState'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Un-registering task and sending final execution state FINISHED to JobManager
for task [1]Read from
debezium/ExternalTransform(beam:transform:org.apache.beam:debezium_read:v1)/ParDo(KafkaSourceConsumer)/ParMultiDo(KafkaSourceConsumer)/ProcessSizedElementsAndRestrictions0
-> [5]{Read from debezium, assert_that} (13/16)#0
b7e35404d22d12ad257a71eb8644fc2b.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.flink.runtime.executiongraph.Execution
transitionState'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
[1]Read from
debezium/ExternalTransform(beam:transform:org.apache.beam:debezium_read:v1)/ParDo(KafkaSourceConsumer)/ParMultiDo(KafkaSourceConsumer)/ProcessSizedElementsAndRestrictions0
-> [5]{Read from debezium, assert_that} (13/16)
(b7e35404d22d12ad257a71eb8644fc2b) switched from RUNNING to FINISHED.'
java.lang.OutOfMemoryError: GC overhead limit exceeded
> Task :sdks:python:test-suites:portable:py36:postCommitPy36IT
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
\t Finished exporting 3 records for table 'inventory.geom'; total duration
'00:00:00.053'"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
\t Exporting data from table 'inventory.orders'"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
\t For table \'inventory.orders\' using select statement: \'SELECT * FROM
"inventory"."orders"\''
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
\t Finished exporting 4 records for table 'inventory.orders'; total duration
'00:00:00.012'"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
\t Exporting data from table 'inventory.products'"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
\t For table \'inventory.products\' using select statement: \'SELECT * FROM
"inventory"."products"\''
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
\t Finished exporting 9 records for table 'inventory.products'; total duration
'00:00:00.028'"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
\t Exporting data from table 'inventory.products_on_hand'"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
\t For table \'inventory.products_on_hand\' using select statement: \'SELECT *
FROM "inventory"."products_on_hand"\''
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
\t Finished exporting 9 records for table 'inventory.products_on_hand'; total
duration '00:00:00.006'"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
\t Exporting data from table 'inventory.spatial_ref_sys'"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
\t For table \'inventory.spatial_ref_sys\' using select statement: \'SELECT *
FROM "inventory"."spatial_ref_sys"\''
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Stopping down connector'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122
b'WARNING: Snapshot was interrupted before completion'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Snapshot - Final stage'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
getProcessBundleDescriptor request with id 1-10'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.flink.runtime.taskmanager.Task transitionState'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
[1]Read from
debezium/ExternalTransform(beam:transform:org.apache.beam:debezium_read:v1)/ParDo(KafkaSourceConsumer)/ParMultiDo(KafkaSourceConsumer)/ProcessSizedElementsAndRestrictions0
-> [5]{Read from debezium, assert_that} (13/16)#0
(b7e35404d22d12ad257a71eb8644fc2b) switched from RUNNING to FINISHED.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.flink.runtime.taskmanager.Task doRun'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Freeing task resources for [1]Read from
debezium/ExternalTransform(beam:transform:org.apache.beam:debezium_read:v1)/ParDo(KafkaSourceConsumer)/ParMultiDo(KafkaSourceConsumer)/ProcessSizedElementsAndRestrictions0
-> [5]{Read from debezium, assert_that} (13/16)#0
(b7e35404d22d12ad257a71eb8644fc2b).'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.flink.runtime.taskexecutor.TaskExecutor
unregisterTaskAndNotifyFinalState'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Un-registering task and sending final execution state FINISHED to JobManager
for task [1]Read from
debezium/ExternalTransform(beam:transform:org.apache.beam:debezium_read:v1)/ParDo(KafkaSourceConsumer)/ParMultiDo(KafkaSourceConsumer)/ProcessSizedElementsAndRestrictions0
-> [5]{Read from debezium, assert_that} (13/16)#0
b7e35404d22d12ad257a71eb8644fc2b.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.flink.runtime.executiongraph.Execution
transitionState'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
[1]Read from
debezium/ExternalTransform(beam:transform:org.apache.beam:debezium_read:v1)/ParDo(KafkaSourceConsumer)/ParMultiDo(KafkaSourceConsumer)/ProcessSizedElementsAndRestrictions0
-> [5]{Read from debezium, assert_that} (13/16)
(b7e35404d22d12ad257a71eb8644fc2b) switched from RUNNING to FINISHED.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Nov 09,
2021 6:49:29 PM org.apache.flink.runtime.taskmanager.Task transitionState'Build
step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
