See
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/4352/display/redirect?page=changes>
Changes:
[noreply] [BEAM-11516] Upgrade to pylint 2.11.1, fix warnings (#15612)
[noreply] [BEAM-12979, BEAM-11097] Change cache to store ReStreams, clean up to…
[noreply] [BEAM-3304, BEAM-12513] Trigger changes and Windowing. (#15644)
------------------------------------------
[...truncated 52.32 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:51 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
database.history =
org.apache.beam.io.debezium.KafkaSourceConsumerFn$DebeziumSDFDatabaseHistory'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:51 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
include.schema.changes = false'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:51 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
database.include.list = inventory'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:51 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
database.port = 36484'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:51 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
No previous offsets found'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:51 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
user 'debezium' connected to database 'inventory' on PostgreSQL 11.13 (Debian
11.13-1.pgdg90+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian
6.3.0-18+deb9u1) 6.3.0 20170516, 64-bit with roles:"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"\trole
'pg_read_all_settings' [superuser: false, replication: false, inherit: true,
create role: false, create db: false, can log in: false]"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"\trole
'pg_stat_scan_tables' [superuser: false, replication: false, inherit: true,
create role: false, create db: false, can log in: false]"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"\trole
'pg_write_server_files' [superuser: false, replication: false, inherit: true,
create role: false, create db: false, can log in: false]"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"\trole
'debezium' [superuser: true, replication: true, inherit: true, create role:
true, create db: true, can log in: true]"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"\trole
'pg_monitor' [superuser: false, replication: false, inherit: true, create role:
false, create db: false, can log in: false]"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"\trole
'pg_read_server_files' [superuser: false, replication: false, inherit: true,
create role: false, create db: false, can log in: false]"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"\trole
'pg_execute_server_program' [superuser: false, replication: false, inherit:
true, create role: false, create db: false, can log in: false]"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"\trole
'pg_read_all_stats' [superuser: false, replication: false, inherit: true,
create role: false, create db: false, can log in: false]"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"\trole
'pg_signal_backend' [superuser: false, replication: false, inherit: true,
create role: false, create db: false, can log in: false]"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:51 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Obtained valid replication slot ReplicationSlot [active=false,
latestFlushedLsn=LSN{0/2039A78}, catalogXmin=597]'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:51 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
No previous offset found'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:51 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Taking initial snapshot for new datasource'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:51 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Requested thread factory for connector PostgresConnector, id = dbserver1 named
= change-event-source-coordinator'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:51 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Creating thread
debezium-postgresconnector-dbserver1-change-event-source-coordinator'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:51 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Metrics registered'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:51 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Context created'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:51 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Taking initial snapshot for new datasource'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:51 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
According to the connector configuration data will be snapshotted'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:51 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Snapshot step 1 - Preparing'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:51 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Snapshot step 2 - Determining captured tables'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:51 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Snapshot step 3 - Locking captured tables []'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:51 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Snapshot step 4 - Determining snapshot offset'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:51 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Creating initial offset context'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:51 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
Read xlogStart at 'LSN{0/207F958}' from transaction '1013'"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:51 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
Read xlogStart at 'LSN{0/207F958}' from transaction '1013'"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:51 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Snapshot step 5 - Reading structure of captured tables'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:51 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Snapshot step 6 - Persisting schema history'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:51 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Snapshot step 7 - Snapshotting data'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:51 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Snapshotting contents of 0 tables while still in transaction'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:51 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Snapshot - Final stage'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:51 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
Snapshot ended with SnapshotResult [status=COMPLETED,
offset=PostgresOffsetContext
[sourceInfoSchema=Schema{io.debezium.connector.postgresql.Source:STRUCT},
sourceInfo=source_info[server='dbserver1'db='inventory', lsn=LSN{0/207F958},
txId=1013, timestamp=2021-10-04T18:19:51.707Z, snapshot=FALSE],
lastSnapshotRecord=true, lastCompletelyProcessedLsn=null, lastCommitLsn=null,
streamingStoppingLsn=null, transactionContext=TransactionContext
[currentTransactionId=null, perTableEventCount={}, totalEventCount=0],
incrementalSnapshotContext=IncrementalSnapshotContext [windowOpened=false,
chunkEndPosition=null, dataCollectionsToSnapshot=[], lastEventKeySent=null,
maximumKey=null]]]"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:51 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
Connected metrics set to 'true'"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:51 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Starting streaming'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:51 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
REPLICA IDENTITY for 'inventory.spatial_ref_sys' is 'DEFAULT'; UPDATE and
DELETE events will contain previous values only for PK columns"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:51 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
REPLICA IDENTITY for 'inventory.geom' is 'DEFAULT'; UPDATE and DELETE events
will contain previous values only for PK columns"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:51 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
REPLICA IDENTITY for 'inventory.products_on_hand' is 'FULL'; UPDATE AND DELETE
events will contain the previous values of all the columns"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:51 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
REPLICA IDENTITY for 'inventory.customers' is 'FULL'; UPDATE AND DELETE events
will contain the previous values of all the columns"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:51 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
REPLICA IDENTITY for 'inventory.orders' is 'FULL'; UPDATE AND DELETE events
will contain the previous values of all the columns"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:51 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
REPLICA IDENTITY for 'inventory.products' is 'FULL'; UPDATE AND DELETE events
will contain the previous values of all the columns"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:51 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
No incremental snapshot in progress, no action needed on start'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:51 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
Retrieved latest position from stored offset 'LSN{0/207F958}'"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:51 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
Looking for WAL restart position for last commit LSN 'null' and last change LSN
'LSN{0/207F958}'"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:51 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Obtained valid replication slot ReplicationSlot [active=false,
latestFlushedLsn=LSN{0/2039A78}, catalogXmin=597]'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:51 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Connection gracefully closed'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:51 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Requested thread factory for connector PostgresConnector, id = dbserver1 named
= keep-alive'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:51 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Creating thread debezium-postgresconnector-dbserver1-keep-alive'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:51 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
REPLICA IDENTITY for 'inventory.spatial_ref_sys' is 'DEFAULT'; UPDATE and
DELETE events will contain previous values only for PK columns"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:51 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
REPLICA IDENTITY for 'inventory.geom' is 'DEFAULT'; UPDATE and DELETE events
will contain previous values only for PK columns"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:51 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
REPLICA IDENTITY for 'inventory.products_on_hand' is 'FULL'; UPDATE AND DELETE
events will contain the previous values of all the columns"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:51 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
REPLICA IDENTITY for 'inventory.customers' is 'FULL'; UPDATE AND DELETE events
will contain the previous values of all the columns"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:51 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
REPLICA IDENTITY for 'inventory.orders' is 'FULL'; UPDATE AND DELETE events
will contain the previous values of all the columns"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:51 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
REPLICA IDENTITY for 'inventory.products' is 'FULL'; UPDATE AND DELETE events
will contain the previous values of all the columns"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:51 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Searching for WAL resume position'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:52 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Stopping down connector'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:52 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
WAL resume position 'null' discovered"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:52 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Connection gracefully closed'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:52 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Requested thread factory for connector PostgresConnector, id = dbserver1 named
= keep-alive'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:52 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Creating thread debezium-postgresconnector-dbserver1-keep-alive'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:52 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Processing messages'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:52 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Connection gracefully closed'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:52 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Finished streaming'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:52 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
Connected metrics set to 'false'"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:52 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Connection gracefully closed'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:52 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Connection gracefully closed'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:52 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Starting PostgresConnectorTask with configuration:'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:52 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
connector.class = io.debezium.connector.postgresql.PostgresConnector'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:52 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
database.dbname = inventory'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:52 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
database.user = debezium'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:52 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
database.hostname = localhost'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:52 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
database.password = ********'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:52 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
beam.parent.instance = 1457030910'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:52 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
database.server.name = dbserver1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:52 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
database.history =
org.apache.beam.io.debezium.KafkaSourceConsumerFn$DebeziumSDFDatabaseHistory'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:52 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
include.schema.changes = false'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:52 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
database.include.list = inventory'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:52 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
database.port = 36484'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:52 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
No previous offsets found'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:52 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
user 'debezium' connected to database 'inventory' on PostgreSQL 11.13 (Debian
11.13-1.pgdg90+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian
6.3.0-18+deb9u1) 6.3.0 20170516, 64-bit with roles:"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"\trole
'pg_read_all_settings' [superuser: false, replication: false, inherit: true,
create role: false, create db: false, can log in: false]"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"\trole
'pg_stat_scan_tables' [superuser: false, replication: false, inherit: true,
create role: false, create db: false, can log in: false]"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"\trole
'pg_write_server_files' [superuser: false, replication: false, inherit: true,
create role: false, create db: false, can log in: false]"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"\trole
'debezium' [superuser: true, replication: true, inherit: true, create role:
true, create db: true, can log in: true]"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"\trole
'pg_monitor' [superuser: false, replication: false, inherit: true, create role:
false, create db: false, can log in: false]"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"\trole
'pg_read_server_files' [superuser: false, replication: false, inherit: true,
create role: false, create db: false, can log in: false]"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"\trole
'pg_execute_server_program' [superuser: false, replication: false, inherit:
true, create role: false, create db: false, can log in: false]"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"\trole
'pg_read_all_stats' [superuser: false, replication: false, inherit: true,
create role: false, create db: false, can log in: false]"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"\trole
'pg_signal_backend' [superuser: false, replication: false, inherit: true,
create role: false, create db: false, can log in: false]"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:52 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Obtained valid replication slot ReplicationSlot [active=false,
latestFlushedLsn=LSN{0/2039A78}, catalogXmin=597]'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:52 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
No previous offset found'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:52 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Taking initial snapshot for new datasource'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:52 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Requested thread factory for connector PostgresConnector, id = dbserver1 named
= change-event-source-coordinator'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:52 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Creating thread
debezium-postgresconnector-dbserver1-change-event-source-coordinator'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:52 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Metrics registered'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:52 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Context created'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:52 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Taking initial snapshot for new datasource'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:52 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
According to the connector configuration data will be snapshotted'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:52 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Snapshot step 1 - Preparing'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:52 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Snapshot step 2 - Determining captured tables'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:52 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Snapshot step 3 - Locking captured tables []'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:52 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Snapshot step 4 - Determining snapshot offset'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:52 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Creating initial offset context'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:52 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
Read xlogStart at 'LSN{0/207F980}' from transaction '1014'"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:52 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
Read xlogStart at 'LSN{0/207F980}' from transaction '1014'"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:52 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Snapshot step 5 - Reading structure of captured tables'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:52 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Snapshot step 6 - Persisting schema history'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:52 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Snapshot step 7 - Snapshotting data'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:52 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Snapshotting contents of 0 tables while still in transaction'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:52 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Snapshot - Final stage'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:52 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
Snapshot ended with SnapshotResult [status=COMPLETED,
offset=PostgresOffsetContext
[sourceInfoSchema=Schema{io.debezium.connector.postgresql.Source:STRUCT},
sourceInfo=source_info[server='dbserver1'db='inventory', lsn=LSN{0/207F980},
txId=1014, timestamp=2021-10-04T18:19:52.419Z, snapshot=FALSE],
lastSnapshotRecord=true, lastCompletelyProcessedLsn=null, lastCommitLsn=null,
streamingStoppingLsn=null, transactionContext=TransactionContext
[currentTransactionId=null, perTableEventCount={}, totalEventCount=0],
incrementalSnapshotContext=IncrementalSnapshotContext [windowOpened=false,
chunkEndPosition=null, dataCollectionsToSnapshot=[], lastEventKeySent=null,
maximumKey=null]]]"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:52 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
Connected metrics set to 'true'"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:52 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Starting streaming'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:52 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
REPLICA IDENTITY for 'inventory.spatial_ref_sys' is 'DEFAULT'; UPDATE and
DELETE events will contain previous values only for PK columns"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:52 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
REPLICA IDENTITY for 'inventory.geom' is 'DEFAULT'; UPDATE and DELETE events
will contain previous values only for PK columns"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:52 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
REPLICA IDENTITY for 'inventory.products_on_hand' is 'FULL'; UPDATE AND DELETE
events will contain the previous values of all the columns"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:52 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
REPLICA IDENTITY for 'inventory.customers' is 'FULL'; UPDATE AND DELETE events
will contain the previous values of all the columns"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:52 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
REPLICA IDENTITY for 'inventory.orders' is 'FULL'; UPDATE AND DELETE events
will contain the previous values of all the columns"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:52 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
REPLICA IDENTITY for 'inventory.products' is 'FULL'; UPDATE AND DELETE events
will contain the previous values of all the columns"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:52 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
No incremental snapshot in progress, no action needed on start'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:52 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
Retrieved latest position from stored offset 'LSN{0/207F980}'"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:52 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
Looking for WAL restart position for last commit LSN 'null' and last change LSN
'LSN{0/207F980}'"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:52 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Obtained valid replication slot ReplicationSlot [active=false,
latestFlushedLsn=LSN{0/2039A78}, catalogXmin=597]'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:52 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Connection gracefully closed'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:52 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Requested thread factory for connector PostgresConnector, id = dbserver1 named
= keep-alive'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:52 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Creating thread debezium-postgresconnector-dbserver1-keep-alive'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:52 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
REPLICA IDENTITY for 'inventory.spatial_ref_sys' is 'DEFAULT'; UPDATE and
DELETE events will contain previous values only for PK columns"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:52 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
REPLICA IDENTITY for 'inventory.geom' is 'DEFAULT'; UPDATE and DELETE events
will contain previous values only for PK columns"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 04,
2021 6:19:52 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
