See
<https://ci-beam.apache.org/job/beam_PostCommit_Python36/4443/display/redirect?page=changes>
Changes:
[noreply] Merge pull request #15614 from [BEAM-12953] [Playground] Create
protobuf
[noreply] [BEAM-11831] Parially Revert "[BEAM-11805] Replace user-agent for
[kawaigin] [BEAM-10708] Enable submit beam_sql built jobs to Dataflow
------------------------------------------
[...truncated 27.36 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
Snapshot ended with SnapshotResult [status=COMPLETED,
offset=PostgresOffsetContext
[sourceInfoSchema=Schema{io.debezium.connector.postgresql.Source:STRUCT},
sourceInfo=source_info[server='dbserver1'db='inventory', lsn=LSN{0/2082930},
txId=1161, timestamp=2021-10-06T00:31:07.599Z, snapshot=FALSE],
lastSnapshotRecord=true, lastCompletelyProcessedLsn=null, lastCommitLsn=null,
streamingStoppingLsn=null, transactionContext=TransactionContext
[currentTransactionId=null, perTableEventCount={}, totalEventCount=0],
incrementalSnapshotContext=IncrementalSnapshotContext [windowOpened=false,
chunkEndPosition=null, dataCollectionsToSnapshot=[], lastEventKeySent=null,
maximumKey=null]]]"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:07 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
Connected metrics set to 'true'"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:07 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Starting streaming'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:07 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
REPLICA IDENTITY for 'inventory.spatial_ref_sys' is 'DEFAULT'; UPDATE and
DELETE events will contain previous values only for PK columns"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:07 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
REPLICA IDENTITY for 'inventory.geom' is 'DEFAULT'; UPDATE and DELETE events
will contain previous values only for PK columns"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:07 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
REPLICA IDENTITY for 'inventory.products_on_hand' is 'FULL'; UPDATE AND DELETE
events will contain the previous values of all the columns"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:07 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
REPLICA IDENTITY for 'inventory.customers' is 'FULL'; UPDATE AND DELETE events
will contain the previous values of all the columns"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:07 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
REPLICA IDENTITY for 'inventory.orders' is 'FULL'; UPDATE AND DELETE events
will contain the previous values of all the columns"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:07 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
REPLICA IDENTITY for 'inventory.products' is 'FULL'; UPDATE AND DELETE events
will contain the previous values of all the columns"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:07 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
No incremental snapshot in progress, no action needed on start'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:07 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
Retrieved latest position from stored offset 'LSN{0/2082930}'"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:07 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
Looking for WAL restart position for last commit LSN 'null' and last change LSN
'LSN{0/2082930}'"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:07 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Obtained valid replication slot ReplicationSlot [active=false,
latestFlushedLsn=LSN{0/2078C00}, catalogXmin=602]'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:07 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Connection gracefully closed'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:07 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Requested thread factory for connector PostgresConnector, id = dbserver1 named
= keep-alive'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:07 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Creating thread debezium-postgresconnector-dbserver1-keep-alive'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:07 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
REPLICA IDENTITY for 'inventory.spatial_ref_sys' is 'DEFAULT'; UPDATE and
DELETE events will contain previous values only for PK columns"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:07 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
REPLICA IDENTITY for 'inventory.geom' is 'DEFAULT'; UPDATE and DELETE events
will contain previous values only for PK columns"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:07 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
REPLICA IDENTITY for 'inventory.products_on_hand' is 'FULL'; UPDATE AND DELETE
events will contain the previous values of all the columns"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:07 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
REPLICA IDENTITY for 'inventory.customers' is 'FULL'; UPDATE AND DELETE events
will contain the previous values of all the columns"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:07 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
REPLICA IDENTITY for 'inventory.orders' is 'FULL'; UPDATE AND DELETE events
will contain the previous values of all the columns"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:07 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
REPLICA IDENTITY for 'inventory.products' is 'FULL'; UPDATE AND DELETE events
will contain the previous values of all the columns"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:07 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Searching for WAL resume position'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Stopping down connector'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
WAL resume position 'null' discovered"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Connection gracefully closed'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Requested thread factory for connector PostgresConnector, id = dbserver1 named
= keep-alive'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Creating thread debezium-postgresconnector-dbserver1-keep-alive'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Processing messages'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Connection gracefully closed'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Finished streaming'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
Connected metrics set to 'false'"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Connection gracefully closed'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Connection gracefully closed'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Starting PostgresConnectorTask with configuration:'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
connector.class = io.debezium.connector.postgresql.PostgresConnector'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
database.dbname = inventory'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
database.user = debezium'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
database.hostname = localhost'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
database.password = ********'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
beam.parent.instance = 1692693773'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
database.server.name = dbserver1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
database.history =
org.apache.beam.io.debezium.KafkaSourceConsumerFn$DebeziumSDFDatabaseHistory'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
include.schema.changes = false'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
database.include.list = inventory'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
database.port = 39262'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
No previous offsets found'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
user 'debezium' connected to database 'inventory' on PostgreSQL 11.13 (Debian
11.13-1.pgdg90+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian
6.3.0-18+deb9u1) 6.3.0 20170516, 64-bit with roles:"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"\trole
'pg_read_all_settings' [superuser: false, replication: false, inherit: true,
create role: false, create db: false, can log in: false]"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"\trole
'pg_stat_scan_tables' [superuser: false, replication: false, inherit: true,
create role: false, create db: false, can log in: false]"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"\trole
'pg_write_server_files' [superuser: false, replication: false, inherit: true,
create role: false, create db: false, can log in: false]"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"\trole
'debezium' [superuser: true, replication: true, inherit: true, create role:
true, create db: true, can log in: true]"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"\trole
'pg_monitor' [superuser: false, replication: false, inherit: true, create role:
false, create db: false, can log in: false]"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"\trole
'pg_read_server_files' [superuser: false, replication: false, inherit: true,
create role: false, create db: false, can log in: false]"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"\trole
'pg_execute_server_program' [superuser: false, replication: false, inherit:
true, create role: false, create db: false, can log in: false]"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"\trole
'pg_read_all_stats' [superuser: false, replication: false, inherit: true,
create role: false, create db: false, can log in: false]"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"\trole
'pg_signal_backend' [superuser: false, replication: false, inherit: true,
create role: false, create db: false, can log in: false]"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Obtained valid replication slot ReplicationSlot [active=false,
latestFlushedLsn=LSN{0/2078C00}, catalogXmin=602]'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
No previous offset found'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Taking initial snapshot for new datasource'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Requested thread factory for connector PostgresConnector, id = dbserver1 named
= change-event-source-coordinator'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Creating thread
debezium-postgresconnector-dbserver1-change-event-source-coordinator'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Metrics registered'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Context created'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Taking initial snapshot for new datasource'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
According to the connector configuration data will be snapshotted'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Snapshot step 1 - Preparing'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Snapshot step 2 - Determining captured tables'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Snapshot step 3 - Locking captured tables []'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Snapshot step 4 - Determining snapshot offset'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Creating initial offset context'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
Read xlogStart at 'LSN{0/2082958}' from transaction '1162'"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
Read xlogStart at 'LSN{0/2082958}' from transaction '1162'"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Snapshot step 5 - Reading structure of captured tables'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Snapshot step 6 - Persisting schema history'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Snapshot step 7 - Snapshotting data'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Snapshotting contents of 0 tables while still in transaction'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Snapshot - Final stage'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
Snapshot ended with SnapshotResult [status=COMPLETED,
offset=PostgresOffsetContext
[sourceInfoSchema=Schema{io.debezium.connector.postgresql.Source:STRUCT},
sourceInfo=source_info[server='dbserver1'db='inventory', lsn=LSN{0/2082958},
txId=1162, timestamp=2021-10-06T00:31:08.362Z, snapshot=FALSE],
lastSnapshotRecord=true, lastCompletelyProcessedLsn=null, lastCommitLsn=null,
streamingStoppingLsn=null, transactionContext=TransactionContext
[currentTransactionId=null, perTableEventCount={}, totalEventCount=0],
incrementalSnapshotContext=IncrementalSnapshotContext [windowOpened=false,
chunkEndPosition=null, dataCollectionsToSnapshot=[], lastEventKeySent=null,
maximumKey=null]]]"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
Connected metrics set to 'true'"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Starting streaming'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
REPLICA IDENTITY for 'inventory.spatial_ref_sys' is 'DEFAULT'; UPDATE and
DELETE events will contain previous values only for PK columns"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
REPLICA IDENTITY for 'inventory.geom' is 'DEFAULT'; UPDATE and DELETE events
will contain previous values only for PK columns"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
REPLICA IDENTITY for 'inventory.products_on_hand' is 'FULL'; UPDATE AND DELETE
events will contain the previous values of all the columns"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
REPLICA IDENTITY for 'inventory.customers' is 'FULL'; UPDATE AND DELETE events
will contain the previous values of all the columns"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
REPLICA IDENTITY for 'inventory.orders' is 'FULL'; UPDATE AND DELETE events
will contain the previous values of all the columns"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
REPLICA IDENTITY for 'inventory.products' is 'FULL'; UPDATE AND DELETE events
will contain the previous values of all the columns"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
No incremental snapshot in progress, no action needed on start'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
Retrieved latest position from stored offset 'LSN{0/2082958}'"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
Looking for WAL restart position for last commit LSN 'null' and last change LSN
'LSN{0/2082958}'"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Obtained valid replication slot ReplicationSlot [active=false,
latestFlushedLsn=LSN{0/2078C00}, catalogXmin=602]'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Connection gracefully closed'
> Task :sdks:python:test-suites:dataflow:py36:postCommitIT
[gw2] [32mPASSED[0m
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/io/gcp/bigquery_io_read_it_test.py::BigqueryIOReadIT::test_bigquery_read_1M_python
> Task :sdks:python:test-suites:portable:py36:postCommitPy36IT
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Requested thread factory for connector PostgresConnector, id = dbserver1 named
= keep-alive'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Creating thread debezium-postgresconnector-dbserver1-keep-alive'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
REPLICA IDENTITY for 'inventory.spatial_ref_sys' is 'DEFAULT'; UPDATE and
DELETE events will contain previous values only for PK columns"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
REPLICA IDENTITY for 'inventory.geom' is 'DEFAULT'; UPDATE and DELETE events
will contain previous values only for PK columns"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
REPLICA IDENTITY for 'inventory.products_on_hand' is 'FULL'; UPDATE AND DELETE
events will contain the previous values of all the columns"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
REPLICA IDENTITY for 'inventory.customers' is 'FULL'; UPDATE AND DELETE events
will contain the previous values of all the columns"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
REPLICA IDENTITY for 'inventory.orders' is 'FULL'; UPDATE AND DELETE events
will contain the previous values of all the columns"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
REPLICA IDENTITY for 'inventory.products' is 'FULL'; UPDATE AND DELETE events
will contain the previous values of all the columns"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Searching for WAL resume position'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Stopping down connector'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:09 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
WAL resume position 'null' discovered"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:09 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Connection gracefully closed'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:09 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Requested thread factory for connector PostgresConnector, id = dbserver1 named
= keep-alive'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:09 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Creating thread debezium-postgresconnector-dbserver1-keep-alive'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:09 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Processing messages'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:09 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Connection gracefully closed'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:09 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Finished streaming'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:09 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
Connected metrics set to 'false'"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:09 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Connection gracefully closed'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:09 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Connection gracefully closed'
> Task :sdks:python:test-suites:portable:py36:postCommitPy36IT
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Requested thread factory for connector PostgresConnector, id = dbserver1 named
= keep-alive'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Creating thread debezium-postgresconnector-dbserver1-keep-alive'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
REPLICA IDENTITY for 'inventory.spatial_ref_sys' is 'DEFAULT'; UPDATE and
DELETE events will contain previous values only for PK columns"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
REPLICA IDENTITY for 'inventory.geom' is 'DEFAULT'; UPDATE and DELETE events
will contain previous values only for PK columns"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
REPLICA IDENTITY for 'inventory.products_on_hand' is 'FULL'; UPDATE AND DELETE
events will contain the previous values of all the columns"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
REPLICA IDENTITY for 'inventory.customers' is 'FULL'; UPDATE AND DELETE events
will contain the previous values of all the columns"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
REPLICA IDENTITY for 'inventory.orders' is 'FULL'; UPDATE AND DELETE events
will contain the previous values of all the columns"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
REPLICA IDENTITY for 'inventory.products' is 'FULL'; UPDATE AND DELETE events
will contain the previous values of all the columns"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Searching for WAL resume position'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:08 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Stopping down connector'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:09 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b"INFO:
WAL resume position 'null' discovered"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:09 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Connection gracefully closed'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Oct 06,
2021 12:31:09 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Requested thread factory for connector PostgresConnector, id = dbserver1 named
= keep-alive'java.lang.OutOfMemoryError: GC overhead limit exceeded
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]