Hi, everyone
I have some really hard time trying to figure out why ack method is not
executed (sometimes) on the spout.
He is the topology that I'm investigating:
https://github.com/europeana/Europeana-Cloud/blob/feat/MET-2229_acks_for_other_topologies/service/dps/storm/topologies/xslt/src/main/java/eu/europeana/cloud/service/dps/storm/topologies/xslt/XSLTTopology.java
The problem is that ack method in not executed on spout and messages
fails after timeout (so the fail method is executed). The funny thing is
that when I remove last three bolts from the topology it works (ack
method is executed on the spout).
I would be very glad if You could help me.
Regards
Here are the logs from the execution where ack is not executed, message
times out and fail method is executed:
(there are also logs from the execution where ack is executed (below).
In this case last three bolts was remored from the topology)
////////////////////////////////////////
[Thread-27-spout-executor[5 5]] INFO
org.apache.kafka.common.utils.AppInfoParser - Kafka version : 0.10.1.0
[Thread-27-spout-executor[5 5]] INFO
org.apache.kafka.common.utils.AppInfoParser - Kafka commitId :
3402a74efb23d1d4
[Thread-27-spout-executor[5 5]] INFO
org.apache.storm.kafka.spout.KafkaSpout - Partitions revoked.
[consumer-group=xslt_topology,
consumer=org.apache.kafka.clients.consumer.KafkaConsumer@4ebc86f2,
topic-partitions=[]]
[Thread-27-spout-executor[5 5]] INFO
org.apache.storm.kafka.spout.KafkaSpout - Partitions reassignment.
[task-ID=5, consumer-group=xslt_topology,
consumer=org.apache.kafka.clients.consumer.KafkaConsumer@4ebc86f2,
topic-partitions=[xslt_topology_3-0, xslt_topology_1-3,
xslt_topology_1-0, xslt_topology_2-1, xslt_topology_3-2,
xslt_topology_2-0, xslt_topology_3-1, xslt_topology_1-2,
xslt_topology_2-3, xslt_topology_1-1, xslt_topology_2-2, xslt_topology_3-3]]
[Thread-27-spout-executor[5 5]] INFO
org.apache.kafka.clients.consumer.internals.AbstractCoordinator -
Discovered coordinator localhost:9092 (id: 2147483647 rack: null) for
group xslt_topology.
[Thread-27-spout-executor[5 5]] INFO
org.apache.storm.kafka.spout.KafkaSpout - Initialization complete
[Thread-27-spout-executor[5 5]] INFO
eu.europeana.cloud.service.dps.storm.utils.TaskStatusChecker - Checking
the task status for the task id from backend: 3724237530006437913
[Thread-27-spout-executor[5 5]] INFO
eu.europeana.cloud.service.dps.storm.spout.ECloudSpout - Emitting record
to the subsequent bolt: DpsRecord(taskId=3724237530006437913,
recordId=https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
metadataPrefix=null)
[Thread-27-spout-executor[5 5]] INFO org.apache.storm.daemon.task -
Emitting: spout default [3724237530006437913, ,
https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
null, {REVISION_PROVIDER=metis_test5, METIS_DATASET_LANGUAGE=sq,
REVISION_NAME=VALIDATION_EXTERNAL, METIS_DATASET_ID=109,
METIS_DATASET_COUNTRY=Albania,
OUTPUT_DATA_SETS=https://test.ecloud.psnc.pl/api//data-providers/metis_test5/data-sets/ce6740de-1455-49a1-a061-a6a7b4bf3090,
XSLT_URL=https://metis-core-rest-test.eanadev.org/datasets/xslt/5d2ecef6b764d018ee77c1d2,
METIS_DATASET_NAME=109_Testing_MET_2678,
NEW_REPRESENTATION_NAME=metadataRecord,
REPRESENTATION_NAME=metadataRecord,
REVISION_TIMESTAMP=2020-07-23T07:31:14.924Z,
PREVIOUS_TASK_ID=4105255046862291860, AUTHORIZATION_HEADER=Basic
bWV0aXNfdGVzdDoxUmtaQnVWZg==,
CLOUD_LOCAL_IDENTIFIER=https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
SCHEMA_NAME=null}, Revision [revisionNme=TRANSFORMATION,
revisionProvider=metis_test5, creationTimeStamp=Thu Jul 23 09:31:36 CEST
2020, acceptance=false, published=false, deleted=false], null, 0]
[Thread-27-spout-executor[5 5]] INFO org.apache.storm.daemon.executor -
TRANSFERING tuple [dest: 3 tuple: source: spout:5, stream: default, id:
{-7951049145241601219=7991394625790237527}, [3724237530006437913, ,
https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
null, {REVISION_PROVIDER=metis_test5, METIS_DATASET_LANGUAGE=sq,
REVISION_NAME=VALIDATION_EXTERNAL, METIS_DATASET_ID=109,
METIS_DATASET_COUNTRY=Albania,
OUTPUT_DATA_SETS=https://test.ecloud.psnc.pl/api//data-providers/metis_test5/data-sets/ce6740de-1455-49a1-a061-a6a7b4bf3090,
XSLT_URL=https://metis-core-rest-test.eanadev.org/datasets/xslt/5d2ecef6b764d018ee77c1d2,
METIS_DATASET_NAME=109_Testing_MET_2678,
NEW_REPRESENTATION_NAME=metadataRecord,
REPRESENTATION_NAME=metadataRecord,
REVISION_TIMESTAMP=2020-07-23T07:31:14.924Z,
PREVIOUS_TASK_ID=4105255046862291860, AUTHORIZATION_HEADER=Basic
bWV0aXNfdGVzdDoxUmtaQnVWZg==,
CLOUD_LOCAL_IDENTIFIER=https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
SCHEMA_NAME=null}, Revision [revisionNme=TRANSFORMATION,
revisionProvider=metis_test5, creationTimeStamp=Thu Jul 23 09:31:36 CEST
2020, acceptance=false, published=false, deleted=false], null, 0]]
[Thread-27-spout-executor[5 5]] INFO org.apache.storm.daemon.task -
Emitting: spout __ack_init [-7951049145241601219 7991394625790237527 5]
[Thread-27-spout-executor[5 5]] INFO org.apache.storm.daemon.executor -
TRANSFERING tuple [dest: 2 tuple: source: spout:5, stream: __ack_init,
id: {}, [-7951049145241601219 7991394625790237527 5]]
[Thread-19-retrieveFileBolt-executor[3 3]] INFO
org.apache.storm.daemon.executor - Processing received message FOR 3
TUPLE: source: spout:5, stream: default, id:
{-7951049145241601219=7991394625790237527}, [3724237530006437913, ,
https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
null, {REVISION_PROVIDER=metis_test5, METIS_DATASET_LANGUAGE=sq,
REVISION_NAME=VALIDATION_EXTERNAL, METIS_DATASET_ID=109,
METIS_DATASET_COUNTRY=Albania,
OUTPUT_DATA_SETS=https://test.ecloud.psnc.pl/api//data-providers/metis_test5/data-sets/ce6740de-1455-49a1-a061-a6a7b4bf3090,
XSLT_URL=https://metis-core-rest-test.eanadev.org/datasets/xslt/5d2ecef6b764d018ee77c1d2,
METIS_DATASET_NAME=109_Testing_MET_2678,
NEW_REPRESENTATION_NAME=metadataRecord,
REPRESENTATION_NAME=metadataRecord,
REVISION_TIMESTAMP=2020-07-23T07:31:14.924Z,
PREVIOUS_TASK_ID=4105255046862291860, AUTHORIZATION_HEADER=Basic
bWV0aXNfdGVzdDoxUmtaQnVWZg==,
CLOUD_LOCAL_IDENTIFIER=https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
SCHEMA_NAME=null}, Revision [revisionNme=TRANSFORMATION,
revisionProvider=metis_test5, creationTimeStamp=Thu Jul 23 09:31:36 CEST
2020, acceptance=false, published=false, deleted=false], null, 0]
[Thread-19-retrieveFileBolt-executor[3 3]] INFO
eu.europeana.cloud.service.dps.storm.io.ReadFileBolt - HERE THE LINK:
https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921
[Thread-17-__acker-executor[2 2]] INFO org.apache.storm.daemon.executor
- Processing received message FOR 2 TUPLE: source: spout:5, stream:
__ack_init, id: {}, [-7951049145241601219 7991394625790237527 5]
[Thread-17-__acker-executor[2 2]] INFO org.apache.storm.daemon.executor
- BOLT ack TASK: 2 TIME: -1 TUPLE: source: spout:5, stream: __ack_init,
id: {}, [-7951049145241601219 7991394625790237527 5]
[Thread-17-__acker-executor[2 2]] INFO org.apache.storm.daemon.executor
- Execute done TUPLE source: spout:5, stream: __ack_init, id: {},
[-7951049145241601219 7991394625790237527 5] TASK: 2 DELTA: -1
[Thread-19-retrieveFileBolt-executor[3 3]] INFO
org.apache.storm.daemon.task - Emitting: retrieveFileBolt default
[3724237530006437913, ,
https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
[B@186a8caa, {REVISION_PROVIDER=metis_test5, METIS_DATASET_LANGUAGE=sq,
REVISION_NAME=VALIDATION_EXTERNAL, METIS_DATASET_ID=109,
METIS_DATASET_COUNTRY=Albania,
OUTPUT_DATA_SETS=https://test.ecloud.psnc.pl/api//data-providers/metis_test5/data-sets/ce6740de-1455-49a1-a061-a6a7b4bf3090,
XSLT_URL=https://metis-core-rest-test.eanadev.org/datasets/xslt/5d2ecef6b764d018ee77c1d2,
METIS_DATASET_NAME=109_Testing_MET_2678,
NEW_REPRESENTATION_NAME=metadataRecord,
REPRESENTATION_NAME=metadataRecord,
REVISION_TIMESTAMP=2020-07-23T07:31:14.924Z,
PREVIOUS_TASK_ID=4105255046862291860, AUTHORIZATION_HEADER=Basic
bWV0aXNfdGVzdDoxUmtaQnVWZg==,
CLOUD_LOCAL_IDENTIFIER=https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
SCHEMA_NAME=null, FAZA=READ_FILE_BOLT}, Revision
[revisionNme=TRANSFORMATION, revisionProvider=metis_test5,
creationTimeStamp=Thu Jul 23 09:31:36 CEST 2020, acceptance=false,
published=false, deleted=false], null, 0]
[Thread-19-retrieveFileBolt-executor[3 3]] INFO
org.apache.storm.daemon.executor - TRANSFERING tuple [dest: 1 tuple:
source: retrieveFileBolt:3, stream: default, id:
{-7951049145241601219=8438657456468788612}, [3724237530006437913, ,
https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
[B@186a8caa, {REVISION_PROVIDER=metis_test5, METIS_DATASET_LANGUAGE=sq,
REVISION_NAME=VALIDATION_EXTERNAL, METIS_DATASET_ID=109,
METIS_DATASET_COUNTRY=Albania,
OUTPUT_DATA_SETS=https://test.ecloud.psnc.pl/api//data-providers/metis_test5/data-sets/ce6740de-1455-49a1-a061-a6a7b4bf3090,
XSLT_URL=https://metis-core-rest-test.eanadev.org/datasets/xslt/5d2ecef6b764d018ee77c1d2,
METIS_DATASET_NAME=109_Testing_MET_2678,
NEW_REPRESENTATION_NAME=metadataRecord,
REPRESENTATION_NAME=metadataRecord,
REVISION_TIMESTAMP=2020-07-23T07:31:14.924Z,
PREVIOUS_TASK_ID=4105255046862291860, AUTHORIZATION_HEADER=Basic
bWV0aXNfdGVzdDoxUmtaQnVWZg==,
CLOUD_LOCAL_IDENTIFIER=https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
SCHEMA_NAME=null, FAZA=READ_FILE_BOLT}, Revision
[revisionNme=TRANSFORMATION, revisionProvider=metis_test5,
creationTimeStamp=Thu Jul 23 09:31:36 CEST 2020, acceptance=false,
published=false, deleted=false], null, 0]]
[Thread-19-retrieveFileBolt-executor[3 3]] INFO
org.apache.storm.daemon.task - Emitting: retrieveFileBolt __ack_ack
[-7951049145241601219 2016206552040955603]
[Thread-19-retrieveFileBolt-executor[3 3]] INFO
org.apache.storm.daemon.executor - TRANSFERING tuple [dest: 2 tuple:
source: retrieveFileBolt:3, stream: __ack_ack, id: {},
[-7951049145241601219 2016206552040955603]]
[Thread-19-retrieveFileBolt-executor[3 3]] INFO
org.apache.storm.daemon.executor - BOLT ack TASK: 3 TIME: -1 TUPLE:
source: spout:5, stream: default, id:
{-7951049145241601219=7991394625790237527}, [3724237530006437913, ,
https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
null, {REVISION_PROVIDER=metis_test5, METIS_DATASET_LANGUAGE=sq,
REVISION_NAME=VALIDATION_EXTERNAL, METIS_DATASET_ID=109,
METIS_DATASET_COUNTRY=Albania,
OUTPUT_DATA_SETS=https://test.ecloud.psnc.pl/api//data-providers/metis_test5/data-sets/ce6740de-1455-49a1-a061-a6a7b4bf3090,
XSLT_URL=https://metis-core-rest-test.eanadev.org/datasets/xslt/5d2ecef6b764d018ee77c1d2,
METIS_DATASET_NAME=109_Testing_MET_2678,
NEW_REPRESENTATION_NAME=metadataRecord,
REPRESENTATION_NAME=metadataRecord,
REVISION_TIMESTAMP=2020-07-23T07:31:14.924Z,
PREVIOUS_TASK_ID=4105255046862291860, AUTHORIZATION_HEADER=Basic
bWV0aXNfdGVzdDoxUmtaQnVWZg==,
CLOUD_LOCAL_IDENTIFIER=https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
SCHEMA_NAME=null, FAZA=READ_FILE_BOLT}, Revision
[revisionNme=TRANSFORMATION, revisionProvider=metis_test5,
creationTimeStamp=Thu Jul 23 09:31:36 CEST 2020, acceptance=false,
published=false, deleted=false], null, 0]
[Thread-19-retrieveFileBolt-executor[3 3]] INFO
org.apache.storm.daemon.executor - Execute done TUPLE source: spout:5,
stream: default, id: {-7951049145241601219=7991394625790237527},
[3724237530006437913, ,
https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
null, {REVISION_PROVIDER=metis_test5, METIS_DATASET_LANGUAGE=sq,
REVISION_NAME=VALIDATION_EXTERNAL, METIS_DATASET_ID=109,
METIS_DATASET_COUNTRY=Albania,
OUTPUT_DATA_SETS=https://test.ecloud.psnc.pl/api//data-providers/metis_test5/data-sets/ce6740de-1455-49a1-a061-a6a7b4bf3090,
XSLT_URL=https://metis-core-rest-test.eanadev.org/datasets/xslt/5d2ecef6b764d018ee77c1d2,
METIS_DATASET_NAME=109_Testing_MET_2678,
NEW_REPRESENTATION_NAME=metadataRecord,
REPRESENTATION_NAME=metadataRecord,
REVISION_TIMESTAMP=2020-07-23T07:31:14.924Z,
PREVIOUS_TASK_ID=4105255046862291860, AUTHORIZATION_HEADER=Basic
bWV0aXNfdGVzdDoxUmtaQnVWZg==,
CLOUD_LOCAL_IDENTIFIER=https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
SCHEMA_NAME=null, FAZA=READ_FILE_BOLT}, Revision
[revisionNme=TRANSFORMATION, revisionProvider=metis_test5,
creationTimeStamp=Thu Jul 23 09:31:36 CEST 2020, acceptance=false,
published=false, deleted=false], null, 0] TASK: 3 DELTA: -1
[Thread-17-__acker-executor[2 2]] INFO org.apache.storm.daemon.executor
- Processing received message FOR 2 TUPLE: source: retrieveFileBolt:3,
stream: __ack_ack, id: {}, [-7951049145241601219 2016206552040955603]
[Thread-21-XSLT_BOLT-executor[1 1]] INFO
org.apache.storm.daemon.executor - Processing received message FOR 1
TUPLE: source: retrieveFileBolt:3, stream: default, id:
{-7951049145241601219=8438657456468788612}, [3724237530006437913, ,
https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
[B@186a8caa, {REVISION_PROVIDER=metis_test5, METIS_DATASET_LANGUAGE=sq,
REVISION_NAME=VALIDATION_EXTERNAL, METIS_DATASET_ID=109,
METIS_DATASET_COUNTRY=Albania,
OUTPUT_DATA_SETS=https://test.ecloud.psnc.pl/api//data-providers/metis_test5/data-sets/ce6740de-1455-49a1-a061-a6a7b4bf3090,
XSLT_URL=https://metis-core-rest-test.eanadev.org/datasets/xslt/5d2ecef6b764d018ee77c1d2,
METIS_DATASET_NAME=109_Testing_MET_2678,
NEW_REPRESENTATION_NAME=metadataRecord,
REPRESENTATION_NAME=metadataRecord,
REVISION_TIMESTAMP=2020-07-23T07:31:14.924Z,
PREVIOUS_TASK_ID=4105255046862291860, AUTHORIZATION_HEADER=Basic
bWV0aXNfdGVzdDoxUmtaQnVWZg==,
CLOUD_LOCAL_IDENTIFIER=https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
SCHEMA_NAME=null, FAZA=READ_FILE_BOLT}, Revision
[revisionNme=TRANSFORMATION, revisionProvider=metis_test5,
creationTimeStamp=Thu Jul 23 09:31:36 CEST 2020, acceptance=false,
published=false, deleted=false], null, 0]
[Thread-17-__acker-executor[2 2]] INFO org.apache.storm.daemon.executor
- BOLT ack TASK: 2 TIME: -1 TUPLE: source: retrieveFileBolt:3, stream:
__ack_ack, id: {}, [-7951049145241601219 2016206552040955603]
[Thread-21-XSLT_BOLT-executor[1 1]] INFO
eu.europeana.cloud.service.dps.storm.topologies.xslt.bolt.XsltBolt -
Processing file:
https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921
with xslt
schema:https://metis-core-rest-test.eanadev.org/datasets/xslt/5d2ecef6b764d018ee77c1d2
[Thread-17-__acker-executor[2 2]] INFO org.apache.storm.daemon.executor
- Execute done TUPLE source: retrieveFileBolt:3, stream: __ack_ack, id:
{}, [-7951049145241601219 2016206552040955603] TASK: 2 DELTA: -1
[Thread-21-XSLT_BOLT-executor[1 1]] INFO
eu.europeana.cloud.service.dps.storm.topologies.xslt.bolt.XsltBolt -
XsltBolt: transformation success for:
https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921
[Thread-21-XSLT_BOLT-executor[1 1]] INFO org.apache.storm.daemon.task -
Emitting: XSLT_BOLT default [3724237530006437913, ,
https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
[B@189d8052, {REVISION_PROVIDER=metis_test5,
REVISION_NAME=VALIDATION_EXTERNAL,
OUTPUT_DATA_SETS=https://test.ecloud.psnc.pl/api//data-providers/metis_test5/data-sets/ce6740de-1455-49a1-a061-a6a7b4bf3090,
NEW_REPRESENTATION_NAME=metadataRecord,
REPRESENTATION_NAME=metadataRecord,
REVISION_TIMESTAMP=2020-07-23T07:31:14.924Z,
PREVIOUS_TASK_ID=4105255046862291860, AUTHORIZATION_HEADER=Basic
bWV0aXNfdGVzdDoxUmtaQnVWZg==,
CLOUD_LOCAL_IDENTIFIER=https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
SCHEMA_NAME=null, FAZA=XSLT_BOLT,
CLOUD_ID=XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA,
REPRESENTATION_VERSION=767d0380-ccb6-11ea-b26c-fa163e8d4ae3}, Revision
[revisionNme=TRANSFORMATION, revisionProvider=metis_test5,
creationTimeStamp=Thu Jul 23 09:31:36 CEST 2020, acceptance=false,
published=false, deleted=false], null, 0]
[Thread-21-XSLT_BOLT-executor[1 1]] INFO
org.apache.storm.daemon.executor - TRANSFERING tuple [dest: 6 tuple:
source: XSLT_BOLT:1, stream: default, id:
{-7951049145241601219=-7378909843835479330}, [3724237530006437913, ,
https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
[B@189d8052, {REVISION_PROVIDER=metis_test5,
REVISION_NAME=VALIDATION_EXTERNAL,
OUTPUT_DATA_SETS=https://test.ecloud.psnc.pl/api//data-providers/metis_test5/data-sets/ce6740de-1455-49a1-a061-a6a7b4bf3090,
NEW_REPRESENTATION_NAME=metadataRecord,
REPRESENTATION_NAME=metadataRecord,
REVISION_TIMESTAMP=2020-07-23T07:31:14.924Z,
PREVIOUS_TASK_ID=4105255046862291860, AUTHORIZATION_HEADER=Basic
bWV0aXNfdGVzdDoxUmtaQnVWZg==,
CLOUD_LOCAL_IDENTIFIER=https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
SCHEMA_NAME=null, FAZA=XSLT_BOLT,
CLOUD_ID=XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA,
REPRESENTATION_VERSION=767d0380-ccb6-11ea-b26c-fa163e8d4ae3}, Revision
[revisionNme=TRANSFORMATION, revisionProvider=metis_test5,
creationTimeStamp=Thu Jul 23 09:31:36 CEST 2020, acceptance=false,
published=false, deleted=false], null, 0]]
[Thread-21-XSLT_BOLT-executor[1 1]] INFO org.apache.storm.daemon.task -
Emitting: XSLT_BOLT __ack_ack [-7951049145241601219 -1403721581375807654]
[Thread-21-XSLT_BOLT-executor[1 1]] INFO
org.apache.storm.daemon.executor - TRANSFERING tuple [dest: 2 tuple:
source: XSLT_BOLT:1, stream: __ack_ack, id: {}, [-7951049145241601219
-1403721581375807654]]
[Thread-21-XSLT_BOLT-executor[1 1]] INFO
org.apache.storm.daemon.executor - BOLT ack TASK: 1 TIME: -1 TUPLE:
source: retrieveFileBolt:3, stream: default, id:
{-7951049145241601219=8438657456468788612}, [3724237530006437913, ,
https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
[B@186a8caa, {REVISION_PROVIDER=metis_test5,
REVISION_NAME=VALIDATION_EXTERNAL,
OUTPUT_DATA_SETS=https://test.ecloud.psnc.pl/api//data-providers/metis_test5/data-sets/ce6740de-1455-49a1-a061-a6a7b4bf3090,
NEW_REPRESENTATION_NAME=metadataRecord,
REPRESENTATION_NAME=metadataRecord,
REVISION_TIMESTAMP=2020-07-23T07:31:14.924Z,
PREVIOUS_TASK_ID=4105255046862291860, AUTHORIZATION_HEADER=Basic
bWV0aXNfdGVzdDoxUmtaQnVWZg==,
CLOUD_LOCAL_IDENTIFIER=https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
SCHEMA_NAME=null, FAZA=XSLT_BOLT,
CLOUD_ID=XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA,
REPRESENTATION_VERSION=767d0380-ccb6-11ea-b26c-fa163e8d4ae3}, Revision
[revisionNme=TRANSFORMATION, revisionProvider=metis_test5,
creationTimeStamp=Thu Jul 23 09:31:36 CEST 2020, acceptance=false,
published=false, deleted=false], null, 0]
[Thread-21-XSLT_BOLT-executor[1 1]] INFO
org.apache.storm.daemon.executor - Execute done TUPLE source:
retrieveFileBolt:3, stream: default, id:
{-7951049145241601219=8438657456468788612}, [3724237530006437913, ,
https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
[B@186a8caa, {REVISION_PROVIDER=metis_test5,
REVISION_NAME=VALIDATION_EXTERNAL,
OUTPUT_DATA_SETS=https://test.ecloud.psnc.pl/api//data-providers/metis_test5/data-sets/ce6740de-1455-49a1-a061-a6a7b4bf3090,
NEW_REPRESENTATION_NAME=metadataRecord,
REPRESENTATION_NAME=metadataRecord,
REVISION_TIMESTAMP=2020-07-23T07:31:14.924Z,
PREVIOUS_TASK_ID=4105255046862291860, AUTHORIZATION_HEADER=Basic
bWV0aXNfdGVzdDoxUmtaQnVWZg==,
CLOUD_LOCAL_IDENTIFIER=https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
SCHEMA_NAME=null, FAZA=XSLT_BOLT,
CLOUD_ID=XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA,
REPRESENTATION_VERSION=767d0380-ccb6-11ea-b26c-fa163e8d4ae3}, Revision
[revisionNme=TRANSFORMATION, revisionProvider=metis_test5,
creationTimeStamp=Thu Jul 23 09:31:36 CEST 2020, acceptance=false,
published=false, deleted=false], null, 0] TASK: 1 DELTA: -1
[Thread-17-__acker-executor[2 2]] INFO org.apache.storm.daemon.executor
- Processing received message FOR 2 TUPLE: source: XSLT_BOLT:1, stream:
__ack_ack, id: {}, [-7951049145241601219 -1403721581375807654]
[Thread-17-__acker-executor[2 2]] INFO org.apache.storm.daemon.executor
- BOLT ack TASK: 2 TIME: -1 TUPLE: source: XSLT_BOLT:1, stream:
__ack_ack, id: {}, [-7951049145241601219 -1403721581375807654]
[Thread-23-writeRecordBolt-executor[6 6]] INFO
org.apache.storm.daemon.executor - Processing received message FOR 6
TUPLE: source: XSLT_BOLT:1, stream: default, id:
{-7951049145241601219=-7378909843835479330}, [3724237530006437913, ,
https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
[B@189d8052, {REVISION_PROVIDER=metis_test5,
REVISION_NAME=VALIDATION_EXTERNAL,
OUTPUT_DATA_SETS=https://test.ecloud.psnc.pl/api//data-providers/metis_test5/data-sets/ce6740de-1455-49a1-a061-a6a7b4bf3090,
NEW_REPRESENTATION_NAME=metadataRecord,
REPRESENTATION_NAME=metadataRecord,
REVISION_TIMESTAMP=2020-07-23T07:31:14.924Z,
PREVIOUS_TASK_ID=4105255046862291860, AUTHORIZATION_HEADER=Basic
bWV0aXNfdGVzdDoxUmtaQnVWZg==,
CLOUD_LOCAL_IDENTIFIER=https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
SCHEMA_NAME=null, FAZA=XSLT_BOLT,
CLOUD_ID=XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA,
REPRESENTATION_VERSION=767d0380-ccb6-11ea-b26c-fa163e8d4ae3}, Revision
[revisionNme=TRANSFORMATION, revisionProvider=metis_test5,
creationTimeStamp=Thu Jul 23 09:31:36 CEST 2020, acceptance=false,
published=false, deleted=false], null, 0]
[Thread-17-__acker-executor[2 2]] INFO org.apache.storm.daemon.executor
- Execute done TUPLE source: XSLT_BOLT:1, stream: __ack_ack, id: {},
[-7951049145241601219 -1403721581375807654] TASK: 2 DELTA: -1
[Thread-23-writeRecordBolt-executor[6 6]] INFO
eu.europeana.cloud.service.dps.storm.io.WriteRecordBolt -
WriteRecordBolt: persisting...
[Thread-23-writeRecordBolt-executor[6 6]] INFO
eu.europeana.cloud.service.dps.storm.io.WriteRecordBolt -
WriteRecordBolt: file modified, new URI:
http://test.ecloud.psnc.pl:80/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/0e21c140-cdfb-11ea-a351-fa163e1e1541/files/1d507d6f-81dc-4777-a79f-c35d02cab620
[Thread-23-writeRecordBolt-executor[6 6]] INFO
org.apache.storm.daemon.task - Emitting: writeRecordBolt default
[3724237530006437913, ,
https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
null, {REVISION_PROVIDER=metis_test5, REVISION_NAME=VALIDATION_EXTERNAL,
OUTPUT_DATA_SETS=https://test.ecloud.psnc.pl/api//data-providers/metis_test5/data-sets/ce6740de-1455-49a1-a061-a6a7b4bf3090,
NEW_REPRESENTATION_NAME=metadataRecord,
REVISION_TIMESTAMP=2020-07-23T07:31:14.924Z,
PREVIOUS_TASK_ID=4105255046862291860, AUTHORIZATION_HEADER=Basic
bWV0aXNfdGVzdDoxUmtaQnVWZg==,
CLOUD_LOCAL_IDENTIFIER=https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
SCHEMA_NAME=null, FAZA=WRITE_RECORD_BOLT,
OUTPUT_URL=http://test.ecloud.psnc.pl:80/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/0e21c140-cdfb-11ea-a351-fa163e1e1541/files/1d507d6f-81dc-4777-a79f-c35d02cab620},
Revision [revisionNme=TRANSFORMATION, revisionProvider=metis_test5,
creationTimeStamp=Thu Jul 23 09:31:36 CEST 2020, acceptance=false,
published=false, deleted=false], null, 0]
[Thread-23-writeRecordBolt-executor[6 6]] INFO
org.apache.storm.daemon.executor - TRANSFERING tuple [dest: 4 tuple:
source: writeRecordBolt:6, stream: default, id:
{-7951049145241601219=-8869993711063170689}, [3724237530006437913, ,
https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
null, {REVISION_PROVIDER=metis_test5, REVISION_NAME=VALIDATION_EXTERNAL,
OUTPUT_DATA_SETS=https://test.ecloud.psnc.pl/api//data-providers/metis_test5/data-sets/ce6740de-1455-49a1-a061-a6a7b4bf3090,
NEW_REPRESENTATION_NAME=metadataRecord,
REVISION_TIMESTAMP=2020-07-23T07:31:14.924Z,
PREVIOUS_TASK_ID=4105255046862291860, AUTHORIZATION_HEADER=Basic
bWV0aXNfdGVzdDoxUmtaQnVWZg==,
CLOUD_LOCAL_IDENTIFIER=https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
SCHEMA_NAME=null, FAZA=WRITE_RECORD_BOLT,
OUTPUT_URL=http://test.ecloud.psnc.pl:80/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/0e21c140-cdfb-11ea-a351-fa163e1e1541/files/1d507d6f-81dc-4777-a79f-c35d02cab620},
Revision [revisionNme=TRANSFORMATION, revisionProvider=metis_test5,
creationTimeStamp=Thu Jul 23 09:31:36 CEST 2020, acceptance=false,
published=false, deleted=false], null, 0]]
[Thread-23-writeRecordBolt-executor[6 6]] INFO
org.apache.storm.daemon.task - Emitting: writeRecordBolt __ack_ack
[-7951049145241601219 2125605705563773857]
[Thread-23-writeRecordBolt-executor[6 6]] INFO
org.apache.storm.daemon.executor - TRANSFERING tuple [dest: 2 tuple:
source: writeRecordBolt:6, stream: __ack_ack, id: {},
[-7951049145241601219 2125605705563773857]]
[Thread-23-writeRecordBolt-executor[6 6]] INFO
org.apache.storm.daemon.executor - BOLT ack TASK: 6 TIME: -1 TUPLE:
source: XSLT_BOLT:1, stream: default, id:
{-7951049145241601219=-7378909843835479330}, [3724237530006437913, ,
https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
[B@189d8052, {REVISION_PROVIDER=metis_test5,
REVISION_NAME=VALIDATION_EXTERNAL,
OUTPUT_DATA_SETS=https://test.ecloud.psnc.pl/api//data-providers/metis_test5/data-sets/ce6740de-1455-49a1-a061-a6a7b4bf3090,
NEW_REPRESENTATION_NAME=metadataRecord,
REVISION_TIMESTAMP=2020-07-23T07:31:14.924Z,
PREVIOUS_TASK_ID=4105255046862291860, AUTHORIZATION_HEADER=Basic
bWV0aXNfdGVzdDoxUmtaQnVWZg==,
CLOUD_LOCAL_IDENTIFIER=https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
SCHEMA_NAME=null, FAZA=WRITE_RECORD_BOLT,
OUTPUT_URL=http://test.ecloud.psnc.pl:80/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/0e21c140-cdfb-11ea-a351-fa163e1e1541/files/1d507d6f-81dc-4777-a79f-c35d02cab620},
Revision [revisionNme=TRANSFORMATION, revisionProvider=metis_test5,
creationTimeStamp=Thu Jul 23 09:31:36 CEST 2020, acceptance=false,
published=false, deleted=false], null, 0]
[Thread-23-writeRecordBolt-executor[6 6]] INFO
org.apache.storm.daemon.task - Emitting: writeRecordBolt __ack_ack
[-7951049145241601219 2125605705563773857]
[Thread-23-writeRecordBolt-executor[6 6]] INFO
org.apache.storm.daemon.executor - TRANSFERING tuple [dest: 2 tuple:
source: writeRecordBolt:6, stream: __ack_ack, id: {},
[-7951049145241601219 2125605705563773857]]
[Thread-23-writeRecordBolt-executor[6 6]] INFO
org.apache.storm.daemon.executor - BOLT ack TASK: 6 TIME: -1 TUPLE:
source: XSLT_BOLT:1, stream: default, id:
{-7951049145241601219=-7378909843835479330}, [3724237530006437913, ,
https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
[B@189d8052, {REVISION_PROVIDER=metis_test5,
REVISION_NAME=VALIDATION_EXTERNAL,
OUTPUT_DATA_SETS=https://test.ecloud.psnc.pl/api//data-providers/metis_test5/data-sets/ce6740de-1455-49a1-a061-a6a7b4bf3090,
NEW_REPRESENTATION_NAME=metadataRecord,
REVISION_TIMESTAMP=2020-07-23T07:31:14.924Z,
PREVIOUS_TASK_ID=4105255046862291860, AUTHORIZATION_HEADER=Basic
bWV0aXNfdGVzdDoxUmtaQnVWZg==,
CLOUD_LOCAL_IDENTIFIER=https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
SCHEMA_NAME=null, FAZA=WRITE_RECORD_BOLT,
OUTPUT_URL=http://test.ecloud.psnc.pl:80/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/0e21c140-cdfb-11ea-a351-fa163e1e1541/files/1d507d6f-81dc-4777-a79f-c35d02cab620},
Revision [revisionNme=TRANSFORMATION, revisionProvider=metis_test5,
creationTimeStamp=Thu Jul 23 09:31:36 CEST 2020, acceptance=false,
published=false, deleted=false], null, 0]
[Thread-23-writeRecordBolt-executor[6 6]] INFO
org.apache.storm.daemon.executor - Execute done TUPLE source:
XSLT_BOLT:1, stream: default, id:
{-7951049145241601219=-7378909843835479330}, [3724237530006437913, ,
https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
[B@189d8052, {REVISION_PROVIDER=metis_test5,
REVISION_NAME=VALIDATION_EXTERNAL,
OUTPUT_DATA_SETS=https://test.ecloud.psnc.pl/api//data-providers/metis_test5/data-sets/ce6740de-1455-49a1-a061-a6a7b4bf3090,
NEW_REPRESENTATION_NAME=metadataRecord,
REVISION_TIMESTAMP=2020-07-23T07:31:14.924Z,
PREVIOUS_TASK_ID=4105255046862291860, AUTHORIZATION_HEADER=Basic
bWV0aXNfdGVzdDoxUmtaQnVWZg==,
CLOUD_LOCAL_IDENTIFIER=https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
SCHEMA_NAME=null, FAZA=WRITE_RECORD_BOLT,
OUTPUT_URL=http://test.ecloud.psnc.pl:80/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/0e21c140-cdfb-11ea-a351-fa163e1e1541/files/1d507d6f-81dc-4777-a79f-c35d02cab620},
Revision [revisionNme=TRANSFORMATION, revisionProvider=metis_test5,
creationTimeStamp=Thu Jul 23 09:31:36 CEST 2020, acceptance=false,
published=false, deleted=false], null, 0] TASK: 6 DELTA: -1
[Thread-17-__acker-executor[2 2]] INFO org.apache.storm.daemon.executor
- Processing received message FOR 2 TUPLE: source: writeRecordBolt:6,
stream: __ack_ack, id: {}, [-7951049145241601219 2125605705563773857]
[Thread-29-revisionWriterBolt-executor[4 4]] INFO
org.apache.storm.daemon.executor - Processing received message FOR 4
TUPLE: source: writeRecordBolt:6, stream: default, id:
{-7951049145241601219=-8869993711063170689}, [3724237530006437913, ,
https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
null, {REVISION_PROVIDER=metis_test5, REVISION_NAME=VALIDATION_EXTERNAL,
OUTPUT_DATA_SETS=https://test.ecloud.psnc.pl/api//data-providers/metis_test5/data-sets/ce6740de-1455-49a1-a061-a6a7b4bf3090,
NEW_REPRESENTATION_NAME=metadataRecord,
REVISION_TIMESTAMP=2020-07-23T07:31:14.924Z,
PREVIOUS_TASK_ID=4105255046862291860, AUTHORIZATION_HEADER=Basic
bWV0aXNfdGVzdDoxUmtaQnVWZg==,
CLOUD_LOCAL_IDENTIFIER=https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
SCHEMA_NAME=null, FAZA=WRITE_RECORD_BOLT,
OUTPUT_URL=http://test.ecloud.psnc.pl:80/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/0e21c140-cdfb-11ea-a351-fa163e1e1541/files/1d507d6f-81dc-4777-a79f-c35d02cab620},
Revision [revisionNme=TRANSFORMATION, revisionProvider=metis_test5,
creationTimeStamp=Thu Jul 23 09:31:36 CEST 2020, acceptance=false,
published=false, deleted=false], null, 0]
[Thread-17-__acker-executor[2 2]] INFO org.apache.storm.daemon.executor
- BOLT ack TASK: 2 TIME: 0 TUPLE: source: writeRecordBolt:6, stream:
__ack_ack, id: {}, [-7951049145241601219 2125605705563773857]
[Thread-29-revisionWriterBolt-executor[4 4]] INFO
eu.europeana.cloud.service.dps.storm.io.RevisionWriterBolt -
RevisionWriterBolt executed
[Thread-29-revisionWriterBolt-executor[4 4]] INFO
eu.europeana.cloud.service.dps.storm.io.RevisionWriterBolt - Adding
revisions to representation version:
https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921
[Thread-17-__acker-executor[2 2]] INFO org.apache.storm.daemon.executor
- Execute done TUPLE source: writeRecordBolt:6, stream: __ack_ack, id:
{}, [-7951049145241601219 2125605705563773857] TASK: 2 DELTA: -1
[Thread-17-__acker-executor[2 2]] INFO org.apache.storm.daemon.executor
- Processing received message FOR 2 TUPLE: source: writeRecordBolt:6,
stream: __ack_ack, id: {}, [-7951049145241601219 2125605705563773857]
[Thread-17-__acker-executor[2 2]] INFO org.apache.storm.daemon.executor
- BOLT ack TASK: 2 TIME: -1 TUPLE: source: writeRecordBolt:6, stream:
__ack_ack, id: {}, [-7951049145241601219 2125605705563773857]
[Thread-17-__acker-executor[2 2]] INFO org.apache.storm.daemon.executor
- Execute done TUPLE source: writeRecordBolt:6, stream: __ack_ack, id:
{}, [-7951049145241601219 2125605705563773857] TASK: 2 DELTA: -1
[Thread-29-revisionWriterBolt-executor[4 4]] INFO
org.apache.storm.daemon.task - Emitting: revisionWriterBolt __ack_ack
[-7951049145241601219 -8869993711063170689]
[Thread-29-revisionWriterBolt-executor[4 4]] INFO
org.apache.storm.daemon.executor - TRANSFERING tuple [dest: 2 tuple:
source: revisionWriterBolt:4, stream: __ack_ack, id: {},
[-7951049145241601219 -8869993711063170689]]
[Thread-29-revisionWriterBolt-executor[4 4]] INFO
org.apache.storm.daemon.executor - BOLT ack TASK: 4 TIME: -1 TUPLE:
source: writeRecordBolt:6, stream: default, id:
{-7951049145241601219=-8869993711063170689}, [3724237530006437913, ,
https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
null, {REVISION_PROVIDER=metis_test5, REVISION_NAME=VALIDATION_EXTERNAL,
OUTPUT_DATA_SETS=https://test.ecloud.psnc.pl/api//data-providers/metis_test5/data-sets/ce6740de-1455-49a1-a061-a6a7b4bf3090,
NEW_REPRESENTATION_NAME=metadataRecord,
REVISION_TIMESTAMP=2020-07-23T07:31:14.924Z,
PREVIOUS_TASK_ID=4105255046862291860, AUTHORIZATION_HEADER=Basic
bWV0aXNfdGVzdDoxUmtaQnVWZg==,
CLOUD_LOCAL_IDENTIFIER=https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
SCHEMA_NAME=null, FAZA=WRITE_RECORD_BOLT,
OUTPUT_URL=http://test.ecloud.psnc.pl:80/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/0e21c140-cdfb-11ea-a351-fa163e1e1541/files/1d507d6f-81dc-4777-a79f-c35d02cab620},
Revision [revisionNme=TRANSFORMATION, revisionProvider=metis_test5,
creationTimeStamp=Thu Jul 23 09:31:36 CEST 2020, acceptance=false,
published=false, deleted=false], null, 0]
[Thread-29-revisionWriterBolt-executor[4 4]] INFO
org.apache.storm.daemon.task - Emitting: revisionWriterBolt __ack_ack
[-7951049145241601219 -8869993711063170689]
[Thread-29-revisionWriterBolt-executor[4 4]] INFO
org.apache.storm.daemon.executor - TRANSFERING tuple [dest: 2 tuple:
source: revisionWriterBolt:4, stream: __ack_ack, id: {},
[-7951049145241601219 -8869993711063170689]]
[Thread-29-revisionWriterBolt-executor[4 4]] INFO
org.apache.storm.daemon.executor - BOLT ack TASK: 4 TIME: -1 TUPLE:
source: writeRecordBolt:6, stream: default, id:
{-7951049145241601219=-8869993711063170689}, [3724237530006437913, ,
https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
null, {REVISION_PROVIDER=metis_test5, REVISION_NAME=VALIDATION_EXTERNAL,
OUTPUT_DATA_SETS=https://test.ecloud.psnc.pl/api//data-providers/metis_test5/data-sets/ce6740de-1455-49a1-a061-a6a7b4bf3090,
NEW_REPRESENTATION_NAME=metadataRecord,
REVISION_TIMESTAMP=2020-07-23T07:31:14.924Z,
PREVIOUS_TASK_ID=4105255046862291860, AUTHORIZATION_HEADER=Basic
bWV0aXNfdGVzdDoxUmtaQnVWZg==,
CLOUD_LOCAL_IDENTIFIER=https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
SCHEMA_NAME=null, FAZA=REWISION_WRITER_BOLT,
OUTPUT_URL=http://test.ecloud.psnc.pl:80/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/0e21c140-cdfb-11ea-a351-fa163e1e1541/files/1d507d6f-81dc-4777-a79f-c35d02cab620},
Revision [revisionNme=TRANSFORMATION, revisionProvider=metis_test5,
creationTimeStamp=Thu Jul 23 09:31:36 CEST 2020, acceptance=false,
published=false, deleted=false], null, 0]
[Thread-29-revisionWriterBolt-executor[4 4]] INFO
org.apache.storm.daemon.executor - Execute done TUPLE source:
writeRecordBolt:6, stream: default, id:
{-7951049145241601219=-8869993711063170689}, [3724237530006437913, ,
https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
null, {REVISION_PROVIDER=metis_test5, REVISION_NAME=VALIDATION_EXTERNAL,
OUTPUT_DATA_SETS=https://test.ecloud.psnc.pl/api//data-providers/metis_test5/data-sets/ce6740de-1455-49a1-a061-a6a7b4bf3090,
NEW_REPRESENTATION_NAME=metadataRecord,
REVISION_TIMESTAMP=2020-07-23T07:31:14.924Z,
PREVIOUS_TASK_ID=4105255046862291860, AUTHORIZATION_HEADER=Basic
bWV0aXNfdGVzdDoxUmtaQnVWZg==,
CLOUD_LOCAL_IDENTIFIER=https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
SCHEMA_NAME=null, FAZA=REWISION_WRITER_BOLT,
OUTPUT_URL=http://test.ecloud.psnc.pl:80/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/0e21c140-cdfb-11ea-a351-fa163e1e1541/files/1d507d6f-81dc-4777-a79f-c35d02cab620},
Revision [revisionNme=TRANSFORMATION, revisionProvider=metis_test5,
creationTimeStamp=Thu Jul 23 09:31:36 CEST 2020, acceptance=false,
published=false, deleted=false], null, 0] TASK: 4 DELTA: 84
[Thread-17-__acker-executor[2 2]] INFO org.apache.storm.daemon.executor
- Processing received message FOR 2 TUPLE: source: revisionWriterBolt:4,
stream: __ack_ack, id: {}, [-7951049145241601219 -8869993711063170689]
[Thread-17-__acker-executor[2 2]] INFO org.apache.storm.daemon.executor
- BOLT ack TASK: 2 TIME: -1 TUPLE: source: revisionWriterBolt:4, stream:
__ack_ack, id: {}, [-7951049145241601219 -8869993711063170689]
[Thread-17-__acker-executor[2 2]] INFO org.apache.storm.daemon.executor
- Execute done TUPLE source: revisionWriterBolt:4, stream: __ack_ack,
id: {}, [-7951049145241601219 -8869993711063170689] TASK: 2 DELTA: -1
[Thread-17-__acker-executor[2 2]] INFO org.apache.storm.daemon.executor
- Processing received message FOR 2 TUPLE: source: revisionWriterBolt:4,
stream: __ack_ack, id: {}, [-7951049145241601219 -8869993711063170689]
[Thread-17-__acker-executor[2 2]] INFO org.apache.storm.daemon.executor
- BOLT ack TASK: 2 TIME: -1 TUPLE: source: revisionWriterBolt:4, stream:
__ack_ack, id: {}, [-7951049145241601219 -8869993711063170689]
[Thread-17-__acker-executor[2 2]] INFO org.apache.storm.daemon.executor
- Execute done TUPLE source: revisionWriterBolt:4, stream: __ack_ack,
id: {}, [-7951049145241601219 -8869993711063170689] TASK: 2 DELTA: -1
//////////////////////////////////////////
Logs where ack was executed. Last three bolts removed from topology:
//////////////////////////////////////////////
[Thread-27-spout-executor[4 4]] INFO
org.apache.kafka.common.utils.AppInfoParser - Kafka version : 0.10.1.0
[Thread-27-spout-executor[4 4]] INFO
org.apache.kafka.common.utils.AppInfoParser - Kafka commitId :
3402a74efb23d1d4
[Thread-27-spout-executor[4 4]] INFO
org.apache.storm.kafka.spout.KafkaSpout - Partitions revoked.
[consumer-group=xslt_topology,
consumer=org.apache.kafka.clients.consumer.KafkaConsumer@63ca0eb0,
topic-partitions=[]]
[Thread-27-spout-executor[4 4]] INFO
org.apache.storm.kafka.spout.KafkaSpout - Partitions reassignment.
[task-ID=4, consumer-group=xslt_topology,
consumer=org.apache.kafka.clients.consumer.KafkaConsumer@63ca0eb0,
topic-partitions=[xslt_topology_3-0, xslt_topology_1-3,
xslt_topology_1-0, xslt_topology_2-1, xslt_topology_3-2,
xslt_topology_2-0, xslt_topology_3-1, xslt_topology_1-2,
xslt_topology_2-3, xslt_topology_1-1, xslt_topology_2-2, xslt_topology_3-3]]
[Thread-27-spout-executor[4 4]] INFO
org.apache.kafka.clients.consumer.internals.AbstractCoordinator -
Discovered coordinator localhost:9092 (id: 2147483647 rack: null) for
group xslt_topology.
[Thread-27-spout-executor[4 4]] INFO
org.apache.storm.kafka.spout.KafkaSpout - Initialization complete
[Thread-27-spout-executor[4 4]] INFO
eu.europeana.cloud.service.dps.storm.utils.TaskStatusChecker - Checking
the task status for the task id from backend: 3724237530006437913
[Thread-27-spout-executor[4 4]] INFO
eu.europeana.cloud.service.dps.storm.spout.ECloudSpout - Emitting record
to the subsequent bolt: DpsRecord(taskId=3724237530006437913,
recordId=https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
metadataPrefix=null)
[Thread-27-spout-executor[4 4]] INFO org.apache.storm.daemon.task -
Emitting: spout default [3724237530006437913, ,
https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
null, {REVISION_PROVIDER=metis_test5, METIS_DATASET_LANGUAGE=sq,
REVISION_NAME=VALIDATION_EXTERNAL, METIS_DATASET_ID=109,
METIS_DATASET_COUNTRY=Albania,
OUTPUT_DATA_SETS=https://test.ecloud.psnc.pl/api//data-providers/metis_test5/data-sets/ce6740de-1455-49a1-a061-a6a7b4bf3090,
XSLT_URL=https://metis-core-rest-test.eanadev.org/datasets/xslt/5d2ecef6b764d018ee77c1d2,
METIS_DATASET_NAME=109_Testing_MET_2678,
NEW_REPRESENTATION_NAME=metadataRecord,
REPRESENTATION_NAME=metadataRecord,
REVISION_TIMESTAMP=2020-07-23T07:31:14.924Z,
PREVIOUS_TASK_ID=4105255046862291860, AUTHORIZATION_HEADER=Basic
bWV0aXNfdGVzdDoxUmtaQnVWZg==,
CLOUD_LOCAL_IDENTIFIER=https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
SCHEMA_NAME=null}, Revision [revisionNme=TRANSFORMATION,
revisionProvider=metis_test5, creationTimeStamp=Thu Jul 23 09:31:36 CEST
2020, acceptance=false, published=false, deleted=false], null, 0]
[Thread-27-spout-executor[4 4]] INFO org.apache.storm.daemon.executor -
TRANSFERING tuple [dest: 3 tuple: source: spout:4, stream: default, id:
{-4856356957915961623=4922195490007624215}, [3724237530006437913, ,
https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
null, {REVISION_PROVIDER=metis_test5, METIS_DATASET_LANGUAGE=sq,
REVISION_NAME=VALIDATION_EXTERNAL, METIS_DATASET_ID=109,
METIS_DATASET_COUNTRY=Albania,
OUTPUT_DATA_SETS=https://test.ecloud.psnc.pl/api//data-providers/metis_test5/data-sets/ce6740de-1455-49a1-a061-a6a7b4bf3090,
XSLT_URL=https://metis-core-rest-test.eanadev.org/datasets/xslt/5d2ecef6b764d018ee77c1d2,
METIS_DATASET_NAME=109_Testing_MET_2678,
NEW_REPRESENTATION_NAME=metadataRecord,
REPRESENTATION_NAME=metadataRecord,
REVISION_TIMESTAMP=2020-07-23T07:31:14.924Z,
PREVIOUS_TASK_ID=4105255046862291860, AUTHORIZATION_HEADER=Basic
bWV0aXNfdGVzdDoxUmtaQnVWZg==,
CLOUD_LOCAL_IDENTIFIER=https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
SCHEMA_NAME=null}, Revision [revisionNme=TRANSFORMATION,
revisionProvider=metis_test5, creationTimeStamp=Thu Jul 23 09:31:36 CEST
2020, acceptance=false, published=false, deleted=false], null, 0]]
[Thread-27-spout-executor[4 4]] INFO org.apache.storm.daemon.task -
Emitting: spout __ack_init [-4856356957915961623 4922195490007624215 4]
[Thread-27-spout-executor[4 4]] INFO org.apache.storm.daemon.executor -
TRANSFERING tuple [dest: 2 tuple: source: spout:4, stream: __ack_init,
id: {}, [-4856356957915961623 4922195490007624215 4]]
[Thread-19-retrieveFileBolt-executor[3 3]] INFO
org.apache.storm.daemon.executor - Processing received message FOR 3
TUPLE: source: spout:4, stream: default, id:
{-4856356957915961623=4922195490007624215}, [3724237530006437913, ,
https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
null, {REVISION_PROVIDER=metis_test5, METIS_DATASET_LANGUAGE=sq,
REVISION_NAME=VALIDATION_EXTERNAL, METIS_DATASET_ID=109,
METIS_DATASET_COUNTRY=Albania,
OUTPUT_DATA_SETS=https://test.ecloud.psnc.pl/api//data-providers/metis_test5/data-sets/ce6740de-1455-49a1-a061-a6a7b4bf3090,
XSLT_URL=https://metis-core-rest-test.eanadev.org/datasets/xslt/5d2ecef6b764d018ee77c1d2,
METIS_DATASET_NAME=109_Testing_MET_2678,
NEW_REPRESENTATION_NAME=metadataRecord,
REPRESENTATION_NAME=metadataRecord,
REVISION_TIMESTAMP=2020-07-23T07:31:14.924Z,
PREVIOUS_TASK_ID=4105255046862291860, AUTHORIZATION_HEADER=Basic
bWV0aXNfdGVzdDoxUmtaQnVWZg==,
CLOUD_LOCAL_IDENTIFIER=https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
SCHEMA_NAME=null}, Revision [revisionNme=TRANSFORMATION,
revisionProvider=metis_test5, creationTimeStamp=Thu Jul 23 09:31:36 CEST
2020, acceptance=false, published=false, deleted=false], null, 0]
[Thread-19-retrieveFileBolt-executor[3 3]] INFO
eu.europeana.cloud.service.dps.storm.io.ReadFileBolt - HERE THE LINK:
https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921
[Thread-17-__acker-executor[2 2]] INFO org.apache.storm.daemon.executor
- Processing received message FOR 2 TUPLE: source: spout:4, stream:
__ack_init, id: {}, [-4856356957915961623 4922195490007624215 4]
[Thread-17-__acker-executor[2 2]] INFO org.apache.storm.daemon.executor
- BOLT ack TASK: 2 TIME: -1 TUPLE: source: spout:4, stream: __ack_init,
id: {}, [-4856356957915961623 4922195490007624215 4]
[Thread-17-__acker-executor[2 2]] INFO org.apache.storm.daemon.executor
- Execute done TUPLE source: spout:4, stream: __ack_init, id: {},
[-4856356957915961623 4922195490007624215 4] TASK: 2 DELTA: -1
[Thread-19-retrieveFileBolt-executor[3 3]] INFO
org.apache.storm.daemon.task - Emitting: retrieveFileBolt default
[3724237530006437913, ,
https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
[B@46f87491, {REVISION_PROVIDER=metis_test5, METIS_DATASET_LANGUAGE=sq,
REVISION_NAME=VALIDATION_EXTERNAL, METIS_DATASET_ID=109,
METIS_DATASET_COUNTRY=Albania,
OUTPUT_DATA_SETS=https://test.ecloud.psnc.pl/api//data-providers/metis_test5/data-sets/ce6740de-1455-49a1-a061-a6a7b4bf3090,
XSLT_URL=https://metis-core-rest-test.eanadev.org/datasets/xslt/5d2ecef6b764d018ee77c1d2,
METIS_DATASET_NAME=109_Testing_MET_2678,
NEW_REPRESENTATION_NAME=metadataRecord,
REPRESENTATION_NAME=metadataRecord,
REVISION_TIMESTAMP=2020-07-23T07:31:14.924Z,
PREVIOUS_TASK_ID=4105255046862291860, AUTHORIZATION_HEADER=Basic
bWV0aXNfdGVzdDoxUmtaQnVWZg==,
CLOUD_LOCAL_IDENTIFIER=https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
SCHEMA_NAME=null, FAZA=READ_FILE_BOLT}, Revision
[revisionNme=TRANSFORMATION, revisionProvider=metis_test5,
creationTimeStamp=Thu Jul 23 09:31:36 CEST 2020, acceptance=false,
published=false, deleted=false], null, 0]
[Thread-19-retrieveFileBolt-executor[3 3]] INFO
org.apache.storm.daemon.executor - TRANSFERING tuple [dest: 1 tuple:
source: retrieveFileBolt:3, stream: default, id:
{-4856356957915961623=4856994563768025993}, [3724237530006437913, ,
https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
[B@46f87491, {REVISION_PROVIDER=metis_test5, METIS_DATASET_LANGUAGE=sq,
REVISION_NAME=VALIDATION_EXTERNAL, METIS_DATASET_ID=109,
METIS_DATASET_COUNTRY=Albania,
OUTPUT_DATA_SETS=https://test.ecloud.psnc.pl/api//data-providers/metis_test5/data-sets/ce6740de-1455-49a1-a061-a6a7b4bf3090,
XSLT_URL=https://metis-core-rest-test.eanadev.org/datasets/xslt/5d2ecef6b764d018ee77c1d2,
METIS_DATASET_NAME=109_Testing_MET_2678,
NEW_REPRESENTATION_NAME=metadataRecord,
REPRESENTATION_NAME=metadataRecord,
REVISION_TIMESTAMP=2020-07-23T07:31:14.924Z,
PREVIOUS_TASK_ID=4105255046862291860, AUTHORIZATION_HEADER=Basic
bWV0aXNfdGVzdDoxUmtaQnVWZg==,
CLOUD_LOCAL_IDENTIFIER=https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
SCHEMA_NAME=null, FAZA=READ_FILE_BOLT}, Revision
[revisionNme=TRANSFORMATION, revisionProvider=metis_test5,
creationTimeStamp=Thu Jul 23 09:31:36 CEST 2020, acceptance=false,
published=false, deleted=false], null, 0]]
[Thread-19-retrieveFileBolt-executor[3 3]] INFO
org.apache.storm.daemon.task - Emitting: retrieveFileBolt __ack_ack
[-4856356957915961623 515842935217629598]
[Thread-19-retrieveFileBolt-executor[3 3]] INFO
org.apache.storm.daemon.executor - TRANSFERING tuple [dest: 2 tuple:
source: retrieveFileBolt:3, stream: __ack_ack, id: {},
[-4856356957915961623 515842935217629598]]
[Thread-19-retrieveFileBolt-executor[3 3]] INFO
org.apache.storm.daemon.executor - BOLT ack TASK: 3 TIME: -1 TUPLE:
source: spout:4, stream: default, id:
{-4856356957915961623=4922195490007624215}, [3724237530006437913, ,
https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
null, {REVISION_PROVIDER=metis_test5, METIS_DATASET_LANGUAGE=sq,
REVISION_NAME=VALIDATION_EXTERNAL, METIS_DATASET_ID=109,
METIS_DATASET_COUNTRY=Albania,
OUTPUT_DATA_SETS=https://test.ecloud.psnc.pl/api//data-providers/metis_test5/data-sets/ce6740de-1455-49a1-a061-a6a7b4bf3090,
XSLT_URL=https://metis-core-rest-test.eanadev.org/datasets/xslt/5d2ecef6b764d018ee77c1d2,
METIS_DATASET_NAME=109_Testing_MET_2678,
NEW_REPRESENTATION_NAME=metadataRecord,
REPRESENTATION_NAME=metadataRecord,
REVISION_TIMESTAMP=2020-07-23T07:31:14.924Z,
PREVIOUS_TASK_ID=4105255046862291860, AUTHORIZATION_HEADER=Basic
bWV0aXNfdGVzdDoxUmtaQnVWZg==,
CLOUD_LOCAL_IDENTIFIER=https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
SCHEMA_NAME=null, FAZA=READ_FILE_BOLT}, Revision
[revisionNme=TRANSFORMATION, revisionProvider=metis_test5,
creationTimeStamp=Thu Jul 23 09:31:36 CEST 2020, acceptance=false,
published=false, deleted=false], null, 0]
[Thread-19-retrieveFileBolt-executor[3 3]] INFO
org.apache.storm.daemon.executor - Execute done TUPLE source: spout:4,
stream: default, id: {-4856356957915961623=4922195490007624215},
[3724237530006437913, ,
https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
null, {REVISION_PROVIDER=metis_test5, METIS_DATASET_LANGUAGE=sq,
REVISION_NAME=VALIDATION_EXTERNAL, METIS_DATASET_ID=109,
METIS_DATASET_COUNTRY=Albania,
OUTPUT_DATA_SETS=https://test.ecloud.psnc.pl/api//data-providers/metis_test5/data-sets/ce6740de-1455-49a1-a061-a6a7b4bf3090,
XSLT_URL=https://metis-core-rest-test.eanadev.org/datasets/xslt/5d2ecef6b764d018ee77c1d2,
METIS_DATASET_NAME=109_Testing_MET_2678,
NEW_REPRESENTATION_NAME=metadataRecord,
REPRESENTATION_NAME=metadataRecord,
REVISION_TIMESTAMP=2020-07-23T07:31:14.924Z,
PREVIOUS_TASK_ID=4105255046862291860, AUTHORIZATION_HEADER=Basic
bWV0aXNfdGVzdDoxUmtaQnVWZg==,
CLOUD_LOCAL_IDENTIFIER=https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
SCHEMA_NAME=null, FAZA=READ_FILE_BOLT}, Revision
[revisionNme=TRANSFORMATION, revisionProvider=metis_test5,
creationTimeStamp=Thu Jul 23 09:31:36 CEST 2020, acceptance=false,
published=false, deleted=false], null, 0] TASK: 3 DELTA: -1
[Thread-17-__acker-executor[2 2]] INFO org.apache.storm.daemon.executor
- Processing received message FOR 2 TUPLE: source: retrieveFileBolt:3,
stream: __ack_ack, id: {}, [-4856356957915961623 515842935217629598]
[Thread-17-__acker-executor[2 2]] INFO org.apache.storm.daemon.executor
- BOLT ack TASK: 2 TIME: -1 TUPLE: source: retrieveFileBolt:3, stream:
__ack_ack, id: {}, [-4856356957915961623 515842935217629598]
[Thread-21-XSLT_BOLT-executor[1 1]] INFO
org.apache.storm.daemon.executor - Processing received message FOR 1
TUPLE: source: retrieveFileBolt:3, stream: default, id:
{-4856356957915961623=4856994563768025993}, [3724237530006437913, ,
https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
[B@46f87491, {REVISION_PROVIDER=metis_test5, METIS_DATASET_LANGUAGE=sq,
REVISION_NAME=VALIDATION_EXTERNAL, METIS_DATASET_ID=109,
METIS_DATASET_COUNTRY=Albania,
OUTPUT_DATA_SETS=https://test.ecloud.psnc.pl/api//data-providers/metis_test5/data-sets/ce6740de-1455-49a1-a061-a6a7b4bf3090,
XSLT_URL=https://metis-core-rest-test.eanadev.org/datasets/xslt/5d2ecef6b764d018ee77c1d2,
METIS_DATASET_NAME=109_Testing_MET_2678,
NEW_REPRESENTATION_NAME=metadataRecord,
REPRESENTATION_NAME=metadataRecord,
REVISION_TIMESTAMP=2020-07-23T07:31:14.924Z,
PREVIOUS_TASK_ID=4105255046862291860, AUTHORIZATION_HEADER=Basic
bWV0aXNfdGVzdDoxUmtaQnVWZg==,
CLOUD_LOCAL_IDENTIFIER=https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
SCHEMA_NAME=null, FAZA=READ_FILE_BOLT}, Revision
[revisionNme=TRANSFORMATION, revisionProvider=metis_test5,
creationTimeStamp=Thu Jul 23 09:31:36 CEST 2020, acceptance=false,
published=false, deleted=false], null, 0]
[Thread-17-__acker-executor[2 2]] INFO org.apache.storm.daemon.executor
- Execute done TUPLE source: retrieveFileBolt:3, stream: __ack_ack, id:
{}, [-4856356957915961623 515842935217629598] TASK: 2 DELTA: -1
[Thread-21-XSLT_BOLT-executor[1 1]] INFO
eu.europeana.cloud.service.dps.storm.topologies.xslt.bolt.XsltBolt -
Processing file:
https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921
with xslt
schema:https://metis-core-rest-test.eanadev.org/datasets/xslt/5d2ecef6b764d018ee77c1d2
[Thread-21-XSLT_BOLT-executor[1 1]] INFO
eu.europeana.cloud.service.dps.storm.topologies.xslt.bolt.XsltBolt -
XsltBolt: transformation success for:
https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921
[Thread-21-XSLT_BOLT-executor[1 1]] INFO org.apache.storm.daemon.task -
Emitting: XSLT_BOLT default [3724237530006437913, ,
https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
[B@7a4ed223, {REVISION_PROVIDER=metis_test5,
REVISION_NAME=VALIDATION_EXTERNAL,
OUTPUT_DATA_SETS=https://test.ecloud.psnc.pl/api//data-providers/metis_test5/data-sets/ce6740de-1455-49a1-a061-a6a7b4bf3090,
NEW_REPRESENTATION_NAME=metadataRecord,
REPRESENTATION_NAME=metadataRecord,
REVISION_TIMESTAMP=2020-07-23T07:31:14.924Z,
PREVIOUS_TASK_ID=4105255046862291860, AUTHORIZATION_HEADER=Basic
bWV0aXNfdGVzdDoxUmtaQnVWZg==,
CLOUD_LOCAL_IDENTIFIER=https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
SCHEMA_NAME=null, FAZA=XSLT_BOLT,
CLOUD_ID=XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA,
REPRESENTATION_VERSION=767d0380-ccb6-11ea-b26c-fa163e8d4ae3}, Revision
[revisionNme=TRANSFORMATION, revisionProvider=metis_test5,
creationTimeStamp=Thu Jul 23 09:31:36 CEST 2020, acceptance=false,
published=false, deleted=false], null, 0]
[Thread-21-XSLT_BOLT-executor[1 1]] INFO
org.apache.storm.daemon.executor - TRANSFERING tuple [dest: 5 tuple:
source: XSLT_BOLT:1, stream: default, id:
{-4856356957915961623=5969751941400414555}, [3724237530006437913, ,
https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
[B@7a4ed223, {REVISION_PROVIDER=metis_test5,
REVISION_NAME=VALIDATION_EXTERNAL,
OUTPUT_DATA_SETS=https://test.ecloud.psnc.pl/api//data-providers/metis_test5/data-sets/ce6740de-1455-49a1-a061-a6a7b4bf3090,
NEW_REPRESENTATION_NAME=metadataRecord,
REPRESENTATION_NAME=metadataRecord,
REVISION_TIMESTAMP=2020-07-23T07:31:14.924Z,
PREVIOUS_TASK_ID=4105255046862291860, AUTHORIZATION_HEADER=Basic
bWV0aXNfdGVzdDoxUmtaQnVWZg==,
CLOUD_LOCAL_IDENTIFIER=https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
SCHEMA_NAME=null, FAZA=XSLT_BOLT,
CLOUD_ID=XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA,
REPRESENTATION_VERSION=767d0380-ccb6-11ea-b26c-fa163e8d4ae3}, Revision
[revisionNme=TRANSFORMATION, revisionProvider=metis_test5,
creationTimeStamp=Thu Jul 23 09:31:36 CEST 2020, acceptance=false,
published=false, deleted=false], null, 0]]
[Thread-21-XSLT_BOLT-executor[1 1]] INFO org.apache.storm.daemon.task -
Emitting: XSLT_BOLT __ack_ack [-4856356957915961623 1278832149415021266]
[Thread-21-XSLT_BOLT-executor[1 1]] INFO
org.apache.storm.daemon.executor - TRANSFERING tuple [dest: 2 tuple:
source: XSLT_BOLT:1, stream: __ack_ack, id: {}, [-4856356957915961623
1278832149415021266]]
[Thread-21-XSLT_BOLT-executor[1 1]] INFO
org.apache.storm.daemon.executor - BOLT ack TASK: 1 TIME: -1 TUPLE:
source: retrieveFileBolt:3, stream: default, id:
{-4856356957915961623=4856994563768025993}, [3724237530006437913, ,
https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
[B@46f87491, {REVISION_PROVIDER=metis_test5,
REVISION_NAME=VALIDATION_EXTERNAL,
OUTPUT_DATA_SETS=https://test.ecloud.psnc.pl/api//data-providers/metis_test5/data-sets/ce6740de-1455-49a1-a061-a6a7b4bf3090,
NEW_REPRESENTATION_NAME=metadataRecord,
REPRESENTATION_NAME=metadataRecord,
REVISION_TIMESTAMP=2020-07-23T07:31:14.924Z,
PREVIOUS_TASK_ID=4105255046862291860, AUTHORIZATION_HEADER=Basic
bWV0aXNfdGVzdDoxUmtaQnVWZg==,
CLOUD_LOCAL_IDENTIFIER=https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
SCHEMA_NAME=null, FAZA=XSLT_BOLT,
CLOUD_ID=XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA,
REPRESENTATION_VERSION=767d0380-ccb6-11ea-b26c-fa163e8d4ae3}, Revision
[revisionNme=TRANSFORMATION, revisionProvider=metis_test5,
creationTimeStamp=Thu Jul 23 09:31:36 CEST 2020, acceptance=false,
published=false, deleted=false], null, 0]
[Thread-21-XSLT_BOLT-executor[1 1]] INFO
org.apache.storm.daemon.executor - Execute done TUPLE source:
retrieveFileBolt:3, stream: default, id:
{-4856356957915961623=4856994563768025993}, [3724237530006437913, ,
https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
[B@46f87491, {REVISION_PROVIDER=metis_test5,
REVISION_NAME=VALIDATION_EXTERNAL,
OUTPUT_DATA_SETS=https://test.ecloud.psnc.pl/api//data-providers/metis_test5/data-sets/ce6740de-1455-49a1-a061-a6a7b4bf3090,
NEW_REPRESENTATION_NAME=metadataRecord,
REPRESENTATION_NAME=metadataRecord,
REVISION_TIMESTAMP=2020-07-23T07:31:14.924Z,
PREVIOUS_TASK_ID=4105255046862291860, AUTHORIZATION_HEADER=Basic
bWV0aXNfdGVzdDoxUmtaQnVWZg==,
CLOUD_LOCAL_IDENTIFIER=https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
SCHEMA_NAME=null, FAZA=XSLT_BOLT,
CLOUD_ID=XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA,
REPRESENTATION_VERSION=767d0380-ccb6-11ea-b26c-fa163e8d4ae3}, Revision
[revisionNme=TRANSFORMATION, revisionProvider=metis_test5,
creationTimeStamp=Thu Jul 23 09:31:36 CEST 2020, acceptance=false,
published=false, deleted=false], null, 0] TASK: 1 DELTA: -1
[Thread-17-__acker-executor[2 2]] INFO org.apache.storm.daemon.executor
- Processing received message FOR 2 TUPLE: source: XSLT_BOLT:1, stream:
__ack_ack, id: {}, [-4856356957915961623 1278832149415021266]
[Thread-25-writeRecordBolt-executor[5 5]] INFO
org.apache.storm.daemon.executor - Processing received message FOR 5
TUPLE: source: XSLT_BOLT:1, stream: default, id:
{-4856356957915961623=5969751941400414555}, [3724237530006437913, ,
https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
[B@7a4ed223, {REVISION_PROVIDER=metis_test5,
REVISION_NAME=VALIDATION_EXTERNAL,
OUTPUT_DATA_SETS=https://test.ecloud.psnc.pl/api//data-providers/metis_test5/data-sets/ce6740de-1455-49a1-a061-a6a7b4bf3090,
NEW_REPRESENTATION_NAME=metadataRecord,
REPRESENTATION_NAME=metadataRecord,
REVISION_TIMESTAMP=2020-07-23T07:31:14.924Z,
PREVIOUS_TASK_ID=4105255046862291860, AUTHORIZATION_HEADER=Basic
bWV0aXNfdGVzdDoxUmtaQnVWZg==,
CLOUD_LOCAL_IDENTIFIER=https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
SCHEMA_NAME=null, FAZA=XSLT_BOLT,
CLOUD_ID=XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA,
REPRESENTATION_VERSION=767d0380-ccb6-11ea-b26c-fa163e8d4ae3}, Revision
[revisionNme=TRANSFORMATION, revisionProvider=metis_test5,
creationTimeStamp=Thu Jul 23 09:31:36 CEST 2020, acceptance=false,
published=false, deleted=false], null, 0]
[Thread-17-__acker-executor[2 2]] INFO org.apache.storm.daemon.executor
- BOLT ack TASK: 2 TIME: -1 TUPLE: source: XSLT_BOLT:1, stream:
__ack_ack, id: {}, [-4856356957915961623 1278832149415021266]
[Thread-25-writeRecordBolt-executor[5 5]] INFO
eu.europeana.cloud.service.dps.storm.io.WriteRecordBolt -
WriteRecordBolt: persisting...
[Thread-17-__acker-executor[2 2]] INFO org.apache.storm.daemon.executor
- Execute done TUPLE source: XSLT_BOLT:1, stream: __ack_ack, id: {},
[-4856356957915961623 1278832149415021266] TASK: 2 DELTA: -1
[Thread-25-writeRecordBolt-executor[5 5]] INFO
eu.europeana.cloud.service.dps.storm.io.WriteRecordBolt -
WriteRecordBolt: file modified, new URI:
http://test.ecloud.psnc.pl:80/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/60ad9c50-cdfa-11ea-b26c-fa163e8d4ae3/files/7dfee961-6a0e-4614-b146-044d93760543
[Thread-25-writeRecordBolt-executor[5 5]] INFO
org.apache.storm.daemon.task - Emitting: writeRecordBolt default
[3724237530006437913, ,
https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
null, {REVISION_PROVIDER=metis_test5, REVISION_NAME=VALIDATION_EXTERNAL,
OUTPUT_DATA_SETS=https://test.ecloud.psnc.pl/api//data-providers/metis_test5/data-sets/ce6740de-1455-49a1-a061-a6a7b4bf3090,
NEW_REPRESENTATION_NAME=metadataRecord,
REVISION_TIMESTAMP=2020-07-23T07:31:14.924Z,
PREVIOUS_TASK_ID=4105255046862291860, AUTHORIZATION_HEADER=Basic
bWV0aXNfdGVzdDoxUmtaQnVWZg==,
CLOUD_LOCAL_IDENTIFIER=https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
SCHEMA_NAME=null, FAZA=WRITE_RECORD_BOLT,
OUTPUT_URL=http://test.ecloud.psnc.pl:80/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/60ad9c50-cdfa-11ea-b26c-fa163e8d4ae3/files/7dfee961-6a0e-4614-b146-044d93760543},
Revision [revisionNme=TRANSFORMATION, revisionProvider=metis_test5,
creationTimeStamp=Thu Jul 23 09:31:36 CEST 2020, acceptance=false,
published=false, deleted=false], null, 0]
[Thread-25-writeRecordBolt-executor[5 5]] INFO
org.apache.storm.daemon.task - Emitting: writeRecordBolt __ack_ack
[-4856356957915961623 5969751941400414555]
[Thread-25-writeRecordBolt-executor[5 5]] INFO
org.apache.storm.daemon.executor - TRANSFERING tuple [dest: 2 tuple:
source: writeRecordBolt:5, stream: __ack_ack, id: {},
[-4856356957915961623 5969751941400414555]]
[Thread-25-writeRecordBolt-executor[5 5]] INFO
org.apache.storm.daemon.executor - BOLT ack TASK: 5 TIME: -1 TUPLE:
source: XSLT_BOLT:1, stream: default, id:
{-4856356957915961623=5969751941400414555}, [3724237530006437913, ,
https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
[B@7a4ed223, {REVISION_PROVIDER=metis_test5,
REVISION_NAME=VALIDATION_EXTERNAL,
OUTPUT_DATA_SETS=https://test.ecloud.psnc.pl/api//data-providers/metis_test5/data-sets/ce6740de-1455-49a1-a061-a6a7b4bf3090,
NEW_REPRESENTATION_NAME=metadataRecord,
REVISION_TIMESTAMP=2020-07-23T07:31:14.924Z,
PREVIOUS_TASK_ID=4105255046862291860, AUTHORIZATION_HEADER=Basic
bWV0aXNfdGVzdDoxUmtaQnVWZg==,
CLOUD_LOCAL_IDENTIFIER=https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
SCHEMA_NAME=null, FAZA=WRITE_RECORD_BOLT,
OUTPUT_URL=http://test.ecloud.psnc.pl:80/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/60ad9c50-cdfa-11ea-b26c-fa163e8d4ae3/files/7dfee961-6a0e-4614-b146-044d93760543},
Revision [revisionNme=TRANSFORMATION, revisionProvider=metis_test5,
creationTimeStamp=Thu Jul 23 09:31:36 CEST 2020, acceptance=false,
published=false, deleted=false], null, 0]
[Thread-25-writeRecordBolt-executor[5 5]] INFO
org.apache.storm.daemon.task - Emitting: writeRecordBolt __ack_ack
[-4856356957915961623 5969751941400414555]
[Thread-25-writeRecordBolt-executor[5 5]] INFO
org.apache.storm.daemon.executor - TRANSFERING tuple [dest: 2 tuple:
source: writeRecordBolt:5, stream: __ack_ack, id: {},
[-4856356957915961623 5969751941400414555]]
[Thread-25-writeRecordBolt-executor[5 5]] INFO
org.apache.storm.daemon.executor - BOLT ack TASK: 5 TIME: -1 TUPLE:
source: XSLT_BOLT:1, stream: default, id:
{-4856356957915961623=5969751941400414555}, [3724237530006437913, ,
https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
[B@7a4ed223, {REVISION_PROVIDER=metis_test5,
REVISION_NAME=VALIDATION_EXTERNAL,
OUTPUT_DATA_SETS=https://test.ecloud.psnc.pl/api//data-providers/metis_test5/data-sets/ce6740de-1455-49a1-a061-a6a7b4bf3090,
NEW_REPRESENTATION_NAME=metadataRecord,
REVISION_TIMESTAMP=2020-07-23T07:31:14.924Z,
PREVIOUS_TASK_ID=4105255046862291860, AUTHORIZATION_HEADER=Basic
bWV0aXNfdGVzdDoxUmtaQnVWZg==,
CLOUD_LOCAL_IDENTIFIER=https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
SCHEMA_NAME=null, FAZA=WRITE_RECORD_BOLT,
OUTPUT_URL=http://test.ecloud.psnc.pl:80/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/60ad9c50-cdfa-11ea-b26c-fa163e8d4ae3/files/7dfee961-6a0e-4614-b146-044d93760543},
Revision [revisionNme=TRANSFORMATION, revisionProvider=metis_test5,
creationTimeStamp=Thu Jul 23 09:31:36 CEST 2020, acceptance=false,
published=false, deleted=false], null, 0]
[Thread-25-writeRecordBolt-executor[5 5]] INFO
org.apache.storm.daemon.executor - Execute done TUPLE source:
XSLT_BOLT:1, stream: default, id:
{-4856356957915961623=5969751941400414555}, [3724237530006437913, ,
https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
[B@7a4ed223, {REVISION_PROVIDER=metis_test5,
REVISION_NAME=VALIDATION_EXTERNAL,
OUTPUT_DATA_SETS=https://test.ecloud.psnc.pl/api//data-providers/metis_test5/data-sets/ce6740de-1455-49a1-a061-a6a7b4bf3090,
NEW_REPRESENTATION_NAME=metadataRecord,
REVISION_TIMESTAMP=2020-07-23T07:31:14.924Z,
PREVIOUS_TASK_ID=4105255046862291860, AUTHORIZATION_HEADER=Basic
bWV0aXNfdGVzdDoxUmtaQnVWZg==,
CLOUD_LOCAL_IDENTIFIER=https://test.ecloud.psnc.pl:443/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/767d0380-ccb6-11ea-b26c-fa163e8d4ae3/files/18f552f0-89c2-49d7-9ebb-620500be4921,
SCHEMA_NAME=null, FAZA=WRITE_RECORD_BOLT,
OUTPUT_URL=http://test.ecloud.psnc.pl:80/api/records/XLYQYKS3CLTNBSMJAY4BD5MQGKHRNVOMYXPEHP5FIPBATYTROHDA/representations/metadataRecord/versions/60ad9c50-cdfa-11ea-b26c-fa163e8d4ae3/files/7dfee961-6a0e-4614-b146-044d93760543},
Revision [revisionNme=TRANSFORMATION, revisionProvider=metis_test5,
creationTimeStamp=Thu Jul 23 09:31:36 CEST 2020, acceptance=false,
published=false, deleted=false], null, 0] TASK: 5 DELTA: -1
[Thread-17-__acker-executor[2 2]] INFO org.apache.storm.daemon.executor
- Processing received message FOR 2 TUPLE: source: writeRecordBolt:5,
stream: __ack_ack, id: {}, [-4856356957915961623 5969751941400414555]
[Thread-17-__acker-executor[2 2]] INFO org.apache.storm.daemon.task -
Emitting direct: 4; __acker __ack_ack [-4856356957915961623 3034]
[Thread-17-__acker-executor[2 2]] INFO org.apache.storm.daemon.executor
- TRANSFERING tuple [dest: 4 tuple: source: __acker:2, stream:
__ack_ack, id: {}, [-4856356957915961623 3034]]
[Thread-17-__acker-executor[2 2]] INFO org.apache.storm.daemon.executor
- BOLT ack TASK: 2 TIME: -1 TUPLE: source: writeRecordBolt:5, stream:
__ack_ack, id: {}, [-4856356957915961623 5969751941400414555]
[Thread-17-__acker-executor[2 2]] INFO org.apache.storm.daemon.executor
- Execute done TUPLE source: writeRecordBolt:5, stream: __ack_ack, id:
{}, [-4856356957915961623 5969751941400414555] TASK: 2 DELTA: -1
[Thread-17-__acker-executor[2 2]] INFO org.apache.storm.daemon.executor
- Processing received message FOR 2 TUPLE: source: writeRecordBolt:5,
stream: __ack_ack, id: {}, [-4856356957915961623 5969751941400414555]
[Thread-17-__acker-executor[2 2]] INFO org.apache.storm.daemon.executor
- BOLT ack TASK: 2 TIME: -1 TUPLE: source: writeRecordBolt:5, stream:
__ack_ack, id: {}, [-4856356957915961623 5969751941400414555]
[Thread-17-__acker-executor[2 2]] INFO org.apache.storm.daemon.executor
- Execute done TUPLE source: writeRecordBolt:5, stream: __ack_ack, id:
{}, [-4856356957915961623 5969751941400414555] TASK: 2 DELTA: -1
[Thread-27-spout-executor[4 4]] INFO org.apache.storm.daemon.executor -
Processing received message FOR 4 TUPLE: source: __acker:2, stream:
__ack_ack, id: {}, [-4856356957915961623 3034]
[Thread-27-spout-executor[4 4]] INFO org.apache.storm.daemon.executor -
SPOUT Acking message -4856356957915961623
{topic-partition=xslt_topology_1-1, offset=5, numFails=0, nullTuple=false}
ACK!!
