thinker0 opened a new issue, #3820:
URL: https://github.com/apache/incubator-heron/issues/3820
**Describe the bug**
The information seems to be broken in the process of updating the topology
information received from Zookeeper.
```
[2022-04-23 15:01:57 +0900] [DEBUG]: Sending request(xid=52):
GetData(path='/heron/pplans/heron-oa-message-event-to-kafka-publisher',
watcher=<bound method DataWatch._watcher of <kazoo.recipe.watchers.DataWatch
object at 0x111b518e0>>)
[2022-04-23 15:01:57 +0900] [DEBUG]: Received EVENT: Watch(type=2, state=3,
path='/heron/executionstate/heron-oa-message-event-to-kafka-publisher')
[2022-04-23 15:01:57 +0900] [DEBUG]: Received error(xid=52) NoNodeError()
[2022-04-23 15:01:57 +0900] [DEBUG]: Sending request(xid=53):
Exists(path='/heron/pplans/heron-oa-message-event-to-kafka-publisher',
watcher=<bound method DataWatch._watcher of <kazoo.recipe.watchers.DataWatch
object at 0x111b518e0>>)
[2022-04-23 15:01:57 +0900] [DEBUG]: Received EVENT: Watch(type=4, state=3,
path='/heron/topologies')
[2022-04-23 15:01:57 +0900] [DEBUG]: Sending request(xid=3):
GetChildren(path='/heron/topologies', watcher=<bound method
ChildrenWatch._watcher of <kazoo.recipe.watchers.ChildrenWatch object at
0x111c515e0>>)
[2022-04-23 15:01:57 +0900] [DEBUG]: Received EVENT: Watch(type=4, state=3,
path='/heron/topologies')
[2022-04-23 15:01:57 +0900] [DEBUG]: Sending request(xid=54):
GetData(path='/heron/schedulers/heron-oa-message-event-to-kafka-publisher',
watcher=<bound method DataWatch._watcher of <kazoo.recipe.watchers.DataWatch
object at 0x111b18760>>)
[2022-04-23 15:01:57 +0900] [DEBUG]: Received response(xid=3):
['heron-chirashi-event-to-kafka-publisher',
'heron-ladp-preprocessor-dmp-lsa-conversion-transformer',
'heron-meta-backfill-lads-event',
'heron-crs-ad-loss-notification-to-ladp-kafka-alpha',
'heron-metajoiner-lads-event', 'heron-lads-thv-audience-member-dmp-alpha',
'heron-bot-contact-reference-conversion-to-kafka-process']
[2022-04-23 15:01:57 +0900] [INFO]: State watch triggered for topologies.
[2022-04-23 15:01:57 +0900] [DEBUG]: Topologies:
{'heron-chirashi-event-to-kafka-publisher',
'heron-crs-ad-loss-notification-to-ladp-kafka-alpha',
'heron-lads-thv-audience-member-dmp-alpha',
'heron-ladp-preprocessor-dmp-lsa-conversion-transformer',
'heron-meta-backfill-lads-event', 'heron-metajoiner-lads-event',
'heron-bot-contact-reference-conversion-to-kafka-process'}
[2022-04-23 15:01:57 +0900] [DEBUG]: Existing topologies:
{'heron-chirashi-event-to-kafka-publisher',
'heron-crs-ad-loss-notification-to-ladp-kafka-alpha',
'heron-lads-thv-audience-member-dmp-alpha',
'heron-ladp-preprocessor-dmp-lsa-conversion-transformer',
'heron-oa-message-event-to-kafka-publisher', 'heron-meta-backfill-lads-event',
'heron-metajoiner-lads-event',
'heron-bot-contact-reference-conversion-to-kafka-process'}
[2022-04-23 15:01:57 +0900] [INFO]: Removing topology:
heron-oa-message-event-to-kafka-publisher in rootpath: /heron
[2022-04-23 15:01:57 +0900] [DEBUG]: Received error(xid=54) NoNodeError()
INFO: 127.0.0.1:53019 - "GET /topologies/states HTTP/1.1" 200 OK
[2022-04-23 15:01:57 +0900] [DEBUG]: Sending request(xid=55):
Exists(path='/heron/schedulers/heron-oa-message-event-to-kafka-publisher',
watcher=<bound method DataWatch._watcher of <kazoo.recipe.watchers.DataWatch
object at 0x111b18760>>)
[2022-04-23 15:01:57 +0900] [DEBUG]: Sending request(xid=56):
GetData(path='/heron/executionstate/heron-oa-message-event-to-kafka-publisher',
watcher=<bound method DataWatch._watcher of <kazoo.recipe.watchers.DataWatch
object at 0x111b51670>>)
[2022-04-23 15:01:57 +0900] [DEBUG]: Received error(xid=56) NoNodeError()
[2022-04-23 15:01:57 +0900] [DEBUG]: Sending request(xid=57):
Exists(path='/heron/executionstate/heron-oa-message-event-to-kafka-publisher',
watcher=<bound method DataWatch._watcher of <kazoo.recipe.watchers.DataWatch
object at 0x111b51670>>)
[2022-04-23 15:01:57 +0900] [DEBUG]: Sending request(xid=58):
GetChildren(path='/heron/topologies', watcher=<bound method
ChildrenWatch._watcher of <kazoo.recipe.watchers.ChildrenWatch object at
0x111a9db80>>)
[2022-04-23 15:01:57 +0900] [DEBUG]: Received response(xid=58):
['heron-chirashi-event-to-kafka-publisher',
'heron-ladp-preprocessor-dmp-lsa-conversion-transformer',
'heron-meta-backfill-lads-event',
'heron-crs-ad-loss-notification-to-ladp-kafka-alpha',
'heron-metajoiner-lads-event', 'heron-lads-thv-audience-member-dmp-alpha',
'heron-bot-contact-reference-conversion-to-kafka-process']
[2022-04-23 15:01:57 +0900] [INFO]: State watch triggered for topologies.
[2022-04-23 15:01:57 +0900] [DEBUG]: Topologies:
{'heron-chirashi-event-to-kafka-publisher',
'heron-crs-ad-loss-notification-to-ladp-kafka-alpha',
'heron-lads-thv-audience-member-dmp-alpha',
'heron-ladp-preprocessor-dmp-lsa-conversion-transformer',
'heron-meta-backfill-lads-event', 'heron-metajoiner-lads-event',
'heron-bot-contact-reference-conversion-to-kafka-process'}
[2022-04-23 15:01:57 +0900] [DEBUG]: Existing topologies:
{'heron-chirashi-event-to-kafka-publisher',
'heron-crs-ad-loss-notification-to-ladp-kafka-alpha',
'heron-lads-thv-audience-member-dmp-alpha',
'heron-ladp-preprocessor-dmp-lsa-conversion-transformer',
'heron-meta-backfill-lads-event', 'heron-metajoiner-lads-event',
'heron-bot-contact-reference-conversion-to-kafka-process'}
[2022-04-23 15:02:24 +0900] [DEBUG]: Received EVENT: Watch(type=4, state=3,
path='/heron/topologies')
[2022-04-23 15:02:24 +0900] [DEBUG]: Sending request(xid=4):
GetChildren(path='/heron/topologies', watcher=<bound method
ChildrenWatch._watcher of <kazoo.recipe.watchers.ChildrenWatch object at
0x111c515e0>>)
[2022-04-23 15:02:24 +0900] [DEBUG]: Received EVENT: Watch(type=4, state=3,
path='/heron/topologies')
[2022-04-23 15:02:24 +0900] [DEBUG]: Sending request(xid=59):
GetChildren(path='/heron/topologies', watcher=<bound method
ChildrenWatch._watcher of <kazoo.recipe.watchers.ChildrenWatch object at
0x111a9db80>>)
[2022-04-23 15:02:24 +0900] [DEBUG]: Received response(xid=59):
['heron-chirashi-event-to-kafka-publisher',
'heron-oa-message-event-to-kafka-publisher',
'heron-ladp-preprocessor-dmp-lsa-conversion-transformer',
'heron-meta-backfill-lads-event',
'heron-crs-ad-loss-notification-to-ladp-kafka-alpha',
'heron-metajoiner-lads-event', 'heron-lads-thv-audience-member-dmp-alpha',
'heron-bot-contact-reference-conversion-to-kafka-process']
[2022-04-23 15:02:24 +0900] [INFO]: State watch triggered for topologies.
[2022-04-23 15:02:24 +0900] [DEBUG]: Topologies:
{'heron-chirashi-event-to-kafka-publisher',
'heron-crs-ad-loss-notification-to-ladp-kafka-alpha',
'heron-lads-thv-audience-member-dmp-alpha',
'heron-ladp-preprocessor-dmp-lsa-conversion-transformer',
'heron-oa-message-event-to-kafka-publisher', 'heron-meta-backfill-lads-event',
'heron-metajoiner-lads-event',
'heron-bot-contact-reference-conversion-to-kafka-process'}
[2022-04-23 15:02:24 +0900] [DEBUG]: Existing topologies:
{'heron-chirashi-event-to-kafka-publisher',
'heron-crs-ad-loss-notification-to-ladp-kafka-alpha',
'heron-lads-thv-audience-member-dmp-alpha',
'heron-ladp-preprocessor-dmp-lsa-conversion-transformer',
'heron-meta-backfill-lads-event', 'heron-metajoiner-lads-event',
'heron-bot-contact-reference-conversion-to-kafka-process'}
[2022-04-23 15:02:24 +0900] [INFO]: Adding new topology:
heron-oa-message-event-to-kafka-publisher, state_manager: lad-beta
[2022-04-23 15:02:24 +0900] [INFO]: Adding data watch for path:
/heron/pplans/heron-oa-message-event-to-kafka-publisher
[2022-04-23 15:02:24 +0900] [DEBUG]: Sending request(xid=60):
GetData(path='/heron/pplans/heron-oa-message-event-to-kafka-publisher',
watcher=<bound method DataWatch._watcher of <kazoo.recipe.watchers.DataWatch
object at 0x111b68520>>)
[2022-04-23 15:02:24 +0900] [DEBUG]: Received response(xid=4):
['heron-chirashi-event-to-kafka-publisher',
'heron-oa-message-event-to-kafka-publisher',
'heron-ladp-preprocessor-dmp-lsa-conversion-transformer',
'heron-meta-backfill-lads-event',
'heron-crs-ad-loss-notification-to-ladp-kafka-alpha',
'heron-metajoiner-lads-event', 'heron-lads-thv-audience-member-dmp-alpha',
'heron-bot-contact-reference-conversion-to-kafka-process']
[2022-04-23 15:02:24 +0900] [INFO]: State watch triggered for topologies.
[2022-04-23 15:02:24 +0900] [DEBUG]: Topologies:
{'heron-chirashi-event-to-kafka-publisher',
'heron-crs-ad-loss-notification-to-ladp-kafka-alpha',
'heron-lads-thv-audience-member-dmp-alpha',
'heron-ladp-preprocessor-dmp-lsa-conversion-transformer',
'heron-oa-message-event-to-kafka-publisher', 'heron-meta-backfill-lads-event',
'heron-metajoiner-lads-event',
'heron-bot-contact-reference-conversion-to-kafka-process'}
[2022-04-23 15:02:24 +0900] [DEBUG]: Existing topologies:
{'heron-chirashi-event-to-kafka-publisher',
'heron-crs-ad-loss-notification-to-ladp-kafka-alpha',
'heron-lads-thv-audience-member-dmp-alpha',
'heron-ladp-preprocessor-dmp-lsa-conversion-transformer',
'heron-oa-message-event-to-kafka-publisher', 'heron-meta-backfill-lads-event',
'heron-metajoiner-lads-event',
'heron-bot-contact-reference-conversion-to-kafka-process'}
[2022-04-23 15:02:24 +0900] [DEBUG]: Received EVENT: Watch(type=1, state=3,
path='/heron/packingplans/heron-oa-message-event-to-kafka-publisher')
[2022-04-23 15:02:24 +0900] [DEBUG]: Received error(xid=60) NoNodeError()
[2022-04-23 15:02:24 +0900] [DEBUG]: Sending request(xid=61):
Exists(path='/heron/pplans/heron-oa-message-event-to-kafka-publisher',
watcher=<bound method DataWatch._watcher of <kazoo.recipe.watchers.DataWatch
object at 0x111b68520>>)
[2022-04-23 15:02:25 +0900] [DEBUG]: Received EVENT: Watch(type=1, state=3,
path='/heron/executionstate/heron-oa-message-event-to-kafka-publisher')
[2022-04-23 15:02:25 +0900] [INFO]: Adding data watch for path:
/heron/packingplans/heron-oa-message-event-to-kafka-publisher
[2022-04-23 15:02:25 +0900] [DEBUG]: Sending request(xid=62):
GetData(path='/heron/packingplans/heron-oa-message-event-to-kafka-publisher',
watcher=<bound method DataWatch._watcher of <kazoo.recipe.watchers.DataWatch
object at 0x111b1a700>>)
[2022-04-23 15:02:25 +0900] [DEBUG]: Received response(xid=62):
(b'\nMheron-oa-message-event-to-kafka-publishered9d7f24-d1de-4711-ab42-7e915be5f1bf\x12\xae\x01\x08\x01\x125\n\x18kafka-oa-message-alpha-1\x10\x01\x18\x00"\x15\t\x9a\x99\x99\x99\x99\x99\xc9?\x10\x80\x80\xc0\x99\x01\x18\x80\x80\x80\x80\x04\x12,\n\x0fkafka-publisher\x10\x02\x18\x00"\x15\t\x9a\x99\x99\x99\x99\x99\xc9?\x10\x80\x80\xc0\x99\x01\x18\x80\x80\x80\x80\x04\x12.\n\x11oa-message-parser\x10\x03\x18\x00"\x15\t\x9a\x99\x99\x99\x99\x99\xc9?\x10\x80\x80\xc0\x99\x01\x18\x80\x80\x80\x80\x04\x1a\x15\t\x00\x00\x00\x00\x00\x00\xf0?\x10\x80\x80\x80\x80\x04\x18\x80\x80\x80\x80(',
ZnodeStat(czxid=128851352130, mzxid=128851352130, ctime=1650693744935,
mtime=1650693744935, version=0, cversion=0, aversion=0, ephemeralOwner=0,
dataLength=256, numChildren=0, pzxid=128851352130))
[2022-04-23 15:02:25 +0900] [INFO]: Adding data watch for path:
/heron/executionstate/heron-oa-message-event-to-kafka-publisher
[2022-04-23 15:02:25 +0900] [DEBUG]: Sending request(xid=63):
GetData(path='/heron/executionstate/heron-oa-message-event-to-kafka-publisher',
watcher=<bound method DataWatch._watcher of <kazoo.recipe.watchers.DataWatch
object at 0x111b68370>>)
[2022-04-23 15:02:25 +0900] [DEBUG]: Received EVENT: Watch(type=2, state=3,
path='/heron/packingplans/heron-oa-message-event-to-kafka-publisher')
[2022-04-23 15:02:25 +0900] [DEBUG]: Received response(xid=63):
(b'\n)heron-oa-message-event-to-kafka-publisher\x12Mheron-oa-message-event-to-kafka-publishered9d7f24-d1de-4711-ab42-7e915be5f1bf\x18\xf0\xac\x8e\x93\x06"\x08thinker0*\x08lad-beta2\x05alpha:\x03wwwB\'\n\x08thinker0\x12\x00\x1a\x19feature/fix-healthmanager',
ZnodeStat(czxid=128851352131, mzxid=128851352131, ctime=1650693744986,
mtime=1650693744986, version=0, cversion=0, aversion=0, ephemeralOwner=0,
dataLength=201, numChildren=0, pzxid=128851352131))
[2022-04-23 15:02:25 +0900] [INFO]: Adding data watch for path:
/heron/tmanagers/heron-oa-message-event-to-kafka-publisher
[2022-04-23 15:02:25 +0900] [DEBUG]: Sending request(xid=64):
GetData(path='/heron/tmanagers/heron-oa-message-event-to-kafka-publisher',
watcher=<bound method DataWatch._watcher of <kazoo.recipe.watchers.DataWatch
object at 0x1117a08b0>>)
[2022-04-23 15:02:25 +0900] [DEBUG]: Received error(xid=64) NoNodeError()
[2022-04-23 15:02:25 +0900] [DEBUG]: Sending request(xid=65):
Exists(path='/heron/tmanagers/heron-oa-message-event-to-kafka-publisher',
watcher=<bound method DataWatch._watcher of <kazoo.recipe.watchers.DataWatch
object at 0x1117a08b0>>)
[2022-04-23 15:02:25 +0900] [INFO]: Adding data watch for path:
/heron/schedulers/heron-oa-message-event-to-kafka-publisher
[2022-04-23 15:02:25 +0900] [DEBUG]: Sending request(xid=66):
GetData(path='/heron/schedulers/heron-oa-message-event-to-kafka-publisher',
watcher=<bound method DataWatch._watcher of <kazoo.recipe.watchers.DataWatch
object at 0x1119ab5b0>>)
[2022-04-23 15:02:25 +0900] [DEBUG]: Received error(xid=66) NoNodeError()
[2022-04-23 15:02:25 +0900] [DEBUG]: Sending request(xid=67):
Exists(path='/heron/schedulers/heron-oa-message-event-to-kafka-publisher',
watcher=<bound method DataWatch._watcher of <kazoo.recipe.watchers.DataWatch
object at 0x1119ab5b0>>)
[2022-04-23 15:02:25 +0900] [DEBUG]: Sending request(xid=68):
GetData(path='/heron/packingplans/heron-oa-message-event-to-kafka-publisher',
watcher=<bound method DataWatch._watcher of <kazoo.recipe.watchers.DataWatch
object at 0x111b51820>>)
[2022-04-23 15:02:25 +0900] [DEBUG]: Received response(xid=68):
(b'\nMheron-oa-message-event-to-kafka-publishered9d7f24-d1de-4711-ab42-7e915be5f1bf\x12\xc5\x01\x08\x01\x125\n\x18kafka-oa-message-alpha-1\x10\x01\x18\x00"\x15\t\x9a\x99\x99\x99\x99\x99\xc9?\x10\x80\x80\xc0\x99\x01\x18\x80\x80\x80\x80\x04\x12,\n\x0fkafka-publisher\x10\x02\x18\x00"\x15\t\x9a\x99\x99\x99\x99\x99\xc9?\x10\x80\x80\xc0\x99\x01\x18\x80\x80\x80\x80\x04\x12.\n\x11oa-message-parser\x10\x03\x18\x00"\x15\t\x9a\x99\x99\x99\x99\x99\xc9?\x10\x80\x80\xc0\x99\x01\x18\x80\x80\x80\x80\x04\x1a\x15\t\x00\x00\x00\x00\x00\x00\xf0?\x10\x80\x80\x80\x80\x04\x18\x80\x80\x80\x80("\x15\t\x00\x00\x00\x00\x00\x00\xf0?\x10\x80\x80\x80\x80\x04\x18\x80\x80\x80\x80(',
ZnodeStat(czxid=128851352133, mzxid=128851352133, ctime=1650693745132,
mtime=1650693745132, version=0, cversion=0, aversion=0, ephemeralOwner=0,
dataLength=279, numChildren=0, pzxid=128851352133))
[2022-04-23 15:02:25 +0900] [DEBUG]: Sending request(xid=69):
GetData(path='/heron/executionstate/heron-oa-message-event-to-kafka-publisher',
watcher=<bound method DataWatch._watcher of <kazoo.recipe.watchers.DataWatch
object at 0x111b51670>>)
[2022-04-23 15:02:25 +0900] [DEBUG]: Received response(xid=69):
(b'\n)heron-oa-message-event-to-kafka-publisher\x12Mheron-oa-message-event-to-kafka-publishered9d7f24-d1de-4711-ab42-7e915be5f1bf\x18\xf0\xac\x8e\x93\x06"\x08thinker0*\x08lad-beta2\x05alpha:\x03wwwB\'\n\x08thinker0\x12\x00\x1a\x19feature/fix-healthmanager',
ZnodeStat(czxid=128851352131, mzxid=128851352131, ctime=1650693744986,
mtime=1650693744986, version=0, cversion=0, aversion=0, ephemeralOwner=0,
dataLength=201, numChildren=0, pzxid=128851352131))
[2022-04-23 15:02:25 +0900] [DEBUG]: Sending request(xid=70):
GetData(path='/heron/packingplans/heron-oa-message-event-to-kafka-publisher',
watcher=<bound method DataWatch._watcher of <kazoo.recipe.watchers.DataWatch
object at 0x111b1a700>>)
[2022-04-23 15:02:25 +0900] [DEBUG]: Received response(xid=70):
(b'\nMheron-oa-message-event-to-kafka-publishered9d7f24-d1de-4711-ab42-7e915be5f1bf\x12\xc5\x01\x08\x01\x125\n\x18kafka-oa-message-alpha-1\x10\x01\x18\x00"\x15\t\x9a\x99\x99\x99\x99\x99\xc9?\x10\x80\x80\xc0\x99\x01\x18\x80\x80\x80\x80\x04\x12,\n\x0fkafka-publisher\x10\x02\x18\x00"\x15\t\x9a\x99\x99\x99\x99\x99\xc9?\x10\x80\x80\xc0\x99\x01\x18\x80\x80\x80\x80\x04\x12.\n\x11oa-message-parser\x10\x03\x18\x00"\x15\t\x9a\x99\x99\x99\x99\x99\xc9?\x10\x80\x80\xc0\x99\x01\x18\x80\x80\x80\x80\x04\x1a\x15\t\x00\x00\x00\x00\x00\x00\xf0?\x10\x80\x80\x80\x80\x04\x18\x80\x80\x80\x80("\x15\t\x00\x00\x00\x00\x00\x00\xf0?\x10\x80\x80\x80\x80\x04\x18\x80\x80\x80\x80(',
ZnodeStat(czxid=128851352133, mzxid=128851352133, ctime=1650693745132,
mtime=1650693745132, version=0, cversion=0, aversion=0, ephemeralOwner=0,
dataLength=279, numChildren=0, pzxid=128851352133))
INFO: 127.0.0.1:53125 - "GET /clusters HTTP/1.1" 200 OK
INFO: 127.0.0.1:53128 - "GET /topologies/states HTTP/1.1" 200 OK
INFO: 127.0.0.1:53131 - "GET /clusters HTTP/1.1" 200 OK
INFO: 127.0.0.1:53134 - "GET /topologies/states HTTP/1.1" 200 OK
INFO: 127.0.0.1:53142 - "GET
/topologies/executionstate?cluster=lad-beta&environ=alpha&topology=heron-oa-message-event-to-kafka-publisher
HTTP/1.1" 200 OK
INFO: 127.0.0.1:53144 - "GET
/topologies/schedulerlocation?cluster=lad-beta&environ=alpha&topology=heron-oa-message-event-to-kafka-publisher
HTTP/1.1" 200 OK
```
**Screenshots**
If applicable, add screenshots to help explain your problem.
**Operating System**
- OS: CentOS
- Version: 7
**Additional context**
- heron-0.20.5 (master)
- Update heron topology
- Tracker Error (watch Zookeeper)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
