GitHub user jmhublar deleted a comment on the discussion: Replication broken
after upgrade from 2.11.2 to 3.0.2
# **Errors**
## Local Broker:
```
2024-11-07 12:19:48.528
2024-11-07T17:19:48,528+0000 [pulsar-io-4-9] ERROR
org.apache.pulsar.client.impl.ClientCnx - [id: 0x1ba867fb,
L:/10.191.108.222:40638 -
R:pulsar-proxy.apps-01.sbx.us-west-2.services.net/10.191.234.154:6651] Close
connection because received internal-server error
{"errorMsg":"","reqId":4396773518956189930,
"remote":"pulsar-broker.pulsar.svc.cluster.local/10.191.230.54:6650",
"local":"/10.191.230.57:51172"}
2024-11-07 12:19:48.529
2024-11-07T17:19:48,528+0000 [pulsar-io-4-9] WARN
org.apache.pulsar.client.impl.BinaryProtoLookupService -
[persistent://tenant-one/testns/hot-topic] failed to get Partitioned metadata :
{"errorMsg":"{"errorMsg":"","reqId":4396773518956189930,
"remote":"pulsar-broker.pulsar.svc.cluster.local/10.191.230.54:6650",
"local":"/10.191.230.57:51172"}","reqId":2797279726740378025,
"remote":"pulsar-proxy.apps-01.sbx.us-west-2.services.net/10.191.234.154:6651",
"local":"/10.191.108.222:40638"}
```
## Distal Proxy:
```
2024-11-07 12:19:48.359
2024-11-07T17:19:48,358+0000 [pulsar-proxy-io-5-10] INFO
org.apache.pulsar.proxy.server.ProxyConnection - [/10.191.235.93:31709] New
connection opened
2024-11-07 12:19:48.422
2024-11-07T17:19:48,422+0000 [pulsar-proxy-io-5-10] INFO
org.apache.pulsar.proxy.server.ProxyConnection - [/10.191.235.93:31709]
complete connection, init proxy handler. authenticated with token role
PULSAR_SUPERUSER, hasProxyToBrokerUrl: false
2024-11-07 12:19:48.495
2024-11-07T17:19:48,495+0000 [pulsar-proxy-io-5-13] INFO
org.apache.pulsar.client.impl.ConnectionPool - [[id: 0x781a1014,
L:/10.191.230.57:51172 -
R:pulsar-broker.pulsar.svc.cluster.local/10.191.230.54:6650]] Connected to
server
2024-11-07 12:19:48.496
2024-11-07T17:19:48,495+0000 [pulsar-proxy-io-5-13] WARN
org.apache.pulsar.proxy.server.LookupProxyHandler -
[persistent://tenant-one/testns/hot-topic] failed to get Partitioned metadata :
{"errorMsg":"","reqId":4396773518956189930,
"remote":"pulsar-broker.pulsar.svc.cluster.local/10.191.230.54:6650",
"local":"/10.191.230.57:51172"}
2024-11-07 12:19:48.496
org.apache.pulsar.client.api.PulsarClientException$TopicDoesNotExistException:
{"errorMsg":"","reqId":4396773518956189930,
"remote":"pulsar-broker.pulsar.svc.cluster.local/10.191.230.54:6650",
"local":"/10.191.230.57:51172"}
2024-11-07 12:19:48.496
at
org.apache.pulsar.client.impl.ClientCnx.getPulsarClientException(ClientCnx.java:1298)
~[org.apache.pulsar-pulsar-client-original-3.0.7.jar:3.0.7]
2024-11-07 12:19:48.496
at
org.apache.pulsar.client.impl.ClientCnx.handlePartitionResponse(ClientCnx.java:666)
~[org.apache.pulsar-pulsar-client-original-3.0.7.jar:3.0.7]
2024-11-07 12:19:48.496
at
org.apache.pulsar.common.protocol.PulsarDecoder.channelRead(PulsarDecoder.java:144)
~[org.apache.pulsar-pulsar-common-3.0.7.jar:3.0.7]
2024-11-07 12:19:48.496
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444)
~[io.netty-netty-transport-4.1.113.Final.jar:4.1.113.Final]
2024-11-07 12:19:48.496
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420)
~[io.netty-netty-transport-4.1.113.Final.jar:4.1.113.Final]
2024-11-07 12:19:48.496
at
io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412)
~[io.netty-netty-transport-4.1.113.Final.jar:4.1.113.Final]
2024-11-07 12:19:48.496
at
io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346)
~[io.netty-netty-codec-4.1.113.Final.jar:4.1.113.Final]
2024-11-07 12:19:48.496
at
io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318)
~[io.netty-netty-codec-4.1.113.Final.jar:4.1.113.Final]
2024-11-07 12:19:48.496
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444)
~[io.netty-netty-transport-4.1.113.Final.jar:4.1.113.Final]
2024-11-07 12:19:48.496
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420)
~[io.netty-netty-transport-4.1.113.Final.jar:4.1.113.Final]
2024-11-07 12:19:48.496
at
io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412)
~[io.netty-netty-transport-4.1.113.Final.jar:4.1.113.Final]
2024-11-07 12:19:48.496
at
io.netty.handler.flush.FlushConsolidationHandler.channelRead(FlushConsolidationHandler.java:152)
~[io.netty-netty-handler-4.1.113.Final.jar:4.1.113.Final]
2024-11-07 12:19:48.496
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442)
~[io.netty-netty-transport-4.1.113.Final.jar:4.1.113.Final]
2024-11-07 12:19:48.496
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420)
~[io.netty-netty-transport-4.1.113.Final.jar:4.1.113.Final]
2024-11-07 12:19:48.496
at
io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412)
~[io.netty-netty-transport-4.1.113.Final.jar:4.1.113.Final]
2024-11-07 12:19:48.496
at
io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1357)
~[io.netty-netty-transport-4.1.113.Final.jar:4.1.113.Final]
2024-11-07 12:19:48.496
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440)
~[io.netty-netty-transport-4.1.113.Final.jar:4.1.113.Final]
2024-11-07 12:19:48.496
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420)
~[io.netty-netty-transport-4.1.113.Final.jar:4.1.113.Final]
2024-11-07 12:19:48.496
at
io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:868)
~[io.netty-netty-transport-4.1.113.Final.jar:4.1.113.Final]
2024-11-07 12:19:48.496
at
io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:799)
~[io.netty-netty-transport-classes-epoll-4.1.113.Final.jar:4.1.113.Final]
2024-11-07 12:19:48.496
at
io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:501)
~[io.netty-netty-transport-classes-epoll-4.1.113.Final.jar:4.1.113.Final]
2024-11-07 12:19:48.496
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:399)
~[io.netty-netty-transport-classes-epoll-4.1.113.Final.jar:4.1.113.Final]
2024-11-07 12:19:48.496
at
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997)
~[io.netty-netty-common-4.1.113.Final.jar:4.1.113.Final]
2024-11-07 12:19:48.496
at
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
~[io.netty-netty-common-4.1.113.Final.jar:4.1.113.Final]
2024-11-07 12:19:48.496
at
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
~[io.netty-netty-common-4.1.113.Final.jar:4.1.113.Final]
2024-11-07 12:19:48.496
at java.lang.Thread.run(Thread.java:840) ~[?:?]
2024-11-07 12:19:48.562
2024-11-07T17:19:48,562+0000 [pulsar-proxy-io-5-10] INFO
org.apache.pulsar.proxy.server.ProxyConnection - [/10.191.235.93:31709]
Connection closed
2024-11-07 12:19:48.562
2024-11-07T17:19:48,562+0000 [pulsar-proxy-io-5-13] INFO
org.apache.pulsar.client.impl.ClientCnx - [id: 0x781a1014,
L:/10.191.230.57:51172 !
R:pulsar-broker.pulsar.svc.cluster.local/10.191.230.54:6650] Disconnected
```
GitHub link:
https://github.com/apache/pulsar/discussions/23558#discussioncomment-11171592
----
This is an automatically sent email for [email protected].
To unsubscribe, please send an email to: [email protected]
