lhotari opened a new issue #9456:
URL: https://github.com/apache/pulsar/issues/9456
org.apache.pulsar.tests.integration.proxy.TestProxy is flaky. The test fails
sporadically.
```
org.apache.pulsar.client.admin.PulsarAdminException$ServerSideErrorException:
HTTP 502 Bad Gateway
at
org.apache.pulsar.client.admin.internal.BaseResource.getApiException(BaseResource.java:205)
at
org.apache.pulsar.client.admin.internal.BaseResource$1.failed(BaseResource.java:129)
at
org.glassfish.jersey.client.JerseyInvocation$1.failed(JerseyInvocation.java:839)
at
org.glassfish.jersey.client.JerseyInvocation$1.completed(JerseyInvocation.java:820)
at
org.glassfish.jersey.client.ClientRuntime.processResponse(ClientRuntime.java:229)
at
org.glassfish.jersey.client.ClientRuntime.access$200(ClientRuntime.java:62)
at
org.glassfish.jersey.client.ClientRuntime$2.lambda$response$0(ClientRuntime.java:173)
at org.glassfish.jersey.internal.Errors$1.call(Errors.java:248)
at org.glassfish.jersey.internal.Errors$1.call(Errors.java:244)
at org.glassfish.jersey.internal.Errors.process(Errors.java:292)
at org.glassfish.jersey.internal.Errors.process(Errors.java:274)
at org.glassfish.jersey.internal.Errors.process(Errors.java:244)
at
org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:288)
at
org.glassfish.jersey.client.ClientRuntime$2.response(ClientRuntime.java:173)
```
Usage tip: To enable automatic navigation to failure message, open the
following links with CTRL/CMD-click.
[example failure
2021-02-01T06:08:49.4104114Z](https://github.com/apache/pulsar/runs/1804096958?check_suite_focus=true#step:14:930)
[example failure
2021-02-01T06:08:49.3802067Z](https://github.com/apache/pulsar/runs/1804096958?check_suite_focus=true#step:14:864)
[example failure
2021-02-01T06:08:49.3556802Z](https://github.com/apache/pulsar/runs/1804096958?check_suite_focus=true#step:14:798)
[example failure
2021-01-31T13:02:30.0545770Z](https://github.com/apache/pulsar/runs/1800964450?check_suite_focus=true#step:13:677)
[example failure
2021-01-31T13:02:30.0137124Z](https://github.com/apache/pulsar/runs/1800964450?check_suite_focus=true#step:13:611)
[example failure
2021-01-30T02:26:30.6628142Z](https://github.com/apache/pulsar/runs/1795631678?check_suite_focus=true#step:13:24214)
[example failure
2021-01-29T17:19:38.4438309Z](https://github.com/apache/pulsar/runs/1791621677?check_suite_focus=true#step:13:773)
[example failure
2021-01-29T17:19:38.4224603Z](https://github.com/apache/pulsar/runs/1791621677?check_suite_focus=true#step:13:707)
[example failure
2021-01-29T17:19:38.3858653Z](https://github.com/apache/pulsar/runs/1791621677?check_suite_focus=true#step:13:641)
[example failure
2021-01-26T08:49:12.4035864Z](https://github.com/apache/pulsar/runs/1767404896?check_suite_focus=true#step:13:660)
[example failure
2021-01-26T08:49:12.3640261Z](https://github.com/apache/pulsar/runs/1767404896?check_suite_focus=true#step:13:554)
[example failure
2021-01-25T23:42:12.7819774Z](https://github.com/apache/pulsar/runs/1762681036?check_suite_focus=true#step:13:684)
[example failure
2021-01-25T23:42:12.7557522Z](https://github.com/apache/pulsar/runs/1762681036?check_suite_focus=true#step:13:618)
[example failure
2021-01-25T23:42:12.7065182Z](https://github.com/apache/pulsar/runs/1762681036?check_suite_focus=true#step:13:552)
[example failure
2021-01-25T23:32:03.6055459Z](https://github.com/apache/pulsar/runs/1762435794?check_suite_focus=true#step:13:800)
[example failure
2021-01-25T23:32:03.5656385Z](https://github.com/apache/pulsar/runs/1762435794?check_suite_focus=true#step:13:694)
[example failure
2021-01-24T07:47:11.3148924Z](https://github.com/apache/pulsar/runs/1756352573?check_suite_focus=true#step:13:685)
[example failure
2021-01-24T07:47:11.2975393Z](https://github.com/apache/pulsar/runs/1756352573?check_suite_focus=true#step:13:619)
[example failure
2021-01-24T07:47:10.8681488Z](https://github.com/apache/pulsar/runs/1756352573?check_suite_focus=true#step:13:553)
[example failure
2021-01-24T02:31:55.7399535Z](https://github.com/apache/pulsar/runs/1755730928?check_suite_focus=true#step:13:823)
[example failure
2021-01-24T02:31:55.7213392Z](https://github.com/apache/pulsar/runs/1755730928?check_suite_focus=true#step:13:757)
[example failure
2021-01-24T02:31:55.6758255Z](https://github.com/apache/pulsar/runs/1755730928?check_suite_focus=true#step:13:691)
[example failure
2021-01-23T05:54:36.9441729Z](https://github.com/apache/pulsar/runs/1752936627?check_suite_focus=true#step:13:687)
[example failure
2021-01-23T05:54:36.9123370Z](https://github.com/apache/pulsar/runs/1752936627?check_suite_focus=true#step:13:621)
[example failure
2021-01-22T16:49:26.2412723Z](https://github.com/apache/pulsar/runs/1749790429?check_suite_focus=true#step:13:747)
[example failure
2021-01-22T16:49:26.1943849Z](https://github.com/apache/pulsar/runs/1749790429?check_suite_focus=true#step:13:681)
[example failure
2021-01-22T16:49:26.1706308Z](https://github.com/apache/pulsar/runs/1749790429?check_suite_focus=true#step:13:615)
[example failure
2021-01-22T04:21:50.8650936Z](https://github.com/apache/pulsar/runs/1746201351?check_suite_focus=true#step:12:40028)
[example failure
2021-01-22T04:21:50.7932591Z](https://github.com/apache/pulsar/runs/1746201351?check_suite_focus=true#step:12:39962)
[example failure
2021-01-22T04:21:50.7403464Z](https://github.com/apache/pulsar/runs/1746201351?check_suite_focus=true#step:12:39896)
[example failure
2021-01-22T04:21:50.6575502Z](https://github.com/apache/pulsar/runs/1746201351?check_suite_focus=true#step:12:39830)
[example failure
2021-01-22T04:21:50.5733658Z](https://github.com/apache/pulsar/runs/1746201351?check_suite_focus=true#step:12:39764)
[example failure
2021-01-22T00:16:00.9898236Z](https://github.com/apache/pulsar/runs/1745443224?check_suite_focus=true#step:13:907)
[example failure
2021-01-22T00:16:00.9719398Z](https://github.com/apache/pulsar/runs/1745443224?check_suite_focus=true#step:13:841)
[example failure
2021-01-22T00:16:00.9320254Z](https://github.com/apache/pulsar/runs/1745443224?check_suite_focus=true#step:13:775)
<details>
<summary>Full exception stacktrace</summary>
<code><pre>
org.apache.pulsar.client.admin.PulsarAdminException$ServerSideErrorException:
HTTP 502 Bad Gateway
at
org.apache.pulsar.client.admin.internal.BaseResource.getApiException(BaseResource.java:205)
at
org.apache.pulsar.client.admin.internal.BaseResource$1.failed(BaseResource.java:129)
at
org.glassfish.jersey.client.JerseyInvocation$1.failed(JerseyInvocation.java:839)
at
org.glassfish.jersey.client.JerseyInvocation$1.completed(JerseyInvocation.java:820)
at
org.glassfish.jersey.client.ClientRuntime.processResponse(ClientRuntime.java:229)
at
org.glassfish.jersey.client.ClientRuntime.access$200(ClientRuntime.java:62)
at
org.glassfish.jersey.client.ClientRuntime$2.lambda$response$0(ClientRuntime.java:173)
at org.glassfish.jersey.internal.Errors$1.call(Errors.java:248)
at org.glassfish.jersey.internal.Errors$1.call(Errors.java:244)
at org.glassfish.jersey.internal.Errors.process(Errors.java:292)
at org.glassfish.jersey.internal.Errors.process(Errors.java:274)
at org.glassfish.jersey.internal.Errors.process(Errors.java:244)
at
org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:288)
at
org.glassfish.jersey.client.ClientRuntime$2.response(ClientRuntime.java:173)
at
org.apache.pulsar.client.admin.internal.http.AsyncHttpConnector.lambda$apply$1(AsyncHttpConnector.java:210)
at
java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
at
java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
at
java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
at
java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
at
org.apache.pulsar.client.admin.internal.http.AsyncHttpConnector.lambda$retryOperation$3(AsyncHttpConnector.java:251)
at
java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
at
java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
at
java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
at
java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
at
org.asynchttpclient.netty.NettyResponseFuture.loadContent(NettyResponseFuture.java:222)
at
org.asynchttpclient.netty.NettyResponseFuture.done(NettyResponseFuture.java:257)
at
org.asynchttpclient.netty.handler.AsyncHttpClientHandler.finishUpdate(AsyncHttpClientHandler.java:241)
at
org.asynchttpclient.netty.handler.HttpHandler.handleChunk(HttpHandler.java:114)
at
org.asynchttpclient.netty.handler.HttpHandler.handleRead(HttpHandler.java:143)
at
org.asynchttpclient.netty.handler.AsyncHttpClientHandler.channelRead(AsyncHttpClientHandler.java:78)
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at
io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at
io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103)
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at
io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at
io.netty.channel.CombinedChannelDuplexHandler$DelegatingChannelHandlerContext.fireChannelRead(CombinedChannelDuplexHandler.java:436)
at
io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:324)
at
io.netty.handler.codec.ByteToMessageDecoder.channelInputClosed(ByteToMessageDecoder.java:383)
at
io.netty.handler.codec.ByteToMessageDecoder.channelInactive(ByteToMessageDecoder.java:354)
at
io.netty.handler.codec.http.HttpClientCodec$Decoder.channelInactive(HttpClientCodec.java:311)
at
io.netty.channel.CombinedChannelDuplexHandler.channelInactive(CombinedChannelDuplexHandler.java:221)
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:262)
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:248)
at
io.netty.channel.AbstractChannelHandlerContext.fireChannelInactive(AbstractChannelHandlerContext.java:241)
at
io.netty.channel.DefaultChannelPipeline$HeadContext.channelInactive(DefaultChannelPipeline.java:1405)
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:262)
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:248)
at
io.netty.channel.DefaultChannelPipeline.fireChannelInactive(DefaultChannelPipeline.java:901)
at
io.netty.channel.AbstractChannel$AbstractUnsafe$8.run(AbstractChannel.java:818)
at
io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:164)
at
io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:472)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:497)
at
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
Caused by: javax.ws.rs.ServerErrorException: HTTP 502 Bad Gateway
at
org.glassfish.jersey.client.JerseyInvocation.createExceptionForFamily(JerseyInvocation.java:941)
at
org.glassfish.jersey.client.JerseyInvocation.convertToException(JerseyInvocation.java:921)
at
org.glassfish.jersey.client.JerseyInvocation.access$500(JerseyInvocation.java:77)
... 55 more
</pre></code>
</details>
[example failure
2021-01-30T02:26:30.7146760Z](https://github.com/apache/pulsar/runs/1795631678?check_suite_focus=true#step:13:24280)
<details>
<summary>Full exception stacktrace</summary>
<code><pre>
org.apache.pulsar.client.admin.PulsarAdminException$ServerSideErrorException:
HTTP 502 Bad Gateway
at
org.apache.pulsar.client.admin.internal.BaseResource.getApiException(BaseResource.java:205)
at
org.apache.pulsar.client.admin.internal.BaseResource$1.failed(BaseResource.java:129)
at
org.glassfish.jersey.client.JerseyInvocation$1.failed(JerseyInvocation.java:839)
at
org.glassfish.jersey.client.JerseyInvocation$1.completed(JerseyInvocation.java:820)
at
org.glassfish.jersey.client.ClientRuntime.processResponse(ClientRuntime.java:229)
at
org.glassfish.jersey.client.ClientRuntime.access$200(ClientRuntime.java:62)
at
org.glassfish.jersey.client.ClientRuntime$2.lambda$response$0(ClientRuntime.java:173)
at org.glassfish.jersey.internal.Errors$1.call(Errors.java:248)
at org.glassfish.jersey.internal.Errors$1.call(Errors.java:244)
at org.glassfish.jersey.internal.Errors.process(Errors.java:292)
at org.glassfish.jersey.internal.Errors.process(Errors.java:274)
at org.glassfish.jersey.internal.Errors.process(Errors.java:244)
at
org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:288)
at
org.glassfish.jersey.client.ClientRuntime$2.response(ClientRuntime.java:173)
at
org.apache.pulsar.client.admin.internal.http.AsyncHttpConnector.lambda$apply$1(AsyncHttpConnector.java:210)
at
java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
at
java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
at
java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
at
java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
at
org.apache.pulsar.client.admin.internal.http.AsyncHttpConnector.lambda$retryOperation$3(AsyncHttpConnector.java:251)
at
java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
at
java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
at
java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
at
java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
at
org.asynchttpclient.netty.NettyResponseFuture.loadContent(NettyResponseFuture.java:222)
at
org.asynchttpclient.netty.NettyResponseFuture.done(NettyResponseFuture.java:257)
at
org.asynchttpclient.netty.handler.AsyncHttpClientHandler.finishUpdate(AsyncHttpClientHandler.java:241)
at
org.asynchttpclient.netty.handler.HttpHandler.handleChunk(HttpHandler.java:114)
at
org.asynchttpclient.netty.handler.HttpHandler.handleRead(HttpHandler.java:143)
at
org.asynchttpclient.netty.handler.AsyncHttpClientHandler.channelRead(AsyncHttpClientHandler.java:78)
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at
io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at
io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103)
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at
io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at
io.netty.channel.CombinedChannelDuplexHandler$DelegatingChannelHandlerContext.fireChannelRead(CombinedChannelDuplexHandler.java:436)
at
io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:324)
at
io.netty.handler.codec.ByteToMessageDecoder.channelInputClosed(ByteToMessageDecoder.java:383)
at
io.netty.handler.codec.ByteToMessageDecoder.channelInactive(ByteToMessageDecoder.java:354)
at
io.netty.handler.codec.http.HttpClientCodec$Decoder.channelInactive(HttpClientCodec.java:311)
at
io.netty.channel.CombinedChannelDuplexHandler.channelInactive(CombinedChannelDuplexHandler.java:221)
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:262)
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:248)
at
io.netty.channel.AbstractChannelHandlerContext.fireChannelInactive(AbstractChannelHandlerContext.java:241)
at
io.netty.channel.DefaultChannelPipeline$HeadContext.channelInactive(DefaultChannelPipeline.java:1405)
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:262)
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:248)
at
io.netty.channel.DefaultChannelPipeline.fireChannelInactive(DefaultChannelPipeline.java:901)
at
io.netty.channel.AbstractChannel$AbstractUnsafe$8.run(AbstractChannel.java:818)
at
io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:164)
at
io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:472)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:497)
at
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
Caused by: javax.ws.rs.ServerErrorException: HTTP 502 Bad Gateway
at
org.glassfish.jersey.client.JerseyInvocation.createExceptionForFamily(JerseyInvocation.java:941)
at
org.glassfish.jersey.client.JerseyInvocation.convertToException(JerseyInvocation.java:921)
at
org.glassfish.jersey.client.JerseyInvocation.access$500(JerseyInvocation.java:77)
... 55 more
02:26:22.699
[docker-java-stream--1705812860:org.apache.pulsar.tests.integration.containers.ChaosContainer$1@82]
INFO org.apache.pulsar.tests.integration.containers.ChaosContainer -
2021-01-30 02:26:22,696 INFO success: broker entered RUNNING state, process has
stayed up for > than 1 seconds (startsecs)
02:26:23.230
[docker-java-stream-585686204:org.apache.pulsar.tests.integration.utils.DockerUtils$2@221]
INFO org.apache.pulsar.tests.integration.utils.DockerUtils -
DOCKER.exec(PulsarFunctionsProcessTest-qhxlj-pulsar-functions-worker-process-gdowa-0:/pulsar/bin/pulsar-admin
functions localrun --broker-service-url pulsar://pulsar-broker-0:6650 --tenant
public --namespace default --name localRunTest --className
exclamation_function.ExclamationFunction --inputs
persistent://public/default/test-function-local-run-PYTHON-input-defkxkby
--output test-function-local-run-PYTHON-output-goncqvke --py
/pulsar/examples/python-examples/exclamation_function.py): STDOUT: 02:26:23.228
[function-timer-thread-3-1] ERROR
org.apache.pulsar.functions.runtime.process.ProcessRuntime - Extracted Process
death exception
java.lang.RuntimeException:
at
org.apache.pulsar.functions.runtime.process.ProcessRuntime.tryExtractingDeathException(ProcessRuntime.java:388)
~[org.apache.pulsar-pulsar-functions-runtime-2.8.0-SNAPSHOT.jar:2.8.0-SNAPSHOT]
at
org.apache.pulsar.functions.runtime.process.ProcessRuntime.isAlive(ProcessRuntime.java:375)
~[org.apache.pulsar-pulsar-functions-runtime-2.8.0-SNAPSHOT.jar:2.8.0-SNAPSHOT]
at
org.apache.pulsar.functions.runtime.RuntimeSpawner.lambda$start$0(RuntimeSpawner.java:86)
~[org.apache.pulsar-pulsar-functions-runtime-2.8.0-SNAPSHOT.jar:2.8.0-SNAPSHOT]
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[?:1.8.0_282]
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
[?:1.8.0_282]
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
[?:1.8.0_282
02:26:23.230
[docker-java-stream-585686204:org.apache.pulsar.tests.integration.utils.DockerUtils$2@221]
INFO org.apache.pulsar.tests.integration.utils.DockerUtils -
DOCKER.exec(PulsarFunctionsProcessTest-qhxlj-pulsar-functions-worker-process-gdowa-0:/pulsar/bin/pulsar-admin
functions localrun --broker-service-url pulsar://pulsar-broker-0:6650 --tenant
public --namespace default --name localRunTest --className
exclamation_function.ExclamationFunction --inputs
persistent://public/default/test-function-local-run-PYTHON-input-defkxkby
--output test-function-local-run-PYTHON-output-goncqvke --py
/pulsar/examples/python-examples/exclamation_function.py): STDOUT: ]
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
[?:1.8.0_282]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[?:1.8.0_282]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[?:1.8.0_282]
at
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
[io.netty-netty-common-4.1.51.Final.jar:4.1.51.Final]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_282]
02:26:23.228 [function-timer-thread-3-1] ERROR
org.apache.pulsar.functions.runtime.RuntimeSpawner -
public/default/localRunTest-java.lang.RuntimeException: Function Container is
dead with exception.. restarting
02:26:23.256
[docker-java-stream-585686204:org.apache.pulsar.tests.integration.utils.DockerUtils$2@221]
INFO org.apache.pulsar.tests.integration.utils.DockerUtils -
DOCKER.exec(PulsarFunctionsProcessTest-qhxlj-pulsar-functions-worker-process-gdowa-0:/pulsar/bin/pulsar-admin
functions localrun --broker-service-url pulsar://pulsar-broker-0:6650 --tenant
public --namespace default --name localRunTest --className
exclamation_function.ExclamationFunction --inputs
persistent://public/default/test-function-local-run-PYTHON-input-defkxkby
--output test-function-local-run-PYTHON-output-goncqvke --py
/pulsar/examples/python-examples/exclamation_function.py): STDOUT: 02:26:23.254
[function-timer-thread-3-1] INFO
org.apache.pulsar.functions.runtime.process.ProcessRuntime - Creating function
log directory /pulsar/logs/functions/public/default/localRunTest
02:26:23.254 [function-timer-thread-3-1] INFO
org.apache.pulsar.functions.runtime.process.ProcessRuntime - Created or found
function log directory /pulsar/logs/functions/public/default/localRunTest
02:26:23.254 [function-timer-thread-3-1] INFO
org.apache.pulsar.functions.runtime.process.ProcessRuntime - ProcessBuilder
starting the process with args python
/pulsar/instances/python-instance/python_instance_main.py --py
/pulsar/examples/python-examples/exclamation_function.py --logging_directory
/pulsar/logs/functions --logging_file localRunTest --logging_config_file
/pulsar/conf/functions-logging/logging_config.ini --instance_id 0 --function_id
72018aaf-e9b1-491a-b65f-6a3d111bd603 --function_version
87b0e0b0-5a0d-4d46-857a-62e545763377 --function_details
'{"tenant":"public","namespace":"default","name":"localRunTest","cla
02:26:23.257
[docker-java-stream-585686204:org.apache.pulsar.tests.integration.utils.DockerUtils$2@221]
INFO org.apache.pulsar.tests.integration.utils.DockerUtils -
DOCKER.exec(PulsarFunctionsProcessTest-qhxlj-pulsar-functions-worker-process-gdowa-0:/pulsar/bin/pulsar-admin
functions localrun --broker-service-url pulsar://pulsar-broker-0:6650 --tenant
public --namespace default --name localRunTest --className
exclamation_function.ExclamationFunction --inputs
persistent://public/default/test-function-local-run-PYTHON-input-defkxkby
--output test-function-local-run-PYTHON-output-goncqvke --py
/pulsar/examples/python-examples/exclamation_function.py): STDOUT:
ssName":"exclamation_function.ExclamationFunction","runtime":"PYTHON","autoAck":true,"parallelism":1,"source":{"inputSpecs":{"persistent://public/default/test-function-local-run-PYTHON-input-defkxkby":{}},"cleanupSubscription":true},"sink":{"topic":"test-function-local-run-PYTHON-output-goncqvke","forwardSourceMessageProperty":
true},"resources":{"cpu":1.0,"ram":"1073741824","disk":"10737418240"},"componentType":"FUNCTION"}'
--pulsar_serviceurl pulsar://pulsar-broker-0:6650 --use_tls false
--tls_allow_insecure false --hostname_verification_enabled false
--max_buffered_tuples 1024 --port 39577 --metrics_port 36073
--expected_healthcheck_interval 30 --secrets_provider
secretsprovider.ClearTextSecretsProvider --cluster_name local
02:26:23.258
[docker-java-stream-585686204:org.apache.pulsar.tests.integration.utils.DockerUtils$2@221]
INFO org.apache.pulsar.tests.integration.utils.DockerUtils -
DOCKER.exec(PulsarFunctionsProcessTest-qhxlj-pulsar-functions-worker-process-gdowa-0:/pulsar/bin/pulsar-admin
functions localrun --broker-service-url pulsar://pulsar-broker-0:6650 --tenant
public --namespace default --name localRunTest --className
exclamation_function.ExclamationFunction --inputs
persistent://public/default/test-function-local-run-PYTHON-input-defkxkby
--output test-function-local-run-PYTHON-output-goncqvke --py
/pulsar/examples/python-examples/exclamation_function.py): STDOUT: 02:26:23.257
[function-timer-thread-3-1] INFO
org.apache.pulsar.functions.runtime.process.ProcessRuntime - Started process
successfully
02:26:23.261
[docker-java-stream-585686204:org.apache.pulsar.tests.integration.utils.DockerUtils$2@221]
INFO org.apache.pulsar.tests.integration.utils.DockerUtils -
DOCKER.exec(PulsarFunctionsProcessTest-qhxlj-pulsar-functions-worker-process-gdowa-0:/pulsar/bin/pulsar-admin
functions localrun --broker-service-url pulsar://pulsar-broker-0:6650 --tenant
public --namespace default --name localRunTest --className
exclamation_function.ExclamationFunction --inputs
persistent://public/default/test-function-local-run-PYTHON-input-defkxkby
--output test-function-local-run-PYTHON-output-goncqvke --py
/pulsar/examples/python-examples/exclamation_function.py): STDOUT: 02:26:23.260
[Timer-0] INFO org.apache.pulsar.functions.LocalRunner - {
"numRestarts": "2",
"instanceId": "0"
}
02:26:23.538
[docker-java-stream--2109383626:org.apache.pulsar.tests.integration.containers.ChaosContainer$1@82]
INFO org.apache.pulsar.tests.integration.containers.ChaosContainer -
2021-01-30 02:26:23,535 INFO success: broker entered RUNNING state, process has
stayed up for > than 1 seconds (startsecs)
02:26:23.549
[docker-java-stream-1855909964:org.apache.pulsar.tests.integration.utils.DockerUtils$2@221]
INFO org.apache.pulsar.tests.integration.utils.DockerUtils -
DOCKER.exec(PulsarFunctionsProcessTest-qhxlj-pulsar-functions-worker-process-gdowa-1:/pulsar/bin/pulsar-admin
functions localrun --broker-service-url pulsar://pulsar-broker-0:6650 --tenant
public --namespace default --name localRunTest --className
org.apache.pulsar.functions.api.examples.ExclamationFunction --inputs
persistent://public/default/test-function-local-run-JAVA-input-qdydxvjv
--output test-function-local-run-JAVA-output-qvwqdytr --jar
/pulsar/examples/java-test-functions.jar): STDOUT: 02:26:23.541
[pulsar-timer-5-1] INFO org.apache.pulsar.client.impl.ConnectionHandler -
[test-function-local-run-JAVA-output-qvwqdytr]
[PulsarFunctionsProcessTest-qhxlj-0-10] Reconnecting after connection was closed
02:26:23.558
[docker-java-stream-1855909964:org.apache.pulsar.tests.integration.utils.DockerUtils$2@221]
INFO org.apache.pulsar.tests.integration.utils.DockerUtils -
DOCKER.exec(PulsarFunctionsProcessTest-qhxlj-pulsar-functions-worker-process-gdowa-1:/pulsar/bin/pulsar-admin
functions localrun --broker-service-url pulsar://pulsar-broker-0:6650 --tenant
public --namespace default --name localRunTest --className
org.apache.pulsar.functions.api.examples.ExclamationFunction --inputs
persistent://public/default/test-function-local-run-JAVA-input-qdydxvjv
--output test-function-local-run-JAVA-output-qvwqdytr --jar
/pulsar/examples/java-test-functions.jar): STDOUT: 02:26:23.554
[pulsar-client-io-1-2] WARN org.apache.pulsar.client.impl.ConnectionPool -
Failed to open connection to pulsar-broker-0:6650 :
io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..)
failed: Connection refused: pulsar-broker-0/172.18.0.6:6650
02:26:23.558
[docker-java-stream-1855909964:org.apache.pulsar.tests.integration.utils.DockerUtils$2@221]
INFO org.apache.pulsar.tests.integration.utils.DockerUtils -
DOCKER.exec(PulsarFunctionsProcessTest-qhxlj-pulsar-functions-worker-process-gdowa-1:/pulsar/bin/pulsar-admin
functions localrun --broker-service-url pulsar://pulsar-broker-0:6650 --tenant
public --namespace default --name localRunTest --className
org.apache.pulsar.functions.api.examples.ExclamationFunction --inputs
persistent://public/default/test-function-local-run-JAVA-input-qdydxvjv
--output test-function-local-run-JAVA-output-qvwqdytr --jar
/pulsar/examples/java-test-functions.jar): STDOUT: 02:26:23.554
[pulsar-client-io-1-2] WARN org.apache.pulsar.client.impl.ConnectionHandler -
[test-function-local-run-JAVA-output-qvwqdytr]
[PulsarFunctionsProcessTest-qhxlj-0-10] Error connecting to broker:
org.apache.pulsar.client.api.PulsarClientException:
java.util.concurrent.CompletionException: io.netty.channel.AbstractC
hannel$AnnotatedConnectException: finishConnect(..) failed: Connection
refused: pulsar-broker-0/172.18.0.6:6650
02:26:23.558
[docker-java-stream-1855909964:org.apache.pulsar.tests.integration.utils.DockerUtils$2@221]
INFO org.apache.pulsar.tests.integration.utils.DockerUtils -
DOCKER.exec(PulsarFunctionsProcessTest-qhxlj-pulsar-functions-worker-process-gdowa-1:/pulsar/bin/pulsar-admin
functions localrun --broker-service-url pulsar://pulsar-broker-0:6650 --tenant
public --namespace default --name localRunTest --className
org.apache.pulsar.functions.api.examples.ExclamationFunction --inputs
persistent://public/default/test-function-local-run-JAVA-input-qdydxvjv
--output test-function-local-run-JAVA-output-qvwqdytr --jar
/pulsar/examples/java-test-functions.jar): STDOUT: 02:26:23.554
[pulsar-client-io-1-2] WARN org.apache.pulsar.client.impl.ConnectionHandler -
[test-function-local-run-JAVA-output-qvwqdytr]
[PulsarFunctionsProcessTest-qhxlj-0-10] Could not get connection to broker:
org.apache.pulsar.client.api.PulsarClientException:
java.util.concurrent.CompletionException: io.netty.channel.A
bstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection
refused: pulsar-broker-0/172.18.0.6:6650 -- Will try again in 2.943 s
02:26:23.573
[docker-java-stream-1855909964:org.apache.pulsar.tests.integration.utils.DockerUtils$2@221]
INFO org.apache.pulsar.tests.integration.utils.DockerUtils -
DOCKER.exec(PulsarFunctionsProcessTest-qhxlj-pulsar-functions-worker-process-gdowa-1:/pulsar/bin/pulsar-admin
functions localrun --broker-service-url pulsar://pulsar-broker-0:6650 --tenant
public --namespace default --name localRunTest --className
org.apache.pulsar.functions.api.examples.ExclamationFunction --inputs
persistent://public/default/test-function-local-run-JAVA-input-qdydxvjv
--output test-function-local-run-JAVA-output-qvwqdytr --jar
/pulsar/examples/java-test-functions.jar): STDOUT: 02:26:23.566
[pulsar-timer-5-1] INFO org.apache.pulsar.client.impl.ConnectionHandler -
[persistent://public/default/test-function-local-run-JAVA-input-qdydxvjv]
[public/default/localRunTest] Reconnecting after connection was closed
02:26:23.573
[docker-java-stream-1855909964:org.apache.pulsar.tests.integration.utils.DockerUtils$2@221]
INFO org.apache.pulsar.tests.integration.utils.DockerUtils -
DOCKER.exec(PulsarFunctionsProcessTest-qhxlj-pulsar-functions-worker-process-gdowa-1:/pulsar/bin/pulsar-admin
functions localrun --broker-service-url pulsar://pulsar-broker-0:6650 --tenant
public --namespace default --name localRunTest --className
org.apache.pulsar.functions.api.examples.ExclamationFunction --inputs
persistent://public/default/test-function-local-run-JAVA-input-qdydxvjv
--output test-function-local-run-JAVA-output-qvwqdytr --jar
/pulsar/examples/java-test-functions.jar): STDOUT: 02:26:23.570
[pulsar-client-io-1-2] WARN org.apache.pulsar.client.impl.ConnectionPool -
Failed to open connection to pulsar-broker-0:6650 :
io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..)
failed: Connection refused: pulsar-broker-0/172.18.0.6:6650
02:26:23.573
[docker-java-stream-1855909964:org.apache.pulsar.tests.integration.utils.DockerUtils$2@221]
INFO org.apache.pulsar.tests.integration.utils.DockerUtils -
DOCKER.exec(PulsarFunctionsProcessTest-qhxlj-pulsar-functions-worker-process-gdowa-1:/pulsar/bin/pulsar-admin
functions localrun --broker-service-url pulsar://pulsar-broker-0:6650 --tenant
public --namespace default --name localRunTest --className
org.apache.pulsar.functions.api.examples.ExclamationFunction --inputs
persistent://public/default/test-function-local-run-JAVA-input-qdydxvjv
--output test-function-local-run-JAVA-output-qvwqdytr --jar
/pulsar/examples/java-test-functions.jar): STDOUT: 02:26:23.570
[pulsar-client-io-1-2] WARN org.apache.pulsar.client.impl.ConnectionHandler -
[persistent://public/default/test-function-local-run-JAVA-input-qdydxvjv]
[public/default/localRunTest] Error connecting to broker:
org.apache.pulsar.client.api.PulsarClientException:
java.util.concurrent.CompletionException: io.netty.
channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed:
Connection refused: pulsar-broker-0/172.18.0.6:6650
02:26:23.573
[docker-java-stream-1855909964:org.apache.pulsar.tests.integration.utils.DockerUtils$2@221]
INFO org.apache.pulsar.tests.integration.utils.DockerUtils -
DOCKER.exec(PulsarFunctionsProcessTest-qhxlj-pulsar-functions-worker-process-gdowa-1:/pulsar/bin/pulsar-admin
functions localrun --broker-service-url pulsar://pulsar-broker-0:6650 --tenant
public --namespace default --name localRunTest --className
org.apache.pulsar.functions.api.examples.ExclamationFunction --inputs
persistent://public/default/test-function-local-run-JAVA-input-qdydxvjv
--output test-function-local-run-JAVA-output-qvwqdytr --jar
/pulsar/examples/java-test-functions.jar): STDOUT: 02:26:23.571
[pulsar-client-io-1-2] WARN org.apache.pulsar.client.impl.ConnectionHandler -
[persistent://public/default/test-function-local-run-JAVA-input-qdydxvjv]
[public/default/localRunTest] Could not get connection to broker:
org.apache.pulsar.client.api.PulsarClientException:
java.util.concurrent.CompletionException: i
o.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..)
failed: Connection refused: pulsar-broker-0/172.18.0.6:6650 -- Will try again
in 3.079 s
02:26:23.680
[docker-java-stream--145340668:org.apache.pulsar.tests.integration.utils.DockerUtils$2@221]
INFO org.apache.pulsar.tests.integration.utils.DockerUtils -
DOCKER.exec(PulsarFunctionsProcessTest-qhxlj-pulsar-broker-0:tail -f
/var/log/pulsar/broker.log): STDOUT: [AppClassLoader@18b4aac2] info AspectJ
Weaver Version 1.9.2 built on Wednesday Oct 24, 2018 at 15:43:33 GMT
</pre></code>
</details>
```
org.apache.pulsar.client.admin.PulsarAdminException$ServerSideErrorException:
HTTP 502 Bad Gateway
at
org.apache.pulsar.client.admin.internal.BaseResource.getApiException(BaseResource.java:207)
at
org.apache.pulsar.client.admin.internal.BaseResource$1.failed(BaseResource.java:131)
at
org.glassfish.jersey.client.JerseyInvocation$1.failed(JerseyInvocation.java:839)
at
org.glassfish.jersey.client.JerseyInvocation$1.completed(JerseyInvocation.java:820)
at
org.glassfish.jersey.client.ClientRuntime.processResponse(ClientRuntime.java:229)
at
org.glassfish.jersey.client.ClientRuntime.access$200(ClientRuntime.java:62)
at
org.glassfish.jersey.client.ClientRuntime$2.lambda$response$0(ClientRuntime.java:173)
at org.glassfish.jersey.internal.Errors$1.call(Errors.java:248)
at org.glassfish.jersey.internal.Errors$1.call(Errors.java:244)
at org.glassfish.jersey.internal.Errors.process(Errors.java:292)
at org.glassfish.jersey.internal.Errors.process(Errors.java:274)
at org.glassfish.jersey.internal.Errors.process(Errors.java:244)
at
org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:288)
at
org.glassfish.jersey.client.ClientRuntime$2.response(ClientRuntime.java:173)
```
Usage tip: To enable automatic navigation to failure message, open the
following links with CTRL/CMD-click.
[example failure
2021-01-13T23:36:56.3767235Z](https://github.com/apache/pulsar/runs/1698382464?check_suite_focus=true#step:13:1009)
[example failure
2021-01-13T23:36:56.3453305Z](https://github.com/apache/pulsar/runs/1698382464?check_suite_focus=true#step:13:943)
<details>
<summary>Full exception stacktrace</summary>
<code><pre>
org.apache.pulsar.client.admin.PulsarAdminException$ServerSideErrorException:
HTTP 502 Bad Gateway
at
org.apache.pulsar.client.admin.internal.BaseResource.getApiException(BaseResource.java:207)
at
org.apache.pulsar.client.admin.internal.BaseResource$1.failed(BaseResource.java:131)
at
org.glassfish.jersey.client.JerseyInvocation$1.failed(JerseyInvocation.java:839)
at
org.glassfish.jersey.client.JerseyInvocation$1.completed(JerseyInvocation.java:820)
at
org.glassfish.jersey.client.ClientRuntime.processResponse(ClientRuntime.java:229)
at
org.glassfish.jersey.client.ClientRuntime.access$200(ClientRuntime.java:62)
at
org.glassfish.jersey.client.ClientRuntime$2.lambda$response$0(ClientRuntime.java:173)
at org.glassfish.jersey.internal.Errors$1.call(Errors.java:248)
at org.glassfish.jersey.internal.Errors$1.call(Errors.java:244)
at org.glassfish.jersey.internal.Errors.process(Errors.java:292)
at org.glassfish.jersey.internal.Errors.process(Errors.java:274)
at org.glassfish.jersey.internal.Errors.process(Errors.java:244)
at
org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:288)
at
org.glassfish.jersey.client.ClientRuntime$2.response(ClientRuntime.java:173)
at
org.apache.pulsar.client.admin.internal.http.AsyncHttpConnector.lambda$apply$1(AsyncHttpConnector.java:210)
at
java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
at
java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
at
java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
at
java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
at
org.apache.pulsar.client.admin.internal.http.AsyncHttpConnector.lambda$retryOperation$3(AsyncHttpConnector.java:251)
at
java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
at
java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
at
java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
at
java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
at
org.asynchttpclient.netty.NettyResponseFuture.loadContent(NettyResponseFuture.java:222)
at
org.asynchttpclient.netty.NettyResponseFuture.done(NettyResponseFuture.java:257)
at
org.asynchttpclient.netty.handler.AsyncHttpClientHandler.finishUpdate(AsyncHttpClientHandler.java:241)
at
org.asynchttpclient.netty.handler.HttpHandler.handleChunk(HttpHandler.java:114)
at
org.asynchttpclient.netty.handler.HttpHandler.handleRead(HttpHandler.java:143)
at
org.asynchttpclient.netty.handler.AsyncHttpClientHandler.channelRead(AsyncHttpClientHandler.java:78)
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at
io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at
io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103)
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at
io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at
io.netty.channel.CombinedChannelDuplexHandler$DelegatingChannelHandlerContext.fireChannelRead(CombinedChannelDuplexHandler.java:436)
at
io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:324)
at
io.netty.handler.codec.ByteToMessageDecoder.channelInputClosed(ByteToMessageDecoder.java:383)
at
io.netty.handler.codec.ByteToMessageDecoder.channelInactive(ByteToMessageDecoder.java:354)
at
io.netty.handler.codec.http.HttpClientCodec$Decoder.channelInactive(HttpClientCodec.java:311)
at
io.netty.channel.CombinedChannelDuplexHandler.channelInactive(CombinedChannelDuplexHandler.java:221)
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:262)
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:248)
at
io.netty.channel.AbstractChannelHandlerContext.fireChannelInactive(AbstractChannelHandlerContext.java:241)
at
io.netty.channel.DefaultChannelPipeline$HeadContext.channelInactive(DefaultChannelPipeline.java:1405)
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:262)
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:248)
at
io.netty.channel.DefaultChannelPipeline.fireChannelInactive(DefaultChannelPipeline.java:901)
at
io.netty.channel.AbstractChannel$AbstractUnsafe$8.run(AbstractChannel.java:818)
at
io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:164)
at
io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:472)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:497)
at
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
Caused by: javax.ws.rs.ServerErrorException: HTTP 502 Bad Gateway
at
org.glassfish.jersey.client.JerseyInvocation.createExceptionForFamily(JerseyInvocation.java:941)
at
org.glassfish.jersey.client.JerseyInvocation.convertToException(JerseyInvocation.java:921)
at
org.glassfish.jersey.client.JerseyInvocation.access$500(JerseyInvocation.java:77)
... 55 more
</pre></code>
</details>
[example failure
2020-12-04T02:22:03.9080570Z](https://github.com/apache/pulsar/runs/1496303240?check_suite_focus=true#step:14:706)
[example failure
2020-12-04T02:22:03.8900090Z](https://github.com/apache/pulsar/runs/1496303240?check_suite_focus=true#step:14:640)
[example failure
2020-12-04T02:22:03.8602668Z](https://github.com/apache/pulsar/runs/1496303240?check_suite_focus=true#step:14:574)
<details>
<summary>Full exception stacktrace</summary>
<code><pre>
org.apache.pulsar.client.admin.PulsarAdminException$ServerSideErrorException:
HTTP 502 Bad Gateway
at
org.apache.pulsar.client.admin.internal.BaseResource.getApiException(BaseResource.java:207)
at
org.apache.pulsar.client.admin.internal.BaseResource$1.failed(BaseResource.java:131)
at
org.glassfish.jersey.client.JerseyInvocation$1.failed(JerseyInvocation.java:839)
at
org.glassfish.jersey.client.JerseyInvocation$1.completed(JerseyInvocation.java:820)
at
org.glassfish.jersey.client.ClientRuntime.processResponse(ClientRuntime.java:229)
at
org.glassfish.jersey.client.ClientRuntime.access$200(ClientRuntime.java:62)
at
org.glassfish.jersey.client.ClientRuntime$2.lambda$response$0(ClientRuntime.java:173)
at org.glassfish.jersey.internal.Errors$1.call(Errors.java:248)
at org.glassfish.jersey.internal.Errors$1.call(Errors.java:244)
at org.glassfish.jersey.internal.Errors.process(Errors.java:292)
at org.glassfish.jersey.internal.Errors.process(Errors.java:274)
at org.glassfish.jersey.internal.Errors.process(Errors.java:244)
at
org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:288)
at
org.glassfish.jersey.client.ClientRuntime$2.response(ClientRuntime.java:173)
at
org.apache.pulsar.client.admin.internal.http.AsyncHttpConnector.lambda$apply$1(AsyncHttpConnector.java:208)
at
java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
at
java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
at
java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
at
java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
at
org.apache.pulsar.client.admin.internal.http.AsyncHttpConnector.lambda$retryOperation$3(AsyncHttpConnector.java:249)
at
java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
at
java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
at
java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
at
java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
at
org.asynchttpclient.netty.NettyResponseFuture.loadContent(NettyResponseFuture.java:222)
at
org.asynchttpclient.netty.NettyResponseFuture.done(NettyResponseFuture.java:257)
at
org.asynchttpclient.netty.handler.AsyncHttpClientHandler.finishUpdate(AsyncHttpClientHandler.java:241)
at
org.asynchttpclient.netty.handler.HttpHandler.handleChunk(HttpHandler.java:114)
at
org.asynchttpclient.netty.handler.HttpHandler.handleRead(HttpHandler.java:143)
at
org.asynchttpclient.netty.handler.AsyncHttpClientHandler.channelRead(AsyncHttpClientHandler.java:78)
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at
io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at
io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103)
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at
io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at
io.netty.channel.CombinedChannelDuplexHandler$DelegatingChannelHandlerContext.fireChannelRead(CombinedChannelDuplexHandler.java:436)
at
io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:324)
at
io.netty.handler.codec.ByteToMessageDecoder.channelInputClosed(ByteToMessageDecoder.java:383)
at
io.netty.handler.codec.ByteToMessageDecoder.channelInactive(ByteToMessageDecoder.java:354)
at
io.netty.handler.codec.http.HttpClientCodec$Decoder.channelInactive(HttpClientCodec.java:311)
at
io.netty.channel.CombinedChannelDuplexHandler.channelInactive(CombinedChannelDuplexHandler.java:221)
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:262)
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:248)
at
io.netty.channel.AbstractChannelHandlerContext.fireChannelInactive(AbstractChannelHandlerContext.java:241)
at
io.netty.channel.DefaultChannelPipeline$HeadContext.channelInactive(DefaultChannelPipeline.java:1405)
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:262)
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:248)
at
io.netty.channel.DefaultChannelPipeline.fireChannelInactive(DefaultChannelPipeline.java:901)
at
io.netty.channel.AbstractChannel$AbstractUnsafe$8.run(AbstractChannel.java:818)
at
io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:164)
at
io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:472)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:497)
at
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
Caused by: javax.ws.rs.ServerErrorException: HTTP 502 Bad Gateway
at
org.glassfish.jersey.client.JerseyInvocation.createExceptionForFamily(JerseyInvocation.java:941)
at
org.glassfish.jersey.client.JerseyInvocation.convertToException(JerseyInvocation.java:921)
at
org.glassfish.jersey.client.JerseyInvocation.access$500(JerseyInvocation.java:77)
... 55 more
</pre></code>
</details>
```
org.apache.pulsar.client.admin.PulsarAdminException$ServerSideErrorException:
HTTP 500 Internal Server Error
at
org.apache.pulsar.client.admin.internal.BaseResource.getApiException(BaseResource.java:205)
at
org.apache.pulsar.client.admin.internal.BaseResource$1.failed(BaseResource.java:129)
at
org.glassfish.jersey.client.JerseyInvocation$1.failed(JerseyInvocation.java:839)
at
org.glassfish.jersey.client.JerseyInvocation$1.completed(JerseyInvocation.java:820)
at
org.glassfish.jersey.client.ClientRuntime.processResponse(ClientRuntime.java:229)
at
org.glassfish.jersey.client.ClientRuntime.access$200(ClientRuntime.java:62)
at
org.glassfish.jersey.client.ClientRuntime$2.lambda$response$0(ClientRuntime.java:173)
at org.glassfish.jersey.internal.Errors$1.call(Errors.java:248)
at org.glassfish.jersey.internal.Errors$1.call(Errors.java:244)
at org.glassfish.jersey.internal.Errors.process(Errors.java:292)
at org.glassfish.jersey.internal.Errors.process(Errors.java:274)
at org.glassfish.jersey.internal.Errors.process(Errors.java:244)
at
org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:288)
at
org.glassfish.jersey.client.ClientRuntime$2.response(ClientRuntime.java:173)
```
Usage tip: To enable automatic navigation to failure message, open the
following links with CTRL/CMD-click.
[example failure
2021-01-25T23:34:18.9377215Z](https://github.com/apache/pulsar/runs/1762435763?check_suite_focus=true#step:12:31480)
[example failure
2021-01-25T23:34:18.9105823Z](https://github.com/apache/pulsar/runs/1762435763?check_suite_focus=true#step:12:31416)
<details>
<summary>Full exception stacktrace</summary>
<code><pre>
org.apache.pulsar.client.admin.PulsarAdminException$ServerSideErrorException:
HTTP 500 Internal Server Error
at
org.apache.pulsar.client.admin.internal.BaseResource.getApiException(BaseResource.java:205)
at
org.apache.pulsar.client.admin.internal.BaseResource$1.failed(BaseResource.java:129)
at
org.glassfish.jersey.client.JerseyInvocation$1.failed(JerseyInvocation.java:839)
at
org.glassfish.jersey.client.JerseyInvocation$1.completed(JerseyInvocation.java:820)
at
org.glassfish.jersey.client.ClientRuntime.processResponse(ClientRuntime.java:229)
at
org.glassfish.jersey.client.ClientRuntime.access$200(ClientRuntime.java:62)
at
org.glassfish.jersey.client.ClientRuntime$2.lambda$response$0(ClientRuntime.java:173)
at org.glassfish.jersey.internal.Errors$1.call(Errors.java:248)
at org.glassfish.jersey.internal.Errors$1.call(Errors.java:244)
at org.glassfish.jersey.internal.Errors.process(Errors.java:292)
at org.glassfish.jersey.internal.Errors.process(Errors.java:274)
at org.glassfish.jersey.internal.Errors.process(Errors.java:244)
at
org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:288)
at
org.glassfish.jersey.client.ClientRuntime$2.response(ClientRuntime.java:173)
at
org.apache.pulsar.client.admin.internal.http.AsyncHttpConnector.lambda$apply$1(AsyncHttpConnector.java:210)
at
java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
at
java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
at
java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
at
java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
at
org.apache.pulsar.client.admin.internal.http.AsyncHttpConnector.lambda$retryOperation$3(AsyncHttpConnector.java:251)
at
java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
at
java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
at
java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
at
java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
at
org.asynchttpclient.netty.NettyResponseFuture.loadContent(NettyResponseFuture.java:222)
at
org.asynchttpclient.netty.NettyResponseFuture.done(NettyResponseFuture.java:257)
at
org.asynchttpclient.netty.handler.AsyncHttpClientHandler.finishUpdate(AsyncHttpClientHandler.java:241)
at
org.asynchttpclient.netty.handler.HttpHandler.handleChunk(HttpHandler.java:114)
at
org.asynchttpclient.netty.handler.HttpHandler.handleRead(HttpHandler.java:143)
at
org.asynchttpclient.netty.handler.AsyncHttpClientHandler.channelRead(AsyncHttpClientHandler.java:78)
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at
io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at
io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103)
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at
io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at
io.netty.channel.CombinedChannelDuplexHandler$DelegatingChannelHandlerContext.fireChannelRead(CombinedChannelDuplexHandler.java:436)
at
io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:324)
at
io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:296)
at
io.netty.channel.CombinedChannelDuplexHandler.channelRead(CombinedChannelDuplexHandler.java:251)
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at
io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at
io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at
io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at
io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at
io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at
io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at
io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
Caused by: javax.ws.rs.InternalServerErrorException: HTTP 500 Internal
Server Error
at
org.glassfish.jersey.client.JerseyInvocation.convertToException(JerseyInvocation.java:914)
at
org.glassfish.jersey.client.JerseyInvocation.access$500(JerseyInvocation.java:77)
... 54 more
</pre></code>
</details>
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
