2019-12-02 01:44:02 UTC - Jorge Miralles: Hi, I’m new to pulsar and I can’t
find why I’m getting this error when producing a message in a partitioned topic
using pulsar-client (pulsar-2.4.1)
----
2019-12-02 01:44:02 UTC - Jorge Miralles: ```01:33:06.790
[pulsar-client-io-1-1] INFO org.apache.pulsar.client.impl.ConnectionPool -
[[id: 0x386cad05, L:/127.0.0.1:57372 - R:localhost/127.0.0.1:6650]] Connected
to server
01:33:06.956 [pulsar-client-io-1-1] INFO
org.apache.pulsar.client.impl.ProducerStatsRecorderImpl - Starting Pulsar
producer perf with config: {
"topicName" : "<persistent://public/default/stage02-test-7-partition-1>",
"producerName" : null,
"sendTimeoutMs" : 30000,
"blockIfQueueFull" : false,
"maxPendingMessages" : 1000,
"maxPendingMessagesAcrossPartitions" : 50000,
"messageRoutingMode" : "RoundRobinPartition",
"hashingScheme" : "JavaStringHash",
"cryptoFailureAction" : "FAIL",
"batchingMaxPublishDelayMicros" : 1000,
"batchingMaxMessages" : 1000,
"batchingEnabled" : true,
"compressionType" : "NONE",
"initialSequenceId" : null,
"autoUpdatePartitions" : true,
"properties" : { }
}
01:33:06.961 [pulsar-client-io-1-1] INFO
org.apache.pulsar.client.impl.ProducerStatsRecorderImpl - Pulsar client config:
{
"serviceUrl" : "<pulsar://localhost:6650/>",
"authPluginClassName" : null,
"authParams" : null,
"operationTimeoutMs" : 30000,
"statsIntervalSeconds" : 60,
"numIoThreads" : 1,
"numListenerThreads" : 1,
"connectionsPerBroker" : 1,
"useTcpNoDelay" : true,
"useTls" : false,
"tlsTrustCertsFilePath" : "",
"tlsAllowInsecureConnection" : false,
"tlsHostnameVerificationEnable" : false,
"concurrentLookupRequest" : 5000,
"maxLookupRequest" : 50000,
"maxNumberOfRejectedRequestPerConnection" : 50,
"keepAliveIntervalSeconds" : 30,
"connectionTimeoutMs" : 10000,
"requestTimeoutMs" : 60000,
"defaultBackoffIntervalNanos" : 100000000,
"maxBackoffIntervalNanos" : 30000000000
}
01:33:07.003 [pulsar-client-io-1-1] INFO
org.apache.pulsar.client.impl.ConnectionPool - [[id: 0xae1fcc9b,
L:/10.64.167.155:59948 - R:ip-10-64-167-50.ec2.internal/10.64.167.50:6650]]
Connected to server
01:33:07.005 [pulsar-client-io-1-1] INFO
org.apache.pulsar.client.impl.ProducerImpl -
[<persistent://public/default/stage02-test-7-partition-1>] [null] Creating
producer on cnx [id: 0xae1fcc9b, L:/10.64.167.155:59948 -
R:ip-10-64-167-50.ec2.internal/10.64.167.50:6650]
01:33:07.015 [pulsar-client-io-1-1] WARN
org.apache.pulsar.client.impl.ClientCnx - [id: 0xae1fcc9b,
L:/10.64.167.155:59948 - R:ip-10-64-167-50.ec2.internal/10.64.167.50:6650]
Received error from server: No value present
01:33:07.017 [pulsar-client-io-1-1] ERROR
org.apache.pulsar.client.impl.ProducerImpl -
[<persistent://public/default/stage02-test-7-partition-1>] [null] Failed to
create producer: No value present
01:33:07.018 [main] ERROR org.apache.pulsar.client.cli.PulsarClientTool - Error
while producing messages
01:33:07.018 [main] ERROR org.apache.pulsar.client.cli.PulsarClientTool -
java.util.concurrent.ExecutionException:
org.apache.pulsar.client.api.PulsarClientException: No value present
org.apache.pulsar.client.api.PulsarClientException:
java.util.concurrent.ExecutionException:
org.apache.pulsar.client.api.PulsarClientException: No value present
at
org.apache.pulsar.client.api.PulsarClientException.unwrap(PulsarClientException.java:297)
~[org.apache.pulsar-pulsar-client-api-2.4.1.jar:2.4.1]
at
org.apache.pulsar.client.impl.ProducerBuilderImpl.create(ProducerBuilderImpl.java:88)
~[org.apache.pulsar-pulsar-client-original-2.4.1.jar:2.4.1]
at org.apache.pulsar.client.cli.CmdProduce.publish(CmdProduce.java:179)
[org.apache.pulsar-pulsar-client-tools-2.4.1.jar:2.4.1]
at org.apache.pulsar.client.cli.CmdProduce.run(CmdProduce.java:169)
[org.apache.pulsar-pulsar-client-tools-2.4.1.jar:2.4.1]
at
org.apache.pulsar.client.cli.PulsarClientTool.run(PulsarClientTool.java:131)
[org.apache.pulsar-pulsar-client-tools-2.4.1.jar:2.4.1]
at
org.apache.pulsar.client.cli.PulsarClientTool.main(PulsarClientTool.java:165)
[org.apache.pulsar-pulsar-client-tools-2.4.1.jar:2.4.1]
Caused by: java.util.concurrent.ExecutionException:
org.apache.pulsar.client.api.PulsarClientException: No value present
at
java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357)
~[?:1.8.0_232]
at
java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1908)
~[?:1.8.0_232]
at
org.apache.pulsar.client.impl.ProducerBuilderImpl.create(ProducerBuilderImpl.java:86)
~[org.apache.pulsar-pulsar-client-original-2.4.1.jar:2.4.1]
... 4 more
Caused by: org.apache.pulsar.client.api.PulsarClientException: No value present
at
org.apache.pulsar.client.impl.ClientCnx.getPulsarClientException(ClientCnx.java:916)
~[org.apache.pulsar-pulsar-client-original-2.4.1.jar:2.4.1]
at
org.apache.pulsar.client.impl.ClientCnx.handleError(ClientCnx.java:598)
~[org.apache.pulsar-pulsar-client-original-2.4.1.jar:2.4.1]
at
org.apache.pulsar.common.protocol.PulsarDecoder.channelRead(PulsarDecoder.java:154)
~[org.apache.pulsar-pulsar-common-2.4.1.jar:2.4.1]
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
~[io.netty-netty-all-4.1.32.Final.jar:4.1.32.Final]
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
~[io.netty-netty-all-4.1.32.Final.jar:4.1.32.Final]
at
io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340)
~[io.netty-netty-all-4.1.32.Final.jar:4.1.32.Final]
at
io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:323)
~[io.netty-netty-all-4.1.32.Final.jar:4.1.32.Final]
at
io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:297)
~[io.netty-netty-all-4.1.32.Final.jar:4.1.32.Final]
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
~[io.netty-netty-all-4.1.32.Final.jar:4.1.32.Final]
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
~[io.netty-netty-all-4.1.32.Final.jar:4.1.32.Final]
at
io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340)
~[io.netty-netty-all-4.1.32.Final.jar:4.1.32.Final]
at
io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1434)
~[io.netty-netty-all-4.1.32.Final.jar:4.1.32.Final]
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
~[io.netty-netty-all-4.1.32.Final.jar:4.1.32.Final]
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
~[io.netty-netty-all-4.1.32.Final.jar:4.1.32.Final]
at
io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:965)
~[io.netty-netty-all-4.1.32.Final.jar:4.1.32.Final]
at
io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:799)
~[io.netty-netty-all-4.1.32.Final.jar:4.1.32.Final]
at
io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:433)
~[io.netty-netty-all-4.1.32.Final.jar:4.1.32.Final]
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:330)
~[io.netty-netty-all-4.1.32.Final.jar:4.1.32.Final]
at
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:909)
~[io.netty-netty-all-4.1.32.Final.jar:4.1.32.Final]
at
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
~[io.netty-netty-all-4.1.32.Final.jar:4.1.32.Final]
at java.lang.Thread.run(Thread.java:748) ~[?:1.8.0_232]
01:33:07.022 [main] INFO org.apache.pulsar.client.cli.PulsarClientTool - 0
messages successfully produced```
----
2019-12-02 01:52:35 UTC - Penghui Li: @Jorge Miralles You can check the log of
server side, maybe there is some information can help us to troubleshoot this
problem.
----
2019-12-02 01:53:54 UTC - Penghui Li: And, can you show the reproduce steps
here? so that i can test is at my laptop.
----
2019-12-02 02:08:35 UTC - Jorge Miralles: @Penghui Li this is broker log when i
try to produce a message
```02:07:00.214 [pulsar-io-22-2] INFO
org.apache.pulsar.broker.service.ServerCnx -
[/10.64.167.155:39728][<persistent://public/default/stage02-test-3-partition-2>]
Creating producer. producerId=2
02:07:00.215 [pulsar-ordered-OrderedExecutor-0-0] INFO
org.apache.bookkeeper.mledger.impl.ManagedLedgerImpl - Opening managed ledger
public/default/persistent/stage02-test-3-partition-2
02:07:00.215 [bookkeeper-ml-workers-OrderedExecutor-3-0] ERROR
org.apache.pulsar.broker.service.ServerCnx - [/10.64.167.155:39728] Failed to
create topic <persistent://public/default/stage02-test-3-partition-2>
java.util.concurrent.CompletionException: java.util.NoSuchElementException: No
value present
at
java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:273)
~[?:1.8.0_232]
at
java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:280)
~[?:1.8.0_232]
at
java.util.concurrent.CompletableFuture.uniApply(CompletableFuture.java:618)
~[?:1.8.0_232]
at
java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:591)
~[?:1.8.0_232]
at
java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
~[?:1.8.0_232]
at
java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
~[?:1.8.0_232]
at
org.apache.pulsar.broker.service.BrokerService$2.openLedgerFailed(BrokerService.java:691)
~[org.apache.pulsar-pulsar-broker-2.4.1.jar:2.4.1]
at
org.apache.bookkeeper.mledger.impl.ManagedLedgerFactoryImpl.lambda$asyncOpen$8(ManagedLedgerFactoryImpl.java:330)
~[org.apache.pulsar-managed-ledger-original-2.4.1.jar:2.4.1]
at
java.util.concurrent.CompletableFuture.uniExceptionally(CompletableFuture.java:884)
~[?:1.8.0_232]
at
java.util.concurrent.CompletableFuture$UniExceptionally.tryFire(CompletableFuture.java:866)
~[?:1.8.0_232]
at
java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
~[?:1.8.0_232]
at
java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:1990)
~[?:1.8.0_232]
at
org.apache.bookkeeper.mledger.impl.ManagedLedgerFactoryImpl$2.initializeFailed(ManagedLedgerFactoryImpl.java:323)
~[org.apache.pulsar-managed-ledger-original-2.4.1.jar:2.4.1]
at
org.apache.bookkeeper.mledger.impl.ManagedLedgerImpl$1.operationFailed(ManagedLedgerImpl.java:336)
~[org.apache.pulsar-managed-ledger-original-2.4.1.jar:2.4.1]
at
org.apache.bookkeeper.mledger.impl.MetaStoreImplZookeeper.lambda$null$1(MetaStoreImplZookeeper.java:164)
~[org.apache.pulsar-managed-ledger-original-2.4.1.jar:2.4.1]
at
org.apache.bookkeeper.mledger.util.SafeRun$1.safeRun(SafeRun.java:32)
[org.apache.pulsar-managed-ledger-original-2.4.1.jar:2.4.1]
at
org.apache.bookkeeper.common.util.SafeRunnable.run(SafeRunnable.java:36)
[org.apache.bookkeeper-bookkeeper-common-4.9.2.jar:4.9.2]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[?:1.8.0_232]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[?:1.8.0_232]
at
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
[io.netty-netty-all-4.1.32.Final.jar:4.1.32.Final]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_232]
Caused by: java.util.NoSuchElementException: No value present
at java.util.Optional.get(Optional.java:135) ~[?:1.8.0_232]
at
java.util.concurrent.CompletableFuture.uniApply(CompletableFuture.java:616)
~[?:1.8.0_232]
... 18 more
02:07:00.558 [pulsar-io-22-1] INFO org.apache.pulsar.broker.service.ServerCnx
- Closed connection from /127.0.0.1:57948
02:07:00.558 [pulsar-io-22-2] INFO org.apache.pulsar.broker.service.ServerCnx
- Closed connection from /10.64.167.155:39728```
+1 : Penghui Li
----
2019-12-02 02:15:32 UTC - Penghui Li: @Jorge Miralles Can you help to check if
the topic auto creation is enable? allowAutoTopicCreation= in broker.conf
----
2019-12-02 02:49:33 UTC - Jorge Miralles: is set to false
----
2019-12-02 03:08:48 UTC - Penghui Li: Ok, there is problem related to disable
topic auto creation while using partitioned topic, we already create a pull
request <https://github.com/apache/pulsar/pull/5572> to fix it. Currently,
you’d better enable it.
----
2019-12-02 03:12:31 UTC - Jorge Miralles: Thank you very much i’ll test this
and give you an update
+1 : Penghui Li
----
2019-12-02 07:12:21 UTC - Jianfeng Qiao: Hi all, I'm running pulsar 2.3.1 as
server side and my app as a consumer is using pulsar go client. I always got
some error after app receives some messages from the topic. The error looks
like "handleRead error: asio.ssl:336151548 : sslv3 alert bad record mac,
bytesTransferred:0". Does anyone have ideas about this issue?
----
2019-12-02 07:17:56 UTC - Penghui Li: Can you help create an issue at github?
Looks need more information(e.g. the version of go client, the reproduce code
etc) which can help find the problem.
----
2019-12-02 07:38:43 UTC - Jianfeng Qiao: Ok, I'll create an issue later.
----
2019-12-02 07:54:53 UTC - Yong Liu: @Yong Liu has joined the channel
----
2019-12-02 08:43:57 UTC - Jianfeng Qiao: Is there any recommendation for
configurationg SSL cipher for pulsar?
----
2019-12-02 09:02:07 UTC - Endre Karlson: Any idea on when Transactions will
land ?
----
2019-12-02 09:08:57 UTC - jia zhai: Here is a page for TLS authentication:
<https://pulsar.apache.org/docs/en/security-tls-authentication/>
Here is a page for TLS Transport Encryption:
<https://pulsar.apache.org/docs/en/security-tls-transport/>
----
2019-12-02 09:09:38 UTC - jia zhai: @Endre Karlson It should be ready in 2.6
release
----
2019-12-02 09:09:52 UTC - Endre Karlson: ETA
----
2019-12-02 09:09:57 UTC - Endre Karlson: You got a ca date ?
----
2019-12-02 09:10:52 UTC - jia zhai: As the release plan, it should be 3 months
later.
----
