codelipenghui commented on issue #6173: Log compaction fails due to timeout
URL: https://github.com/apache/pulsar/issues/6173#issuecomment-580557285
 
 
   @EugenDueck 
   I've tried on my laptop, it's hard to reproduce. Here is my reproduce steps:
   ```
    ✘ lipenghui@lipenghuideMacBook-Pro  ~/Downloads/apache-pulsar-2.5.0/bin  
 master ●✚  ./pulsar-client produce -m '{}' test
   10:37:17.928 [pulsar-client-io-1-1] INFO  
org.apache.pulsar.client.impl.ConnectionPool - [[id: 0xb6f73439, 
L:/127.0.0.1:53315 - R:localhost/127.0.0.1:6650]] Connected to server
   10:37:18.915 [pulsar-client-io-1-1] INFO  
org.apache.pulsar.client.impl.ProducerStatsRecorderImpl - Starting Pulsar 
producer perf with config: {
     "topicName" : "test",
     "producerName" : null,
     "sendTimeoutMs" : 30000,
     "blockIfQueueFull" : false,
     "maxPendingMessages" : 1000,
     "maxPendingMessagesAcrossPartitions" : 50000,
     "messageRoutingMode" : "RoundRobinPartition",
     "hashingScheme" : "JavaStringHash",
     "cryptoFailureAction" : "FAIL",
     "batchingMaxPublishDelayMicros" : 1000,
     "batchingPartitionSwitchFrequencyByPublishDelay" : 10,
     "batchingMaxMessages" : 1000,
     "batchingMaxBytes" : 131072,
     "batchingEnabled" : true,
     "compressionType" : "NONE",
     "initialSequenceId" : null,
     "autoUpdatePartitions" : true,
     "multiSchema" : true,
     "properties" : { }
   }
   10:37:18.920 [pulsar-client-io-1-1] INFO  
org.apache.pulsar.client.impl.ProducerStatsRecorderImpl - Pulsar client config: 
{
     "serviceUrl" : "pulsar://localhost:6650/",
     "authPluginClassName" : null,
     "authParams" : null,
     "operationTimeoutMs" : 30000,
     "statsIntervalSeconds" : 60,
     "numIoThreads" : 1,
     "numListenerThreads" : 1,
     "connectionsPerBroker" : 1,
     "useTcpNoDelay" : true,
     "useTls" : false,
     "tlsTrustCertsFilePath" : "",
     "tlsAllowInsecureConnection" : false,
     "tlsHostnameVerificationEnable" : false,
     "concurrentLookupRequest" : 5000,
     "maxLookupRequest" : 50000,
     "maxNumberOfRejectedRequestPerConnection" : 50,
     "keepAliveIntervalSeconds" : 30,
     "connectionTimeoutMs" : 10000,
     "requestTimeoutMs" : 60000,
     "initialBackoffIntervalNanos" : 100000000,
     "maxBackoffIntervalNanos" : 60000000000
   }
   10:37:18.989 [pulsar-client-io-1-1] INFO  
org.apache.pulsar.client.impl.ProducerImpl - [test] [null] Creating producer on 
cnx [id: 0xb6f73439, L:/127.0.0.1:53315 - R:localhost/127.0.0.1:6650]
   10:37:19.053 [pulsar-client-io-1-1] INFO  
org.apache.pulsar.client.impl.ProducerImpl - [test] [standalone-0-2] Created 
producer on cnx [id: 0xb6f73439, L:/127.0.0.1:53315 - 
R:localhost/127.0.0.1:6650]
   10:37:19.094 [pulsar-timer-4-1] WARN  
com.scurrilous.circe.checksum.Crc32cIntChecksum - Failed to load Circe JNI 
library. Falling back to Java based CRC32c provider
   10:37:19.161 [main] INFO  org.apache.pulsar.client.impl.PulsarClientImpl - 
Client closing. URL: pulsar://localhost:6650/
   10:37:19.190 [pulsar-client-io-1-1] INFO  
org.apache.pulsar.client.impl.ProducerImpl - [test] [standalone-0-2] Closed 
Producer
   10:37:19.214 [pulsar-client-io-1-1] INFO  
org.apache.pulsar.client.impl.ClientCnx - [id: 0xb6f73439, L:/127.0.0.1:53315 ! 
R:localhost/127.0.0.1:6650] Disconnected
   10:37:19.255 [main] INFO  org.apache.pulsar.client.cli.PulsarClientTool - 1 
messages successfully produced
    lipenghui@lipenghuideMacBook-Pro  ~/Downloads/apache-pulsar-2.5.0/bin   
master ●✚  ./pulsar-client produce -m '{}' test -n 10
   10:37:25.969 [pulsar-client-io-1-1] INFO  
org.apache.pulsar.client.impl.ConnectionPool - [[id: 0x0d76dfd4, 
L:/127.0.0.1:53316 - R:localhost/127.0.0.1:6650]] Connected to server
   10:37:26.548 [pulsar-client-io-1-1] INFO  
org.apache.pulsar.client.impl.ProducerStatsRecorderImpl - Starting Pulsar 
producer perf with config: {
     "topicName" : "test",
     "producerName" : null,
     "sendTimeoutMs" : 30000,
     "blockIfQueueFull" : false,
     "maxPendingMessages" : 1000,
     "maxPendingMessagesAcrossPartitions" : 50000,
     "messageRoutingMode" : "RoundRobinPartition",
     "hashingScheme" : "JavaStringHash",
     "cryptoFailureAction" : "FAIL",
     "batchingMaxPublishDelayMicros" : 1000,
     "batchingPartitionSwitchFrequencyByPublishDelay" : 10,
     "batchingMaxMessages" : 1000,
     "batchingMaxBytes" : 131072,
     "batchingEnabled" : true,
     "compressionType" : "NONE",
     "initialSequenceId" : null,
     "autoUpdatePartitions" : true,
     "multiSchema" : true,
     "properties" : { }
   }
   10:37:26.558 [pulsar-client-io-1-1] INFO  
org.apache.pulsar.client.impl.ProducerStatsRecorderImpl - Pulsar client config: 
{
     "serviceUrl" : "pulsar://localhost:6650/",
     "authPluginClassName" : null,
     "authParams" : null,
     "operationTimeoutMs" : 30000,
     "statsIntervalSeconds" : 60,
     "numIoThreads" : 1,
     "numListenerThreads" : 1,
     "connectionsPerBroker" : 1,
     "useTcpNoDelay" : true,
     "useTls" : false,
     "tlsTrustCertsFilePath" : "",
     "tlsAllowInsecureConnection" : false,
     "tlsHostnameVerificationEnable" : false,
     "concurrentLookupRequest" : 5000,
     "maxLookupRequest" : 50000,
     "maxNumberOfRejectedRequestPerConnection" : 50,
     "keepAliveIntervalSeconds" : 30,
     "connectionTimeoutMs" : 10000,
     "requestTimeoutMs" : 60000,
     "initialBackoffIntervalNanos" : 100000000,
     "maxBackoffIntervalNanos" : 60000000000
   }
   10:37:26.593 [pulsar-client-io-1-1] INFO  
org.apache.pulsar.client.impl.ProducerImpl - [test] [null] Creating producer on 
cnx [id: 0x0d76dfd4, L:/127.0.0.1:53316 - R:localhost/127.0.0.1:6650]
   10:37:26.641 [pulsar-client-io-1-1] INFO  
org.apache.pulsar.client.impl.ProducerImpl - [test] [standalone-0-3] Created 
producer on cnx [id: 0x0d76dfd4, L:/127.0.0.1:53316 - 
R:localhost/127.0.0.1:6650]
   10:37:26.680 [main] WARN  com.scurrilous.circe.checksum.Crc32cIntChecksum - 
Failed to load Circe JNI library. Falling back to Java based CRC32c provider
   10:37:26.772 [main] INFO  org.apache.pulsar.client.impl.PulsarClientImpl - 
Client closing. URL: pulsar://localhost:6650/
   10:37:26.797 [pulsar-client-io-1-1] INFO  
org.apache.pulsar.client.impl.ProducerImpl - [test] [standalone-0-3] Closed 
Producer
   10:37:26.803 [pulsar-client-io-1-1] INFO  
org.apache.pulsar.client.impl.ClientCnx - [id: 0x0d76dfd4, L:/127.0.0.1:53316 ! 
R:localhost/127.0.0.1:6650] Disconnected
   10:37:26.831 [main] INFO  org.apache.pulsar.client.cli.PulsarClientTool - 10 
messages successfully produced
    lipenghui@lipenghuideMacBook-Pro  ~/Downloads/apache-pulsar-2.5.0/bin   
master ●✚  ./pulsar-admin topics compact test
   Topic compaction requested for persistent://public/default/test
    ✘ lipenghui@lipenghuideMacBook-Pro  ~/Downloads/apache-pulsar-2.5.0/bin  
 master ●✚  ./pulsar-admin topics compaction-status test
   Compaction was a success
    lipenghui@lipenghuideMacBook-Pro  ~/Downloads/apache-pulsar-2.5.0/bin   
master ●✚  ./pulsar-admin topics compaction-status test
   Compaction was a success
   ```
   
   Did I lose some information?

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


With regards,
Apache Git Services

Reply via email to