Hi Team,
I am working currently on performance tuning of the redis cache and for
this purpose we are using Protobuf to serialize/deserialize the data we are
fetching from Cassandra into Redis when starting our application.
This approach works very well when loading 1000 records from Cassandra into
redis whereas when loading records around 1 million there is *time out
exception* from Cassandra.This issue exists only after using the Protobuf
implementation. Below is a snippet of the exception
com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s)
tried for query failed (tried: /xx.xxx.x.xxx:9042
(com.datastax.driver.core.exceptions.OperationTimedOutException: [
/xx.xxx.x.xxx:9042] Timed out waiting for server response))
at
com.datastax.driver.core.exceptions.NoHostAvailableException.copy(NoHostAvailableException.java:84)
at
com.datastax.driver.core.exceptions.NoHostAvailableException.copy(NoHostAvailableException.java:37)
at
com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:37)[167:com.datastax.driver.core:3.5.0]
at
com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:245)[167:com.datastax.driver.core:3.5.0]
at
com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:68)[167:com.datastax.driver.core:3.5.0]
at
org.apache.camel.component.cassandra.CassandraProducer.executeStatement(CassandraProducer.java:158)[169:org.apache.camel.camel-cassandraql:2.15.1.redhat-621107]
at
org.apache.camel.component.cassandra.CassandraProducer.execute(CassandraProducer.java:107)[169:org.apache.camel.camel-cassandraql:2.15.1.redhat-621107]
at
org.apache.camel.component.cassandra.CassandraProducer.process(CassandraProducer.java:168)[169:org.apache.camel.camel-cassandraql:2.15.1.redhat-621107]
at
org.apache.camel.util.AsyncProcessorConverterHelper$ProcessorToAsyncProcessorBridge.process(AsyncProcessorConverterHelper.java:61)[55:org.apache.camel.camel-core:2.15.1.redhat-621107]
at
org.apache.camel.processor.SendProcessor.process(SendProcessor.java:139)[55:org.apache.camel.camel-core:2.15.1.redhat-621107]
at
org.apache.camel.management.InstrumentationProcessor.process(InstrumentationProcessor.java:77)[55:org.apache.camel.camel-core:2.15.1.redhat-621107]
at
org.apache.camel.processor.RedeliveryErrorHandler.process(RedeliveryErrorHandler.java:448)[55:org.apache.camel.camel-core:2.15.1.redhat-621107]
at
org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:191)[55:org.apache.camel.camel-core:2.15.1.redhat-621107]
at
org.apache.camel.processor.Pipeline.process(Pipeline.java:121)[55:org.apache.camel.camel-core:2.15.1.redhat-621107]
at
org.apache.camel.processor.Pipeline.process(Pipeline.java:83)[55:org.apache.camel.camel-core:2.15.1.redhat-621107]
at
org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:191)[55:org.apache.camel.camel-core:2.15.1.redhat-621107]
at
org.apache.camel.component.directvm.DirectVmProcessor.process(DirectVmProcessor.java:55)[55:org.apache.camel.camel-core:2.15.1.redhat-621107]
at
org.apache.camel.component.directvm.DirectVmProducer.process(DirectVmProducer.java:55)[55:org.apache.camel.camel-core:2.15.1.redhat-621107]
at
org.apache.camel.processor.SendProcessor.process(SendProcessor.java:139)[55:org.apache.camel.camel-core:2.15.1.redhat-621107]
at
org.apache.camel.management.InstrumentationProcessor.process(InstrumentationProcessor.java:77)[55:org.apache.camel.camel-core:2.15.1.redhat-621107]
at
org.apache.camel.processor.RedeliveryErrorHandler.process(RedeliveryErrorHandler.java:448)[55:org.apache.camel.camel-core:2.15.1.redhat-621107]
at
org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:191)[55:org.apache.camel.camel-core:2.15.1.redhat-621107]
at
org.apache.camel.processor.Pipeline.process(Pipeline.java:121)[55:org.apache.camel.camel-core:2.15.1.redhat-621107]
at
org.apache.camel.processor.Pipeline.process(Pipeline.java:83)[55:org.apache.camel.camel-core:2.15.1.redhat-621107]
at
org.apache.camel.processor.RedeliveryErrorHandler.process(RedeliveryErrorHandler.java:448)[55:org.apache.camel.camel-core:2.15.1.redhat-621107]
at
org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:191)[55:org.apache.camel.camel-core:2.15.1.redhat-621107]
at
org.apache.camel.util.AsyncProcessorHelper.process(AsyncProcessorHelper.java:109)[55:org.apache.camel.camel-core:2.15.1.redhat-621107]
at
org.apache.camel.processor.MulticastProcessor.doProcessParallel(MulticastProcessor.java:808)[55:org.apache.camel.camel-core:2.15.1.redhat-621107]
at
org.apache.camel.processor.MulticastProcessor.access$200(MulticastProcessor.java:84)[55:org.apache.camel.camel-core:2.15.1.redhat-621107]
at
org.apache.camel.processor.MulticastProcessor$1.call(MulticastProcessor.java:314)[55:org.apache.camel.camel-core:2.15.1.redhat-621107]
at
org.apache.camel.processor.MulticastProcessor$1.call(MulticastProcessor.java:299)[55:org.apache.camel.camel-core:2.15.1.redhat-621107]
at java.util.concurrent.FutureTask.run(FutureTask.java:277)[:1.8.0]
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:522)[:1.8.0]
at java.util.concurrent.FutureTask.run(FutureTask.java:277)[:1.8.0]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1160)[:1.8.0]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)[:1.8.0]
at java.lang.Thread.run(Thread.java:785)[:2.6 (07-22-2017)]
Any help would be appreciated if anyone has faced a similar issue or knows
how to fix this
Thanks,
Joel
--
You received this message because you are subscribed to the Google Groups
"Protocol Buffers" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To post to this group, send email to [email protected].
Visit this group at https://groups.google.com/group/protobuf.
For more options, visit https://groups.google.com/d/optout.
