Casandra insert very slow if i use connection pool

[ruslan usifov]

Hello


I use follow python program to insert records into cassandra cluster (i my
test case this is two computers). And i have very very slow inserts (1.4 sec
per 100 records).
lazyboy python lib use round robin to chose which connection need use to
insert.

from lazyboy import *
from lazyboy.key import Key

import time;

# Define your cluster(s)
begin = 0;
btime = time.time();
connection.add_pool('Keyspace1', ['localhost:9090', '192.168.0.220:9160'])

for i in xrange(begin, begin + 500000):
  if i!=begin and (i % 10000) == 0:
    print time.time() - btime;
    btime = time.time();

  rc = record.Record({'value': i, 'text': "ruslan text"})
  rc.key = Key("Keyspace1", "Standard1", str(i));
  rc.save(ZERO);

print time.time() - btime;


If i remove from pool 1 connection, all fine. What i do wrong?


Here is my test one node configuration. Second gave identical except ip
addreses

  <ClusterName>Test Cluster</ClusterName>

  <Keyspaces>
    <Keyspace Name="Keyspace1">
      <ColumnFamily CompareWith="BytesType"
                    Name="Standard1"
                    FlushPeriodInMinutes="60"/>
      <ColumnFamily CompareWith="UTF8Type" Name="Standard2"/>
      <ColumnFamily CompareWith="TimeUUIDType" Name="StandardByUUID1"/>
      <ColumnFamily ColumnType="Super"
                    CompareWith="UTF8Type"
                    CompareSubcolumnsWith="UTF8Type"
                    Name="Super1"/>
    </Keyspace>
  </Keyspaces>

  <Partitioner>org.apache.cassandra.dht.RandomPartitioner</Partitioner>

  <InitialToken></InitialToken>


<EndPointSnitch>org.apache.cassandra.locator.EndPointSnitch</EndPointSnitch>


<ReplicaPlacementStrategy>org.apache.cassandra.locator.RackUnawareStrategy</ReplicaPlacementStrategy>

  <ReplicationFactor>1</ReplicationFactor>

  <CommitLogDirectory>/data/cassandra/commitlog</CommitLogDirectory>
  <DataFileDirectories>
      <DataFileDirectory>/data/cassandra/data</DataFileDirectory>
  </DataFileDirectories>
  <CalloutLocation>/data/cassandra/callouts</CalloutLocation>
  <BootstrapFileDirectory>/data/cassandra/bootstrap</BootstrapFileDirectory>
  <StagingFileDirectory>/data/cassandra/staging</StagingFileDirectory>

  <Seeds>
      <Seed>192.168.0.37</Seed>
  </Seeds>


  <RpcTimeoutInMillis>5000</RpcTimeoutInMillis>
  <CommitLogRotationThresholdInMB>128</CommitLogRotationThresholdInMB>


  <ListenAddress>192.168.0.220</ListenAddress>
  <StoragePort>7000</StoragePort>
  <ControlPort>7001</ControlPort>

  <ThriftAddress>0.0.0.0</ThriftAddress>
  <ThriftPort>9160</ThriftPort>
  <ThriftFramedTransport>false</ThriftFramedTransport>


  <SlicedBufferSizeInKB>64</SlicedBufferSizeInKB>

  <FlushDataBufferSizeInMB>32</FlushDataBufferSizeInMB>
  <FlushIndexBufferSizeInMB>8</FlushIndexBufferSizeInMB>

  <ColumnIndexSizeInKB>64</ColumnIndexSizeInKB>

  <MemtableSizeInMB>64</MemtableSizeInMB>
  <MemtableObjectCountInMillions>0.1</MemtableObjectCountInMillions>

  <ConcurrentReads>8</ConcurrentReads>
  <ConcurrentWrites>32</ConcurrentWrites>

  <CommitLogSync>periodic</CommitLogSync>
  <CommitLogSyncPeriodInMS>1000</CommitLogSyncPeriodInMS>
  <GCGraceSeconds>864000</GCGraceSeconds>

  <FlushMinThreads>1</FlushMinThreads>
  <FlushMaxThreads>1</FlushMaxThreads>

  <BinaryMemtableSizeInMB>256</BinaryMemtableSizeInMB>

</Storage>