Re: Cassandra: maximum size of collection list type

[DuyHai Doan]

My usual rule-of-thumb recommendation for most use-cases is not to exceed
1000 elements. The reasoning behind this is if you have more than 1000
elements, maybe using extra clustering columns to handle them is cleaner
and put less pressure on the heap since all the collection data are fetched
at once for each access

On Thu, Dec 1, 2016 at 7:38 PM, Jeff Jirsa <jeff.ji...@crowdstrike.com>
wrote:

> A 64k element list will not be performant. Even 10% of that will be
> painful for many users.
>
>
>
>
>
>
>
>
>
> *From: *Vladimir Yudovin <vla...@winguzone.com>
> *Reply-To: *"user@cassandra.apache.org" <user@cassandra.apache.org>
> *Date: *Thursday, December 1, 2016 at 10:34 AM
> *To: *user <user@cassandra.apache.org>
> *Subject: *Re: Cassandra: maximum size of collection list type
>
>
>
> As doc says:
>
>-  The maximum size of an item in a collection is 64K.
>
>
>- Keep collections small to prevent delays during querying because
>Cassandra reads a collection in its entirety. The collection is not paged
>internally.
>As discussed earlier, collections are designed to store only a small
>amount of data.
>
>
>- Never insert more than 64K items in a collection.
>If you insert more than 64K items into a collection, only 64K of them
>will be queryable, resulting in data loss.
>
>
>
> Best regards, Vladimir Yudovin,
>
> *Winguzone
> <https://urldefense.proofpoint.com/v2/url?u=https-3A__winguzone.com-3Ffrom-3Dlist=DgMFaQ=08AGY6txKsvMOP6lYkHQpPMRA1U6kqhAwGa8-0QCg3M=yfYEBHVkX6l0zImlOIBID0gmhluYPD5Jje-3CtaT3ow=whVs90PRbaXk6QGQCWZ4xqJN4BZ3flRmMhcc-qHurSw=V8U-ezAXPvQ3MzWGOUGEMtRkBL9vQQRtCNSq8UFBGZg=>
> - Cloud Cassandra Hosting*
>
>
>
>
>
>  On Thu, 01 Dec 2016 12:17:23 -0500 *Benjamin Roth
> <benjamin.r...@jaumo.com <benjamin.r...@jaumo.com>>* wrote 
>
>
>
> You can read it in the docs but i think it was 2^16 aka 64k
>
>
>
> Am 01.12.2016 18:00 schrieb "Selvam Raman" <sel...@gmail.com>:
>
> Hi,
>
>
>
> What is the maximum size which can be stored into collection list(in a row
> ) in cassandra.
>
>
>
> --
>
> Selvam Raman
>
> "லஞ்சம் தவிர்த்து நெஞ்சம் நிமிர்த்து"
>
>
>

Re: Cassandra: maximum size of collection list type

[Jeff Jirsa]

A 64k element list will not be performant. Even 10% of that will be painful for 
many users. 

 

 

 

 

From: Vladimir Yudovin <vla...@winguzone.com>
Reply-To: "user@cassandra.apache.org" <user@cassandra.apache.org>
Date: Thursday, December 1, 2016 at 10:34 AM
To: user <user@cassandra.apache.org>
Subject: Re: Cassandra: maximum size of collection list type

 

As doc says:

 The maximum size of an item in a collection is 64K.
Keep collections small to prevent delays during querying because Cassandra 
reads a collection in its entirety. The collection is not paged internally.
As discussed earlier, collections are designed to store only a small amount of 
data.
Never insert more than 64K items in a collection. 
If you insert more than 64K items into a collection, only 64K of them will be 
queryable, resulting in data loss.
 

Best regards, Vladimir Yudovin, 

Winguzone - Cloud Cassandra Hosting

 

 

 On Thu, 01 Dec 2016 12:17:23 -0500 Benjamin Roth <benjamin.r...@jaumo.com> 
wrote 

 

You can read it in the docs but i think it was 2^16 aka 64k

 

Am 01.12.2016 18:00 schrieb "Selvam Raman" <sel...@gmail.com>:

Hi,

 

What is the maximum size which can be stored into collection list(in a row ) in 
cassandra.

 

-- 

Selvam Raman

"லஞ்சம் தவிர்த்து நெஞ்சம் நிமிர்த்து"

 



smime.p7s
Description: S/MIME cryptographic signature

Re: Cassandra: maximum size of collection list type

[Vladimir Yudovin]

As doc says:

 The maximum size of an item in a collection is 64K.


Keep collections small to prevent delays during querying because Cassandra 
reads a collection in its entirety. The collection is not paged internally.
As discussed earlier, collections are designed to store only a small amount of 
data.


Never insert more than 64K items in a collection. 
If you insert more than 64K items into a collection, only 64K of them will be 
queryable, resulting in data loss.




Best regards, Vladimir Yudovin, 

Winguzone - Cloud Cassandra Hosting






 On Thu, 01 Dec 2016 12:17:23 -0500 Benjamin Roth 
benjamin.r...@jaumo.com wrote 




You can read it in the docs but i think it was 2^16 aka 64k



Am 01.12.2016 18:00 schrieb "Selvam Raman" sel...@gmail.com:

Hi,



What is the maximum size which can be stored into collection list(in a row ) in 
cassandra.



-- 

Selvam Raman

"லஞ்சம் தவிர்த்து நெஞ்சம் நிமிர்த்து"

Re: Cassandra: maximum size of collection list type

[Benjamin Roth]

You can read it in the docs but i think it was 2^16 aka 64k

Am 01.12.2016 18:00 schrieb "Selvam Raman" :

> Hi,
>
> What is the maximum size which can be stored into collection list(in a row
> ) in cassandra.
>
> --
> Selvam Raman
> "லஞ்சம் தவிர்த்து நெஞ்சம் நிமிர்த்து"
>

Re: Cassandra: maximum size of collection list type

[Selvam Raman]

I am getting the below error when i am having huge list( greater than
3lakh).

"Cassandra timeout during write query at consistency LOCAL_ONE (1 replica
were required but only 0 acknowledged the write)"

2016-12-01 16:20 GMT+00:00 Selvam Raman :

> Hi,
>
> What is the maximum size which can be stored into collection list(in a row
> ) in cassandra.
>
> --
> Selvam Raman
> "லஞ்சம் தவிர்த்து நெஞ்சம் நிமிர்த்து"
>



-- 
Selvam Raman
"லஞ்சம் தவிர்த்து நெஞ்சம் நிமிர்த்து"