Hello Jorg,
Thanks a lot for the info., i tried applying the template provided by you
but the size is not reducing.On the other hand, I was noticing decrease in
size when i was disabling the fields via Mapping API.
Thanks and Regards
Sri
On Sunday, June 8, 2014 4:37:58 PM UTC-4, Jörg Prante wrote:
>
> Try this index template for new index creations
>
> curl -XPUT 'localhost:9200/_template/template1' -d '
> {
> "template" : "*",
> "mappings" : {
> "_default_" : {
> "_source" : { "enabled" : false },
> "_all" : { "enabled" : false}
> }
> }
> }
> '
>
> See also
>
>
> http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/indices-templates.html
>
> You can not disable _all or _source in an existing index.
>
> Jörg
>
>
>
> On Sun, Jun 8, 2014 at 10:22 PM, sri <[email protected] <javascript:>>
> wrote:
>
>> Thanks a lot for the insight Patrick.
>>
>> I have a few more queries:
>>
>> - it is possible to disable the '_source' and '_all' fields by
>> default for all the indices that would be created later (possibility
>> define
>> in the elasticsearch.yml file)
>> - what happens if my index is created and then i disable '_source'
>> and '_all' fields, would that effect the file size of the index, i.e.,
>> will
>> the fields be removed/disabled for only the documents that will be added
>> after the disabling the fields??
>>
>> Thanks and Regards
>> Sri
>>
>> On Sunday, June 8, 2014 2:48:16 PM UTC-4, Patrick Proniewski wrote:
>>
>>> Hello,
>>>
>>> I don't know how it's compressed but it appears that data is compressed
>>> up to an amount of 4k. ie. it's useless to store data on a compressed (lz4)
>>> filesystem if fs block size is 4k:
>>>
>>> Filesystem Size Used Avail Capacity Mounted on
>>> zdata/ES-lz4 1.1T 1.9G 1.1T 0% /zdata/ES-lz4
>>> zdata/ES 1.1T 1.9G 1.1T 0% /zdata/ES
>>>
>>> But if fs block size is greater (say 128k), filesystem compression is a
>>> huge win:
>>>
>>> Filesystem Size Used Avail Capacity Mounted on
>>> zdata/ES-lz4 1.1T 1.1G 1.1T 0%
>>> /zdata/ES-lz4 -> compressratio 1.73x
>>> zdata/ES-gzip 1.1T 901M 1.1T 0%
>>> /zdata/ES-gzip -> compressratio 2.27x
>>> zdata/ES 1.1T 1.9G 1.1T 0% /zdata/ES
>>>
>>> Unfortunately, a filesystem block size greater than 4K is not optimal
>>> for IO (unless you have a big amount of physical memory you can dedicate to
>>> filesystem data cache, which would be redundant with ES cache).
>>>
>>>
>>>
>>> On 08 juin 2014, at 18:41, David Pilato wrote:
>>>
>>> > It's compressed by default now.
>>> >
>>> > --
>>> > David ;-)
>>> > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs
>>> >
>>> >
>>> > Le 8 juin 2014 à 18:01, sri <[email protected]> a écrit :
>>> >
>>> > Hello everyone,
>>> >
>>> > I have read posts and blogs on how elasticsearch compression can be
>>> enabled in the previous versions(0.17 - 0.19).
>>> >
>>> > I am currently using ES 1.2.1, i wasn't able to find out how to enable
>>> compression in this version or if at all there is any such option for it.
>>> >
>>> > I know that i can reduce the storage amount by disabling the source
>>> using the mapping api, but what i was interested is the compression of data
>>> storage.
>>> >
>>> > Thanks and Regards
>>> > Sri
>>>
>>> --
>> You received this message because you are subscribed to the Google Groups
>> "elasticsearch" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to [email protected] <javascript:>.
>> To view this discussion on the web visit
>> https://groups.google.com/d/msgid/elasticsearch/ea1e6264-9694-47b0-98d1-992c67bbb63d%40googlegroups.com
>>
>> <https://groups.google.com/d/msgid/elasticsearch/ea1e6264-9694-47b0-98d1-992c67bbb63d%40googlegroups.com?utm_medium=email&utm_source=footer>
>> .
>>
>> For more options, visit https://groups.google.com/d/optout.
>>
>
>
--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/a61f2eda-9c6e-4981-bde1-15d18bff5fd7%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
