Hello Jorg,
I am sorry, there was some problem in the implementation at my end. Thanks
a lot guys for the insight and help.
Appreciate the quick responses.
Thanks and Regards
Sri
On Sunday, June 8, 2014 5:04:24 PM UTC-4, sri wrote:
>
> Hello Jorg,
>
> Thanks a lot for the info., i tried applying the template provided by you
> but the size is not reducing.On the other hand, I was noticing decrease in
> size when i was disabling the fields via Mapping API.
>
> Thanks and Regards
> Sri
>
> On Sunday, June 8, 2014 4:37:58 PM UTC-4, Jörg Prante wrote:
>>
>> Try this index template for new index creations
>>
>> curl -XPUT 'localhost:9200/_template/template1' -d '
>> {
>> "template" : "*",
>> "mappings" : {
>> "_default_" : {
>> "_source" : { "enabled" : false },
>> "_all" : { "enabled" : false}
>> }
>> }
>> }
>> '
>>
>> See also
>>
>>
>> http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/indices-templates.html
>>
>> You can not disable _all or _source in an existing index.
>>
>> Jörg
>>
>>
>>
>> On Sun, Jun 8, 2014 at 10:22 PM, sri <[email protected]> wrote:
>>
>>> Thanks a lot for the insight Patrick.
>>>
>>> I have a few more queries:
>>>
>>> - it is possible to disable the '_source' and '_all' fields by
>>> default for all the indices that would be created later (possibility
>>> define
>>> in the elasticsearch.yml file)
>>> - what happens if my index is created and then i disable '_source'
>>> and '_all' fields, would that effect the file size of the index, i.e.,
>>> will
>>> the fields be removed/disabled for only the documents that will be added
>>> after the disabling the fields??
>>>
>>> Thanks and Regards
>>> Sri
>>>
>>> On Sunday, June 8, 2014 2:48:16 PM UTC-4, Patrick Proniewski wrote:
>>>
>>>> Hello,
>>>>
>>>> I don't know how it's compressed but it appears that data is compressed
>>>> up to an amount of 4k. ie. it's useless to store data on a compressed
>>>> (lz4)
>>>> filesystem if fs block size is 4k:
>>>>
>>>> Filesystem Size Used Avail Capacity Mounted on
>>>> zdata/ES-lz4 1.1T 1.9G 1.1T 0% /zdata/ES-lz4
>>>> zdata/ES 1.1T 1.9G 1.1T 0% /zdata/ES
>>>>
>>>> But if fs block size is greater (say 128k), filesystem compression is a
>>>> huge win:
>>>>
>>>> Filesystem Size Used Avail Capacity Mounted on
>>>> zdata/ES-lz4 1.1T 1.1G 1.1T 0%
>>>> /zdata/ES-lz4 -> compressratio 1.73x
>>>> zdata/ES-gzip 1.1T 901M 1.1T 0%
>>>> /zdata/ES-gzip -> compressratio 2.27x
>>>> zdata/ES 1.1T 1.9G 1.1T 0% /zdata/ES
>>>>
>>>> Unfortunately, a filesystem block size greater than 4K is not optimal
>>>> for IO (unless you have a big amount of physical memory you can dedicate
>>>> to
>>>> filesystem data cache, which would be redundant with ES cache).
>>>>
>>>>
>>>>
>>>> On 08 juin 2014, at 18:41, David Pilato wrote:
>>>>
>>>> > It's compressed by default now.
>>>> >
>>>> > --
>>>> > David ;-)
>>>> > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs
>>>> >
>>>> >
>>>> > Le 8 juin 2014 à 18:01, sri <[email protected]> a écrit :
>>>> >
>>>> > Hello everyone,
>>>> >
>>>> > I have read posts and blogs on how elasticsearch compression can be
>>>> enabled in the previous versions(0.17 - 0.19).
>>>> >
>>>> > I am currently using ES 1.2.1, i wasn't able to find out how to
>>>> enable compression in this version or if at all there is any such option
>>>> for it.
>>>> >
>>>> > I know that i can reduce the storage amount by disabling the source
>>>> using the mapping api, but what i was interested is the compression of
>>>> data
>>>> storage.
>>>> >
>>>> > Thanks and Regards
>>>> > Sri
>>>>
>>>> --
>>> You received this message because you are subscribed to the Google
>>> Groups "elasticsearch" group.
>>> To unsubscribe from this group and stop receiving emails from it, send
>>> an email to [email protected].
>>> To view this discussion on the web visit
>>> https://groups.google.com/d/msgid/elasticsearch/ea1e6264-9694-47b0-98d1-992c67bbb63d%40googlegroups.com
>>>
>>> <https://groups.google.com/d/msgid/elasticsearch/ea1e6264-9694-47b0-98d1-992c67bbb63d%40googlegroups.com?utm_medium=email&utm_source=footer>
>>> .
>>>
>>> For more options, visit https://groups.google.com/d/optout.
>>>
>>
>>
--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/acc298a6-bae1-4bb1-ab1c-24ae28a54ff1%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
