Thank you very much, Mark. On Mon, Feb 23, 2015 at 12:54 PM, Mark Walkom <[email protected]> wrote:
> Thanks John, this is a really interesting test. > > > If you have no _source you cannot reindex or view the actual raw content > that was sent to ES, only the analysed portions you keep. > No _all means you have to know the exact field you want to search on or > else you may get no results, as ES will search _all by default (think of it > as a shortcut search field). > > > As an aside, we are working on adding a new compression algorithm for ES > which will also improve storage capacity. > > On 24 February 2015 at 07:27, Jack Park <[email protected]> wrote: > >> What is lost (the tradeoff) when _source is disabled? >> What is lost when _all is disabled? >> >> This is interesting! >> >> Thanks >> Jack >> >> >> On Mon, Feb 23, 2015 at 12:10 PM, John Smith <[email protected]> >> wrote: >> >>> I don't run a blog but I thought I would share some results with the >>> community. >>> >>> Using Elasticsearch 1.4.3 >>> >>> I wanted to test the various ways we could save some storage on our ES >>> index and here are some numbers >>> >>> Created 6 different indexes with the various mapping settings. >>> Each index containing 4 types. >>> Insert 100,000 documents per type so total 400,000 per index. >>> Average document size 300-400 bytes. >>> >>> The values represent the total primary space taken by each index based >>> on the different mapping settings. >>> >>> _source: true = 45MB >>> _source: true, _all: false = 34MB >>> _source: false = 30MB >>> _source: false, _all: false = 18MB >>> _source: false, store: true (all fields) = 39.5MB >>> _source: false, store: true (all fields), _all: false = 28.5MB >>> >>> As you can see the default _source setting takes the most space, while >>> disabling the _source and _all field saves the most space. >>> >>> >>> >>> -- >>> You received this message because you are subscribed to the Google >>> Groups "elasticsearch" group. >>> To unsubscribe from this group and stop receiving emails from it, send >>> an email to [email protected]. >>> To view this discussion on the web visit >>> https://groups.google.com/d/msgid/elasticsearch/423ea99b-b9f2-4551-bb0c-d0167ed52150%40googlegroups.com >>> <https://groups.google.com/d/msgid/elasticsearch/423ea99b-b9f2-4551-bb0c-d0167ed52150%40googlegroups.com?utm_medium=email&utm_source=footer> >>> . >>> For more options, visit https://groups.google.com/d/optout. >>> >> >> -- >> You received this message because you are subscribed to the Google Groups >> "elasticsearch" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to [email protected]. >> To view this discussion on the web visit >> https://groups.google.com/d/msgid/elasticsearch/CAH6s0fwgm%3DTJqN7Vqu7v3yUxg7OKz20rrpRgSx6HpApBRzWgpw%40mail.gmail.com >> <https://groups.google.com/d/msgid/elasticsearch/CAH6s0fwgm%3DTJqN7Vqu7v3yUxg7OKz20rrpRgSx6HpApBRzWgpw%40mail.gmail.com?utm_medium=email&utm_source=footer> >> . >> >> For more options, visit https://groups.google.com/d/optout. >> > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > To view this discussion on the web visit > https://groups.google.com/d/msgid/elasticsearch/CAEYi1X-JaJOZ9bB7j62K1Y74QNGPZViYpNtpJWuU3nh-myUFfw%40mail.gmail.com > <https://groups.google.com/d/msgid/elasticsearch/CAEYi1X-JaJOZ9bB7j62K1Y74QNGPZViYpNtpJWuU3nh-myUFfw%40mail.gmail.com?utm_medium=email&utm_source=footer> > . > > For more options, visit https://groups.google.com/d/optout. > -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAH6s0fw6%2BE17PEBhq%3DMH7YeHME6tzEqgofwZ7Qnx_BmQf3afkg%40mail.gmail.com. For more options, visit https://groups.google.com/d/optout.
