Thanks John, this is a really interesting test.
If you have no _source you cannot reindex or view the actual raw content that was sent to ES, only the analysed portions you keep. No _all means you have to know the exact field you want to search on or else you may get no results, as ES will search _all by default (think of it as a shortcut search field). As an aside, we are working on adding a new compression algorithm for ES which will also improve storage capacity. On 24 February 2015 at 07:27, Jack Park <[email protected]> wrote: > What is lost (the tradeoff) when _source is disabled? > What is lost when _all is disabled? > > This is interesting! > > Thanks > Jack > > > On Mon, Feb 23, 2015 at 12:10 PM, John Smith <[email protected]> > wrote: > >> I don't run a blog but I thought I would share some results with the >> community. >> >> Using Elasticsearch 1.4.3 >> >> I wanted to test the various ways we could save some storage on our ES >> index and here are some numbers >> >> Created 6 different indexes with the various mapping settings. >> Each index containing 4 types. >> Insert 100,000 documents per type so total 400,000 per index. >> Average document size 300-400 bytes. >> >> The values represent the total primary space taken by each index based on >> the different mapping settings. >> >> _source: true = 45MB >> _source: true, _all: false = 34MB >> _source: false = 30MB >> _source: false, _all: false = 18MB >> _source: false, store: true (all fields) = 39.5MB >> _source: false, store: true (all fields), _all: false = 28.5MB >> >> As you can see the default _source setting takes the most space, while >> disabling the _source and _all field saves the most space. >> >> >> >> -- >> You received this message because you are subscribed to the Google Groups >> "elasticsearch" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to [email protected]. >> To view this discussion on the web visit >> https://groups.google.com/d/msgid/elasticsearch/423ea99b-b9f2-4551-bb0c-d0167ed52150%40googlegroups.com >> <https://groups.google.com/d/msgid/elasticsearch/423ea99b-b9f2-4551-bb0c-d0167ed52150%40googlegroups.com?utm_medium=email&utm_source=footer> >> . >> For more options, visit https://groups.google.com/d/optout. >> > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > To view this discussion on the web visit > https://groups.google.com/d/msgid/elasticsearch/CAH6s0fwgm%3DTJqN7Vqu7v3yUxg7OKz20rrpRgSx6HpApBRzWgpw%40mail.gmail.com > <https://groups.google.com/d/msgid/elasticsearch/CAH6s0fwgm%3DTJqN7Vqu7v3yUxg7OKz20rrpRgSx6HpApBRzWgpw%40mail.gmail.com?utm_medium=email&utm_source=footer> > . > > For more options, visit https://groups.google.com/d/optout. > -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAEYi1X-JaJOZ9bB7j62K1Y74QNGPZViYpNtpJWuU3nh-myUFfw%40mail.gmail.com. For more options, visit https://groups.google.com/d/optout.
