Following the suggestion from Jörg, I calculated a rough 72MB per second (500 docs per second x 144KB/doc). Not too shabby!
One thing to do sustain a higher docs/second rate is to carefully craft a mapping and: 1. Disable the _all field. I rarely (never!) need this in a production application. My locked-down mappings always direct queries to specific fields and always get-by-id for the best overall performance whenever possible. And my recent ELK stack exploration shows me that the message field contains the entire source of each log entry, so there is no need for _all there either; just tell Kibana to search message instead of _all. 2. Set "index" : "no" for the fields that you don't want to query or don't need to query. You would be pleasantly surprised at how quickly a large document goes in when you only index the subset of fields you actually wish to query, and also disable the _all field. Hope this helps! Brian -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/5f1a9c25-6fae-41e0-a12c-b0ce1201f847%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
