Hey, so index: month, type: symbol? Might make sense.. you could also use routing and use the symbol for this, to ensure that you only query one shard for one symbol in order to have faster queries. This presentation might be interesting for you regarding data flows
http://www.elasticsearch.org/videos/big-data-search-and-analytics/ --Alex On Sat, Feb 1, 2014 at 9:27 PM, Bobby Richards <[email protected]>wrote: > Wanting to get some advice on how to go about design. I have some > currency market data and I get roughly 10 million events a week currently > storing in postgres, it actually ends up being about 10 gigs, though I > would like to work on getting this down obviously. The data is seldom > queried but I have all of my other data in elastic search which I love. I > am trying to determine the best way to store this. > > I would like to query by symbol and time and indexing by month so I can > drop months whenever. i guess that would mean 'month/symbol/(unixtime for > minute). > > I am far from a data guy, so I am looking for direction, thoughts, > etc...is this even a good use case for elastic search? > > Thanks, > Bobby > > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > To view this discussion on the web visit > https://groups.google.com/d/msgid/elasticsearch/54f02434-37b8-4435-a846-8d20f7e9d723%40googlegroups.com > . > For more options, visit https://groups.google.com/groups/opt_out. > -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAGCwEM-z%3DV7YhiVO9Qxq_3TKHeze9LpvWaCh4FJae5Z%3D-Q_-6w%40mail.gmail.com. For more options, visit https://groups.google.com/groups/opt_out.
