Hi,
I need a general guidance on number of machines/shards required for our
first blur set-up
Some data as follows
1. Shard-Server Config : 128GB RAM, 16-core dual socket with
hyper-threading. 32 procs
2. Total dataset size: 10TB. With rep-factor=3, total cluster-size=30TB.
Pre-populated via
MR or Thrift...
3. We receive very less queries per minute [600-900 queries]. But the
response times for
every query must be <=150 ms
Initially we thought we can create 500 shards each of 20GB size with around
20 machines.
Can each shard-server machine with above specs handle 25 shards? Is such a
configuration over-utilized/under-utilized?
How do folks run in production. Any numbers/pointers will be really helpful
--
Ravi
