Re: [Shadow Regions / Read Replicas ] Wal per region?

2013-12-03 Thread Devaraj Das
On Mon, Dec 2, 2013 at 10:20 PM, Jonathan Hsieh j...@cloudera.com wrote: Deveraj: Jonathan Hsieh, WAL per region (WALpr) would give you the locality (and hence HDFS short circuit) of reads if you were to couple it with the favored nodes. The cost is of course more WAL files... In the

Re: [Shadow Regions / Read Replicas ] Wal per region?

2013-12-03 Thread Enis Söztutar
On Mon, Dec 2, 2013 at 10:20 PM, Jonathan Hsieh j...@cloudera.com wrote: Deveraj: Jonathan Hsieh, WAL per region (WALpr) would give you the locality (and hence HDFS short circuit) of reads if you were to couple it with the favored nodes. The cost is of course more WAL files... In the

Re: [Shadow Regions / Read Replicas ] Wal per region?

2013-12-03 Thread Jonathan Hsieh
On Tue, Dec 3, 2013 at 11:21 AM, Devaraj Das d...@hortonworks.com wrote: On Mon, Dec 2, 2013 at 10:20 PM, Jonathan Hsieh j...@cloudera.com wrote: With this in mind, I actually I making the case that we would group the all the regions from RS-A onto the same set of preferred regions

Re: [Shadow Regions / Read Replicas ] Wal per region?

2013-12-03 Thread Jonathan Hsieh
On Tue, Dec 3, 2013 at 11:42 AM, Enis Söztutar enis@gmail.com wrote: On Mon, Dec 2, 2013 at 10:20 PM, Jonathan Hsieh j...@cloudera.com wrote: Deveraj: Jonathan Hsieh, WAL per region (WALpr) would give you the locality (and hence HDFS short circuit) of reads if you were to couple

Re: [Shadow Regions / Read Replicas ] Wal per region?

2013-12-03 Thread Enis Söztutar
On Tue, Dec 3, 2013 at 2:03 PM, Jonathan Hsieh j...@cloudera.com wrote: On Tue, Dec 3, 2013 at 11:42 AM, Enis Söztutar enis@gmail.com wrote: On Mon, Dec 2, 2013 at 10:20 PM, Jonathan Hsieh j...@cloudera.com wrote: Deveraj: Jonathan Hsieh, WAL per region (WALpr) would give you

Re: [Shadow Regions / Read Replicas ] Wal per region?

2013-12-03 Thread Jonathan Hsieh
On Tue, Dec 3, 2013 at 3:07 PM, Enis Söztutar enis@gmail.com wrote: On Tue, Dec 3, 2013 at 2:03 PM, Jonathan Hsieh j...@cloudera.com wrote: On Tue, Dec 3, 2013 at 11:42 AM, Enis Söztutar enis@gmail.com wrote: On Mon, Dec 2, 2013 at 10:20 PM, Jonathan Hsieh j...@cloudera.com

Re: [Shadow Regions / Read Replicas ] Wal per region?

2013-12-02 Thread Jonathan Hsieh
Deveraj: Jonathan Hsieh, WAL per region (WALpr) would give you the locality (and hence HDFS short circuit) of reads if you were to couple it with the favored nodes. The cost is of course more WAL files... In the current situation (no WALpr) it would create quite some traffic cross machine, no?