[Question: replication] why only one regionserver is used during replication? 0.94.9
hi, guys, I am using hbase 0.94.9. And setup replication from a 4-nodes master(3 regserver) to a 3-nodes slave(2 regserver). I can tell that all source regservers can successfully replicate data. However, it seems for each particular table, only one regserver will handle its replication at each given table. For example, I am using YCSB to load 1,000,000 rows with workloada, with 16 threads. During the load period, I looked at the ageOfLastShippedOp and sizeOfLogQueue. I can tell one of the regserver from Master is doing the replication. While values of both age and sizeOfLog are growing, another two regserver doesn't come into help. So does that mean: for each table and process, only one regionserver will do the replication regardless how long the queue is? Or did I miss some setup configuration? Thanks. Demai
Re: [Question: replication] why only one regionserver is used during replication? 0.94.9
Region servers replicate data written to them, so look at how your regions are distributed. J-D On Tue, Aug 27, 2013 at 11:29 AM, Demai Ni nid...@gmail.com wrote: hi, guys, I am using hbase 0.94.9. And setup replication from a 4-nodes master(3 regserver) to a 3-nodes slave(2 regserver). I can tell that all source regservers can successfully replicate data. However, it seems for each particular table, only one regserver will handle its replication at each given table. For example, I am using YCSB to load 1,000,000 rows with workloada, with 16 threads. During the load period, I looked at the ageOfLastShippedOp and sizeOfLogQueue. I can tell one of the regserver from Master is doing the replication. While values of both age and sizeOfLog are growing, another two regserver doesn't come into help. So does that mean: for each table and process, only one regionserver will do the replication regardless how long the queue is? Or did I miss some setup configuration? Thanks. Demai
Re: [Question: replication] why only one regionserver is used during replication? 0.94.9
J-D, thanks for the tip. On Tue, Aug 27, 2013 at 11:40 AM, Jean-Daniel Cryans jdcry...@apache.orgwrote: Region servers replicate data written to them, so look at how your regions are distributed. J-D On Tue, Aug 27, 2013 at 11:29 AM, Demai Ni nid...@gmail.com wrote: hi, guys, I am using hbase 0.94.9. And setup replication from a 4-nodes master(3 regserver) to a 3-nodes slave(2 regserver). I can tell that all source regservers can successfully replicate data. However, it seems for each particular table, only one regserver will handle its replication at each given table. For example, I am using YCSB to load 1,000,000 rows with workloada, with 16 threads. During the load period, I looked at the ageOfLastShippedOp and sizeOfLogQueue. I can tell one of the regserver from Master is doing the replication. While values of both age and sizeOfLog are growing, another two regserver doesn't come into help. So does that mean: for each table and process, only one regionserver will do the replication regardless how long the queue is? Or did I miss some setup configuration? Thanks. Demai
Re: [Question: replication] why only one regionserver is used during replication? 0.94.9
BEGIN:VCALENDAR VERSION:2.0 PRODID://RESEARCH IN MOTION//BIS 3.0 METHOD:REQUEST BEGIN:VEVENT X-RIM-REVISION:0 X-MICROSOFT-CDO-BUSYSTATUS:BUSY SUMMARY:Re: [Question: replication] why only one regionserver is used durin g replication? 0.94.9 CLASS:PUBLIC ATTENDEE;PARTSTAT=NEEDS-ACTION;RSVP=TRUE:MAILTO:user@hbase.apache.org ATTENDEE;PARTSTAT=NEEDS-ACTION;RSVP=TRUE:MAILTO:nid...@gmail.com UID:XRIMCAL-564352521-1675005804-15279064 SEQUENCE:2 DTSTART:20130827T231557Z DTEND:20130828T001557Z DESCRIPTION:J-D\, thanks for the tip.\n\n\nOn Tue\, Aug 27\, 2013 at 11:40 AM\, Jean-Daniel Cryans jdcry...@apache.orgwrote:\n\n Region servers re plicate data written to them\, so look at how your regions\n are distribu ted.\n\n J-D\n\n\n On Tue\, Aug 27\, 2013 at 11:29 AM\, Demai Ni nid m...@gmail.com wrote:\n\n hi\, guys\,\n \n I am using hbase 0.94. 9. And setup replication from a 4-nodes master(3\n regserver) to a 3-no des slave(2 regserver).\n \n I can tell that all source regservers c an successfully replicate data.\n However\, it seems for each particula r table\, only one regserver will\n handle\n its replication at each g iven table.\n \n For example\, I am using YCSB to load 1\,000\,000 ro ws with workloada\, with\n 16\n threads. During the load period\, I lo oked at the ageOfLastShippedOp and\n sizeOfLogQueue. I can tell one of the regserver from Master is doing the\n replication. While values of b oth age and sizeOfLog are growing\, another\n two regserver doesn't com e into help.\n \n So does that mean: for each table and process\, onl y one regionserver will\n do the replication regardless how long the qu eue is? Or did I miss some\n setup configuration?\n \n Thanks.\n \n Demai\n \n DTSTAMP:20130827T231318Z ORGANIZER:MAILTO:tla...@capitaltg.com END:VEVENT END:VCALENDAR
