Yes. Large uploads are working now in this release! Thanks!
However, it baffles me a little that it's so slow. I don't quite understand
the bottleneck - load on the machine is 0.20 for a pure load. Nevertheless,
large batch loads that run a little slow is WAY better to me than crashing
with OOME.
On Tue, Apr 29, 2008 at 11:25 AM, stack <[EMAIL PROTECTED]> wrote:
> I just tried it w/ a decent sized table and ran into the same issue. For a
> while we've known offlining to be unreliable, HBASE-478, and intended fixing
> it for 0.2.0 but with this demonstration of how bad our offlining is
> currently working, I think it needs to be fixed in the branch and included
> in 0.1.2 release. I'll put up a new candidate in a few days.
>
> Did your upload work?
> St.Ack
>
>
>
> Daniel Leffel wrote:
>
>> New piece of info. Now a simple select count(*) from sample_table; results
>> in the following error:
>>
>> HRegionInfo was null or empty in .META.
>>
>>
>> On Mon, Apr 28, 2008 at 7:04 PM, Daniel Leffel <[EMAIL PROTECTED]>
>> wrote:
>>
>>
>>
>>> Ever since upgrading to the first 0.1.2 release candidate, I cannot alter
>>> or drop a table. The shell reports the operation succeeded, but the
>>> master
>>> node starts failing to respond to any requests (although it's still
>>> running). Stopping and starting hbase causes the table to be unchanged.
>>> Below is a DEBUG output from an attempt to drop a table (you'll note no
>>> interesting messages).
>>>
>>> 2008-04-28 20:02:20,133 INFO org.apache.hadoop.hbase.HMaster: deleted
>>> table: sample_table
>>> 2008-04-28 20:02:23,937 INFO org.apache.hadoop.hbase.HMaster:
>>> 127.0.0.1:60020 no longer serving regionname:
>>> sample_table,,1209431861956,
>>> startKey: <>, endKey: <>, encodedName: 665384872, tableDesc: {name:
>>> sample_table, families: {categories:={name: categories, max versions: 3,
>>> compression: NONE, in memory: false, max length: 2147483647, bloom
>>> filter:
>>> none}, condition:={name: condition, max versions: 3, compression: NONE,
>>> in
>>> memory: false, max length: 2147483647, bloom filter: none}, fax:={name:
>>> fax,
>>> max versions: 3, compression: NONE, in memory: false, max length:
>>> 2147483647, bloom filter: none}, image_10:={name: image_10, max versions:
>>> 3,
>>> compression: NONE, in memory: false, max length: 2147483647, bloom
>>> filter:
>>> none}, image_1:={name: image_1, max versions: 3, compression: NONE, in
>>> memory: false, max length: 2147483647, bloom filter: none},
>>> image_2:={name:
>>> image_2, max versions: 3, compression: NONE, in memory: false, max
>>> length:
>>> 2147483647, bloom filter: none}, image_3:={name: image_3, max versions:
>>> 3,
>>> compression: NONE, in memory: false, max length: 2147483647, bloom
>>> filter:
>>> none}, image_4:={name: image_4, max versions: 3, compression: NONE, in
>>> memory: false, max length: 2147483647, bloom filter: none},
>>> image_5:={name:
>>> image_5, max versions: 3, compression: NONE, in memory: false, max
>>> length:
>>> 2147483647, bloom filter: none}, image_6:={name: image_6, max versions:
>>> 3,
>>> compression: NONE, in memory: false, max length: 2147483647, bloom
>>> filter:
>>> none}, image_7:={name: image_7, max versions: 3, compression: NONE, in
>>> memory: false, max length: 2147483647, bloom filter: none},
>>> image_8:={name:
>>> image_8, max versions: 3, compression: NONE, in memory: false, max
>>> length:
>>> 2147483647, bloom filter: none}, image_9:={name: image_9, max versions:
>>> 3,
>>> compression: NONE, in memory: false, max length: 2147483647, bloom
>>> filter:
>>> none}, location:={name: location, max versions: 3, compression: NONE, in
>>> memory: false, max length: 2147483647, bloom filter: none},
>>> manufacturer:={name: manufacturer, max versions: 3, compression: NONE, in
>>> memory: false, max length: 2147483647, bloom filter: none}, model:={name:
>>> model, max versions: 3, compression: NONE, in memory: false, max length:
>>> 2147483647, bloom filter: none}, phone:={name: phone, max versions: 3,
>>> compression: NONE, in memory: false, max length: 2147483647, bloom
>>> filter:
>>> none}, price:={name: price, max versions: 3, compression: NONE, in
>>> memory:
>>> false, max length: 2147483647, bloom filter: none}, seller:={name:
>>> seller,
>>> max versions: 3, compression: NONE, in memory: false, max length:
>>> 2147483647, bloom filter: none}, serial_number:={name: serial_number, max
>>> versions: 3, compression: NONE, in memory: false, max length: 2147483647,
>>> bloom filter: none}, stock_number:={name: stock_number, max versions: 3,
>>> compression: NONE, in memory: false, max length: 2147483647, bloom
>>> filter:
>>> none}, title:={name: title, max versions: 3, compression: NONE, in
>>> memory:
>>> false, max length: 2147483647, bloom filter: none}}}
>>> 2008-04-28 20:02:23,939 INFO org.apache.hadoop.hbase.HMaster: region
>>> closed: sample_table,,1209431861956
>>> 2008-04-28 20:02:38,674 INFO org.apache.hadoop.hbase.HMaster:
>>> HMaster.rootScanner scanning meta region {regionname: -ROOT-,,0,
>>> startKey:
>>> <>, server: 127.0.0.1:60020}
>>> 2008-04-28 20:02:38,688 INFO org.apache.hadoop.hbase.HMaster:
>>> HMaster.rootScanner scan of meta region {regionname: -ROOT-,,0, startKey:
>>> <>, server: 127.0.0.1:60020} complete
>>> 2008-04-28 20:02:44,661 INFO org.apache.hadoop.hbase.HMaster:
>>> HMaster.metaScanner scanning meta region {regionname: .META.,,1,
>>> startKey:
>>> <>, server: 127.0.0.1:60020}
>>> 2008-04-28 20:02:44,680 INFO org.apache.hadoop.hbase.HMaster:
>>> HMaster.metaScanner scan of meta region {regionname: .META.,,1, startKey:
>>> <>, server: 127.0.0.1:60020} complete
>>> 2008-04-28 20:02:44,680 INFO org.apache.hadoop.hbase.HMaster: all meta
>>> regions scanned
>>> 2008-04-28 20:02:44,969 INFO org.apache.hadoop.hbase.HMaster: assigning
>>> region sample_table,,1209431861956 to the only server 127.0.0.1:60020
>>> 2008-04-28 20:02:47,975 INFO org.apache.hadoop.hbase.HMaster:
>>> 127.0.0.1:60020 serving sample_table,,1209431861956
>>> 2008-04-28 20:02:47,976 INFO org.apache.hadoop.hbase.HMaster: regionname:
>>> sample_table,,1209431861956, startKey: <>, endKey: <>, encodedName:
>>> 665384872, tableDesc: {name: sample_table, families: {categories:={name:
>>> categories, max versions: 3, compression: NONE, in memory: false, max
>>> length: 2147483647, bloom filter: none}, condition:={name: condition, max
>>> versions: 3, compression: NONE, in memory: false, max length: 2147483647,
>>> bloom filter: none}, fax:={name: fax, max versions: 3, compression: NONE,
>>> in
>>> memory: false, max length: 2147483647, bloom filter: none},
>>> image_10:={name:
>>> image_10, max versions: 3, compression: NONE, in memory: false, max
>>> length:
>>> 2147483647, bloom filter: none}, image_1:={name: image_1, max versions:
>>> 3,
>>> compression: NONE, in memory: false, max length: 2147483647, bloom
>>> filter:
>>> none}, image_2:={name: image_2, max versions: 3, compression: NONE, in
>>> memory: false, max length: 2147483647, bloom filter: none},
>>> image_3:={name:
>>> image_3, max versions: 3, compression: NONE, in memory: false, max
>>> length:
>>> 2147483647, bloom filter: none}, image_4:={name: image_4, max versions:
>>> 3,
>>> compression: NONE, in memory: false, max length: 2147483647, bloom
>>> filter:
>>> none}, image_5:={name: image_5, max versions: 3, compression: NONE, in
>>> memory: false, max length: 2147483647, bloom filter: none},
>>> image_6:={name:
>>> image_6, max versions: 3, compression: NONE, in memory: false, max
>>> length:
>>> 2147483647, bloom filter: none}, image_7:={name: image_7, max versions:
>>> 3,
>>> compression: NONE, in memory: false, max length: 2147483647, bloom
>>> filter:
>>> none}, image_8:={name: image_8, max versions: 3, compression: NONE, in
>>> memory: false, max length: 2147483647, bloom filter: none},
>>> image_9:={name:
>>> image_9, max versions: 3, compression: NONE, in memory: false, max
>>> length:
>>> 2147483647, bloom filter: none}, location:={name: location, max versions:
>>> 3,
>>> compression: NONE, in memory: false, max length: 2147483647, bloom
>>> filter:
>>> none}, manufacturer:={name: manufacturer, max versions: 3, compression:
>>> NONE, in memory: false, max length: 2147483647, bloom filter: none},
>>> model:={name: model, max versions: 3, compression: NONE, in memory:
>>> false,
>>> max length: 2147483647, bloom filter: none}, phone:={name: phone, max
>>> versions: 3, compression: NONE, in memory: false, max length: 2147483647,
>>> bloom filter: none}, price:={name: price, max versions: 3, compression:
>>> NONE, in memory: false, max length: 2147483647, bloom filter: none},
>>> seller:={name: seller, max versions: 3, compression: NONE, in memory:
>>> false,
>>> max length: 2147483647, bloom filter: none}, serial_number:={name:
>>> serial_number, max versions: 3, compression: NONE, in memory: false, max
>>> length: 2147483647, bloom filter: none}, stock_number:={name:
>>> stock_number,
>>> max versions: 3, compression: NONE, in memory: false, max length:
>>> 2147483647, bloom filter: none}, title:={name: title, max versions: 3,
>>> compression: NONE, in memory: false, max length: 2147483647, bloom
>>> filter:
>>> none}}} open on 127.0.0.1:60020
>>> 2008-04-28 20:02:47,976 INFO org.apache.hadoop.hbase.HMaster: updating
>>> row
>>> sample_table,,1209431861956 in table .META.,,1 with startcode
>>> 1209437914462
>>> and server 127.0.0.1:60020
>>> 2008-04-28 20:03:38,676 INFO org.apache.hadoop.hbase.HMaster:
>>> HMaster.rootScanner scanning meta region {regionname: -ROOT-,,0,
>>> startKey:
>>> <>, server: 127.0.0.1:60020}
>>> 2008-04-28 20:03:38,692 INFO org.apache.hadoop.hbase.HMaster:
>>> HMaster.rootScanner scan of meta region {regionname: -ROOT-,,0, startKey:
>>> <>, server: 127.0.0.1:60020} complete
>>> 2008-04-28 20:03:44,662 INFO org.apache.hadoop.hbase.HMaster:
>>> HMaster.metaScanner scanning meta region {regionname: .META.,,1,
>>> startKey:
>>> <>, server: 127.0.0.1:60020}
>>> 2008-04-28 20:03:44,683 INFO org.apache.hadoop.hbase.HMaster:
>>> HMaster.metaScanner scan of meta region {regionname: .META.,,1, startKey:
>>> <>, server: 127.0.0.1:60020} complete
>>> 2008-04-28 20:03:44,683 INFO org.apache.hadoop.hbase.HMaster: all meta
>>> regions scanned
>>>
>>>
>>>
>>
>>
>>
>
>
