Re: getting into the industry, is theory enough?

2014-10-18 Thread Dima Spivak
Dear S, If you're interested in HBase, you can't go wrong with reading the ref guide (hbase.apache.org/book.html) and checking out open JIRAs ( issues.apache.org/jira/browse/HBASE) waiting for someone to fix them :). Even if you don't want to go into developing the technology itself, there's no

Archive Files

2014-10-18 Thread Ravindranath Akila
Is there any approach HBASE can store archive like rarely used files on cheap storage? That's a vague question. If I may elaborate... Our current office stores terabytes of well structured log data on s3 to save cost. The other day I was asked to process all these files. These files are still

Re: Archive Files

2014-10-18 Thread Wilm Schumacher
Am 18.10.2014 um 12:35 schrieb Ravindranath Akila: Is there any approach HBASE can store archive like rarely used files on cheap storage? hadoop directly is equiped for that. There are HAR files, map files and sequence files. If I understand correctly, sequence files is what you are searching

Re: Archive Files

2014-10-18 Thread Ted Yu
Take a look at https://issues.apache.org/jira/browse/HDFS-6584 It is in the upcoming hadoop 2.6 release. Cheers On Oct 18, 2014, at 3:35 AM, Ravindranath Akila ravindranathak...@gmail.com wrote: Is there any approach HBASE can store archive like rarely used files on cheap storage?

Re: Archive Files

2014-10-18 Thread Ravindranath Akila
Thanks so much guys! This is exactly what I was looking for! :-) On Saturday, October 18, 2014, Ted Yu yuzhih...@gmail.com wrote: Take a look at https://issues.apache.org/jira/browse/HDFS-6584 It is in the upcoming hadoop 2.6 release. Cheers On Oct 18, 2014, at 3:35 AM, Ravindranath Akila