To Store Large Number of Video and Image files

2016-04-16 Thread Ascot Moss
Hi, I have a project that needs to store large number of image and video files, the file size varies from 10MB to 10GB, the initial number of files will be 0.1 billion and would grow over 1 billion, what will be the practical recommendations to store and view these files? #1 One cluster, store

Hbase v1 vs 0.98x

2016-04-16 Thread Ascot Moss
Hi, Is there any document about what's new in HBase v1.x vs 9.98.x? Regards

Re: To Store Large Number of Video and Image files

2016-04-16 Thread Ascot Moss
does not handle 10GB objects well. Consider store GB > image on hdfs. > > Cheers > > On Sat, Apr 16, 2016 at 6:21 PM, Ascot Moss wrote: > > > Hi, > > > > I have a project that needs to store large number of image and video > files, > > the file size varie

Re: To Store Large Number of Video and Image files

2016-04-16 Thread Ascot Moss
ore RAM in region servers? for instances, the servers in the cluster, each has 768GB RAM + 14 x 6T HDD. regards On Sun, Apr 17, 2016 at 9:56 AM, Ascot Moss wrote: > Thanks Ted! > > Just visited HBASE-11339, its status is "resolved" however, it is for > "Fix Version :

Re: To Store Large Number of Video and Image files

2016-04-16 Thread Ascot Moss
but it was decided not to backport the > > feature. > > > > FYI > > > > On Sat, Apr 16, 2016 at 7:26 PM, Ascot Moss > wrote: > > > > > Hi, > > > > > > About HBase-11339, > > > "The size of the MOB data could not be ver

Re: To Store Large Number of Video and Image files

2016-04-16 Thread Ascot Moss
Hi, Any idea about the implementation of Facebook f4? Does it use HBase as the indexer? Regards On Sun, Apr 17, 2016 at 2:36 PM, Ascot Moss wrote: > Hi, > > Yes, the files are immutable. > > Regards > > > On Sun, Apr 17, 2016 at 12:25 PM, Vladimir Rodionov < >

Re: To Store Large Number of Video and Image files

2016-04-17 Thread Ascot Moss
an this be resolved if we provide more RAM in region servers? for instances, the servers in the cluster, each has 768GB RAM + 14 x 6T HDD. regards On Sun, Apr 17, 2016 at 2:37 PM, Ascot Moss wrote: > Hi, > > Any idea about the implementation of Facebook f4? Does it use HBase as the >

How to backport MOB to Hbase 1.2.2

2016-08-20 Thread Ascot Moss
Hi, I want to use MOB in Hbase 1.2.2, can anyone advise the step to backport MOB to HBase 1.2.2? Regards

Re: How to backport MOB to Hbase 1.2.2

2016-08-20 Thread Ascot Moss
> Cheers, > > On Saturday, August 20, 2016, Ascot Moss > wrote: > > > Hi, > > > > I want to use MOB in Hbase 1.2.2, can anyone advise the step to backport > > MOB to HBase 1.2.2? > > > > Regards > > > > > -- > -Dima >

Re: Is HBase 2.X suitable for running on Hadoop 3.X?

2021-04-12 Thread Ascot Moss
I tried to build hadoop 3.2.2 with -Pnative, got error below: Run Build Command(s):/usr/bin/gmake -f Makefile cmTC_c17b0/fast && /usr/bin/gmake -f CMakeFiles/cmTC_c17b0.dir/build.make CMakeFiles/cmTC_c17b0.dir/build gmake[1]: Entering directory `/edh_all_sources/hadoop-3.2.2-src/hadoop-common-p

Re: Is HBase 2.X suitable for running on Hadoop 3.X?

2021-04-12 Thread Ascot Moss
Hi, I tried to build Hadoop 3.2.2, but got error below, please help! Run Build Command(s):/usr/bin/gmake -f Makefile cmTC_c17b0/fast && /usr/bin/gmake -f CMakeFiles/cmTC_c17b0.dir/build.make CMakeFiles/cmTC_c17b0.dir/build gmake[1]: Entering directory `/hadoop-3.2.2-src/hadoop-common-project/

Python on HBase

2017-08-12 Thread Ascot Moss
Hi, I use Python as the programming language, how can I use Python to connect to HBase which is Kerberos enabled? Regards

ERROR ipc.AbstractRpcClient: SASL authentication failed

2017-10-04 Thread Ascot Moss
Hi, I am trying to use hbase-indexer to index hbase table to Solr, Kerberos is enabled Hbase-Indexer is 1.6 Hbase is 1.2.5 with Kerberos enabled, Solr 6.6 After putting new test rows into the Hbase table, I got the following error from hbase-indexer: WARN ipc.AbstractRpcClient: Exception encou

Re: ERROR ipc.AbstractRpcClient: SASL authentication failed

2017-10-04 Thread Ascot Moss
wrote: > Consider using hbase-indexer's mailing list. > > Did you execute kinit for hbase-indexer prior to running it ? > > Cheers > > On Wed, Oct 4, 2017 at 7:15 AM, Ascot Moss wrote: > > > Hi, > > > > I am trying to use hbase-indexer to index h