Re: Implementing Bulk Loading

2019-06-16 Thread Artem Ervits
Start here https://hbase.apache.org/book.html#arch.bulk.load On Sun, Jun 16, 2019, 5:30 AM Sachit Murarka wrote: > Hi All, > > I would like to implement Bulk Loading in Hbase. > > Can anyone please give pointers on that? > > Thanks > Sachit >

Re: [DISCUSS] Publishing hbase binaries with different hadoop release lines

2019-05-29 Thread Artem Ervits
I can't comment whether we need every Hadoop release but at the minimum, 2.8.5 as we recently switched to it from 2.7.7. I ran into issues with 2.8.5 and 2.1.5rc0 and used workaround in https://issues.apache.org/jira/browse/HBASE-22052 to overcome it. I guess if 2.1 will not live past 2.1.6 then

Re: [ANNOUNCE] Please welcome Jan Hentschel to the Apache HBase PMC

2019-05-08 Thread Artem Ervits
Well deserved Jan! On Wed, May 8, 2019, 5:37 PM Sean Busbey wrote: > On behalf of the Apache HBase PMC I am pleased to announce that Jan > Hentschel has accepted our invitation to become a PMC member on the > HBase project. We appreciate Jan stepping up to take more > responsibility in the

Re: Use hadoop.profile with maven

2018-08-14 Thread Artem Ervits
ny success :-( > > Do you have other suggestion please ? > > jc > > > Le 13/08/2018 à 17:53, Artem Ervits a écrit : > > there may be a better way but you can try making hadoop-3 profile default > > in your pom > > https://github.com/apache/hbase/blob/maste

Re: Use hadoop.profile with maven

2018-08-13 Thread Artem Ervits
there may be a better way but you can try making hadoop-3 profile default in your pom https://github.com/apache/hbase/blob/master/pom.xml#L2514-L2771 you can test and confirm but I believe the diff in the activation section is what controls which profile gets executed

MRUNit unit test example

2016-02-12 Thread Artem Ervits
has anyone been able to successfully test MRUnit example in HBase 1.1? firstly, I updated the pom for hadoop2 org.apache.mrunit mrunit 1.1.0 hadoop2 test I setup the test exactly as the code on the reference page. I'm getting

Re: equivalent to HTableUtil in v. 1.1

2015-10-28 Thread Artem Ervits
example > code in hbase-examples module for BM usage. But let us know if it covers > your use case or not. > > Enis > > On Tue, Oct 27, 2015 at 7:58 PM, Artem Ervits <artemerv...@gmail.com> > wrote: > > > Hello all, > > > > is there an equivale

equivalent to HTableUtil in v. 1.1

2015-10-27 Thread Artem Ervits
Hello all, is there an equivalent utility in HBase 1.0+ to HTableUtil? I'd like to batch mutations by region server. Thanks

Re: Purging an Hbase table after accidentally deleting the store files

2015-10-26 Thread Artem Ervits
See if its still in hdfs trash On Oct 26, 2015 4:18 PM, "Sam William" wrote: > Hi, > I accidentally deleted the HDFS location '/hbase/mytable' before I > dropped the table from the hbase shell. This table was a candidate for > deleting anyway and I don't care about

Re: wal.FSHLog: Slow sync cost: 143 ms, current pipeline:

2015-10-17 Thread Artem Ervits
your first post, I got the impression that 'Slow sync' appeared in new > region server logs. > > Can you monitor disk activities across the 6 datanodes ? > Take into consideration of YARN usage. > > Cheers > > On Sat, Oct 17, 2015 at 9:07 AM, Artem Ervits <artemerv...@gmail

wal.FSHLog: Slow sync cost: 143 ms, current pipeline:

2015-10-17 Thread Artem Ervits
Hello all, trying to address a sudden change in performance, processing Kafka, Storm, HBase pipeline. I'm seeing error wal.FSHLog: Slow sync cost: 143 ms, current pipeline:, this started appearing once I added more regionservers. Is there a problem with small Xmx value for datanode? That's what

Re: wal.FSHLog: Slow sync cost: 143 ms, current pipeline:

2015-10-17 Thread Artem Ervits
ervers Were any of the new regionservers on the Kafka broker nodes ? Which release of hbase are you using ? Looks like 1.x since the log was added by HBASE-11240 Thanks On Sat, Oct 17, 2015 at 8:22 AM, Artem Ervits <artemerv...@gmail.com> wrote: > Hello all, trying to address a sud

Re: NoSuchElementException while executing MapReduce-job

2014-08-27 Thread Artem Ervits
Check your pom.xml, some artifacts changed from earlier releases. Artem Ervits Data Analyst New York Presbyterian Hospital - Original Message - From: Malte Otten [mailto:malte.maltesm...@gmail.com] Sent: Monday, August 25, 2014 02:12 PM To: user@hbase.apache.org user@hbase.apache.org

Re: Using HBase in standalone mode in production

2014-07-07 Thread Artem Ervits
Though I have not looked at it myself but you can run hbase as a long running process on Yarn (apache slider). As far as I understand, you can have an instance of any size with flexibility of growing and shrinking. Artem Ervits Data Analyst New York Presbyterian Hospital - Original

restore snapshot on another cluster

2014-04-09 Thread Artem Ervits
Hello all, When I take a snapshot on cluster 1, copy it to cluster 2 using ExportSnapshot utility, what permissions should I set on the snapshot to be able to clone it into a new table? I matched the permissions of the external snapshot to the permissions of any local snapshots on cluster 2

Re: restore snapshot on another cluster

2014-04-09 Thread Artem Ervits
I read it thanks. I'm getting privilege access exception hbase user on write permission. I don't have the exception handy. I will supply it shortly. I'm using 0.96.1.1 on hadoop 2. Artem Ervits Data Analyst New York Presbyterian Hospital - Original Message - From: Ted Yu

RE: restore snapshot on another cluster

2014-04-09 Thread Artem Ervits
) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1491) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2047) -Original Message- From: Artem Ervits Sent: Wednesday, April 09, 2014 5:58 PM To: 'user@hbase.apache.org' Subject: Re: restore snapshot on another cluster I read

Re: Maven dependency for HBase 0.96

2014-03-31 Thread Artem Ervits
I usually look at imports and use native IDE auto suggest to search maven. For my examples I end up having hbase-client version 0.96.1-hadoop2. Artem Ervits Data Analyst New York Presbyterian Hospital - Original Message - From: rakesh rakshit [mailto:ihavethepotent...@gmail.com] Sent

Re: Puppetized HBASE + Passwordless SSH examples

2013-08-06 Thread Artem Ervits
Check out apache ambari, it uses Puppet to deploy and manage HBase and other apps. Artem Ervits Data Analyst New York Presbyterian Hospital - Original Message - From: Jay Vyas [mailto:jayunit...@gmail.com] Sent: Monday, August 05, 2013 10:52 AM To: user@hbase.apache.org user

RE: Problem with Hadoop and /etc/hosts file

2012-09-27 Thread Artem Ervits
I confirm, once I removed the localhost entry, HBase started working. My hosts file now contains only: x.x.x.1 Machine1 x.x.x..2Machine2 x.x.x.x.3 Machine3 x.x.x.N MachineN -Original Message- From: Artem Ervits [mailto:are9...@nyp.org] Sent

Re: Problem with Hadoop and /etc/hosts file

2012-09-21 Thread Artem Ervits
see that node running on localhost and not on the static ip. The datanodes would not see the name node either. It is kind of confusing that hadoop wants it one way and hbase requires it the way hadoop won't work. Artem Ervits Data Analyst New York Presbyterian Hospital - Original

Re: Problem with Hadoop and /etc/hosts file

2012-09-21 Thread Artem Ervits
I removed the reference to 127.0.0.1 from every node. Hadoop started as necessary and I didn't test hbase yet. Artem Ervits Data Analyst New York Presbyterian Hospital - Original Message - From: Alberto Cordioli [mailto:cordioli.albe...@gmail.com] Sent: Friday, September 21, 2012 10