date:20151104

Re: HBase error disabled security features are not available

2015-11-04 Thread Enis Söztutar

You should also configure authentication set to kerberos.

Enis

On Tue, Nov 3, 2015 at 9:00 PM, kumar r  wrote:

> Yes I have set all this property,
>
> I got user ticket using kinit command and when trying to run *user_permission
> or grant *command in hbase shell, getting this exception
>
> Posted the question is stack overflow in the below link
>
>
> http://stackoverflow.com/questions/33496541/hbase-error-disabled-security-features-are-not-available
>
>
>
> On Wed, Nov 4, 2015 at 10:23 AM, Ted Yu  wrote:
>
>> Have you set the following config ?
>>
>> hbase.master.keytab.file
>> hbase.master.kerberos.principal
>> hbase.regionserver.keytab.file
>> hbase.regionserver.kerberos.principal
>>
>> Refer to http://hbase.apache.org/book.html for their meaning / sample
>> value.
>>
>> Please show the stack trace of the exception you got.
>>
>> Cheers
>>
>> On Tue, Nov 3, 2015 at 8:43 PM, kumar r  wrote:
>>
>> > Configured secure HBase-1.1.2 with Hadoop-2.7.1 on Windows. When i
>> enable
>> > authorization referring Configuring HBase Authorization
>> > <
>> >
>> http://www.cloudera.com/content/www/en-us/documentation/archive/cdh/4-x/4-3-2/CDH4-Security-Guide/cdh4sg_topic_8_3.html
>> > >,
>> > getting *ERROR: DISABLED: Security features are not available*
>> exception.
>> >
>> > I have set the authorization configurations as below,
>> >
>> > 
>> >  hbase.security.authorization
>> >  true
>> > 
>> >
>> > 
>> >  hbase.coprocessor.master.classes
>> >
>> >  org.apache.hadoop.hbase.security.access.AccessController
>> > 
>> >
>> > 
>> >  hbase.coprocessor.region.classes
>> >
>> >
>> org.apache.hadoop.hbase.security.token.TokenProvider,org.apache.hadoop.hbase.security.access.AccessController
>> > 
>> >
>> > But HBase Authorization works fine when i tried with HBase-0.98.13
>> > version. Some one help me to enable HBase Authorization in a correct
>> > way.
>> >
>>
>
>

Re: Opinions wanted: new site skin

2015-11-04 Thread Misty Stanley-Jones

Thanks to everyone for your feedback. The new site skin is now live on
http://hbase.apache.org/! If you see problems, please reply here or file a
JIRA.

On Sat, Oct 31, 2015 at 8:39 AM, Misty Stanley-Jones <
mstanleyjo...@cloudera.com> wrote:

> Filed https://issues.apache.org/jira/browse/HBASE-14732 and attached a
> patch. :)
>
> On Sat, Oct 31, 2015 at 8:11 AM, Stack  wrote:
>
>>  I like them both Misty. Sounds like [0] Fluido will be easier to maintain
>> going forward. Lets go with it. I can mess with the search np.
>>
>> St.Ack
>>
>> On Fri, Oct 30, 2015 at 3:02 PM, Misty Stanley-Jones <
>> mstanleyjo...@cloudera.com> wrote:
>>
>> > Ok I've got the Fluido version [0] looking pretty good in mobile and
>> normal
>> > browsers now. Opinions appreciated.
>> >
>> > On Oct 29, 2015, at 4:51 PM, Misty Stanley-Jones <
>> > mstanleyjo...@cloudera.com>
>> > wrote:
>> >
>> > I know how to take off the Fork on Github ribbon and have done so. :)
>> >
>> > The two links below use two different Maven site skins. [0] uses Fluido,
>> > from Apache. [1] uses the same Reflow skin we are already using, with
>> some
>> > CSS and Javascript tweaks, and some tweaks to the source files for the
>> > site.
>> >
>> > I've learned some nifty tricks along the way, which is good all the way
>> > around.
>> >
>> > [0] has the site search, which is rather nice, but I have no idea how to
>> > modify it to use the Hadoop search site that Stack lines instead of
>> Google.
>> > I have zero clue how to get a site search in [1] at all.
>> >
>> > I've re-staged [0] with a few tweaks to hopefully make it more
>> > mobile-friendly. I do agree that it is a cleaner look overall. However,
>> it
>> > is not based on Bootstrap (I believe). Apparently a version 2.0 is in
>> the
>> > works which may bring more responsive design.
>> >
>> > I've just re-staged [1] without the per-page navigation menus because
>> the
>> > Bootstrap affix code was too tricky to get right, and none of our site
>> > pages are really long enough to need a page-specific menu. I've also
>> > switched the font back from Oxygen (Google Fonts) to Helvetica Neue,
>> which
>> > is what [0] is using as well.
>> >
>> > It seems to take some time (30-60 minutes) for Github to rebuild the
>> pages,
>> > so perhaps give it some time before clicking. I think I have time zones
>> on
>> > my side and it won't be a problem.
>> >
>> > [0]: http://mstanleyjones.github.io/hbase/index.html
>> > > [1]: http://mstanleyjones.github.io/hbase/reflow_update/index.html
>> > >
>> >
>> > Of course I've kept the changes needed for each version on different
>> > branches and if we like either of them better than what we currently
>> have,
>> > I will put up a patch for review.
>> >
>>
>
>

Re: Opinions wanted: new site skin

2015-11-04 Thread Andrew Purtell

Looks great!

> On Nov 4, 2015, at 3:44 PM, Misty Stanley-Jones  
> wrote:
> 
> Thanks to everyone for your feedback. The new site skin is now live on
> http://hbase.apache.org/! If you see problems, please reply here or file a
> JIRA.
> 
> On Sat, Oct 31, 2015 at 8:39 AM, Misty Stanley-Jones <
> mstanleyjo...@cloudera.com> wrote:
> 
>> Filed https://issues.apache.org/jira/browse/HBASE-14732 and attached a
>> patch. :)
>> 
>>> On Sat, Oct 31, 2015 at 8:11 AM, Stack  wrote:
>>> 
>>> I like them both Misty. Sounds like [0] Fluido will be easier to maintain
>>> going forward. Lets go with it. I can mess with the search np.
>>> 
>>> St.Ack
>>> 
>>> On Fri, Oct 30, 2015 at 3:02 PM, Misty Stanley-Jones <
>>> mstanleyjo...@cloudera.com> wrote:
>>> 
 Ok I've got the Fluido version [0] looking pretty good in mobile and
>>> normal
 browsers now. Opinions appreciated.
 
 On Oct 29, 2015, at 4:51 PM, Misty Stanley-Jones <
 mstanleyjo...@cloudera.com>
 wrote:
 
 I know how to take off the Fork on Github ribbon and have done so. :)
 
 The two links below use two different Maven site skins. [0] uses Fluido,
 from Apache. [1] uses the same Reflow skin we are already using, with
>>> some
 CSS and Javascript tweaks, and some tweaks to the source files for the
 site.
 
 I've learned some nifty tricks along the way, which is good all the way
 around.
 
 [0] has the site search, which is rather nice, but I have no idea how to
 modify it to use the Hadoop search site that Stack lines instead of
>>> Google.
 I have zero clue how to get a site search in [1] at all.
 
 I've re-staged [0] with a few tweaks to hopefully make it more
 mobile-friendly. I do agree that it is a cleaner look overall. However,
>>> it
 is not based on Bootstrap (I believe). Apparently a version 2.0 is in
>>> the
 works which may bring more responsive design.
 
 I've just re-staged [1] without the per-page navigation menus because
>>> the
 Bootstrap affix code was too tricky to get right, and none of our site
 pages are really long enough to need a page-specific menu. I've also
 switched the font back from Oxygen (Google Fonts) to Helvetica Neue,
>>> which
 is what [0] is using as well.
 
 It seems to take some time (30-60 minutes) for Github to rebuild the
>>> pages,
 so perhaps give it some time before clicking. I think I have time zones
>>> on
 my side and it won't be a problem.
 
 [0]: http://mstanleyjones.github.io/hbase/index.html
> [1]: http://mstanleyjones.github.io/hbase/reflow_update/index.html
 
 Of course I've kept the changes needed for each version on different
 branches and if we like either of them better than what we currently
>>> have,
 I will put up a patch for review.
>> 
>>

hbase timerange scan

2015-11-04 Thread Shushant Arora

Does hbase timerange scan is full table scan without the start and stop key?
Or is it take care of HFile meta data about min and max timerange n HFile .
And how it optimises this metadata after compaction of multiple files?

RE: HBase error disabled security features are not available

2015-11-04 Thread kumar r

Thanks for the reply,

I have configured with kerberos only. Authentication works fine but 
authorization and http authentication not working.

-Original Message-
From: "Enis Söztutar" 
Sent: ‎05/‎11/‎2015 02:30
To: "hbase-user" 
Subject: Re: HBase error disabled security features are not available

You should also configure authentication set to kerberos.

Enis

On Tue, Nov 3, 2015 at 9:00 PM, kumar r  wrote:

> Yes I have set all this property,
>
> I got user ticket using kinit command and when trying to run *user_permission
> or grant *command in hbase shell, getting this exception
>
> Posted the question is stack overflow in the below link
>
>
> http://stackoverflow.com/questions/33496541/hbase-error-disabled-security-features-are-not-available
>
>
>
> On Wed, Nov 4, 2015 at 10:23 AM, Ted Yu  wrote:
>
>> Have you set the following config ?
>>
>> hbase.master.keytab.file
>> hbase.master.kerberos.principal
>> hbase.regionserver.keytab.file
>> hbase.regionserver.kerberos.principal
>>
>> Refer to http://hbase.apache.org/book.html for their meaning / sample
>> value.
>>
>> Please show the stack trace of the exception you got.
>>
>> Cheers
>>
>> On Tue, Nov 3, 2015 at 8:43 PM, kumar r  wrote:
>>
>> > Configured secure HBase-1.1.2 with Hadoop-2.7.1 on Windows. When i
>> enable
>> > authorization referring Configuring HBase Authorization
>> > <
>> >
>> http://www.cloudera.com/content/www/en-us/documentation/archive/cdh/4-x/4-3-2/CDH4-Security-Guide/cdh4sg_topic_8_3.html
>> > >,
>> > getting *ERROR: DISABLED: Security features are not available*
>> exception.
>> >
>> > I have set the authorization configurations as below,
>> >
>> > 
>> >  hbase.security.authorization
>> >  true
>> > 
>> >
>> > 
>> >  hbase.coprocessor.master.classes
>> >
>> >  org.apache.hadoop.hbase.security.access.AccessController
>> > 
>> >
>> > 
>> >  hbase.coprocessor.region.classes
>> >
>> >
>> org.apache.hadoop.hbase.security.token.TokenProvider,org.apache.hadoop.hbase.security.access.AccessController
>> > 
>> >
>> > But HBase Authorization works fine when i tried with HBase-0.98.13
>> > version. Some one help me to enable HBase Authorization in a correct
>> > way.
>> >
>>
>
>

Re: Error while loading bulk data from pig to hbase

2015-11-04 Thread Ted Yu

... 22 moreCaused by: java.lang.NoSuchMethodError:
org.apache.hadoop.hbase.client.Scan.setCacheBlocks(Z)Vat

Looks like the version of Pig you use is not compiled against hbase 1.1.2

This is related:
Author: Enis Soztutar 
Date:   Fri Sep 5 18:48:38 2014 -0700

HBASE-10841 Scan,Get,Put,Delete,etc setters should consistently return
this

FYI

On Tue, Nov 3, 2015 at 10:36 PM, Naresh Reddy <
naresh.re...@aletheconsulting.com> wrote:

> Hi
> Thanks for the reply.Below is the full error log.
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
> *Pig Stack Trace---ERROR 1200: Pig script failed to parse:
>  pig script failed to validate:
> java.lang.RuntimeException: could not instantiate
> 'org.apache.pig.backend.hadoop.hbase.HBaseStorage' with arguments
> '[info:fname info:lname]'Failed to parse: Pig script failed to parse:  2, column 0> pig script failed to validate: java.lang.RuntimeException:
> could not instantiate 'org.apache.pig.backend.hadoop.hbase.HBaseStorage'
> with arguments '[info:fname info:lname]'at
> org.apache.pig.parser.QueryParserDriver.parse(QueryParserDriver.java:199)
> at org.apache.pig.PigServer$Graph.validateQuery(PigServer.java:1707)at
> org.apache.pig.PigServer$Graph.registerQuery(PigServer.java:1680)at
> org.apache.pig.PigServer.registerQuery(PigServer.java:623)at
> org.apache.pig.tools.grunt.GruntParser.processPig(GruntParser.java:1063)
> at
>
> org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:501)
> at
>
> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:230)
> at
>
> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:205)
> at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:66)at
> org.apache.pig.Main.run(Main.java:558)at
> org.apache.pig.Main.main(Main.java:170)at
> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)at
>
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at
>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)at
> org.apache.hadoop.util.RunJar.main(RunJar.java:212)Caused by:  column 0> pig script failed to validate: java.lang.RuntimeException: could
> not instantiate 'org.apache.pig.backend.hadoop.hbase.HBaseStorage' with
> arguments '[info:fname info:lname]'at
>
> org.apache.pig.parser.LogicalPlanBuilder.buildStoreOp(LogicalPlanBuilder.java:1009)
> at
>
> org.apache.pig.parser.LogicalPlanGenerator.store_clause(LogicalPlanGenerator.java:7775)
> at
>
> org.apache.pig.parser.LogicalPlanGenerator.op_clause(LogicalPlanGenerator.java:1669)
> at
>
> org.apache.pig.parser.LogicalPlanGenerator.general_statement(LogicalPlanGenerator.java:1102)
> at
>
> org.apache.pig.parser.LogicalPlanGenerator.statement(LogicalPlanGenerator.java:560)
> at
>
> org.apache.pig.parser.LogicalPlanGenerator.query(LogicalPlanGenerator.java:421)
> at
> org.apache.pig.parser.QueryParserDriver.parse(QueryParserDriver.java:191)
> ... 15 moreCaused by: java.lang.RuntimeException: could not instantiate
> 'org.apache.pig.backend.hadoop.hbase.HBaseStorage' with arguments
> '[info:fname info:lname]'at
> org.apache.pig.impl.PigContext.instantiateFuncFromSpec(PigContext.java:772)
> at
>
> org.apache.pig.parser.LogicalPlanBuilder.buildStoreOp(LogicalPlanBuilder.java:988)
> ... 21 moreCaused by: java.lang.reflect.InvocationTargetExceptionat
> sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)at
>
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
> at
>
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:526)at
> org.apache.pig.impl.PigContext.instantiateFuncFromSpec(PigContext.java:740)
> ... 22 moreCaused by: java.lang.NoSuchMethodError:
> org.apache.hadoop.hbase.client.Scan.setCacheBlocks(Z)Vat
>
> org.apache.pig.backend.hadoop.hbase.HBaseStorage.initScan(HBaseStorage.java:405)
> at
>
> org.apache.pig.backend.hadoop.hbase.HBaseStorage.(HBaseStorage.java:346)
> at
>
> org.apache.pig.backend.hadoop.hbase.HBaseStorage.(HBaseStorage.java:235)
> ... 27
>
> more*
>
> Regards
> Naresh
>
> On Wed, Nov 4, 2015 at 11:46 AM, Naresh Reddy <
> naresh.re...@aletheconsulting.com> wrote:
>
> > Hi
> > Thanks for the reply.PFA for the full error.
> >
> > Regard
> > Naresh
> >
> >
> > On Wed, Nov 4, 2015 at 11:29 AM, Ted Yu  wrote:
> >
> >> Naresh:
> >> Can you pastebin the full error ?
> >> It should be in pig_.log
> >>
> >> Cheers
> >>
> >> > On Nov 3, 2015, at 9:07 PM, Naresh Reddy <
> >> naresh.re...@aletheconsulting.com> wrote:
> >> >
> >> > Hi
> >> >
> >> > I am getting the below error while

Re: equivalent to HTableUtil in v. 1.1

2015-11-04 Thread Solomon Duskis

I would think that a single BM ought to perform well over time, although
I'd be interested in hearing otherwise.

FWIW, BM's criteria for sending batch requests is more about size of the
puts rather than the number of puts.

On Wed, Oct 28, 2015 at 6:17 PM, Artem Ervits  wrote:

> Thanks Enis, would you say creating a new BM every 10k rows vs reusing the
> same BM would make any difference in performance?
> On Oct 28, 2015 2:54 PM, "Enis Söztutar"  wrote:
>
> > Hi Artem,
> >
> > The 1.0 API BufferedMutator should cover the use case where previously
> > HTableUtil was used or HTable.setAutoFlush(false) is used.
> >
> > BufferedMutator already groups the mutations per region server under the
> > hood (AsyncProcess) and sends the buffered mutations in the background.
> > There should be enough documentation to get started, and there is example
> > code in hbase-examples module for BM usage. But let us know if it covers
> > your use case or not.
> >
> > Enis
> >
> > On Tue, Oct 27, 2015 at 7:58 PM, Artem Ervits 
> > wrote:
> >
> > > Hello all,
> > >
> > > is there an equivalent utility in HBase 1.0+ to HTableUtil? I'd like to
> > > batch mutations by region server.
> > >
> > > Thanks
> > >
> >
>

RE: delete of cells with visibility expressions

2015-11-04 Thread Anoop Sharma

Thanks for finding the issue, appreciate your help.

Yes, please go ahead and file a JIRA or let me know if you would like me to  
file it.

Which release would the fix be in?  Could it be backported on an earlier 
release?

anoop

-Original Message-
From: ramkrishna vasudevan [mailto:ramkrishna.s.vasude...@gmail.com] 
Sent: Tuesday, November 3, 2015 9:51 PM
To: user@hbase.apache.org
Subject: Re: delete of cells with visibility expressions

Seeing the code I think we have identified the issue as Anoop John said. We 
could fix this probably in the next release.  Let us know if you want us to 
file a JIRA for this.

Regards
Ram


On Wed, Nov 4, 2015 at 11:09 AM, ramkrishna vasudevan < 
ramkrishna.s.vasude...@gmail.com> wrote:

> Sorry for the confusion. Yes the bug exists. When I tried in the 
> cluster the Visibilty CP was not on. So it is better we can raise a 
> JIRA and fix this over there. Thanks Anoop Sharma and sorry for the 
> delay from my side due to wrong info.
>
> Regards
> Ram
>
> On Wed, Nov 4, 2015 at 4:15 AM, Anoop Sharma 
> wrote:
>
>> hi
>>
>> which hbase version did you try this on?
>> We tried on the following 2 hbase versions and see the delete problem.
>>
>>Version 1.0.2, r76745a2cbffe08b812be16e0e19e637a23a923c5, Tue Aug 
>> 25
>> 15:59:49 PDT 2015
>>Version 1.1.2, rcc2b70cf03e3378800661ec5cab11eb43fafe0fc, Wed Aug 
>> 26
>> 20:11:27 PDT 2015
>>
>> Is there a later version that has the fix?
>>
>> thanks
>>
>> -Original Message-
>> From: ramkrishna vasudevan [mailto:ramkrishna.s.vasude...@gmail.com]
>> Sent: Sunday, November 1, 2015 11:11 PM
>> To: user@hbase.apache.org
>> Subject: Re: delete of cells with visibility expressions
>>
>> Is it still a bug? I reproduced the above steps in latest trunk and I 
>> thought the behaviour was corrected due to a recent bug fix?  Is it 
>> not that case ?
>>
>> Regards
>> Ram
>>
>> On Mon, Nov 2, 2015 at 12:20 PM, Anoop John 
>> wrote:
>>
>> > I believe it is a bug.. I think I know the reason also..  Can you 
>> > file a jira?  We can discuss under that.  Thanks for the test.
>> >
>> > -Anoop-
>> >
>> > On Sat, Oct 31, 2015 at 12:45 AM, Anoop Sharma 
>> > 
>> > wrote:
>> >
>> > > Thanks Ram.
>> > >
>> > > we are using hbase 1.0.2.
>> > >
>> > > anoop
>> > >
>> > > -Original Message-
>> > > From: ramkrishna vasudevan 
>> > > [mailto:ramkrishna.s.vasude...@gmail.com]
>> > > Sent: Thursday, October 29, 2015 10:22 PM
>> > > To: user@hbase.apache.org
>> > > Subject: Re: delete of cells with visibility expressions
>> > >
>> > > Hi Anoop
>> > >
>> > > Which version of the HBase are you using?  This got solved in the 
>> > > latest version of 0.98 and above. Could you try that?  I just 
>> > > reproduced this
>> > and
>> > > this problem no longer occurs.
>> > >
>> > > Regards
>> > > Ram
>> > >
>> > > On Fri, Oct 30, 2015 at 3:26 AM, Anoop Sharma 
>> > > 
>> > > wrote:
>> > >
>> > > > hi
>> > > >
>> > > >   running into an issue related to visibility expressions and
>> delete.
>> > > >
>> > > > Example run from hbase shell is listed below.
>> > > >
>> > > > Will appreciate any help on this issue.
>> > > >
>> > > > thanks.
>> > > >
>> > > >
>> > > >
>> > > > In the example below, user running queries has ‘MANAGER’
>> > > > authorization.
>> > > >
>> > > >
>> > > >
>> > > > *First example:*
>> > > >
>> > > >   add a column with visib expr ‘MANAGER’
>> > > >
>> > > >   delete it by passing in visibility of ‘MANAGER’
>> > > >
>> > > >   This works and scan doesn’t return anything.
>> > > >
>> > > >
>> > > >
>> > > > *Second example:*
>> > > >
>> > > >   add a column with visib expr ‘MANAGER’
>> > > >
>> > > >   delete it by not passing in any visibility.
>> > > >
>> > > >   This doesn’t delete the column.
>> > > >
>> > > >   Scan doesn’t return the row but RAW scan shows the column
>> > > >
>> > > >   marked as deleteColumn.
>> > > >
>> > > >
>> > > >
>> > > >   Now if delete is done again with visibility of ‘MANAGER’,
>> > > >
>> > > >   it still doesn’t delete it and scan returns the original column.
>> > > >
>> > > >
>> > > >
>> > > >
>> > > >
>> > > >
>> > > >
>> > > > *Example 1:*
>> > > >
>> > > > hbase(main):096:0> create 'HBT1', 'cf'
>> > > >
>> > > >
>> > > >
>> > > > hbase(main):098:0* *put 'HBT1', 'John', 'cf:a', 'CA',
>> > > > {VISIBILITY=>'MANAGER'}*
>> > > >
>> > > >
>> > > >
>> > > > hbase(main):099:0> *scan 'HBT1'*
>> > > >
>> > > > ROW
>> > > > COLUMN+CELL
>> > > >
>> > > >  John column=cf:a, timestamp=1446154722055,
>> > > > value=CA
>> > > >
>> > > > 1 row(s) in 0.0030 seconds
>> > > >
>> > > >
>> > > >
>> > > > hbase(main):100:0> *delete 'HBT1', 'John', 'cf:a',
>> > > > {VISIBILITY=>'MANAGER'}*
>> > > >
>> > > > 0 row(s) in 0.0030 seconds
>> > > >
>> > > >
>> > > >
>> > > > hbase(main):101:0> *scan 'HBT1'*
>> > > >
>> > > > ROW
>> > > > COLUMN+CELL
>> > > >
>> > > > 0 row(s) in 0.0030 seconds
>> > >

Re: Error while loading bulk data from pig to hbase

2015-11-04 Thread Daniel Dai

Will need to change ivy/libraries.properties, specify the right hbase
version and compile again.

On Wed, Nov 4, 2015 at 6:31 AM, Ted Yu  wrote:

> ... 22 moreCaused by: java.lang.NoSuchMethodError:
> org.apache.hadoop.hbase.client.Scan.setCacheBlocks(Z)Vat
>
> Looks like the version of Pig you use is not compiled against hbase 1.1.2
>
> This is related:
> Author: Enis Soztutar 
> Date:   Fri Sep 5 18:48:38 2014 -0700
>
> HBASE-10841 Scan,Get,Put,Delete,etc setters should consistently return
> this
>
> FYI
>
> On Tue, Nov 3, 2015 at 10:36 PM, Naresh Reddy <
> naresh.re...@aletheconsulting.com> wrote:
>
>> Hi
>> Thanks for the reply.Below is the full error log.
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>> *Pig Stack Trace---ERROR 1200: Pig script failed to parse:
>>  pig script failed to validate:
>> java.lang.RuntimeException: could not instantiate
>> 'org.apache.pig.backend.hadoop.hbase.HBaseStorage' with arguments
>> '[info:fname info:lname]'Failed to parse: Pig script failed to parse:
>> > 2, column 0> pig script failed to validate: java.lang.RuntimeException:
>> could not instantiate 'org.apache.pig.backend.hadoop.hbase.HBaseStorage'
>> with arguments '[info:fname info:lname]'at
>> org.apache.pig.parser.QueryParserDriver.parse(QueryParserDriver.java:199)
>> at org.apache.pig.PigServer$Graph.validateQuery(PigServer.java:1707)at
>> org.apache.pig.PigServer$Graph.registerQuery(PigServer.java:1680)at
>> org.apache.pig.PigServer.registerQuery(PigServer.java:623)at
>> org.apache.pig.tools.grunt.GruntParser.processPig(GruntParser.java:1063)
>> at
>>
>> org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:501)
>> at
>>
>> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:230)
>> at
>>
>> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:205)
>> at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:66)at
>> org.apache.pig.Main.run(Main.java:558)at
>> org.apache.pig.Main.main(Main.java:170)at
>> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)at
>>
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>> at
>>
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>> at java.lang.reflect.Method.invoke(Method.java:606)at
>> org.apache.hadoop.util.RunJar.main(RunJar.java:212)Caused by: > column 0> pig script failed to validate: java.lang.RuntimeException: could
>> not instantiate 'org.apache.pig.backend.hadoop.hbase.HBaseStorage' with
>> arguments '[info:fname info:lname]'at
>>
>> org.apache.pig.parser.LogicalPlanBuilder.buildStoreOp(LogicalPlanBuilder.java:1009)
>> at
>>
>> org.apache.pig.parser.LogicalPlanGenerator.store_clause(LogicalPlanGenerator.java:7775)
>> at
>>
>> org.apache.pig.parser.LogicalPlanGenerator.op_clause(LogicalPlanGenerator.java:1669)
>> at
>>
>> org.apache.pig.parser.LogicalPlanGenerator.general_statement(LogicalPlanGenerator.java:1102)
>> at
>>
>> org.apache.pig.parser.LogicalPlanGenerator.statement(LogicalPlanGenerator.java:560)
>> at
>>
>> org.apache.pig.parser.LogicalPlanGenerator.query(LogicalPlanGenerator.java:421)
>> at
>> org.apache.pig.parser.QueryParserDriver.parse(QueryParserDriver.java:191)
>> ... 15 moreCaused by: java.lang.RuntimeException: could not instantiate
>> 'org.apache.pig.backend.hadoop.hbase.HBaseStorage' with arguments
>> '[info:fname info:lname]'at
>>
>> org.apache.pig.impl.PigContext.instantiateFuncFromSpec(PigContext.java:772)
>> at
>>
>> org.apache.pig.parser.LogicalPlanBuilder.buildStoreOp(LogicalPlanBuilder.java:988)
>> ... 21 moreCaused by: java.lang.reflect.InvocationTargetExceptionat
>> sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
>> at
>>
>> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
>> at
>>
>> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
>> at java.lang.reflect.Constructor.newInstance(Constructor.java:526)at
>>
>> org.apache.pig.impl.PigContext.instantiateFuncFromSpec(PigContext.java:740)
>> ... 22 moreCaused by: java.lang.NoSuchMethodError:
>> org.apache.hadoop.hbase.client.Scan.setCacheBlocks(Z)Vat
>>
>> org.apache.pig.backend.hadoop.hbase.HBaseStorage.initScan(HBaseStorage.java:405)
>> at
>>
>> org.apache.pig.backend.hadoop.hbase.HBaseStorage.(HBaseStorage.java:346)
>> at
>>
>> org.apache.pig.backend.hadoop.hbase.HBaseStorage.(HBaseStorage.java:235)
>> ... 27
>>
>> more*
>>
>> Regards
>> Naresh
>>
>> On Wed, Nov 4, 2015 at 11:46 AM, Naresh Reddy <
>> naresh.re...@aletheconsulting.com> wrote:
>>
>> > Hi
>> > Thanks for the reply.PFA for the full error.
>> >
>> > Regard
>> > Naresh
>> >

Re: Error while loading bulk data from pig to hbase

2015-11-04 Thread Ted Yu

Looks like there is more to be done to make the build against hbase 1.x
succeed.

See PIG-4728

On Wed, Nov 4, 2015 at 9:59 AM, Daniel Dai  wrote:

> Will need to change ivy/libraries.properties, specify the right hbase
> version and compile again.
>
> On Wed, Nov 4, 2015 at 6:31 AM, Ted Yu  wrote:
>
>> ... 22 moreCaused by: java.lang.NoSuchMethodError:
>> org.apache.hadoop.hbase.client.Scan.setCacheBlocks(Z)Vat
>>
>> Looks like the version of Pig you use is not compiled against hbase 1.1.2
>>
>> This is related:
>> Author: Enis Soztutar 
>> Date:   Fri Sep 5 18:48:38 2014 -0700
>>
>> HBASE-10841 Scan,Get,Put,Delete,etc setters should consistently
>> return this
>>
>> FYI
>>
>> On Tue, Nov 3, 2015 at 10:36 PM, Naresh Reddy <
>> naresh.re...@aletheconsulting.com> wrote:
>>
>>> Hi
>>> Thanks for the reply.Below is the full error log.
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> *Pig Stack Trace---ERROR 1200: Pig script failed to parse:
>>>  pig script failed to validate:
>>> java.lang.RuntimeException: could not instantiate
>>> 'org.apache.pig.backend.hadoop.hbase.HBaseStorage' with arguments
>>> '[info:fname info:lname]'Failed to parse: Pig script failed to parse:
>>> >> 2, column 0> pig script failed to validate: java.lang.RuntimeException:
>>> could not instantiate 'org.apache.pig.backend.hadoop.hbase.HBaseStorage'
>>> with arguments '[info:fname info:lname]'at
>>> org.apache.pig.parser.QueryParserDriver.parse(QueryParserDriver.java:199)
>>> at org.apache.pig.PigServer$Graph.validateQuery(PigServer.java:1707)
>>> at
>>> org.apache.pig.PigServer$Graph.registerQuery(PigServer.java:1680)at
>>> org.apache.pig.PigServer.registerQuery(PigServer.java:623)at
>>> org.apache.pig.tools.grunt.GruntParser.processPig(GruntParser.java:1063)
>>> at
>>>
>>> org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:501)
>>> at
>>>
>>> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:230)
>>> at
>>>
>>> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:205)
>>> at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:66)at
>>> org.apache.pig.Main.run(Main.java:558)at
>>> org.apache.pig.Main.main(Main.java:170)at
>>> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)at
>>>
>>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>>> at
>>>
>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>> at java.lang.reflect.Method.invoke(Method.java:606)at
>>> org.apache.hadoop.util.RunJar.main(RunJar.java:212)Caused by: >> column 0> pig script failed to validate: java.lang.RuntimeException:
>>> could
>>> not instantiate 'org.apache.pig.backend.hadoop.hbase.HBaseStorage' with
>>> arguments '[info:fname info:lname]'at
>>>
>>> org.apache.pig.parser.LogicalPlanBuilder.buildStoreOp(LogicalPlanBuilder.java:1009)
>>> at
>>>
>>> org.apache.pig.parser.LogicalPlanGenerator.store_clause(LogicalPlanGenerator.java:7775)
>>> at
>>>
>>> org.apache.pig.parser.LogicalPlanGenerator.op_clause(LogicalPlanGenerator.java:1669)
>>> at
>>>
>>> org.apache.pig.parser.LogicalPlanGenerator.general_statement(LogicalPlanGenerator.java:1102)
>>> at
>>>
>>> org.apache.pig.parser.LogicalPlanGenerator.statement(LogicalPlanGenerator.java:560)
>>> at
>>>
>>> org.apache.pig.parser.LogicalPlanGenerator.query(LogicalPlanGenerator.java:421)
>>> at
>>> org.apache.pig.parser.QueryParserDriver.parse(QueryParserDriver.java:191)
>>> ... 15 moreCaused by: java.lang.RuntimeException: could not instantiate
>>> 'org.apache.pig.backend.hadoop.hbase.HBaseStorage' with arguments
>>> '[info:fname info:lname]'at
>>>
>>> org.apache.pig.impl.PigContext.instantiateFuncFromSpec(PigContext.java:772)
>>> at
>>>
>>> org.apache.pig.parser.LogicalPlanBuilder.buildStoreOp(LogicalPlanBuilder.java:988)
>>> ... 21 moreCaused by: java.lang.reflect.InvocationTargetExceptionat
>>> sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
>>> at
>>>
>>> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
>>> at
>>>
>>> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
>>> at java.lang.reflect.Constructor.newInstance(Constructor.java:526)at
>>>
>>> org.apache.pig.impl.PigContext.instantiateFuncFromSpec(PigContext.java:740)
>>> ... 22 moreCaused by: java.lang.NoSuchMethodError:
>>> org.apache.hadoop.hbase.client.Scan.setCacheBlocks(Z)Vat
>>>
>>> org.apache.pig.backend.hadoop.hbase.HBaseStorage.initScan(HBaseStorage.java:405)
>>> at
>>>
>>> org.apache.pig.backend.hadoop.hbase.HBaseStorage.(HBaseStorage.java:346)
>>> at
>>>
>>>

Re: HBase error disabled security features are not available

Re: Opinions wanted: new site skin

Re: Opinions wanted: new site skin

hbase timerange scan

RE: HBase error disabled security features are not available

Re: Error while loading bulk data from pig to hbase

Re: equivalent to HTableUtil in v. 1.1

RE: delete of cells with visibility expressions

Re: Error while loading bulk data from pig to hbase

Re: Error while loading bulk data from pig to hbase

10 matches

Site Navigation

Mail list logo

Footer information