Re: Cannot insert to phoenix table through hive

[spats]

 Issue was we are using older version of phoenix 4.4 , some one copied 4.8
phoenix jars to server that lead me believe we are using 4.8 but actually
servers are of version 4.4. 



--
Sent from: http://apache-phoenix-user-list.1124778.n5.nabble.com/

Re: Load HFiles in Apache Phoenix

[James Taylor]

If you put together a nice example, we can post a link to it from the FAQ.
Sorry, but with open source, the answer is often "go look at the source
code". :-)

On Fri, Oct 20, 2017 at 2:13 PM, snhir...@gmail.com 
wrote:

>
>
> On 2017-10-20 17:07, James Taylor  wrote:
> > Load Phoenix into Eclipse and search for references to
> > PhoenixRuntime.getUncommittedDataIterator(). There's even a unit test
> does
> > this.
> >
>
> Ok, I appreciate the response.  But I've already encountered the source
> code during my searches and it really isn't very enlightening in terms of
> how one simply uses it.  I'll take your advice and go after the unit test
> next.
>

Re: Load HFiles in Apache Phoenix

[snhir...@gmail.com]

On 2017-10-20 17:07, James Taylor  wrote: 
> Load Phoenix into Eclipse and search for references to
> PhoenixRuntime.getUncommittedDataIterator(). There's even a unit test does
> this.
> 

Ok, I appreciate the response.  But I've already encountered the source code 
during my searches and it really isn't very enlightening in terms of how one 
simply uses it.  I'll take your advice and go after the unit test next.

Re: Load HFiles in Apache Phoenix

[James Taylor]

Load Phoenix into Eclipse and search for references to
PhoenixRuntime.getUncommittedDataIterator(). There's even a unit test does
this.

On Fri, Oct 20, 2017 at 2:04 PM, snhir...@gmail.com 
wrote:

>
>
> On 2017-10-20 16:49, James Taylor  wrote:
> > Here's a little more info:
> > https://phoenix.apache.org/faq.html#Why_empty_key_value
> >
> > Lot's of hits here too:
> > http://search-hadoop.com/?project=Phoenix=empty+key+value
> >
> > On Fri, Oct 20, 2017 at 1:45 PM, sn5  wrote:
> >
> > > It would be very helpful to see a complete, working example (preferably
> > > with
> > > some comments) of this hfile load technique.  Apparently it's a known
> > > idiom,
> > > but I've spent most of the afternoon searching Google and cannot find a
> > > single reference other than this thread.  In particular I do not
> understand
> > > what is meant by "
> > > ..loading the empty column".
> > >
> > >
> > >
> > >
> > >
> > > --
> > > Sent from: http://apache-phoenix-user-list.1124778.n5.nabble.com/
> > >
> >
>
> Thanks, but that answers only a part of my question.  I would like to see
> a reference to the entire idiom of using the uncommitted data from a
> transaction that will be subsequently rolled back.  I can sort of infer
> what's going on from that original post, but cannot find any further
> references or examples.
>
>

Re: Load HFiles in Apache Phoenix

[snhir...@gmail.com]

On 2017-10-20 16:49, James Taylor  wrote: 
> Here's a little more info:
> https://phoenix.apache.org/faq.html#Why_empty_key_value
> 
> Lot's of hits here too:
> http://search-hadoop.com/?project=Phoenix=empty+key+value
> 
> On Fri, Oct 20, 2017 at 1:45 PM, sn5  wrote:
> 
> > It would be very helpful to see a complete, working example (preferably
> > with
> > some comments) of this hfile load technique.  Apparently it's a known
> > idiom,
> > but I've spent most of the afternoon searching Google and cannot find a
> > single reference other than this thread.  In particular I do not understand
> > what is meant by "
> > ..loading the empty column".
> >
> >
> >
> >
> >
> > --
> > Sent from: http://apache-phoenix-user-list.1124778.n5.nabble.com/
> >
> 

Thanks, but that answers only a part of my question.  I would like to see a 
reference to the entire idiom of using the uncommitted data from a transaction 
that will be subsequently rolled back.  I can sort of infer what's going on 
from that original post, but cannot find any further references or examples.

Re: Load HFiles in Apache Phoenix

[James Taylor]

Here's a little more info:
https://phoenix.apache.org/faq.html#Why_empty_key_value

Lot's of hits here too:
http://search-hadoop.com/?project=Phoenix=empty+key+value

On Fri, Oct 20, 2017 at 1:45 PM, sn5  wrote:

> It would be very helpful to see a complete, working example (preferably
> with
> some comments) of this hfile load technique.  Apparently it's a known
> idiom,
> but I've spent most of the afternoon searching Google and cannot find a
> single reference other than this thread.  In particular I do not understand
> what is meant by "
> ..loading the empty column".
>
>
>
>
>
> --
> Sent from: http://apache-phoenix-user-list.1124778.n5.nabble.com/
>

Re: Load HFiles in Apache Phoenix

[sn5]

It would be very helpful to see a complete, working example (preferably with
some comments) of this hfile load technique.  Apparently it's a known idiom,
but I've spent most of the afternoon searching Google and cannot find a
single reference other than this thread.  In particular I do not understand
what is meant by "
..loading the empty column".





--
Sent from: http://apache-phoenix-user-list.1124778.n5.nabble.com/

Re: Async get

[James Taylor]

I haven't heard that there will be an async client for HBase (but I'd love
to be corrected).

On Fri, Oct 20, 2017 at 11:05 AM, Karan Mehta 
wrote:

> That is coming up in HBase 2.0 AFAIK. You can try out AsyncHBase (
> https://github.com/OpenTSDB/asynchbase/) till HBase 1.3, although it has
> limited capabilities.
> ᐧ
>
> On Fri, Oct 13, 2017 at 10:17 AM, Flavio Pompermaier  > wrote:
>
>> I totally agree.  An official HBase async client would be awesome
>>
>> On 6 Oct 2017 08:08, "Jonathan Leech"  wrote:
>>
>> I agree here but will go farther. Hbase needs an asynchronous api that
>> goes further than its current capability, for example like building lamda
>> functions in the client tier that execute in a java streams manner. Being
>> able to run mapping functions, aggregations, etc without needing
>> coprocessors would be a big win. If Hbase doesn’t do it, the next thing
>> will.
>>
>> On Oct 5, 2017, at 11:31 AM, James Taylor  wrote:
>>
>> I do think it would be good for Phoenix to have a netty-based async means
>> of interacting with the server. We've found that to really drive down
>> latency for a parallelized query over a big cluster, you have to have a
>> ridiculously large thread pool on the client side (4000 threads for cluster
>> with 100s of nodes). A netty-based means of interacting would allow us to
>> drive down the latency without resorting to this (though this is pure
>> conjecture at this point - we might run into other, unknown scaling
>> constraints through an async API). Asynchbase, however, has a lot of
>> restrictions in terms of how you can interact with the server. If it could
>> become part of HBase and support the full wire protocol, then it might be
>> an option.
>>
>> Thanks,
>> James
>>
>> On Thu, Oct 5, 2017 at 7:00 AM, Flavio Pompermaier 
>> wrote:
>>
>>> Maybe Phoenix could benefit from https://github.com/OpenTSDB/asynchbase,
>>> what do you think?
>>>
>>> On Thu, Oct 5, 2017 at 12:03 AM, Kevin Liew  wrote:
>>>
 Wrapping a thread-blocking call in a Future makes it asynchronous, but
 does not turn it into a non-blocking call.

 https://www.google.ca/amp/blog.colinbreck.com/calling-blocki
 ng-code-there-is-no-free-lunch/amp/

 On Wed, Oct 4, 2017 at 11:36 AM Stan Campbell 
 wrote:

> Wrap the call in a Future.  You're home.
>
> On Wed, Oct 4, 2017, 9:36 AM James Taylor 
> wrote:
>
>> Hi Flavio,
>> Phoenix supports JDBC. The implementation may do gets, scans, etc.,
>> but it's completely transparent to the user.
>> Thanks,
>> James
>>
>> On Wed, Oct 4, 2017 at 6:36 AM, Flavio Pompermaier <
>> pomperma...@okkam.it> wrote:
>>
>>> Hi to all,
>>> does Phoenix support async get? I can't find anything about this..
>>>
>>> Best,
>>> Flavio
>>>
>>
>>
>>>
>>
>>
>

Re: Async get

[Karan Mehta]

That is coming up in HBase 2.0 AFAIK. You can try out AsyncHBase (
https://github.com/OpenTSDB/asynchbase/) till HBase 1.3, although it has
limited capabilities.
ᐧ

On Fri, Oct 13, 2017 at 10:17 AM, Flavio Pompermaier 
wrote:

> I totally agree.  An official HBase async client would be awesome
>
> On 6 Oct 2017 08:08, "Jonathan Leech"  wrote:
>
> I agree here but will go farther. Hbase needs an asynchronous api that
> goes further than its current capability, for example like building lamda
> functions in the client tier that execute in a java streams manner. Being
> able to run mapping functions, aggregations, etc without needing
> coprocessors would be a big win. If Hbase doesn’t do it, the next thing
> will.
>
> On Oct 5, 2017, at 11:31 AM, James Taylor  wrote:
>
> I do think it would be good for Phoenix to have a netty-based async means
> of interacting with the server. We've found that to really drive down
> latency for a parallelized query over a big cluster, you have to have a
> ridiculously large thread pool on the client side (4000 threads for cluster
> with 100s of nodes). A netty-based means of interacting would allow us to
> drive down the latency without resorting to this (though this is pure
> conjecture at this point - we might run into other, unknown scaling
> constraints through an async API). Asynchbase, however, has a lot of
> restrictions in terms of how you can interact with the server. If it could
> become part of HBase and support the full wire protocol, then it might be
> an option.
>
> Thanks,
> James
>
> On Thu, Oct 5, 2017 at 7:00 AM, Flavio Pompermaier 
> wrote:
>
>> Maybe Phoenix could benefit from https://github.com/OpenTSDB/asynchbase,
>> what do you think?
>>
>> On Thu, Oct 5, 2017 at 12:03 AM, Kevin Liew  wrote:
>>
>>> Wrapping a thread-blocking call in a Future makes it asynchronous, but
>>> does not turn it into a non-blocking call.
>>>
>>> https://www.google.ca/amp/blog.colinbreck.com/calling-blocki
>>> ng-code-there-is-no-free-lunch/amp/
>>>
>>> On Wed, Oct 4, 2017 at 11:36 AM Stan Campbell 
>>> wrote:
>>>
 Wrap the call in a Future.  You're home.

 On Wed, Oct 4, 2017, 9:36 AM James Taylor 
 wrote:

> Hi Flavio,
> Phoenix supports JDBC. The implementation may do gets, scans, etc.,
> but it's completely transparent to the user.
> Thanks,
> James
>
> On Wed, Oct 4, 2017 at 6:36 AM, Flavio Pompermaier <
> pomperma...@okkam.it> wrote:
>
>> Hi to all,
>> does Phoenix support async get? I can't find anything about this..
>>
>> Best,
>> Flavio
>>
>
>
>>
>
>

Re: Cannot connect phoenix client in kerberos cluster

[rafa]

Hi Mallieswari,

As far as I know you can configure queryServer to connect to a secured
cluster with a proper keytab and principal on its configuration. Once the
queryserver is started that way you can connect with a simple:

 python sqlline-thin.py http://hostname:8765

can you login correctly in the cluster with the used keytab? could you
regenerate the keytab?
have you started the queryserver with the keytab and the log confirms it
has authenticated correctly?

regards,
rafa

On Thu, Oct 19, 2017 at 7:55 AM, Mallieswari Dineshbabu <
dmalliesw...@gmail.com> wrote:

> Hi Rafa,
>
> following are the checksum failed exception with additional logs gathered
> in query server side.
>
> ... 19 more
> Caused by: java.security.GeneralSecurityException: Checksum failed
> at sun.security.krb5.internal.crypto.dk.ArcFourCrypto.
> decrypt(ArcFourCry
> pto.java:408)
> at sun.security.krb5.internal.crypto.ArcFourHmac.decrypt(
> ArcFourHmac.jav
> a:91)
> at sun.security.krb5.internal.crypto.ArcFourHmacEType.
> decrypt(ArcFourHma
> cEType.java:100)
> ... 25 more
> 17/10/19 05:42:10 DEBUG server.AvaticaJsonHandler: HTTP request from
> 172.0.0.4 i
> s unauthenticated and authentication is required
> 17/10/19 05:42:10 DEBUG server.HttpConnection:
> org.apache.phoenix.shaded.org.ecl
> ipse.jetty.server.HttpConnection$SendCallback@5891b2c8[PROCESSING][i=
> ResponseInf
> o{HTTP/1.1 404 null,278,false},cb=org.apache.phoenix.shaded.org.eclipse.
> jetty.se
> rver.HttpChannel$CommitCallback@76bf3474] generate: NEED_HEADER
> (null,[p=0,l=278
> ,c=2048,r=278],true)@START
> 17/10/19 05:42:10 DEBUG server.HttpConnection:
> org.apache.phoenix.shaded.org.ecl
> ipse.jetty.server.HttpConnection$SendCallback@5891b2c8[PROCESSING][i=
> ResponseInf
> o{HTTP/1.1 404 null,278,false},cb=org.apache.phoenix.shaded.org.eclipse.
> jetty.se
> rver.HttpChannel$CommitCallback@76bf3474] generate: FLUSH
> ([p=0,l=210,c=8192,r=2
> 10],[p=0,l=278,c=2048,r=278],true)@COMPLETING
> 17/10/19 05:42:10 DEBUG io.WriteFlusher: write: WriteFlusher@3d86d805{IDLE}
> [Hea
> pByteBuffer@58e0ca22[p=0,l=210,c=8192,r=210]={<< ...z-SNAPSHOT)
> \r\n\r\n>>>erver: Jetty(9.2\x00\x00\x00\x00\
> x00\x00\x00\x00\x00\x00\x00\x00\
> x00\x00\x00},HeapByteBuffer@30ce894[p=0,l=278,c=2048,r=
> 278]={<<<\n\n
> \n\n>>>\x00\x00\x00\x00\x00\x00\x00\
> x00\x00\x00\x00\x00\x00\x
> 00\x00\x00\x00...\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\
> x00\x00\x00\x00\x00}]
> 17/10/19 05:42:10 DEBUG io.WriteFlusher: update WriteFlusher@3d86d805
> {WRITING}:I
> DLE-->WRITING
>
> Regards,
> Mallieswari D
>
> On Thu, Oct 12, 2017 at 11:00 AM, Mallieswari Dineshbabu <
> dmalliesw...@gmail.com> wrote:
>
>> Hi Rafa,
>>
>> As per your concerns, I have updated the JCE policy and tested now
>> getting "Checksum Failed" Exception. Please find the error below.
>>
>>
>>
>> GSSException: Failure unspecified at GSS-API level (Mechanism level: 
>> *Checksum
>> fa*
>>
>> *iled*)
>>
>> at sun.security.jgss.krb5.Krb5Context.acceptSecContext(Krb5Cont
>> ext.java:
>>
>> 788)
>>
>> at sun.security.jgss.GSSContextImpl.acceptSecContext(GSSContext
>> Impl.java
>>
>> :342)
>>
>> at sun.security.jgss.GSSContextImpl.acceptSecContext(GSSContext
>> Impl.java
>>
>> :285)
>>
>> at sun.security.jgss.spnego.SpNegoContext.GSS_acceptSecContext(
>> SpNegoCon
>>
>> text.java:871)
>>
>> at sun.security.jgss.spnego.SpNegoContext.acceptSecContext(
>> SpNegoContext
>>
>> .java:544)
>>
>> at sun.security.jgss.GSSContextImpl.acceptSecContext(GSSContext
>> Impl.java
>>
>> :342)
>>
>> at sun.security.jgss.GSSContextImpl.acceptSecContext(GSSContext
>> Impl.java
>>
>> :285)
>>
>> at org.apache.phoenix.shaded.org.eclipse.jetty.security.SpnegoL
>> oginServi
>>
>> ce.login(SpnegoLoginService.java:137)
>>
>> at org.apache.phoenix.shaded.org.eclipse.jetty.security.authent
>> ication.L
>>
>> oginAuthenticator.login(LoginAuthenticator.java:61)
>>
>> at org.apache.phoenix.shaded.org.eclipse.jetty.security.authent
>> ication.S
>>
>> pnegoAuthenticator.validateRequest(SpnegoAuthenticator.java:99)
>>
>> at org.apache.phoenix.shaded.org.eclipse.jetty.security.Securit
>> yHandler.
>>
>> handle(SecurityHandler.java:512)
>>
>> at org.apache.phoenix.shaded.org.eclipse.jetty.server.handler.H
>> andlerLis
>>
>> t.handle(HandlerList.java:52)
>>
>> at org.apache.phoenix.shaded.org.eclipse.jetty.server.handler.H
>> andlerWra
>>
>> pper.handle(HandlerWrapper.java:97)
>>
>> at org.apache.phoenix.shaded.org.eclipse.jetty.server.Server.ha
>> ndle(Serv
>>
>> er.java:499)
>>
>> at org.apache.phoenix.shaded.org.eclipse.jetty.server.HttpChann
>> el.handle
>>
>> (HttpChannel.java:311)
>>
>> at org.apache.phoenix.shaded.org.eclipse.jetty.server.HttpConne
>> ction.onF
>>
>> illable(HttpConnection.java:257)
>>
>> at org.apache.phoenix.shaded.org.eclipse.jetty.io.AbstractConne
>> ction$2.r
>>
>>