Hi We are using the Pig-Phoenix Bulkload integration to load data into a table. We realize that Pig does not support TINYINT and SMALLINT datatypes. So we are declaring those fields as INT in Pig but trying to write them into a Phoenix TINYINT datatype. I suppose we're looking to write/cast an INT in PIG to a TINYINT/SMALLINT in Phoenix. The only way we found around this was to declare the Pig fields with the type BYTEARRAY and then write them into TINYINT columns in a Phoenix table. Is there a more refined way of doing this?
On Sat, Feb 13, 2016 at 10:10 AM, anil gupta <[email protected]> wrote: > I think, Ravi answered my question. One of my team mate was working on > Pig-Phoenix loader so i'll share this with him. We will update once we try > this out. > Thanks Guys. > > On Sat, Feb 13, 2016 at 10:01 AM, James Taylor <[email protected]> > wrote: > >> I think the question Anil is asking is "Does Pig have support for TinyInt >> (byte) and SmallInt (short)?" I don't know the answer. >> >> On Sat, Feb 13, 2016 at 9:46 AM, Ravi Kiran <[email protected]> >> wrote: >> >>> Hi Anil, >>> >>> We do a mapping of PTintInt and PSmallInt to Pig DataType.INTEGER . >>> https://github.com/apache/phoenix/blob/master/phoenix-pig/src/main/java/org/apache/phoenix/pig/util/TypeUtil.java#L94 >>> . Can you please share the error you are seeing. >>> >>> HTH >>> >>> Ravi. >>> >>> On Sat, Feb 13, 2016 at 3:16 AM, anil gupta <[email protected]> >>> wrote: >>> >>>> Hi, >>>> >>>> We are using Pig-Phoenix loader to load data into a table. Initially, >>>> we created some columns as TinyInt and SmallInt in our Phoenix table. But, >>>> Pig does not have TinyInt and SmallInt datatypes, so we were forced to >>>> convert all TinyInt and SmallInt columns into INTEGER. >>>> Is there a way/trick we can still use TinyInt and SmallInt in Phoenix >>>> table while using Pig-Phoenix loader? >>>> >>>> If currently there is no way to do it, can we enhance Pig-Phoenix >>>> loader to support TinyInt and SmallInt? >>>> >>>> -- >>>> Thanks & Regards, >>>> Anil Gupta >>>> >>> >>> >> > > > -- > Thanks & Regards, > Anil Gupta >
