For hive-333 - I have posted a contrib/thrift module with new libthrift from thrift trunk and (aside from new libraries) ports of exising serdes that use thrift trunk instead of the old thrift library. This is just for ingesting thrift data (not internal use of thrift in hive).
This is pretty clean imho. There aren't any people who query thrift data from hive outside FB today (AFAIK). New people can use/augment contrib/thrift for this purpose. FB can keep using the com.facebook version (since our internal trees still use that namespace). -----Original Message----- From: Prasad Chakka [mailto:[email protected]] Sent: Saturday, April 11, 2009 7:51 AM To: [email protected] Subject: Re: libthrift and hive We can do the backward compatibility with com.facebook.thrift classes the same way we did the migration from com.facebook.hive to org.apache.hadoop.hive. We can register serde with both the names and might have to change some of the thrift serdes for that. ________________________________ From: Joydeep Sen Sarma <[email protected]> Reply-To: <[email protected]> Date: Sat, 11 Apr 2009 02:28:41 -0700 To: <[email protected]> Subject: RE: libthrift and hive Yeah - aside from internal use of Thrift within Hive - the other problem is external access of Thrift log files using Hive. The namespace of the Thrift trunk is now org.apache.thrift (where we are using com.facebook.thrift). The old thrift serdes no longer work against log files generated from thrift trunk. Quite a mess and no easy way out it seems. -----Original Message----- From: Ashish Thusoo [mailto:[email protected]] Sent: Friday, April 10, 2009 10:40 AM To: [email protected] Subject: RE: libthrift and hive Just saw this. I guess since we are already packaging a libthrift.jar(an older version) in hive/libs we should be ok with the release... Ashish -----Original Message----- From: Joydeep Sen Sarma [mailto:[email protected]] Sent: Friday, April 10, 2009 10:24 AM To: [email protected] Subject: libthrift and hive Hive no longer compiles with an updated libthrift from thrift trunk. Just as an fyi. The problems are too numerous to have a simple fix (lots and lots member variables were apparently labeled 'final' and hive depends on assigning them values at numerous points).
