Re: [jira] Commented: (PIG-1526) HiveColumnarLoader Partitioning Support

2010-08-06 Thread Gerrit van Vuuren
Hi, Could you paste the error messages? I've run this locally and it works. I'll try and do this on a different machine to see what's wrong. - Original Message - From: Daniel Dai (JIRA) j...@apache.org To: pig-dev@hadoop.apache.org pig-dev@hadoop.apache.org Sent: Fri Aug 06 19:48:16

Re: COMPLETED merge of load-store-redesign branch to trunk

2010-02-19 Thread Gerrit van Vuuren
Great stuff guys, I've been keen on refactoring the pig HiveRCLoader reader and writer to use the new load-store redesign. - Original Message - From: Pradeep Kamath prade...@yahoo-inc.com To: pig-dev@hadoop.apache.org pig-dev@hadoop.apache.org; pig-u...@hadoop.apache.org

RE: [jira] Updated: (PIG-1117) Pig reading hive columnar rc tables

2009-12-07 Thread Gerrit van Vuuren
Hi, I would like to extend the HiveColumnarRC Reader in such a way that it can tell Pig to only use a certain group of files, i.e. I want to filter the files and have Pig only use these for calculating the amount of tasks to run. I'll appreciate if anybody can point me in the right direction.

RE: [jira] Updated: (PIG-1117) Pig reading hive columnar rc tables

2009-12-03 Thread Gerrit van Vuuren
Hi, I've made 2 patches one for the Loader and another is the Unit Test. It's not perfect yet but atleast this way people can start testing it and give some inputs. How do I submit the patch? I tried the SubmitPatch link but could not attach the actual patch, then just ended up attaching it as

Pig reading hive columnar rc tables

2009-11-30 Thread Gerrit van Vuuren
Hi, I've coded a LoadFunc implementation that can read from Hive Columnar RC tables, this is needed for a project that I'm working on because all our data is stored using the Hive thrift serialized Columnar RC format. I have looked at the piggy bank but did not find any implementation that