Re: TBLPROPERTIES appears to be ignored by custom inputformats

2016-12-19 Thread Chris Teoh
istakes - saves debug and fixing time. > At the same time, your inputformat should have either default values for > configuration or where not possible throw an exception if expected > configuration is it there. > > > On 19 Dec 2016, at 07:53, Chris Teoh <chris.t...@gmail.com>

Re: TBLPROPERTIES appears to be ignored by custom inputformats

2016-12-18 Thread Chris Teoh
t properties, but check the source code of the serde you used. > > > On 19 Dec 2016, at 07:22, Chris Teoh <chris.t...@gmail.com> wrote: > > > > rows. >

Re: TBLPROPERTIES appears to be ignored by custom inputformats

2016-12-18 Thread Chris Teoh
tting. Kind Regards Chris On Mon, 19 Dec 2016 at 17:08 Jörn Franke <jornfra...@gmail.com> wrote: > What is the create table statement? Do you parse the tblproperties in the > HiveSerde? Do you have exceptions in the log? > > > On 19 Dec 2016, at 07:02, Chris Teoh

TBLPROPERTIES appears to be ignored by custom inputformats

2016-12-18 Thread Chris Teoh
Hi there, Can anyone confirm whether TBLPROPERTIES in DDLs are ignored by custom inputformats in the context of a UDAF? I've written a custom input format and it works with a SELECT * but when I do anything more like SELECT count(*) it returns 0. INSERT INTO SELECT * FROM doesn't appear to

Hive unit testing in other projects

2016-08-09 Thread Chris Teoh
Hi folks, I'm working on a Sqoop patch that imports to Hive and am wondering what's the easiest way to incorporate a unit test that uses a mini Hive server without requiring a full dependency on Hive project? Kind Regards Chris