pig-user  

Re: MySQL or JDBC StoreFunc?

Ankur C. Goel
Mon, 08 Feb 2010 00:04:11 -0800

A while back, Ian Holsman developed a StoreFunc UDF to write to MySQL DB 
directly from Hadoop.
Hopefully, he is listening and is in a position to contribute this to piggybank 
:-)

Regards
-...@nkur

On 2/7/10 7:14 PM, "Jeff Zhang" <zjf...@gmail.com> wrote:

Hi Anthony,

Pig is integrating hadoop's InputFormat and OutputFormat
(Pig-966<https://issues.apache.org/jira/browse/PIG-966>).
After this jira is done, it is easy to implement JDBC loadfunc and
storefunc, just using DBInputFormat and DBOutputFormat


On Sun, Feb 7, 2010 at 4:24 AM, Anthony Urso <antho...@cs.ucla.edu> wrote:

> Anyone have an implementation or ideas towards a StoreFunc for JDBC or
> MySQL?
>
> It looks like I would need to spawn a thread to read the InputStream
> and reparse the tuples.  Overall, it sounds a little unappealing.
>
> Thanks for any advice,
> Anthony
>



--
Best Regards

Jeff Zhang