I mean to add a step, putting a Python piped script in the middle. So instead of

RDBMS --> Sqoop --> Hive

You would do

RDBMS --> some file format --> Python (replacing ctrl-a) --> modified files --> 
Sqoop --> Hive

Does that help?

Chuck


From: Nitin kak [mailto:[email protected]]
Sent: Monday, February 04, 2013 2:53 PM
To: [email protected]
Subject: Re: String replace functionality in Sqoop import using Oozie

Didn't get you. Could you please elaborate just a bit?
On Mon, Feb 4, 2013 at 2:43 PM, Connell, Chuck 
<[email protected]<mailto:[email protected]>> wrote:
Do it first with Python??


From: Nitin kak [mailto:[email protected]<mailto:[email protected]>]
Sent: Monday, February 04, 2013 2:42 PM
To: [email protected]<mailto:[email protected]>
Subject: String replace functionality in Sqoop import using Oozie

Hi guys,


     Is there a way to replace (or drop) a character in one of the fields on 
the fly while importing data from an RDBMS system? I basically want to replace 
Ctrl-A characters in the fields. I know its possible to do that with Sqoop Hive 
Import(--hive-delims-replacement) but Hive Sqoop import is know not to work 
correctly with Oozie(hope this one gets remedied soon).

Regards,
Nitin Kak

Reply via email to