Re: Oozie Sqoop Wallet Specification

[Arun Selvan]

Hi Peter,

Thanks for the mail.

Now I changed the Oozie Sqoop Action like the following.


mapreduce.map.java.opts
-Dmapred.map.child.java.opts='-Doracle.net.tns_admin=${TNS_ADMIN}
-Doracle.net.wallet_location=${walletLocation} -Dyarn.app.mapreduce.am.
staging-dir=//dev'

import

-Dmapred.map.child.java.opts='-Doracle.net.tns_admin=.
-Doracle.net.wallet_location=. -Dyarn.app.mapreduce.am.staging-dir=//dev'

-files
${walletLocation}/cwallet.sso,${walletLocation}/ewallet.p12,
${TNS_ADMIN}/sqlnet.ora,${TNS_ADMIN}/tnsnames.ora
--options-file
Options_File

What am I missing?

Thanks,
Arun


On Wed, Jun 14, 2017 at 4:26 AM, Peter Cseh  wrote:

> Hey,
>
> This might be related to whitespaces:
> https://oozie.apache.org/docs/4.3.0/DG_SqoopActionExtension.html
> "The Sqoop command can be specified either using the command element or
> multiple arg elements.
>
> When using the command element, Oozie will split the command on every space
> into multiple arguments.
>
> When using the arg elements, Oozie will pass each argument value as an
> argument to Sqoop.
>
> The arg variant should be used when there are spaces within a single
> argument."
>
> If you check the launcher logs, I'm pretty sure that Sqoop gets a messed up
> version of the parameter list.
>
> Also, you should set java properties via the  section of the
> workflow.xml.
>
> Options strating with  "-D" in the command line won't take effect as Sqoop
> runs in the same JVM as the Launcher.
>
> Please check out https://cwiki.apache.org/confluence/display/OOZIE/
> Cookbooks
> for several examples (Not for Sqoop, sorry for that)
>
> I hope this helps
>
> gp
>
> On Tue, Jun 13, 2017 at 11:17 PM, Arun Selvan  >
> wrote:
>
> > Hi Team,
> >
> > I'm invoking Sqoop via Oozie with the Optionsfile. Now I need to use
> Wallet
> > file for Authentication. I'm able to use wallet file in command line. But
> > when I gave those args in Oozie Sqoop Action, I'm getting Unknown Host
> > specified Error. PFB the command used in oozie Sqoop Action.
> >
> >  import -Dmapreduce.job.quenename=a
> > -Dmapred.map.child.java.opts='-Doracle.net.tns_admin=.
> > -Doracle.net.wallet_location=. -Dyarn.app.mapreduce.am.
> staging-dir=//dev'
> > -files cwallet.sso,ewallet.p12,sqlnet.ora,tnsnames.ora -libjars
> > oraclepki.jar,osdt_cert.jar,osdt_core.jar --options-file
> > Options_File
> > ${walletLocation}/cwallet.sso#cwallet.sso
> > ${walletLocation}/ewallet.p12#ewallet.p12
> > ${walletLocation}/sqlnet.ora#sqlnet.ora
> > ${walletLocation}/tnsnames.ora#tnsnames.ora
> >
> > Kindly help.
> >
> > Thanks,
> > Arun
> >
> > --
> >
> > *Clarity Solution Group is now Clarity Insights. Check out our website
> > using the link below. *
> > *ClarityInsights.com* 
> >
> >
>
>
> --
> Peter Cseh
> Software Engineer
> 
>

-- 

*Clarity Solution Group is now Clarity Insights. Check out our website 
using the link below. *
*ClarityInsights.com* 

Re: Oozie Sqoop Wallet Specification

[Peter Cseh]

Hey,

This might be related to whitespaces:
https://oozie.apache.org/docs/4.3.0/DG_SqoopActionExtension.html
"The Sqoop command can be specified either using the command element or
multiple arg elements.

When using the command element, Oozie will split the command on every space
into multiple arguments.

When using the arg elements, Oozie will pass each argument value as an
argument to Sqoop.

The arg variant should be used when there are spaces within a single
argument."

If you check the launcher logs, I'm pretty sure that Sqoop gets a messed up
version of the parameter list.

Also, you should set java properties via the  section of the
workflow.xml.

Options strating with  "-D" in the command line won't take effect as Sqoop
runs in the same JVM as the Launcher.

Please check out https://cwiki.apache.org/confluence/display/OOZIE/Cookbooks
for several examples (Not for Sqoop, sorry for that)

I hope this helps

gp

On Tue, Jun 13, 2017 at 11:17 PM, Arun Selvan 
wrote:

> Hi Team,
>
> I'm invoking Sqoop via Oozie with the Optionsfile. Now I need to use Wallet
> file for Authentication. I'm able to use wallet file in command line. But
> when I gave those args in Oozie Sqoop Action, I'm getting Unknown Host
> specified Error. PFB the command used in oozie Sqoop Action.
>
>  import -Dmapreduce.job.quenename=a
> -Dmapred.map.child.java.opts='-Doracle.net.tns_admin=.
> -Doracle.net.wallet_location=. -Dyarn.app.mapreduce.am.staging-dir=//dev'
> -files cwallet.sso,ewallet.p12,sqlnet.ora,tnsnames.ora -libjars
> oraclepki.jar,osdt_cert.jar,osdt_core.jar --options-file
> Options_File
> ${walletLocation}/cwallet.sso#cwallet.sso
> ${walletLocation}/ewallet.p12#ewallet.p12
> ${walletLocation}/sqlnet.ora#sqlnet.ora
> ${walletLocation}/tnsnames.ora#tnsnames.ora
>
> Kindly help.
>
> Thanks,
> Arun
>
> --
>
> *Clarity Solution Group is now Clarity Insights. Check out our website
> using the link below. *
> *ClarityInsights.com* 
>
>


-- 
Peter Cseh
Software Engineer