In the insecure case (without Kerberos) I would expect the app_user in the
appConf to be the same as the user that is running YARN.
On Wed, Sep 28, 2016 at 2:39 PM, Panagiotis Garefalakis <panga...@gmail.com>
wrote:
> Hello Billie,
>
> Thanks for the reply!
> It definitely seems like a permission issue but since its the user's home
> as you mentioned and *YARN* is actually running as the* same user *why
> would that be an issue?
> By the way, hbase user/group in the *appConf* should be set to the OS
> user/group or the HDFS ? (user/user vs user/supergroup)
> I will also try changing *YARN's* data and let you know.
>
> Thanks,
> Panagiotis
>
>
> On Wed, Sep 28, 2016 at 6:23 PM, Billie Rinaldi <billie.rina...@gmail.com>
> wrote:
>
> > I think the permission error is in running the hbase_master.py script
> > (something like python /home/pg1712/yarn-dev-panos/data/nm/usercache/
> > pg1712/appcache/application_1474990070300_0006/filecache/
> > 134/slider-hbase-app-package-1.2.3.zip/package/scripts/hbase_master.py
> > [other args]). I haven't tried running this from a user's home directory
> > before, so it's possible the user running the command doesn't have access
> > to this file/directory. The user whose permissions you should check will
> > depend on your configuration, but it might be "yarn".
> >
> > Billie
> >
> > On Wed, Sep 28, 2016 at 6:21 AM, Panagiotis Garefalakis <
> > panga...@gmail.com>
> > wrote:
> >
> > > Hello all,
> > >
> > > I tried to compile Slider trunk code with Hadoop version 3.0.0.
> > > I had to make some minor code changes and to update guice lib to v4.0
> and
> > > jersey to v1.19 to make it work.
> > >
> > > Everything looks fine but when I am trying to deploy hbase-1.2.3
> package
> > I
> > > run into a weird Permission denied error when setting the PYTHONPATH!
> > (log
> > > attached). Any idea what could have gone wrong? Any hint would be
> greatly
> > > appreciated!
> > >
> > >
> > > Thanks in advance,
> > > Panagiotis
> > >
> > >
> > > INFO 2016-09-28 13:58:45,990 AgentToggleLogger.py:40 - Running command
> > ['',
> > > '-S',
> > > u'/home/pg1712/yarn-dev-panos/data/nm/usercache/
> > > pg1712/appcache/application_1474990070300_0006/filecache/
> > > 134/slider-hbase-app-package-1.2.3.zip/package/scripts/
> hbase_master.py',
> > > u'INSTALL',
> > > '/home/pg1712/yarn-dev-panos/data/nm/logs/application_
> > > 1474990070300_0006/container_1474990070300_0006_01_000014/
> > > command-32.json',
> > > '/home/pg1712/yarn-dev-panos/data/nm/usercache/pg1712/
> > > appcache/application_1474990070300_0006/filecache/
> > > 134/slider-hbase-app-package-1.2.3.zip/package',
> > > '/home/pg1712/yarn-dev-panos/data/nm/logs/application_
> > > 1474990070300_0006/container_1474990070300_0006_01_000014/
> > > structured-out-32.json',
> > > 'INFO',
> > > '/home/pg1712/yarn-dev-panos/data/nm/usercache/pg1712/
> > > appcache/application_1474990070300_0006/container_
> > > 1474990070300_0006_01_000014']
> > > INFO 2016-09-28 13:58:45,990 AgentToggleLogger.py:40 - Setting env:
> > > PYTHONPATH to /home/pg1712/yarn-dev-panos/data/nm/usercache/pg1712/
> > > appcache/application_1474990070300_0006/filecache/
> > > 84/slider-agent.tar.gz/slider-agent/jinja2:/home/pg1712/
> > > yarn-dev-panos/data/nm/usercache/pg1712/appcache/
> > > application_1474990070300_0006/filecache/84/slider-
> > > agent.tar.gz/slider-agent
> > > ERROR 2016-09-28 13:58:46,005 CustomServiceOrchestrator.py:171 -
> Caught
> > > an exception while executing command: <type 'exceptions.OSError'>:
> [Errno
> > > 13] Permission denied
> > > Traceback (most recent call last):
> > > File "/home/pg1712/yarn-dev-panos/data/nm/usercache/pg1712/
> > > appcache/application_1474990070300_0006/filecache/
> > > 84/slider-agent.tar.gz/slider-agent/agent/
> CustomServiceOrchestrator.py",
> > > line 158, in runCommand
> > > environment_vars)
> > > File "/home/pg1712/yarn-dev-panos/data/nm/usercache/pg1712/
> > > appcache/application_1474990070300_0006/filecache/
> > > 84/slider-agent.tar.gz/slider-agent/agent/PythonExecutor.py", line 88,
> > in
> > > run_file
> > > environment_vars)
> > > File "/home/pg1712/yarn-dev-panos/data/nm/usercache/pg1712/
> > > appcache/application_1474990070300_0006/filecache/
> > > 84/slider-agent.tar.gz/slider-agent/agent/PythonExecutor.py", line
> 158,
> > > in launch_python_subprocess
> > > stderr=tmperr, close_fds=close_fds, env=env)
> > > File "/usr/lib/python2.7/subprocess.py", line 710, in __init__
> > > errread, errwrite)
> > > File "/usr/lib/python2.7/subprocess.py", line 1327, in
> _execute_child
> > > raise child_exception
> > > OSError: [Errno 13] Permission denied
> > > INFO 2016-09-28 13:58:46,089 AgentToggleLogger.py:40 - Queue result:
> > > {'componentStatus': [],
> > > 'reports': [{'actionId': u'32-1',
> > > 'clusterName': u'hbcl12',
> > > 'exitcode': 1,
> > > 'reportResult': True,
> > > 'role': u'HBASE_MASTER',
> > > 'roleCommand': u'INSTALL',
> > > 'serviceName': u'hbcl12',
> > > 'status': 'FAILED',
> > > 'stderr': "Caught an exception while executing command:
> > > <type 'exceptions.OSError'>: [Errno 13] Permission denied",
> > > 'stdout': "Caught an exception while executing command:
> > > <type 'exceptions.OSError'>: [Errno 13] Permission denied",
> > > 'structuredOut': '{}',
> > > 'taskId': 32}]}
> > >
> > >
> >
>
