[jira] [Commented] (MESOS-6914) Command 'hadoop version 2>&1' failed
[ https://issues.apache.org/jira/browse/MESOS-6914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16431847#comment-16431847 ] wangyuzhao commented on MESOS-6914: --- I encountered this issue, even add "export MESOS_hadoop_home=xxx" in the mesos_agent_env.sh. i wonder it's related to the isolation mechanism, such as cgroups.Does it includes the namespace's file system isolation, i.e Mount? > Command 'hadoop version 2>&1' failed > > > Key: MESOS-6914 > URL: https://issues.apache.org/jira/browse/MESOS-6914 > Project: Mesos > Issue Type: Bug >Reporter: yangjunfeng >Priority: Major > > I am green hand in spark on mesos. > when I run spark-shell on mesos. The error is below: > Command 'hadoop version 2>&1' failed; this is the output: > sh: hadoop: command not found > Failed to fetch > 'hdfs://188.188.0.189:9000/usr/yjf/spark-2.1.0-bin-hadoop2.7.tgz': Failed to > create HDFS client: Failed to execute 'hadoop version 2>&1'; the command was > either not found or exited with a non-zero exit status: 127 > Failed to synchronize with agent (it's probably exited) > How can I fix this problom. > Thanks a lot! -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (MESOS-6914) Command 'hadoop version 2>&1' failed
[
https://issues.apache.org/jira/browse/MESOS-6914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256218#comment-16256218
]
Damien Gerard commented on MESOS-6914:
--
Logs:
{noformat}
Nov 17 09:30:25 * mesos-slave[63839]: I1117 09:30:25.006713 63839
systemd.cpp:326] Started systemd slice `mesos_executors.slice`
Nov 17 09:30:25 * mesos-slave[63839]: I1117 09:30:25.007498 63839
resolver.cpp:69] Creating default secret resolver
Nov 17 09:30:25 * mesos-slave[63839]: I1117 09:30:25.100229 63839
containerizer.cpp:246] Using isolation:
disk/du,docker/runtime,filesystem/linux,namespaces/pid,volume/sandbox_path,network/cni,volume/image,environment_secret
Nov 17 09:30:25 * mesos-slave[63839]: I1117 09:30:25.106936 63839
linux_launcher.cpp:150] Using /sys/fs/cgroup/freezer as the freezer hierarchy
for the Linux launcher
Nov 17 09:30:25 * mesos-slave[63839]: E1117 09:30:25.112092 63839
shell.hpp:107] Command 'hadoop version 2>&1' failed; this is the output:
Nov 17 09:30:25 * mesos-slave[63839]: sh: 1: hadoop: not found
Nov 17 09:30:25 * mesos-slave[63839]: I1117 09:30:25.112385 63839
fetcher.cpp:69] Skipping URI fetcher plugin 'hadoop' as it could not be
created: Failed to create HDFS client: Failed to execute 'hadoop version 2>&1';
the command was either not found or exited with a non-zero exit status: 127
Nov 17 09:30:25 * mesos-slave[63839]: I1117 09:30:25.112963 63839
provisioner.cpp:255] Using default backend 'overlay'
{noformat}
So basically this hadoop/hdfs client has not its place here.
> Command 'hadoop version 2>&1' failed
>
>
> Key: MESOS-6914
> URL: https://issues.apache.org/jira/browse/MESOS-6914
> Project: Mesos
> Issue Type: Bug
>Reporter: yangjunfeng
>
> I am green hand in spark on mesos.
> when I run spark-shell on mesos. The error is below:
> Command 'hadoop version 2>&1' failed; this is the output:
> sh: hadoop: command not found
> Failed to fetch
> 'hdfs://188.188.0.189:9000/usr/yjf/spark-2.1.0-bin-hadoop2.7.tgz': Failed to
> create HDFS client: Failed to execute 'hadoop version 2>&1'; the command was
> either not found or exited with a non-zero exit status: 127
> Failed to synchronize with agent (it's probably exited)
> How can I fix this problom.
> Thanks a lot!
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Commented] (MESOS-6914) Command 'hadoop version 2>&1' failed
[
https://issues.apache.org/jira/browse/MESOS-6914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256215#comment-16256215
]
Damien Gerard commented on MESOS-6914:
--
Actually there is a bug on this.
Just add {{docker/volume}} as isolation and you will get this error. And there
is no hadoop/spark whatever in my mesos installation. I am running with the
latest versions of mesos.
> Command 'hadoop version 2>&1' failed
>
>
> Key: MESOS-6914
> URL: https://issues.apache.org/jira/browse/MESOS-6914
> Project: Mesos
> Issue Type: Bug
>Reporter: yangjunfeng
>
> I am green hand in spark on mesos.
> when I run spark-shell on mesos. The error is below:
> Command 'hadoop version 2>&1' failed; this is the output:
> sh: hadoop: command not found
> Failed to fetch
> 'hdfs://188.188.0.189:9000/usr/yjf/spark-2.1.0-bin-hadoop2.7.tgz': Failed to
> create HDFS client: Failed to execute 'hadoop version 2>&1'; the command was
> either not found or exited with a non-zero exit status: 127
> Failed to synchronize with agent (it's probably exited)
> How can I fix this problom.
> Thanks a lot!
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Commented] (MESOS-6914) Command 'hadoop version 2>&1' failed
[ https://issues.apache.org/jira/browse/MESOS-6914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15851791#comment-15851791 ] Anand Mazumdar commented on MESOS-6914: --- Did you get a chance to see this [~kingpoker]? > Command 'hadoop version 2>&1' failed > > > Key: MESOS-6914 > URL: https://issues.apache.org/jira/browse/MESOS-6914 > Project: Mesos > Issue Type: Bug >Reporter: yangjunfeng > > I am green hand in spark on mesos. > when I run spark-shell on mesos. The error is below: > Command 'hadoop version 2>&1' failed; this is the output: > sh: hadoop: command not found > Failed to fetch > 'hdfs://188.188.0.189:9000/usr/yjf/spark-2.1.0-bin-hadoop2.7.tgz': Failed to > create HDFS client: Failed to execute 'hadoop version 2>&1'; the command was > either not found or exited with a non-zero exit status: 127 > Failed to synchronize with agent (it's probably exited) > How can I fix this problom. > Thanks a lot! -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (MESOS-6914) Command 'hadoop version 2>&1' failed
[ https://issues.apache.org/jira/browse/MESOS-6914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15822267#comment-15822267 ] Kevin Klues commented on MESOS-6914: Maybe you could give a bit more context about how to reproduce the error? > Command 'hadoop version 2>&1' failed > > > Key: MESOS-6914 > URL: https://issues.apache.org/jira/browse/MESOS-6914 > Project: Mesos > Issue Type: Bug >Reporter: yangjunfeng > > I am green hand in spark on mesos. > when I run spark-shell on mesos. The error is below: > Command 'hadoop version 2>&1' failed; this is the output: > sh: hadoop: command not found > Failed to fetch > 'hdfs://188.188.0.189:9000/usr/yjf/spark-2.1.0-bin-hadoop2.7.tgz': Failed to > create HDFS client: Failed to execute 'hadoop version 2>&1'; the command was > either not found or exited with a non-zero exit status: 127 > Failed to synchronize with agent (it's probably exited) > How can I fix this problom. > Thanks a lot! -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (MESOS-6914) Command 'hadoop version 2>&1' failed
[ https://issues.apache.org/jira/browse/MESOS-6914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15822255#comment-15822255 ] Kevin Klues commented on MESOS-6914: To resolve this, it depends on exactly what it is you'd like to accomplish. Do you actually want/need HDFS running on your system, or are you just bothered by the error message being there? The agent should still start up despite this error, correct? > Command 'hadoop version 2>&1' failed > > > Key: MESOS-6914 > URL: https://issues.apache.org/jira/browse/MESOS-6914 > Project: Mesos > Issue Type: Bug >Reporter: yangjunfeng > > I am green hand in spark on mesos. > when I run spark-shell on mesos. The error is below: > Command 'hadoop version 2>&1' failed; this is the output: > sh: hadoop: command not found > Failed to fetch > 'hdfs://188.188.0.189:9000/usr/yjf/spark-2.1.0-bin-hadoop2.7.tgz': Failed to > create HDFS client: Failed to execute 'hadoop version 2>&1'; the command was > either not found or exited with a non-zero exit status: 127 > Failed to synchronize with agent (it's probably exited) > How can I fix this problom. > Thanks a lot! -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (MESOS-6914) Command 'hadoop version 2>&1' failed
[ https://issues.apache.org/jira/browse/MESOS-6914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15820300#comment-15820300 ] yangjunfeng commented on MESOS-6914: hadoop has installed in these agents there are some configurations which I have missed however I cant find any documents to solve this problom > Command 'hadoop version 2>&1' failed > > > Key: MESOS-6914 > URL: https://issues.apache.org/jira/browse/MESOS-6914 > Project: Mesos > Issue Type: Bug >Reporter: yangjunfeng > > I am green hand in spark on mesos. > when I run spark-shell on mesos. The error is below: > Command 'hadoop version 2>&1' failed; this is the output: > sh: hadoop: command not found > Failed to fetch > 'hdfs://188.188.0.189:9000/usr/yjf/spark-2.1.0-bin-hadoop2.7.tgz': Failed to > create HDFS client: Failed to execute 'hadoop version 2>&1'; the command was > either not found or exited with a non-zero exit status: 127 > Failed to synchronize with agent (it's probably exited) > How can I fix this problom. > Thanks a lot! -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (MESOS-6914) Command 'hadoop version 2>&1' failed
[ https://issues.apache.org/jira/browse/MESOS-6914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15820298#comment-15820298 ] yangjunfeng commented on MESOS-6914: hadoop has installed in these agents there are some configurations which I have missed however I cant find any documents to solve this problom > Command 'hadoop version 2>&1' failed > > > Key: MESOS-6914 > URL: https://issues.apache.org/jira/browse/MESOS-6914 > Project: Mesos > Issue Type: Bug >Reporter: yangjunfeng > > I am green hand in spark on mesos. > when I run spark-shell on mesos. The error is below: > Command 'hadoop version 2>&1' failed; this is the output: > sh: hadoop: command not found > Failed to fetch > 'hdfs://188.188.0.189:9000/usr/yjf/spark-2.1.0-bin-hadoop2.7.tgz': Failed to > create HDFS client: Failed to execute 'hadoop version 2>&1'; the command was > either not found or exited with a non-zero exit status: 127 > Failed to synchronize with agent (it's probably exited) > How can I fix this problom. > Thanks a lot! -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (MESOS-6914) Command 'hadoop version 2>&1' failed
[ https://issues.apache.org/jira/browse/MESOS-6914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15820289#comment-15820289 ] haosdent commented on MESOS-6914: - this is no a bug. we use this to determine if hadoop installed in the agents. > Command 'hadoop version 2>&1' failed > > > Key: MESOS-6914 > URL: https://issues.apache.org/jira/browse/MESOS-6914 > Project: Mesos > Issue Type: Bug >Reporter: yangjunfeng > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
