Thanks all. I realized MapR has a work around for me that I will try soon in that I have MapR fs NFS mounted on each node, I.e. I should be able to get the tar from there.
That said, perhaps someone with better coding skills than me could provide an env variable where a user could provide the HDFS prefixes to try. I know we did that with the tachyon project and it works well for other HDFS compatible fs implementations, perhaps that would work here? Hard coding a pluggable system seems like a long term issue that will keep coming up. On Aug 15, 2014 4:02 PM, "Tim St Clair" <[email protected]> wrote: > The uri doesn't currently start with any of the known types (at least on > 1st grok). > You could redirect via a proxy that does the job for you. > > | if you had some fuse mount that would work too. > > Cheers, > Tim > > ------------------------------ > > *From: *"John Omernik" <[email protected]> > *To: *[email protected] > *Sent: *Friday, August 15, 2014 3:55:02 PM > *Subject: *Alternate HDFS Filesystems + Hadoop on Mesos > > I am on a wonderful journey trying to get hadoop on Mesos working with > MapR. I feel like I am close, but when the slaves try to run the packaged > Hadoop, I get the error below. The odd thing is, I KNOW I got Spark > running on Mesos pulling both data and the packages from MapRFS. So I am > confused why there is and issue with the fetcher.cpp here. Granted, when I > got spark working, it was on 0.19.0, and I am trying a "fresh" version from > git (0.20.0?) that I just pulled today. I am not sure if that work, but > when I have more time I will try spark again. > > Any thoughts on this error? Thanks. > > > > > Error: > > > WARNING: Logging before InitGoogleLogging() is written to STDERR > I0815 15:48:35.446071 20636 fetcher.cpp:76] Fetching URI > 'maprfs:///mesos/hadoop-0.20.2-mapr-4.0.0.tgz' > E0815 15:48:35.446184 20636 fetcher.cpp:161] A relative path was passed for > the resource but the environment variable MESOS_FRAMEWORKS_HOME is not set. > Please either specify this config option or avoid using a relative path > Failed to fetch: maprfs:///mesos/hadoop-0.20.2-mapr-4.0.0.tgz > Failed to synchronize with slave (it's probably exited) > > > > > -- > Cheers, > Timothy St. Clair > Red Hat Inc. >
