This might have been on purpose, since the goal is to make this HDFS-friendly, and of course still allow local directories. With no scheme, a path is ambiguous.
On Sat, Jan 31, 2015 at 4:18 PM, Ted Yu <yuzhih...@gmail.com> wrote: > Looking at https://github.com/apache/spark/pull/1222/files , the following > change may have caused what Stephen described: > > + if (!fileSystem.isDirectory(new Path(logBaseDir))) { > > When there is no schema associated with logBaseDir, local path should be > assumed. > > On Fri, Jan 30, 2015 at 8:37 AM, Stephen Haberman > <stephen.haber...@gmail.com> wrote: >> >> Hi Krishna/all, >> >> I think I found it, and it wasn't related to Scala-2.11... >> >> I had "spark.eventLog.dir=/mnt/spark/work/history", which worked >> in Spark 1.2, but now am running Spark master, and it wants a >> Hadoop URI, e.g. file:///mnt/spark/work/history (I believe due to >> commit 45645191). >> >> This looks like a breaking change to the spark.eventLog.dir >> config property. >> >> Perhaps it should be patched to convert the previously supported >> "just a file path" values to HDFS-compatible "file://..." URIs >> for backwards compatibility? >> >> - Stephen >> >> >> On Wed, 28 Jan 2015 12:27:17 -0800 >> Krishna Sankar <ksanka...@gmail.com> wrote: >> >> > Stephen, >> > Scala 2.11 worked fine for me. Did the dev change and then >> > compile. Not using in production, but I go back and forth >> > between 2.10 & 2.11. Cheers >> > <k/> >> > >> > On Wed, Jan 28, 2015 at 12:18 PM, Stephen Haberman < >> > stephen.haber...@gmail.com> wrote: >> > >> > > Hey, >> > > >> > > I recently compiled Spark master against scala-2.11 (by >> > > running the dev/change-versions script), but when I run >> > > spark-shell, it looks like the "sc" variable is missing. >> > > >> > > Is this a known/unknown issue? Are others successfully using >> > > Spark with scala-2.11, and specifically spark-shell? >> > > >> > > It is possible I did something dumb while compiling master, >> > > but I'm not sure what it would be. >> > > >> > > Thanks, >> > > Stephen >> > > >> > > --------------------------------------------------------------------- >> > > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org >> > > For additional commands, e-mail: user-h...@spark.apache.org >> > > >> > > >> >> >> --------------------------------------------------------------------- >> To unsubscribe, e-mail: user-unsubscr...@spark.apache.org >> For additional commands, e-mail: user-h...@spark.apache.org >> > --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
