The tragic thing here is that I was asked to review the patch that introduced this <https://github.com/apache/spark/pull/3377#issuecomment-68077315>, and totally missed it... :(
On Wed Feb 11 2015 at 2:46:35 PM Nicholas Chammas < nicholas.cham...@gmail.com> wrote: > lol yeah, I changed the path for the email... turned out to be the issue > itself. > > > On Wed Feb 11 2015 at 2:43:09 PM Ted Yu <yuzhih...@gmail.com> wrote: > >> I see. >> '/path/to/spark-1.2.1-bin-hadoop2.4' didn't contain space :-) >> >> On Wed, Feb 11, 2015 at 2:41 PM, Nicholas Chammas < >> nicholas.cham...@gmail.com> wrote: >> >>> Found it: >>> >>> https://github.com/apache/spark/compare/v1.2.0...v1.2.1#diff- >>> 73058f8e51951ec0b4cb3d48ade91a1fR73 >>> >>> GRRR BASH WORD SPLITTING >>> >>> My path has a space in it... >>> >>> Nick >>> >>> On Wed Feb 11 2015 at 2:37:39 PM Nicholas Chammas < >>> nicholas.cham...@gmail.com> wrote: >>> >>>> This is what get: >>>> >>>> spark-1.2.1-bin-hadoop2.4$ ls -1 lib/ >>>> datanucleus-api-jdo-3.2.6.jar >>>> datanucleus-core-3.2.10.jar >>>> datanucleus-rdbms-3.2.9.jar >>>> spark-1.2.1-yarn-shuffle.jar >>>> spark-assembly-1.2.1-hadoop2.4.0.jar >>>> spark-examples-1.2.1-hadoop2.4.0.jar >>>> >>>> So that looks correct… Hmm. >>>> >>>> Nick >>>> >>>> >>>> On Wed Feb 11 2015 at 2:34:51 PM Ted Yu <yuzhih...@gmail.com> wrote: >>>> >>>>> I downloaded 1.2.1 tar ball for hadoop 2.4 >>>>> I got: >>>>> >>>>> ls lib/ >>>>> datanucleus-api-jdo-3.2.6.jar datanucleus-rdbms-3.2.9.jar >>>>> spark-assembly-1.2.1-hadoop2.4.0.jar >>>>> datanucleus-core-3.2.10.jar spark-1.2.1-yarn-shuffle.jar >>>>> spark-examples-1.2.1-hadoop2.4.0.jar >>>>> >>>>> FYI >>>>> >>>>> On Wed, Feb 11, 2015 at 2:27 PM, Nicholas Chammas < >>>>> nicholas.cham...@gmail.com> wrote: >>>>> >>>>>> I just downloaded 1.2.1 pre-built for Hadoop 2.4+ and ran >>>>>> sbin/start-all.sh >>>>>> on my OS X. >>>>>> >>>>>> Failed to find Spark assembly in /path/to/spark-1.2.1-bin-hadoo >>>>>> p2.4/lib >>>>>> You need to build Spark before running this program. >>>>>> >>>>>> Did the same for 1.2.0 and it worked fine. >>>>>> >>>>>> Nick >>>>>> >>>>>> >>>>> >>>>> >>
