One more nightly on power: http://s3.amazonaws.com/julianightlies/bin/linux/ppc64le/0.6/julia-0.6.0-5f91c39b1c-linuxppc64.tar.gz
With this PR being merged, I am hoping 0.5 will build fine on the powerpc buildbot, and that we should start getting regular nightlies (until something break). https://github.com/JuliaLang/julia/pull/18418 -viral On Friday, September 2, 2016 at 10:32:47 PM UTC+5:30, Paulito Palmes wrote: > > Hi Viral, > > That is what I thought and read in the docs but if you run the code I > attached, merely 'using' would spit some errors where the workers are not > aware of the existence of certain function. > > It can be in the name resolution or is it because the function is inside > the a macro? I thin not a lot of packages are tested in using @parallel > for. So far, the only solution so that my code work is to use using first > and the @everywhere using. > > Sent from my iPhone > > On 2 Sep 2016, at 17:29, Viral Shah <vi...@mayin.org> wrote: > > You do not need @everywhere. `using` will load on all nodes. > > -viral > > On Friday, September 2, 2016 at 2:39:34 PM UTC+5:30, Paulito Palmes wrote: >> >> I also noticed (not specific to Power machines) that when you want to >> load packages in Julia with several workers, I have to do the following to >> have successful loading of packages: >> >> nprocs()==1 && addprocs() >> using Knet >> @everywhere using Knet >> using RDatasets >> @everywhere using RDatasets >> using MLBase >> @everywhere using MLBase >> >> >> If I use, >> nprocs()==1 && addprocs() >> @everywhere using RDatasets >> @everywhere using Knet >> @everywhere using MLBase >> >> I have this error: >> ERROR: On worker 2: >> LoadError: LoadError: UndefVarError: @knet not defined >> >> If I use, >> nprocs()==1 && addprocs() >> using RDatasets >> using Knet >> using MLBase >> >> ERROR (unhandled task failure): On worker 4: >> On worker 4: >> On worker 4: >> UndefVarError: Gaussian not defined >> >> Attached is the code that I use which uses 3 @parallel for syntax >> >> My insight is that you need to load first all the packages into the >> process id 1 to avoid clashes during pre-cache compilation and use >> @everywhere using >> to export the functions to other processes. It seems that just *using* >> directives does not immediately export those functions to all processes >> based on the code attached such that I have to use "@everywhere using" >> directives. Is this a bug? >> >> Please try to reproduce the errors I have with the attached code. This >> error only happens if you do addprocs() to run parallel julia. >> >> I'm using Julia 0.4.6 (2016-06-19 17:16 UTC) >> >> On Fri, Sep 2, 2016 at 9:52 AM, Paulito Palmes <ppal...@gmail.com> wrote: >> >>> Hi All, >>> >>> I noticed that some of the packages are not aware that Julia has power >>> port now and when you install those packages, they include some compiler >>> directives specific to Intel processor such as SSE. In the Makefile, I >>> removed this extra option and the package compiles. However, if I do >>> Pkg.build("Package"), it does not respect the edited Makefile and starts to >>> download from github. I don't know the sequence of operations behind but is >>> there a way to manually compile and install the local package downloaded >>> after you edit some files to make it work for the power machine? >>> >>> I think the long term solution is to have a test server running power >>> machine to flag that the package did not compile successfully to the power >>> port. >>> >>> -paulito >>> >>> On Fri, Sep 2, 2016 at 8:02 AM, Viral Shah <vi...@mayin.org> wrote: >>> >>>> Can you try this one? I believe this error is addressed now. >>>> >>>> >>>> http://s3.amazonaws.com/julianightlies/bin/linux/ppc64le/julia-latest-linuxppc64.tar.gz >>>> >>>> Also, Elliot enabled the nightlies: >>>> >>>> https://build.julialang.org/builders/package_tarballppc64le >>>> >>>> -viral >>>> >>>> >>>> > On Sep 2, 2016, at 4:15 AM, James Fairbanks <jpfairba...@gmail.com> >>>> wrote: >>>> > >>>> > Hi Viral, >>>> > >>>> > I got negative results on my power8 machine. >>>> > After untarring the link above I got the following errors when just >>>> running the repl. >>>> > >>>> > >>>> > [jpf@power8 julia-3005940a21]$ ./bin/julia >>>> > 'powerpc64le' is not a recognized processor for this target (ignoring >>>> processor) >>>> > 'powerpc64le' is not a recognized processor for this target (ignoring >>>> processor) >>>> > 'powerpc64le' is not a recognized processor for this target (ignoring >>>> processor) >>>> > 'powerpc64le' is not a recognized processor for this target (ignoring >>>> processor) >>>> > 'powerpc64le' is not a recognized processor for this target (ignoring >>>> processor) >>>> > 'powerpc64le' is not a recognized processor for this target (ignoring >>>> processor) >>>> > 'powerpc64le' is not a recognized processor for this target (ignoring >>>> processor) >>>> > 'powerpc64le' is not a recognized processor for this target (ignoring >>>> processor) >>>> > 'powerpc64le' is not a recognized processor for this target (ignoring >>>> processor) >>>> > 'powerpc64le' is not a recognized processor for this target (ignoring >>>> processor) >>>> > 'powerpc64le' is not a recognized processor for this target (ignoring >>>> processor) >>>> > 'powerpc64le' is not a recognized processor for this target (ignoring >>>> processor) >>>> > _ >>>> > _ _ _(_)_ | A fresh approach to technical computing >>>> > (_) | (_) (_) | Documentation: http://docs.julialang.org >>>> > _ _ _| |_ __ _ | Type "?help" for help. >>>> > | | | | | | |/ _` | | >>>> > | | |_| | | | (_| | | Version 0.5.0-rc3+3 (2016-08-26 06:19 UTC) >>>> > _/ |\__'_|_|_|\__'_| | sf/ppc64le/3005940 (fork: 3 commits, 9 days) >>>> > |__/ | powerpc64le-unknown-linux-gnu >>>> > >>>> > >>>> > Then I got a lot more errors. >>>> > For example: >>>> > >>>> > WARNING: Method definition f(Tuple{Vararg{Int64, #N<:Any}}, >>>> AbstractArray{#T<:Any, #N<:Any}) in module Main at >>>> /home/jpf/julia-3005940a21/share/julia/test/core.jl:706 overwritten at >>>> /home/jpf/julia-3005940a21/share/julia/test/core.jl:712. >>>> > From worker 13: * linalg/diagonal in 101.62 >>>> seconds, maxrss 348.31 MB >>>> > From worker 13: * inference in 0.92 >>>> seconds, maxrss 352.38 MB >>>> > From worker 13: * keywordargs in 1.56 >>>> seconds, maxrss 354.13 MB >>>> > WARNING: Method definition f() in module JLCall14301 at >>>> /home/jpf/julia-3005940a21/share/julia/test/core.jl:3529 overwritten at >>>> /home/jpf/julia-3005940a21/share/julia/test/core.jl:3539. >>>> > From worker 5: * linalg/matmul in 169.17 seconds, >>>> maxrss 367.69 MB >>>> > From worker 16: * linalg/cholesky in 96.71 >>>> seconds, maxrss 332.44 MB >>>> > From worker 16: * char Error During Test >>>> > From worker 16: Test threw an exception of type InexactError >>>> > From worker 16: Expression: $(Expr(:escape, >>>> :(convert(Char,Float16(x))))) $(Expr(:escape, :(==))) $(Expr(:escape, >>>> :(convert(Char,Float32(x))))) $(Expr(:escape, :(==))) $(Expr(:escape, >>>> :(convert(Char,Float64(x))))) $(Expr(:escape, :(==))) $(Expr(:escape, >>>> :(Char(x)))) >>>> > From worker 16: InexactError() >>>> > From worker 16: in macro expansion; at >>>> /home/jpf/julia-3005940a21/share/julia/test/char.jl:72 [inlined] >>>> > From worker 16: in anonymous at ./<missing>:? >>>> > From worker 16: in include_string(::String, ::String) at >>>> ./loading.jl:380 >>>> > From worker 16: in include_from_node1(::String) at >>>> ./loading.jl:429 >>>> > From worker 16: in macro expansion at ./util.jl:226 >>>> [inlined] >>>> > From worker 16: in runtests(::String) at >>>> /home/jpf/julia-3005940a21/share/julia/test/testdefs.jl:7 >>>> > From worker 16: in >>>> (::Base.Serializer.__deserialized_types__.##16#24)(::String) at >>>> /home/jpf/julia-3005940a21/share/julia/test/runtests.jl:44 >>>> > From worker 16: in >>>> (::Base.##625#627{Base.CallMsg{:call_fetch}})() at ./multi.jl:1421 >>>> > From worker 16: in >>>> run_work_thunk(::Base.##625#627{Base.CallMsg{:call_fetch}}, ::Bool) at >>>> ./multi.jl:1001 >>>> > From worker 16: in macro expansion at ./multi.jl:1421 >>>> [inlined] >>>> > From worker 16: in >>>> (::Base.##624#626{Base.CallMsg{:call_fetch},Base.MsgHeader,TCPSocket})() >>>> at >>>> ./event.jl:68 >>>> > >>>> > On Tuesday, August 30, 2016 at 1:30:54 AM UTC-4, Viral Shah wrote: >>>> > I should point out that the linalg tests are expected to fail for >>>> now, since we are awaiting a new openblas release, which is known to fix >>>> these issues. >>>> > >>>> > -viral >>>> > >>>> > On Friday, August 19, 2016 at 10:26:38 AM UTC+5:30, Viral Shah wrote: >>>> > I have uploaded Julia-0.5 on Power8 binaries here. These are built >>>> with the latest openblas (that passes all julia tests) and hence there is >>>> no need to use ATLAS. >>>> > >>>> > https://drive.google.com/open?id=0B0rXlkvSbIfhVWpZb2hqclBIVms >>>> > >>>> > Would be great if people can try this out. >>>> > >>>> > -viral >>>> > >>>> > >>>> > >>>> > > On Aug 19, 2016, at 9:06 AM, Viral Shah <vi...@mayin.org> wrote: >>>> > > >>>> > > I am getting successful builds on the OSU Power8 machine. Once >>>> openblas has a new release, I suspect we can provide pre-packaged power8 >>>> binaries. >>>> > > >>>> > > I am building on CentOS 7 and this is what lscpu says: >>>> > > >>>> > > Architecture: ppc64le >>>> > > Byte Order: Little Endian >>>> > > CPU(s): 160 >>>> > > On-line CPU(s) list: 0-159 >>>> > > Thread(s) per core: 8 >>>> > > Core(s) per socket: 10 >>>> > > Socket(s): 2 >>>> > > NUMA node(s): 2 >>>> > > Model: 8335-GCA >>>> > > L1d cache: 64K >>>> > > L1i cache: 32K >>>> > > L2 cache: 512K >>>> > > L3 cache: 8192K >>>> > > NUMA node0 CPU(s): 0-79 >>>> > > NUMA node8 CPU(s): 80-159 >>>> > > >>>> > > I suspect you are running into a codegen issue. Let’s give it a few >>>> days and once llvm 3.9 releases, we can try that. If not, we may need >>>> Jameson’s help. >>>> > > >>>> > > -viral >>>> > > >>>> > > >>>> > > >>>> > >> On Aug 19, 2016, at 8:54 AM, Viral Shah <vi...@mayin.org> wrote: >>>> > >> >>>> > >> It is hard to say what is happening there. Trying it out. >>>> > >> >>>> > >> OpenBLAS develop branch is now passing on Power and hence Atlas >>>> should no longer be required. Note that you need the latest (3.10.4?) >>>> ATLAS, but in any case, this should not affect the build. >>>> > >> >>>> > >> -viral >>>> > >> >>>> > >> >>>> > >> >>>> > >>> On Aug 18, 2016, at 7:03 PM, Geert Janssen <gee...@gmail.com> >>>> wrote: >>>> > >>> >>>> > >>> Dear Viral, >>>> > >>> >>>> > >>> I am building Julie release-0.5 on a Power8E Ubuntu 14.10 machine. >>>> > >>> I use the following Make.user after having had trouble compiling >>>> OpenBLAS that was pulled in: >>>> > >>> >>>> > >>> created Make.user: >>>> > >>> override USE_SYSTEM_BLAS = 1 >>>> > >>> override USE_BLAS64 = 0 >>>> > >>> override LIBBLAS = -L/opt/atlas/lib -ltatlas >>>> > >>> override LIBBLASNAME = libtatlas >>>> > >>> >>>> > >>> I get a clean build all the way till the end and then this >>>> happens: >>>> > >>> >>>> > >>> .... >>>> > >>> JULIA usr/lib/julia/inference.ji >>>> > >>> /bin/sh: line 1: 6967 Segmentation fault >>>> /localhome/geert/src/julia/usr/bin/julia -C native --output-ji >>>> /localhome/geert/src/julia/usr/lib/julia/inference.ji --startup-file=no >>>> coreimg.jl >>>> > >>> Makefile:215: recipe for target >>>> '/localhome/geert/src/julia/usr/lib/julia/inference.ji' failed >>>> > >>> make[1]: *** >>>> [/localhome/geert/src/julia/usr/lib/julia/inference.ji] Error 139 >>>> > >>> Makefile:96: recipe for target 'julia-inference' failed >>>> > >>> make: *** [julia-inference] Error 2 >>>> > >>> >>>> > >>> The machine and OS details are: >>>> > >>> >>>> > >>> geert@tulgpu505:~/src/julia$ lscpu >>>> > >>> Architecture: ppc64le >>>> > >>> Byte Order: Little Endian >>>> > >>> CPU(s): 184 >>>> > >>> On-line CPU(s) list: 0-151,160-191 >>>> > >>> Thread(s) per core: 8 >>>> > >>> Core(s) per socket: 5 >>>> > >>> Socket(s): 4 >>>> > >>> NUMA node(s): 4 >>>> > >>> Model: 8247-42L >>>> > >>> CPU max MHz: 3923.0000 >>>> > >>> CPU min MHz: 2061.0000 >>>> > >>> L1d cache: 64K >>>> > >>> L1i cache: 32K >>>> > >>> L2 cache: 512K >>>> > >>> L3 cache: 8192K >>>> > >>> NUMA node0 CPU(s): 0-47 >>>> > >>> NUMA node1 CPU(s): 48-95 >>>> > >>> NUMA node16 CPU(s): 96-143 >>>> > >>> NUMA node17 CPU(s): 144-151,160-191 >>>> > >>> geert@tulgpu505:~/src/julia$ cat /etc/os-release >>>> > >>> NAME="Ubuntu" >>>> > >>> VERSION="14.10 (Utopic Unicorn)" >>>> > >>> ID=ubuntu >>>> > >>> ID_LIKE=debian >>>> > >>> PRETTY_NAME="Ubuntu 14.10" >>>> > >>> VERSION_ID="14.10" >>>> > >>> HOME_URL="http://www.ubuntu.com/"; >>>> > >>> SUPPORT_URL="http://help.ubuntu.com/"; >>>> > >>> BUG_REPORT_URL="http://bugs.launchpad.net/ubuntu/"; >>>> > >>> geert@tulgpu505:~/src/julia$ uname -a >>>> > >>> Linux tulgpu505 3.16.0-30-generic #40-Ubuntu SMP Mon Jan 12 >>>> 22:07:11 UTC 2015 ppc64le ppc64le ppc64le GNU/Linux >>>> > >>> geert@tulgpu505:~/src/julia$ >>>> > >>> >>>> > >>> Any suggestions? >>>> > >>> >>>> > >>> Thanks, >>>> > >>> >>>> > >>> Geert >>>> > >> >>>> > > >>>> > >>>> >>>> >>> >>
