Hi Kenneth, Is it possible that you forgot to check in the patches TensorFlow-1.4.0_swig-env.patch and TensorFlow-1.4.0_no-enum34.patch in your PR? Attempting to build TensorFlow fails because it cannot find these.
Best regards Jakob > On 4 Jan 2018, at 16:37, Jakob Schiøtz <[email protected]> wrote: > > Dear Kenneth, Pablo and Maxime, > > Thanks for your feedback. Yes, I will try to see if I can build from source, > but I will focus on the foss toolchain since we use that one for our Python > here (we do not have the Intel MPI license, and the iomkl toolchain could not > built Python last time I tried). > > I assume the reason for building from source is to ensure consistent library > versions etc. If that proves very difficult, could we perhaps in the interim > have builds (with a -bin suffix?) using the prebuilt wheels? > > Best regards > > Jakob > > >> On 4 Jan 2018, at 15:29, Kenneth Hoste <[email protected]> wrote: >> >> Dear Jakob, >> >> On 04/01/2018 10:23, Jakob Schiøtz wrote: >>> Hi, >>> >>> I made a TensorFlow easyconfig a while ago depending on Python with the >>> foss toolchain; and including a variant with GPU support (PR 4904). The >>> latter has not yet been merged, probably because it is annoying to have >>> something that can only build on a machine with a GPU (it fails the sanity >>> check otherwise, as TensorFlow with GPU support cannot load on a machine >>> without it). >> >> Not being able to test this on a non-GPU system is a bit unfortunate, but >> that's not a reason that it hasn't been merged yet, that's mostly due to a >> lack of time from my side to get back to it... >> >>> Since I made that PR, two newer releases of TensorFlow have appeared (1.3 >>> and 1.4). There are easyconfigs for 1.3 with the Intel tool chain. I am >>> considering making easyconfigs for TensorFlow 1.4 with >>> Python-3.6.3-foss-2017b (both with and without GPU support), but first I >>> would like to know if anybody else is doing this - it is my impression that >>> somebody who actually know what they are doing may be working on >>> TensorFlow. :-) >> >> I have spent quite a bit of time puzzling together an easyblock that >> supports building TensorFlow from source, see [1]. >> >> It already works for non-GPU installations (see [2] for example), but it's >> not entirely finished yet because: >> >> * building from source with CUDA support does not work yet, the build fails >> with strange Bazel errors... >> >> * there are some issues when the TensorFlow easyblock is used together with >> --use-ccache and the Intel compilers; >> because two compiler wrappers are used, they end up calling each other >> resulting in a "fork bomb" style situation... >> >> I would really like to get it finished and have easyconfigs available for >> TensorFlow 1.4 and newer where we properly build TensorFlow from source >> rather than using the binary wheels... >> >> Are you up for giving it a try, and maybe helping out with the problems >> mentioned above? >> >> >> regards, >> >> Kenneth >> >> >> [1] https://github.com/easybuilders/easybuild-easyblocks/pull/1287 >> [2] https://github.com/easybuilders/easybuild-easyconfigs/pull/5499 >> >>> >>> Best regards >>> >>> Jakob >>> >>> -- >>> Jakob Schiøtz, professor, Ph.D. >>> Department of Physics >>> Technical University of Denmark >>> DK-2800 Kongens Lyngby, Denmark >>> http://www.fysik.dtu.dk/~schiotz/ >>> >>> >>> >> > > -- > Jakob Schiøtz, professor, Ph.D. > Department of Physics > Technical University of Denmark > DK-2800 Kongens Lyngby, Denmark > http://www.fysik.dtu.dk/~schiotz/ > > > -- Jakob Schiøtz, professor, Ph.D. Department of Physics Technical University of Denmark DK-2800 Kongens Lyngby, Denmark http://www.fysik.dtu.dk/~schiotz/
