Dear Randy,
On 08/05/2019 19:45, Randy Philipp wrote:
I am currently having issues with building TensorFlow with the fosscuda
toolchain. It appears to be crashing at a different part during the
build, here are some examples:
easybuild-TensorFlow-1.12.0-20190506.122602.aYbgD.log:ERROR:
/umbc/ebuild-soft/skylake/build/TensorFlow/1.12.0/fosscuda-2018b-Python-3.6.6/TensorFlow/tensorflow-1.12.0/tensorflow/contrib/tpu/BUILD:94:1:
undeclared inclusion(s) in rule
'//tensorflow/contrib/tpu:cross_replica_ops_op_lib':
easybuild-TensorFlow-1.12.0-20190507.103937.SGqcM.log:ERROR:
/umbc/ebuild-soft/skylake/build/TensorFlow/1.12.0/fosscuda-2018b-Python-3.6.6/TensorFlow/tensorflow-1.12.0/tensorflow/contrib/periodic_resample/BUILD:29:1:
undeclared inclusion(s) in rule
'//tensorflow/contrib/periodic_resample:python/ops/_periodic_resample_op.so':
easybuild-TensorFlow-1.12.0-20190508.094415.cUbwF.log:ERROR:
/umbc/ebuild-soft/skylake/build/TensorFlow/1.12.0/fosscuda-2018b-Python-3.6.6/TensorFlow/tensorflow-1.12.0/tensorflow/contrib/text/BUILD:73:1:
undeclared inclusion(s) in rule
'//tensorflow/contrib/text:python/ops/_skip_gram_ops.so':
I have successfully built TensorFlow with foss-2018b toolchain.
Here a few of the log files on GIST:
https://gist.github.com/crphilipp/7bfd6457c1cb49cb7afab4c770438f3e
https://gist.github.com/crphilipp/eb185070f4fd4d32aa5c2a8a1a263c21
Please let me know if there is any additional information you need. Any
help you could provide would be greatly appreciated.
Is there any reason you're building TensorFlow 1.12.0 here rather than
the latest stable 1.13.1? You could be hitting a bug that was fixed in
TF 1.13.1...
As mentioned on the EasyBuild Slack channel, please try and clean up
both $HOME/.cache/pip and $HOME/.cache/bazel, to rule out that this
problem is caused due to a caching issue.
We've made some changes recently (to be included in EasyBuild v3.9.1) to
prevent Bazel/pip from (ab)using $HOME/.cache...
regards,
Kenneth