[GitHub] aashudwivedi commented on issue #13853: Error while running the mxnet spark examples and test cases
aashudwivedi commented on issue #13853: Error while running the mxnet spark examples and test cases URL: https://github.com/apache/incubator-mxnet/issues/13853#issuecomment-461555283 @piyushghai unfortunately I still have the same problem and I am not sure what other information I should provide you to be able to reproduce this. This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] aashudwivedi commented on issue #13853: Error while running the mxnet spark examples and test cases
aashudwivedi commented on issue #13853: Error while running the mxnet spark
examples and test cases
URL:
https://github.com/apache/incubator-mxnet/issues/13853#issuecomment-458672045
@piyushghai
I am building it on macOS High Sierra 10.13.6.
Here's what I do to build the libmxnet.so, followed the instructions from
http://mxnet.incubator.apache.org/versions/master/install/osx_setup.html#build-the-shared-library
```
git clone --recursive https://github.com/apache/incubator-mxnet ~/mxnet
cd ~/mxnet
cp make/osx.mk ./config.mk
echo "USE_BLAS = openblas" >> ./config.mk
echo "ADD_CFLAGS += -I/usr/local/opt/openblas/include" >> ./config.mk
echo "ADD_LDFLAGS += -L/usr/local/opt/openblas/lib" >> ./config.mk
echo "ADD_LDFLAGS += -L/usr/local/lib/graphviz/" >> ./config.mk
echo "USE_DIST_KVSTORE=1" >> ./config.mk
make -j$(sysctl -n hw.ncpu)
```
Here's the instance info :
```
--Python Info--
('Version :', '2.7.15')
('Compiler :', 'GCC 4.2.1 Compatible Apple LLVM 10.0.0
(clang-1000.11.45.2)')
('Build:', ('default', 'Oct 2 2018 11:47:18'))
('Arch :', ('64bit', ''))
Pip Info---
('Version :', '18.0')
('Directory:', '/usr/local/lib/python2.7/site-packages/pip')
--MXNet Info---
No MXNet installed.
--System Info--
('Platform :', 'Darwin-17.7.0-x86_64-i386-64bit')
('system :', 'Darwin')
('node :', 'ashutdwi-mac')
('release :', '17.7.0')
('version :', 'Darwin Kernel Version 17.7.0: Wed Oct 10 23:06:14 PDT
2018; root:xnu-4570.71.13~1/RELEASE_X86_64')
--Hardware Info--
('machine :', 'x86_64')
('processor:', 'i386')
machdep.cpu.brand_string: Intel(R) Core(TM) i7-4770HQ CPU @ 2.20GHz
machdep.cpu.features: FPU VME DE PSE TSC MSR PAE MCE CX8 APIC SEP MTRR PGE
MCA CMOV PAT PSE36 CLFSH DS ACPI MMX FXSR SSE SSE2 SS HTT TM PBE SSE3 PCLMULQDQ
DTES64 MON DSCPL VMX EST TM2 SSSE3 FMA CX16 TPR PDCM SSE4.1 SSE4.2 x2APIC MOVBE
POPCNT AES PCID XSAVE OSXSAVE SEGLIM64 TSCTMR AVX1.0 RDRAND F16C
machdep.cpu.leaf7_features: SMEP ERMS RDWRFSGS TSC_THREAD_OFFSET BMI1 AVX2
BMI2 INVPCID FPU_CSDS
machdep.cpu.extfeatures: SYSCALL XD 1GBPAGE EM64T LAHF LZCNT RDTSCP TSCI
```
Here's are the details of xcode:
```
Xcode 10.1
Build version 10B61
```
I've also attached the config.log from `3rdparty/ps-lite/protobuf-2.5.0` dir
here
[config.log](https://github.com/apache/incubator-mxnet/files/2809313/config.log)
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
With regards,
Apache Git Services
[GitHub] aashudwivedi commented on issue #13853: Error while running the mxnet spark examples and test cases
aashudwivedi commented on issue #13853: Error while running the mxnet spark examples and test cases URL: https://github.com/apache/incubator-mxnet/issues/13853#issuecomment-458610016 @piyushghai The path of the jars are still incorrect / incomplete. I've fixed this in this pull request, here : https://github.com/apache/incubator-mxnet/pull/14020 However there's still one problem, with the latest changes. The mxnet shared library fails to build when `USE_DIST_KVSTORE = 1` because of a the following error : ``` checking whether the C compiler works... no configure: error: in `/path_to_mxnet/incubator-mxnet/3rdparty/ps-lite/protobuf-2.5.0': configure: error: C compiler cannot create executables See `config.log' for more details make[1]: *** [/path_to_mxnet/incubator-mxnet/deps/include/google/protobuf/message.h] Error 77 make: *** [PSLITE] Error 2 ``` This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] aashudwivedi commented on issue #13853: Error while running the mxnet spark examples and test cases
aashudwivedi commented on issue #13853: Error while running the mxnet spark examples and test cases URL: https://github.com/apache/incubator-mxnet/issues/13853#issuecomment-457561018 The complete stack trace of the error is : `Testing started at 6:07 PM ... /Library/Java/JavaVirtualMachines/jdk1.8.0_181.jdk/Contents/Home/bin/java -Djava.library.path=/Users/ashutdwi/ora/opensource/incubator-mxnet/scala-package/native/osx-x86_64-cpu/target "-javaagent:/Applications/IntelliJ IDEA CE.app/Contents/lib/idea_rt.jar=55436:/Applications/IntelliJ IDEA CE.app/Contents/bin" -Dfile.encoding=UTF-8 -classpath "/Users/ashutdwi/Library/Application
[GitHub] aashudwivedi commented on issue #13853: Error while running the mxnet spark examples and test cases
aashudwivedi commented on issue #13853: Error while running the mxnet spark examples and test cases URL: https://github.com/apache/incubator-mxnet/issues/13853#issuecomment-457549027 @piyushghai The error still persists. You can reproduce it by un-commenting the test = `run spark with MLP` with it's related methods in the file `org/apache/mxnet/spark/MXNetGeneralSuite.scala` Also, the latest version in master doesn't respect the `-Djava.library.path` or `LD_LIBRARY_PATH_VARIABLES` and only picks up the native files from the jar (which doesn't seem to have these files). So to test this I am running a hacked version to make the libraries get picked up from the path I hard code `NativeLibraryLoader.scala` This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
