Thanks for the reply, I have tested with systemml-standalone.py too. I am still faced with the same problem. Currently my spark is configured to work on local fs instead of HDFS hence I did not have a problem with the ~.
Regards, Krishna On Sat, Sep 16, 2017 at 7:24 AM, Matthias Boehm <[email protected]> wrote: > well, I don't think any HDFS fs implementation resolves '~' - so it has > probably created a directory called '~/open-source/scripts/PCA_data' in > your user path in HDFS or current directory in local FS. > > Regards, > Matthias > > On Fri, Sep 15, 2017 at 5:47 PM, Krishna Kalyan <[email protected]> > wrote: > > > Hello, > > I using PCA > > <https://github.com/apache/systemml/blob/master/scripts/ > > datagen/genRandData4PCA.dml> > > data > > generation scripts to generate data. Unfortunately they do not produce > any > > output in the specified target directory. > > > > Command used: > > > > systemml/bin/systemml-spark-submit.py -f genRandData4PCA.dml -nvargs > > R=1000000 C=1000 OUT=~/open-source/scripts/PCA_data > > > > logs > > https://gist.github.com/krishnakalyan3/70796b13735743886e41d3da6b75d7d5 > > > > This job also does not throw any errors during exection. > > > > Thank you so much, > > Krishna > > >
