Hello, Please check out /tmp/spark-edp/<id_of_job>/ directory on the master node of your cluster for additional details about job's failure.
Also, it would be helpful if you will share with us additional details about your cluster setup. I mean, plugin, version, version of OpenStack installed on your lab. Best regards, Vitaly Gridnev > On Nov 23, 2016, at 2:31 PM, Reza Bakhshayeshi <[email protected]> wrote: > > Hi all, > > I'm going to execute Spark job with help of Sahara and Swift from here on > OpenStack mitaka: > > https://github.com/openstack/sahara-tests/tree/master/sahara_tests/scenario/defaults/edp-examples/edp-spark > > <https://github.com/openstack/sahara-tests/tree/master/sahara_tests/scenario/defaults/edp-examples/edp-spark> > Without any error in sahara logs, job goes to Done with Error when I'm trying > to use Swift. I've set swift username and password, and ...spark.adapt... in > configuration and input and output file in arguments part. And I've created > input file in swift. Worth to mention, there are some authentication > disabled lines in Spark log file in VM. > > But, when I use HDFS instead of swift everything is OK and job is done > successfully. > > What am I missing? > > Regards > Reza > > _______________________________________________ > Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack > Post to : [email protected] > Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
_______________________________________________ Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack Post to : [email protected] Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
