Re: graphframes on cluster

2017-09-22 Thread Imran Rajjad
the --packages options with > spark-submit command > > ------ > *From:* Imran Rajjad <raj...@gmail.com> > *Sent:* Wednesday, September 20, 2017 5:47:27 AM > *To:* user @spark > *Subject:* graphframes on cluster > > Trying to run graph

Re: graphframes on cluster

2017-09-20 Thread Felix Cheung
Could you include the code where it fails? Generally the best way to use gf is to use the --packages options with spark-submit command From: Imran Rajjad <raj...@gmail.com> Sent: Wednesday, September 20, 2017 5:47:27 AM To: user @spark Subject: graph

graphframes on cluster

2017-09-20 Thread Imran Rajjad
Trying to run graph frames on a spark cluster. Do I need to include the package in spark context settings? or the only the driver program is suppose to have the graphframe libraries in its class path? Currently the job is crashing when action function is invoked on graphframe classes. regards,