Re: graphframes on cluster

2017-09-22 Thread Imran Rajjad
ons with > spark-submit command > > -- > *From:* Imran Rajjad > *Sent:* Wednesday, September 20, 2017 5:47:27 AM > *To:* user @spark > *Subject:* graphframes on cluster > > Trying to run graph frames on a spark cluster. Do I need to include the > pac

Re: graphframes on cluster

2017-09-20 Thread Felix Cheung
Could you include the code where it fails? Generally the best way to use gf is to use the --packages options with spark-submit command From: Imran Rajjad Sent: Wednesday, September 20, 2017 5:47:27 AM To: user @spark Subject: graphframes on cluster Trying to

graphframes on cluster

2017-09-20 Thread Imran Rajjad
Trying to run graph frames on a spark cluster. Do I need to include the package in spark context settings? or the only the driver program is suppose to have the graphframe libraries in its class path? Currently the job is crashing when action function is invoked on graphframe classes. regards, Imr