Re: serialization error

ml > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > - > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For additional commands, e-mail: user-h...@spark.apache.org > > -- Andy Huang | Managing Consultant | Servian Pty Ltd | t: 02 9376 0700 | f: 02 9376 0730| m: 0433221979

Addition of Meetup Group - Sydney, Mebourne Australia

-Meetup/ Thanks -- Andy Huang | Managing Consultant | Servian Pty Ltd | t: 02 9376 0700 | f: 02 9376 0730| m: 0433221979

Re: No space left on device when running graphx job

ss the > error comes from the amount of data. > > This is how I submit the job: > > > > spark-submit --class "myclass" > > --master spark://hadoopmaster:7077 (I am using standalone) > > --executor-memory 2048M > > --driver-java-options "-XX:MaxPermS

Re: How to get RDD from PairRDD<key,value> in Java

ate to the official business of the sending company must be taken not to > have been sent or endorsed by that company or any of its related entities. > No warranty is made that the e-mail or attachments are free from computer > virus or other defect. -- Andy Huang | Managing Consultant | Servian Pty Ltd | t: 02 9376 0700 | f: 02 9376 0730| m: 0433221979

Re: Scala Limitation - Case Class definition with more than 22 arguments

any restriction as such in "case Class not allowing > more than 22 Arguments" > > As I need to define a schema of around 37 arguments > > Regards, > Satish Chandra > > On Wed, Sep 23, 2015 at 9:50 AM, Andy Huang <andy.hu...@servian.com.au> > wrote: > >

Parallel collection in driver programs

ot;("+qry+") a", pCol, lo, //lower bound hi, //upper bound part, //number of partitions prop //java.utils.Properties - key value pair ) //save to parquet jdbcDF.write.mode("overwrite").parquet(_STORE_DEFAULT+pair._1+".parquet") }) Thanks. -- Andy Huang | Managing Consultant | Servian Pty Ltd | t: 02 9376 0700 | f: 02 9376 0730| m: 0433221979

Re: Scala Limitation - Case Class definition with more than 22 arguments

g an error as "*error: Implementation >> restriction: case classes cannot have more than 22 parameters.*" >> >> It would be a great help if any inputs on the same >> >> Regards, >> Satish Chandra >> >> >> > -- Andy Huang | Managing Consultant | Servian Pty Ltd | t: 02 9376 0700 | f: 02 9376 0730| m: 0433221979

Re: 1.4.0 regression: out-of-memory errors on small data

List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org -- Andy Huang | Managing Consultant | Servian Pty Ltd | t: 02