thank you Suzen, i've had a try to generate 1 billion records within 1.5min. It is fast.And I will go on to try some other cases.
-------------------------------- Thanks&Best regards! San.Luo ----- 原始邮件 ----- 发件人:"Suzen, Mehmet" <su...@acm.org> 收件人:luohui20...@sina.com 抄送人:user <user@spark.apache.org> 主题:Re: A tool to generate simulation data 日期:2017年07月28日 01点18分 I suggest RandomRDDs API. It provides nice tools. If you write wrappers around that might be good. https://spark.apache.org/docs/latest/api/scala/index.html#org.apache.spark.mllib.random.RandomRDDs$ --------------------------------------------------------------------- To unsubscribe e-mail: user-unsubscr...@spark.apache.org