thank you Suzen, i've had a try to generate 1 billion records within 1.5min. It 
is fast.And I will go on to try some other cases.

--------------------------------

 

Thanks&Best regards!
San.Luo

----- 原始邮件 -----
发件人:"Suzen, Mehmet" <su...@acm.org>
收件人:luohui20...@sina.com
抄送人:user <user@spark.apache.org>
主题:Re: A tool to generate simulation data
日期:2017年07月28日 01点18分


I suggest RandomRDDs API. It provides nice tools. If you write
wrappers around that might be good.
https://spark.apache.org/docs/latest/api/scala/index.html#org.apache.spark.mllib.random.RandomRDDs$
---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscr...@spark.apache.org

Reply via email to