Are these ticker prices for these companies like share value etc? How do you get this company data in Spark? Are you using Spark streaming to get the prices, then work out the stats (AVG, STDDEV etc) and put them back into DB?
HTH Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>* http://talebzadehmich.wordpress.com *Disclaimer:* Use it at your own risk. Any and all responsibility for any loss, damage or destruction of data or any other property which may arise from relying on this email's technical content is explicitly disclaimed. The author will in no case be liable for any monetary damages arising from such loss, damage or destruction. On Fri, 5 Apr 2019 at 10:51, Shyam P <shyamabigd...@gmail.com> wrote: > Hi , > In my scenario I have few companies , for which I need to calculate few > stats like avg I need to be stored in Cassandra , for next set of records I > need to get previously calculated and over it i need to calculate > accumulated results ( i.e preset set of data + previously stored stats) and > stored it back to Cassandra. > > what function/API of spark be used while calculating the above for a group > of companies? > > > Regards, > Shyam >
