You can also find a lot of GitHub repos for external packages here: http://spark.apache.org/third-party-projects.html
Matei > On Jul 25, 2017, at 5:30 PM, Frank Austin Nothaft <[email protected]> > wrote: > > There’s a number of real-world open source Spark applications in the sciences: > > genomics: > > github.com/bigdatagenomics/adam <— core is scala, has py/r wrappers > https://github.com/broadinstitute/gatk <— core is java > https://github.com/hail-is/hail <— core is scala, mostly used through python > wrappers > > neuroscience: > > https://github.com/thunder-project/thunder#using-with-spark <— pyspark > > Frank Austin Nothaft > [email protected] > [email protected] > 202-340-0466 > >> On Jul 25, 2017, at 8:09 AM, Jörn Franke <[email protected]> wrote: >> >> Continuous integration (Travis, jenkins) and reporting on unit tests, >> integration tests etc for each source code version. >> >> On 25. Jul 2017, at 16:58, Adaryl Wakefield <[email protected]> >> wrote: >> >>> ci+reporting? I’ve never heard of that term before. What is that? >>> >>> Adaryl "Bob" Wakefield, MBA >>> Principal >>> Mass Street Analytics, LLC >>> 913.938.6685 >>> www.massstreet.net >>> www.linkedin.com/in/bobwakefieldmba >>> Twitter: @BobLovesData >>> >>> >>> From: Jörn Franke [mailto:[email protected]] >>> Sent: Tuesday, July 25, 2017 8:31 AM >>> To: Adaryl Wakefield <[email protected]> >>> Cc: [email protected] >>> Subject: Re: real world spark code >>> >>> Look for the ones that have unit and integration tests as well as a >>> ci+reporting on code quality. >>> >>> All the others are just toy examples. Well should be :) >>> >>> On 25. Jul 2017, at 01:08, Adaryl Wakefield <[email protected]> >>> wrote: >>> >>> Anybody know of publicly available GitHub repos of real world Spark >>> applications written in scala? >>> >>> Adaryl "Bob" Wakefield, MBA >>> Principal >>> Mass Street Analytics, LLC >>> 913.938.6685 >>> www.massstreet.net >>> www.linkedin.com/in/bobwakefieldmba >>> Twitter: @BobLovesData > --------------------------------------------------------------------- To unsubscribe e-mail: [email protected]
