"Moving Compactions Off Heap to Spark" - Nice. Any presentation/doc abt the overall solution for this John?
On Thu, Aug 4, 2016 at 11:01 AM, Stack <[email protected]> wrote: > Congrats on open sourcing John et al. That is sweet. Thanks for the note to > the dev list and links to stuff of interest. Anything else we should pull > into core? > St.Ack > > On Wed, Aug 3, 2016 at 4:48 PM, John Leach <[email protected]> wrote: > >> Hi Apache HBase Community Member, >> >> We'd like to introduce you to a new open source project utilizing Apache >> HBase. It is called Splice Machine and it is an ANSI-SQL, ACID compliant >> RDBMS powered by HBase, Spark, and Derby. It is like a Lambda >> Architecture-in-a-Box with specific compute engines for analytical and >> operational queries. >> >> Here's our new community site where you can find code, docs, tutorials and >> even a sandbox on AWS: http://community.splicemachine.com/ < >> http://community.splicemachine.com/> >> >> Here's a blog describing our move to open source: >> http://www.splicemachine.com/big-move-open-source-database-world/ < >> http://www.splicemachine.com/big-move-open-source-database-world/> >> >> With respect to Apache HBase, here are a couple of extensions that might >> be of interest to the community. >> >> Moving Compactions Off Heap to Spark >> >> https://github.com/splicemachine/spliceengine/blob/master/hbase_sql/src/main/java/com/splicemachine/derby/stream/compaction/SparkCompactionFunction.java >> < >> https://github.com/splicemachine/spliceengine/blob/master/hbase_sql/src/main/java/com/splicemachine/derby/stream/compaction/SparkCompactionFunction.java >> > >> >> https://github.com/splicemachine/spliceengine/blob/master/hbase_sql/src/main/java/com/splicemachine/olap/CompactionJob.java >> < >> https://github.com/splicemachine/spliceengine/blob/master/hbase_sql/src/main/java/com/splicemachine/olap/CompactionJob.java >> > >> Consistent Store File Scans with Memstore Incremental Deltas >> >> https://github.com/splicemachine/spliceengine/blob/master/hbase_sql/src/main/java/com/splicemachine/hbase/MemstoreAwareObserver.java >> < >> https://github.com/splicemachine/spliceengine/blob/master/hbase_sql/src/main/java/com/splicemachine/hbase/MemstoreAwareObserver.java >> > >> >> https://github.com/splicemachine/spliceengine/blob/master/hbase_sql/src/main/java/com/splicemachine/mrio/api/core/SMRecordReaderImpl.java >> < >> https://github.com/splicemachine/spliceengine/blob/master/hbase_sql/src/main/java/com/splicemachine/mrio/api/core/SMRecordReaderImpl.java >> > >> Non Blocking Write Pipeline that batches calls to each region server vs. >> each region. >> >> https://github.com/splicemachine/spliceengine/blob/master/pipeline_api/src/main/java/com/splicemachine/pipeline/callbuffer/PipingCallBuffer.java >> < >> https://github.com/splicemachine/spliceengine/blob/master/pipeline_api/src/main/java/com/splicemachine/pipeline/callbuffer/PipingCallBuffer.java >> > >> >> https://github.com/splicemachine/spliceengine/blob/master/pipeline_api/src/main/java/com/splicemachine/pipeline/PipelineWriter.java >> < >> https://github.com/splicemachine/spliceengine/blob/master/pipeline_api/src/main/java/com/splicemachine/pipeline/PipelineWriter.java >> > >> >> Please check it out and feel free to ask us anything on our Community: >> Forum: http://community.splicemachine.com/community/forum/ < >> http://community.splicemachine.com/community/forum/> >> Slack Channel: http://community.splicemachine.com/slack-channel-signup/ < >> http://community.splicemachine.com/slack-channel-signup/> >> StackOverflow: http://stackoverflow.com/questions/tagged/splicemachine < >> http://stackoverflow.com/questions/tagged/splicemachine> >> >> We look forward to collaborating with you. >> >> Best, >> >> John Leach <https://www.linkedin.com/in/johnleach>, PMC Member, >> [email protected] <mailto:[email protected]> >> Monte Zweben <https://www.linkedin.com/in/mzweben> PMC Member, >> [email protected] <mailto:[email protected]>
