Just to add to James' comment, they're indeed complementary and it all comes down to your own use case. Phoenix offers a convenient SQL interface over HBase, which is capable of doing very fast queries. If you're just doing insert / retrieval, it's unlikely that Spark will help you much there.
However, if you have requirements to do some of the types of "big data processing" that Spark excels at, such as graph algorithms or machine learning, the plugin allows you to access the data in Phoenix+HBase. Good luck, Josh On Sun, Sep 11, 2016 at 11:12 AM, James Taylor <[email protected]> wrote: > It's not an either/or with Phoenix and Spark - often companies use both as > they're very complementary. See this [1] blog for an example. Spark is a > processing engine while Phoenix+HBase is a database/store. You'll need to > store your data somewhere. > Thanks, > James > > [1] http://tech.marinsoftware.com/nosql/digital-advertising- > storage-on-apache-hbase-and-apache-phoenix/?platform=hootsuite > > > On Sunday, September 11, 2016, Cheyenne Forbes < > [email protected]> wrote: > >> Thank you. For a project as big as Facebook or Snapschat, would you >> recommend using Spark or Phoenix for things such as message >> retrieval/insert, user search, user feeds retrieval/insert, etc. and what >> are the pros and cons? >> >> Regard, >> Cheyenne >> >> >> On Sun, Sep 11, 2016 at 8:31 AM, John Leach <[email protected]> wrote: >> >>> Spark has a robust execution model with the following features that are >>> not part of phoenix >>> * Scalable >>> * fault tolerance with lineage (Handles large intermediate >>> results) >>> * memory management for tasks >>> * Resource Management (Fair Scheduling) >>> * Additional SQL Features (Windowing ,etc.) >>> * Machine Learning Libraries >>> >>> >>> Regards, >>> John >>> >>> > On Sep 11, 2016, at 2:45 AM, Cheyenne Forbes < >>> [email protected]> wrote: >>> > >>> > I realized there is a spark plugin for phoenix, any use cases? why >>> would I use spark with phoenix instead of phoenix by itself? >>> >>> >>
