Re: When would/should I use spark with phoenix?

2016-09-11 Thread Josh Mahonin
Just to add to James' comment, they're indeed complementary and it all comes down to your own use case. Phoenix offers a convenient SQL interface over HBase, which is capable of doing very fast queries. If you're just doing insert / retrieval, it's unlikely that Spark will help you much there.

Re: When would/should I use spark with phoenix?

2016-09-11 Thread James Taylor
It's not an either/or with Phoenix and Spark - often companies use both as they're very complementary. See this [1] blog for an example. Spark is a processing engine while Phoenix+HBase is a database/store. You'll need to store your data somewhere. Thanks, James [1]

Re: When would/should I use spark with phoenix?

2016-09-11 Thread Cheyenne Forbes
Thank you. For a project as big as Facebook or Snapschat, would you recommend using Spark or Phoenix for things such as message retrieval/insert, user search, user feeds retrieval/insert, etc. and what are the pros and cons? Regard, Cheyenne On Sun, Sep 11, 2016 at 8:31 AM, John Leach

Re: When would/should I use spark with phoenix?

2016-09-11 Thread John Leach
Spark has a robust execution model with the following features that are not part of phoenix * Scalable * fault tolerance with lineage (Handles large intermediate results) * memory management for tasks * Resource Management (Fair Scheduling) * Additional

The capacity of data types

2016-09-11 Thread Yang Zhang
Hi everyone I used varchar in phoenix to record string.But one the page of help ,I can't find how many bytes can varchar contain. So i tried to write a very large text to it, and I got The data exceeds the max capacity for the data type. Maybe I should use varbinary, but i still can't

When would/should I use spark with phoenix?

2016-09-11 Thread Cheyenne Forbes
I realized there is a spark plugin for phoenix, any use cases? why would I use spark with phoenix instead of phoenix by itself?