Re: [PROPOSAL]Pistachio

2015-06-29 Thread Gavin Li
Hi Roman, I've taken a brief look at Geode. Pistachio and Geode both can support similar in-memory consistent HA distributed storage, and the data aware function routing idea is also similar. Here are what I think are different: 1. Pistachio actually uses a very different approach to resolve the

Re: [PROPOSAL]Pistachio

2015-06-29 Thread Gavin Li
simple embedding the computation to the storage layer to achieve best data locality. It evolves from Yahoo’s global user profile storage system. == Proposal == Pistachio is a distributed key value store system with fault tolerance and consistency

Re: [PROPOSAL]Pistachio

2015-06-29 Thread Roman Shaposhnik
Hi Gavin! On Mon, Jun 29, 2015 at 11:27 AM, Gavin Li lyo.ga...@gmail.com wrote: Hi Roman, I've taken a brief look at Geode. Pistachio and Geode both can support similar in-memory consistent HA distributed storage, and the data aware function routing idea is also similar. Here are what I

Re: [PROPOSAL]Pistachio

2015-06-29 Thread jan i
locality. It evolves from Yahoo’s global user profile storage system. == Proposal == Pistachio is a distributed key value store system with fault tolerance and consistency guarantee. It supports multiple local storage engine including

Re: [PROPOSAL]Pistachio

2015-06-26 Thread amareshwarisr .
Hello Gavin, I would like to volunteer as mentor. I'm first time mentor, hope you will bare with me. Kytoto cabinet is under GNU GPL, but it is not a hard necessary dependency to Pistachio, it’s an optional pluggable storage engine. It’s designed in the way that it’s totally pluggable and very

Re: [PROPOSAL]Pistachio

2015-06-26 Thread Gavin Li
Thank you, Amareshwari. On Friday, June 26, 2015, Jake Farrell jfarr...@apache.org wrote: Hi Amareshwari Thanks for catching the incorrect wording for removing the dependency before graduation, should have been before first incubating release, updated. Glad to have you on board as a mentor

Re: [PROPOSAL]Pistachio

2015-06-26 Thread Andrew Purtell
= == Abstract == Pistachio is a fault-tolerant low latency distributed storage system which enables simple embedding the computation to the storage layer to achieve best data locality. It evolves from Yahoo’s global user profile storage system. == Proposal

Re: [PROPOSAL]Pistachio

2015-06-25 Thread Gavin Li
We need more mentors. Please let me know if you are interested. THanks, Gavin Li On Mon, Jun 22, 2015 at 8:25 PM, Gavin Li lyo.ga...@gmail.com wrote: Roman, I think Pistachio is similar to Ignite in the sense that they both try to distribute the computation to storage to co-locate the data

Re: [PROPOSAL]Pistachio

2015-06-22 Thread Gavin Li
. It evolves from Yahoo’s global user profile storage system. == Proposal == Pistachio is a distributed key value store system with fault tolerance and consistency guarantee. It supports multiple local storage engine including in-memory, kyoto cabinet, rocks DB etc. Pistachio is being used

Re: [PROPOSAL]Pistachio

2015-06-22 Thread Andrew Purtell
distributed storage system which enables simple embedding the computation to the storage layer to achieve best data locality. It evolves from Yahoo’s global user profile storage system. == Proposal == Pistachio is a distributed key value store system with fault tolerance and consistency guarantee

Re: [PROPOSAL]Pistachio

2015-06-22 Thread Andrew Purtell
the computation to the storage layer to achieve best data locality. It evolves from Yahoo’s global user profile storage system. == Proposal == Pistachio is a distributed key value store system with fault tolerance and consistency guarantee. It supports multiple local storage engine

Re: [PROPOSAL]Pistachio

2015-06-22 Thread Roman Shaposhnik
On Mon, Jun 22, 2015 at 7:45 PM, John D. Ament johndam...@apache.org wrote: On Mon, Jun 22, 2015 at 10:26 PM Andrew Purtell apurt...@apache.org wrote: Pistachio can easily embed computation to the storage layer to achieve the best data locality to improve the computation performance

Re: [PROPOSAL]Pistachio

2015-06-22 Thread Roman Shaposhnik
On Mon, Jun 22, 2015 at 7:54 PM, Gavin Li lyo.ga...@gmail.com wrote: The other difference is in Pistachio we can do computation based on in-memory storage with data replication. Different from the in-memory computation in Spark, the storage can be in-memory here. Have you guys looked at

Re: [PROPOSAL]Pistachio

2015-06-22 Thread John D. Ament
system which enables simple embedding the computation to the storage layer to achieve best data locality. It evolves from Yahoo’s global user profile storage system. == Proposal == Pistachio is a distributed key value store system with fault tolerance and consistency guarantee

Re: [PROPOSAL]Pistachio

2015-06-22 Thread Gavin Li
distributed storage system which enables simple embedding the computation to the storage layer to achieve best data locality. It evolves from Yahoo’s global user profile storage system. == Proposal == Pistachio is a distributed key value store system with fault tolerance

Re: [PROPOSAL]Pistachio

2015-06-22 Thread Gavin Li
Roman, I think Pistachio is similar to Ignite in the sense that they both try to distribute the computation to storage to co-locate the data and computation. One difference might be Pistachio also supports other storage options like disk based storage to support longer term durability. Actually

Re: [PROPOSAL]Pistachio

2015-06-19 Thread Gavin Li
layer to achieve best data locality. It evolves from Yahoo’s global user profile storage system. == Proposal == Pistachio is a distributed key value store system with fault tolerance and consistency guarantee. It supports multiple local storage engine including in-memory, kyoto

[PROPOSAL]Pistachio

2015-06-18 Thread Gavin Li
to achieve best data locality. It evolves from Yahoo’s global user profile storage system. == Proposal == Pistachio is a distributed key value store system with fault tolerance and consistency guarantee. It supports multiple local storage engine including in-memory, kyoto cabinet, rocks DB etc. Pistachio