Re: [HACKERS] Hadoop backend?

2009-02-21 Thread pi song
on distributed file system (doesn't have to be specific hadoop). Pi Song On Sun, Feb 22, 2009 at 7:17 AM, Paul Sheer paulsh...@gmail.com wrote: Hadoop backend for PostGreSQL A problem that my client has, and one that I come across often, is that a database seems to always be associated

Re: [HACKERS] Hadoop backend?

2009-02-22 Thread pi song
One more problem is that data placement on HDFS is inherent, meaning you have no explicit control. Thus, you cannot place two sets of data which are likely to be joined together on the same node = uncontrollable latency during query processing. Pi Song On Mon, Feb 23, 2009 at 7:47 AM, Robert Haas

Re: [HACKERS] Hadoop backend?

2009-02-22 Thread pi song
On Mon, Feb 23, 2009 at 3:56 PM, pi song pi.so...@gmail.com wrote: I think the point that you can access more system cache is right but that doesn't mean it will be more efficient than accessing from your local disk. Take Hadoop for example, your request for file content will have to go

Re: [HACKERS] Hadoop backend?

2009-02-23 Thread pi song
already exist). Pi Song On Tue, Feb 24, 2009 at 11:24 AM, Tom Lane t...@sss.pgh.pa.us wrote: Jonah H. Harris jonah.har...@gmail.com writes: I believe there is more than that which would need to be done nowadays. I seem to recall that the storage manager abstraction has slowly been