Well, there are other approaches. I don't want to be a broken record, but these problems are all solved in MapR. (there I said it... I won't repeat it for a week or more).
The long and short of it is that HDFS is not a given. It should be supported, but the limitations of HDFS should not be baked into Drill as gospel. On Tue, Aug 28, 2012 at 9:07 AM, Min Zhou <[email protected]> wrote: > On Tue, Aug 28, 2012 at 7:39 PM, Ted Dunning <[email protected]> > wrote: > > > Can't do variable block size in vanilla hadoop. That is part of the > whole > > namenode legacy. > > > Exactly. HDFS doesn't support variable block sizes. There is a jira of HDFS > metioned such feature (HDFS-2362). After all, variable block sizes would > make things more complex. It seems that we need a tradeoff: locality or > simplicity. >
