yes, that is my environment. as i know, blur use map reduce to index document and save it to hdfs. but for searching, it just use hdfs as a lucene directory. because hdfs is not suitable for random access, blur use some tricks to tackle this problem. so as far as l know, it only using hdfs when doing searching, does that means i need some machines to do searching which is cpu heavy tasks? if i am right, lucene is not easy to scale to large data as solr, it can not split data to shards. how do blur deal with this problem? 在 2013-2-2 晚上11:46，"Aaron McCurry" <[email protected]>写道：
> If I understand your setup correctly, you have a Hadoop Cluster running > MapReduce and HDFS. You have permissions to read and write to HDFS however > you cannot add any new software to the machine running Hadoop. You also > have some other machines where you can manage the software and they have > write/read access to HDFS. So if I'm understanding your question and setup > correctly then yes you can install Blur on machines that do not run Hadoop > (HDFS) locally. Blur only needs access to HDS the service, however > I believe that you will get better performance by running a separate HDFS > instance just for Blur, but it is not required. > > Please let us know if you have any issues or questions. Thanks! > > Aaron > > > On Fri, Feb 1, 2013 at 6:08 AM, Tim Williams <[email protected]> wrote: > > > On Fri, Feb 1, 2013 at 4:14 AM, Li Li <[email protected]> wrote: > > > hi all > > > I want to use hadoop and it's hdfs to provide searching > functionality. > > > I can use hadoop to run map reduce jobs and store/retrive data in > > hdfs. > > > but I can't the permission to manage hadoop cluster. > > > I have another a few machines which can communicate with hadoop > > > cluster(my own machines can use hdfs and also hadoop map-reduce job can > > get > > > mysql database data resided in my own machines) > > > can I setting up blur for searching? thanks. > > > > Hi Li, > > If you can run jobs and permissions to write to hdfs, you should be > > fine - if you encounter problems, let us know? > > > > Thanks > > --tim > > >
