Re: Solr on S3FileSystem, Kosmos, GlusterFS, etc….

2014-06-25 Thread jay vyas
Hi paul. Im not using it on S3 -- But yes - I dont think S3 would be ideal for Solr at all. There are several other Hadoop Compatible File Systems, however, some of which might be ideal for certain types of SolrCloud workloads. Anyways... would love to see a Solr wiki page on FileSystem

Re: Solr on S3FileSystem, Kosmos, GlusterFS, etc….

2014-06-24 Thread Jay Vyas
Hi Solr ! I got this working . Here's how : With the example jetty runner, you can Extract the tarball, and go to the examples/ directory, where you can launch an embedded core. Then, find the solrconfig.xml file. Edit it to contain the following xml: directoryFactory

Re: Solr on S3FileSystem, Kosmos, GlusterFS, etc….

2014-06-24 Thread Paul Libbrecht
I've always been under the impression that file-system-access-speed is crucial for Lucene-based storage and have always advocated to not use NFS for that (for which we had slowness of a factor of 5 approximately). Has there any performance measurement made for such a setting? Is FS-caching

Solr on S3FileSystem, Kosmos, GlusterFS, etc….

2014-06-23 Thread Jay Vyas
Hi folks. Does anyone deploy solr indices on other HCFS implementations (S3FileSystem, for example) regularly ? If so I'm wondering 1) Where are the docs for doing this - or examples? Seems like everything, including parameter names for dfs setup, are based around hdfs. Maybe I should