Re: Migrating from cores to collections

2015-12-01 Thread Mikhail Khludnev
I hope, to complete https://issues.apache.org/jira/browse/SOLR-7188 that makes DIH a world class ETL in near future. For those who already faced the bottleneck there is a kind of steroids https://issues.apache.org/jira/browse/SOLR-3585 . On Tue, Dec 1, 2015 at 9:05 PM, Erick Erickson wrote: > Ye

Re: Migrating from cores to collections

2015-12-01 Thread Erick Erickson
Yes, DIH works with SolrCloud. I don't particularly like it as it doesn't parallelize well, i.e. all the action happens on one Solr server. Admittedly it does send the docs to the correct shards etc. But often the bottleneck becomes acquiring the data, and there DIH will be the bottleneck since i

Re: Migrating from cores to collections

2015-12-01 Thread Upayavira
I've never used DIH in earnest. I'm not sure if/how it works with SolrCloud. There is a ticket somewhere to make a 'standalone' DIH that sits outside of Solr and pushes to it, which would be a much better idea, I think, and would work better with SolrCloud. Others here (perhaps in a separate thread

Re: Migrating from cores to collections

2015-11-30 Thread William Bell
ok. What about using DIH handler? Does it index in a SolrCloud setup ? Or how would I convert a query to use SolrJ ? On Mon, Nov 30, 2015 at 5:36 AM, Upayavira wrote: > > > On Sun, Nov 29, 2015, at 07:38 PM, William Bell wrote: > > OK. Been using Cores for 4 years. Want to migrate to collection

Re: Migrating from cores to collections

2015-11-30 Thread Upayavira
On Sun, Nov 29, 2015, at 07:38 PM, William Bell wrote: > OK. Been using Cores for 4 years. Want to migrate to collections / Cloud. > > Do we have to change our queries? > > http://loadbalancer:8983/solr/corename/select?q=*:* > > What does this become once we have the collection sharded? Do we

Migrating from cores to collections

2015-11-29 Thread William Bell
OK. Been using Cores for 4 years. Want to migrate to collections / Cloud. Do we have to change our queries? http://loadbalancer:8983/solr/corename/select?q=*:* What does this become once we have the collection sharded? Do we need a Load Balancer or just point to one box and run the new query? Or