Re: Nutch 2, Solr 5 - solrdedup causes ClassCastException:

2016-10-24 Thread Tom Chiverton
Oh, I misunderstood then. Tom On 21/10/16 19:52, lewis john mcgibbney wrote: No it's definitively not worth removing the schema.xml as it works perfectly. Please have a peek at the previous commands I posted. They will set you up with what you need.

Re: Nutch 2, Solr 5 - solrdedup causes ClassCastException:

2016-10-20 Thread Tom Chiverton
gt; To: user@nutch.apache.org Cc: Date: Mon, 17 Oct 2016 09:55:53 +0100 Subject: Re: Nutch 2, Solr 5 - solrdedup causes ClassCastException: I tried that, and it still gives ERROR: Error CREATEing SolrCore 'nutch': Unable to create core [nutch] Caused by: enablePositionIncrements is not a valid option as o

Re: Nutch 2, Solr 5 - solrdedup causes ClassCastException:

2016-10-20 Thread lewis john mcgibbney
com> > To: user@nutch.apache.org > Cc: > Date: Mon, 17 Oct 2016 09:55:53 +0100 > Subject: Re: Nutch 2, Solr 5 - solrdedup causes ClassCastException: > I tried that, and it still gives > > ERROR: Error CREATEing SolrCore 'nutch': Unable to create core [nutch] > Caused by: enab

Re: Nutch 2, Solr 5 - solrdedup causes ClassCastException:

2016-10-14 Thread Tom Chiverton
. -Original message- From:Tom Chiverton <t...@extravision.com> Sent: Friday 14th October 2016 17:34 To: user@nutch.apache.org Subject: Re: Nutch 2, Solr 5 - solrdedup causes ClassCastException: Hmm, that makes a certain sense. But then I seem to be getting errors like ERROR: Error CRE

RE: Nutch 2, Solr 5 - solrdedup causes ClassCastException:

2016-10-14 Thread Markus Jelsma
You can probably use the one from Nutch 1.12, it certainly got more updates. M. -Original message- > From:Tom Chiverton <t...@extravision.com> > Sent: Friday 14th October 2016 17:44 > To: user@nutch.apache.org > Subject: Re: Nutch 2, Solr 5 - solrdedup causes

RE: Nutch 2, Solr 5 - solrdedup causes ClassCastException:

2016-10-14 Thread Markus Jelsma
> > Felix > > > >> -Ursprüngliche Nachricht- > >> Von: Markus Jelsma [mailto:markus.jel...@openindex.io] > >> Gesendet: Freitag, 14. Oktober 2016 17:05 > >> An: user@nutch.apache.org > >> Betreff: RE: Nutch 2, Sol

AW: Nutch 2, Solr 5 - solrdedup causes ClassCastException:

2016-10-14 Thread Felix von Zadow
> What version were you running ? nutch 2.3.1 and solr 5.5.0

Re: Nutch 2, Solr 5 - solrdedup causes ClassCastException:

2016-10-14 Thread Tom Chiverton
suggested) the schema.xml from nutch which sets -Ursprüngliche Nachricht- Von: Markus Jelsma [mailto:markus.jel...@openindex.io] Gesendet: Freitag, 14. Oktober 2016 17:05 An: user@nutch.apache.org Betreff: RE: Nutch 2, Solr 5 - solrdedup causes ClassCastException: Yes, current Solr comes

Re: Nutch 2, Solr 5 - solrdedup causes ClassCastException:

2016-10-14 Thread Tom Chiverton
I mean, of course, the schema browser shows them as strings, but the query interface now shows them as arrays e.g. |"digest": [ "0f1e6553ede0daec9c9449a3a80e3a80" ],| Tom On 14/10/16 16:18, Tom Chiverton wrote: But still, Solr schema browser is showing the digest field as string (as

Re: Nutch 2, Solr 5 - solrdedup causes ClassCastException:

2016-10-14 Thread Tom Chiverton
Not sure what was going on, so I deleted the core, and the underlying folders under solr/server/nutch, bounced the solr service, and the schema browser in the Solr interface shows now schema as expected. If it put a single document it (i.e. a single URL in the seed list, then run inject,

Re: Nutch 2, Solr 5 - solrdedup causes ClassCastException:

2016-10-14 Thread Felix von Zadow
-Ursprüngliche Nachricht- > Von: Markus Jelsma [mailto:markus.jel...@openindex.io] > Gesendet: Freitag, 14. Oktober 2016 17:05 > An: user@nutch.apache.org > Betreff: RE: Nutch 2, Solr 5 - solrdedup causes ClassCastException: > > Yes, current Solr comes with a schemaless mod

RE: Nutch 2, Solr 5 - solrdedup causes ClassCastException:

2016-10-14 Thread Markus Jelsma
<t...@extravision.com> > Sent: Friday 14th October 2016 16:58 > To: user@nutch.apache.org > Subject: Re: Nutch 2, Solr 5 - solrdedup causes ClassCastException: > > I don't understand what you mean here. I am not a Solr expert, though > I've used it a bit in the past, though not with Nutc

Re: Nutch 2, Solr 5 - solrdedup causes ClassCastException:

2016-10-14 Thread Tom Chiverton
I don't understand what you mean here. I am not a Solr expert, though I've used it a bit in the past, though not with Nutch. Is there a schema I should be feeding it ? Tom On 14/10/16 15:50, Markus Jelsma wrote: Solr supports schemaless mode, which may be your case. Perhaps it made your

RE: Nutch 2, Solr 5 - solrdedup causes ClassCastException:

2016-10-14 Thread Markus Jelsma
r 2016 16:44 > To: user@nutch.apache.org > Subject: Re: Nutch 2, Solr 5 - solrdedup causes ClassCastException: > > Where would this be configured ? I'm creating the solr core by just doing > > "solr/bin/solr create_core -c nutch" > > should I be feeding it a special s

Re: Nutch 2, Solr 5 - solrdedup causes ClassCastException:

2016-10-14 Thread Tom Chiverton
Where would this be configured ? I'm creating the solr core by just doing "solr/bin/solr create_core -c nutch" should I be feeding it a special schema file somehow ? Tom On 14/10/16 14:39, Markus Jelsma wrote: Your digest field is configured as multi valued, which should not be the case.

Nutch 2, Solr 5 - solrdedup causes ClassCastException:

2016-10-14 Thread Tom Chiverton
I've tried using both Solr 6 and 5 with the latest Nutch 2, and with both I am getting an error from Nutch's bin/crawl. mnt/nutch/nutch/runtime/local/bin/nutch solrdedup -D mapred.reduce.tasks=2 -D mapred.child.java.opts=-Xmx1000m -D mapred.reduce.tasks.speculative.execution=false -D