Thank you for the resources and all the help. I hope that I clear this up soon. I will ask the Islandora folks for their thoughts.
Cheers, Shane On Tue, Nov 17, 2015 at 3:19 PM, Alexandre Rafalovitch <arafa...@gmail.com> wrote: > Add echoParams=all to see what are default and other parameters that > apply to your request > https://wiki.apache.org/solr/CoreQueryParameters#echoParams . > Specifically, what the 'fl' setting is. Or try setting 'fl' explicitly > and see if the display changes. > > copyField, The one that I would expect to see is the one with your > field as destination, not target. > > At this point, baring any other ideas, I would put the blame on > Islandora. Or at least ask on their mailing list/forum. > > Or, if you want to troubleshoot on a lower level and can resubmit the > documents to be reindexed via your pipeline, get your system > administrator to put a WireShark on the Solr side or on a network in a > sniffing mode. Or get him to modify Jetty that houses Solr to log > incoming requests. Both are a bit hard to explain in emails, so either > they know how to do it or not. But basically you are trying to catch > an indexing operation in mid-flight in-between Solr and Islandora and > see what kind of record is being sent to Solr. I expect it will have > that multiplication issue already present. > > Regards, > Alex. > > ---- > Solr Analyzers, Tokenizers, Filters, URPs and even a newsletter: > http://www.solr-start.com/ > > > On 17 November 2015 at 13:07, Shane McCarthy <smccar...@upei.ca> wrote: > > Thank you for the speedy responses. > > > > I will give the results I have found based on your comments. > > > > In the schema.xml there are 19 dynamicField are specified. The query and > > the fields list I want are included in these 19 variables. They are all > > stored so based on your comment Erick I would assume that I should be > > seeing them. I am not. Any ideas why I am not? > > > > There are 10 copyField directives in the schema.xml. The only one that > > matches the variables with duplicated results is <copyField source="*" > > dest="catch_all_fields_mt"/>. > > > > How can I find if I am using a custom request handler? I had assumed I > was > > using the default as in the Request Handler box it has /select. > > > > Thanks, > > > > Shane > > > > > > > > > > > > > > > > On Tue, Nov 17, 2015 at 12:52 PM, Alexandre Rafalovitch < > arafa...@gmail.com> > > wrote: > > > >> If you have access to the Admin UI, go to the Schema Browser field > >> under the core (I assume Solr 4+ here, never actually asked for your > >> version). > >> https://cwiki.apache.org/confluence/display/solr/Schema+Browser+Screen > >> > >> You can see in the example that when you select a field, it will show > >> whether it is copied to from other fields. That's the copyField I was > >> talking about earlier. Check that first. > >> > >> You might also be able to get your schema.xml and solrconfig.xml on > >> the Files screen: > >> https://cwiki.apache.org/confluence/display/solr/Files+Screen. Check > >> there for definitions. A definition for "fl" under "/select" or > >> perhaps your custom request handler may restrict the fields you are > >> getting. > >> > >> Regards, > >> Alex. > >> ---- > >> Solr Analyzers, Tokenizers, Filters, URPs and even a newsletter: > >> http://www.solr-start.com/ > >> > >> > >> On 17 November 2015 at 11:32, Shane McCarthy <smccar...@upei.ca> wrote: > >> > Yes a complex situation and I am having trouble knowing who to ask > for an > >> > explanation. > >> > > >> > I have been given access to the Solr Admin page. Using the > persistent > >> > identifier PID, I have done a query for PID = *. The PID that are > found > >> > with that query all have cml_hfenergy_md, a multivalued double field, > >> > repeated 8 or 4 times. > >> > > >> > I have multiple string, multiple date fields that are also repeated > >> > > >> > There are single string and integer fields that are not repeated. > >> > > >> > Do you know if all results of the query are returned with the Solr > Admin? > >> > It tells me the numFound but does not give me the all the fields > >> requested > >> > for all the results. Is this usual behaviour? > >> > > >> > Cheers, > >> > > >> > Shane > >> > > >> > > >> > On Mon, Nov 16, 2015 at 7:11 PM, Alexandre Rafalovitch < > >> arafa...@gmail.com> > >> > wrote: > >> > > >> >> On 16 November 2015 at 17:40, Shane McCarthy <smccar...@upei.ca> > wrote: > >> >> > I am using an instance of Islandora. > >> >> > >> >> Ah. This complicates the situation as there is an unknown - to most > of > >> >> us - layer in between. So, it is not clear whether this > multiplication > >> >> is happening in Solr or in Islandora. > >> >> > >> >> Your best option is to hit Solr server directly and basically do a > >> >> query for a specific record's id with the fields that you are having > a > >> >> problem with. If that field for that record shows the problem the > same > >> >> way as through the full Islandora path, the problem is Solr. Then, > you > >> >> review the copyFields, etc. If it does not....... > >> >> > >> >> Also, is this only happening with one "double" field but not another, > >> >> with all "double" fields or with some other combination? > >> >> > >> >> And did it start at some point or was this always like that? > >> >> > >> >> You need to figure out something to contrast the observed behavior > >> against. > >> >> > >> >> Regards, > >> >> Alex. > >> >> > >> >> > >> >> > >> >> ---- > >> >> Solr Analyzers, Tokenizers, Filters, URPs and even a newsletter: > >> >> http://www.solr-start.com/ > >> >> > >> >
