Thanks, yes Ben is correct on the problem. Glad to know it's being
corrected - we can't really use that workround as our repository is meant
to index everything it finds in EXIFs, etc. (although I'll try it on the
client anyway).
Cheers, Rich
On 19 July 2012 01:28, Gert Schmeltz Pedersen <gerts...@gmail.com> wrote:
> Ben is right about ampersand not being modified, this will be corrected at
> next release of GSearch, which will be as soon as possible after the
> expected release of Fedora 3.6 in August.
>
> But there is no problem for you now, you can use the parameters of
> getDatastreamFromTika to avoid it. Here is a quote from the documentation
> page:
>
> "
> selectedFields - comma-separated list of metadata
> fieldSpecs, if empty then all fields are included with default params
> fieldSpec - metadataFieldName [ '='
> indexFieldName] [ '/' [index] [ '/' [store] [ '/' [termVector] [ '/'
> [boost]]]]]
> - metadataFieldName must be exactly as extracted by Tika from the
> document.
> You may see the available
> names, if you log in debug mode and look for "METADATA name="
> under "fullDsId=" in the log,
> when "getFromTika" was called during updateIndex
> - indexFieldName is used as the generated index field name.
> If not given, GSearch uses
> metadataFieldName after replacement of the characters ' ', ':', '/', '=',
> '(', ')' with '_'
> "
>
> So use the selectedFields parameter to list the metadata fields that you
> want to include in your index, giving a valid indexFieldName for the
> metadataFieldName.
>
> -Gert
>
>
> On 18/07/2012, at 14.24, Benjamin Armintor wrote:
>
> > I think he's saying that the field is called 'Quality & File Format',
> > and gsearch replaces the whitespace with underscores but leaves the
> > ampersand unmodified. Then the resulting solr xml document is
> > malformed, because the ampersand isn't encoded.
> >
> > On Wed, Jul 18, 2012 at 4:19 AM, Richard Green <r.gr...@hull.ac.uk>
> wrote:
> >> Could you be more specific about “XML special chars”?
> >>
> >>
> >>
> >> Richard Green
> >>
> >>
> >>
> >> From: Rich d'Rich [mailto:rich.d.r...@gmail.com]
> >> Sent: 18 July 2012 6:21 AM
> >> To: fedora-commons-users@lists.sourceforge.net
> >> Subject: [fcrepo-user] SOLR indexing fails when XML chars in EXIF
> >> fieldsextracted in gsearch
> >>
> >>
> >>
> >> We have a large repository with images files included with EXIF data.
> >>
> >>
> >>
> >> Some of these have fields (e.g. 'Quality & File Format') that contain
> XML
> >> special chars in the field name.
> >>
> >>
> >>
> >> When the getDatastreamFromTika function in the gsearch template extracts
> >> these fields, the resulting document has an badly formed entity tag
> >>
> >> &_File_Format that causes SOLR to fail to index the document.
> >>
> >>
> >>
> >> Is this a known issue? Any workrounds?
> >>
> >>
> >>
> >>
> >> **************************************************
> >> To view the terms under which this email is
> >> distributed, please go to
> >> http://www2.hull.ac.uk/legal/disclaimer.aspx
> >> **************************************************
> >>
> ------------------------------------------------------------------------------
> >> Live Security Virtual Conference
> >> Exclusive live event will cover all the ways today's security and
> >> threat landscape has changed and how IT managers can respond.
> Discussions
> >> will include endpoint security, mobile security and the latest in
> malware
> >> threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
> >> _______________________________________________
> >> Fedora-commons-users mailing list
> >> Fedora-commons-users@lists.sourceforge.net
> >> https://lists.sourceforge.net/lists/listinfo/fedora-commons-users
> >>
> >
> >
> ------------------------------------------------------------------------------
> > Live Security Virtual Conference
> > Exclusive live event will cover all the ways today's security and
> > threat landscape has changed and how IT managers can respond. Discussions
> > will include endpoint security, mobile security and the latest in malware
> > threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
> > _______________________________________________
> > Fedora-commons-users mailing list
> > Fedora-commons-users@lists.sourceforge.net
> > https://lists.sourceforge.net/lists/listinfo/fedora-commons-users
>
>
>
> ------------------------------------------------------------------------------
> Live Security Virtual Conference
> Exclusive live event will cover all the ways today's security and
> threat landscape has changed and how IT managers can respond. Discussions
> will include endpoint security, mobile security and the latest in malware
> threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
> _______________________________________________
> Fedora-commons-users mailing list
> Fedora-commons-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/fedora-commons-users
>
------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and
threat landscape has changed and how IT managers can respond. Discussions
will include endpoint security, mobile security and the latest in malware
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
Fedora-commons-users mailing list
Fedora-commons-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/fedora-commons-users