[ 
https://issues.apache.org/jira/browse/SOLR-284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12509683
 ] 

Eric Pugh commented on SOLR-284:
--------------------------------

So, I was not attempting to "boil the ocean" and provide the ultimate solution. 
 Our need was just to take all the raw text and index it in a field, and pass 
in a bunch of other data fields to be indexed.  

We are parsing a large number of unstructured documents, that may or may not 
have common fields populated, but fortunately we don't really need them.  Our 
users aren't searching by author, but by content.  

I think there are only 5 additional libraries, and one (poi-scratchpad) may be 
able to be removed...

Yonik also mentioned using Tika, as a framework for creating a common interface 
to these types of rich documents, but Tika is still in incubation and has no 
code in it!

I originally had separate handlers for each data type, and that was really 
icky, so I condensed it into the RichDocumentRequestHandler.  I could also 
merge in the CSVRequestHandler into it as well, by just taking out the logic 
for parsing CSV and putting it into a CSVParser.  However, the 
CSVRequestHandler has very complex and rich semantics that these unstructured 
documents don't really need.



> Parsing Rich Document Types
> ---------------------------
>
>                 Key: SOLR-284
>                 URL: https://issues.apache.org/jira/browse/SOLR-284
>             Project: Solr
>          Issue Type: New Feature
>          Components: update
>    Affects Versions: 1.3
>            Reporter: Eric Pugh
>             Fix For: 1.3
>
>         Attachments: libs.zip, rich.patch, test-files.zip
>
>
> I have developed a RichDocumentRequestHandler based on the CSVRequestHandler 
> that supports streaming a PDF, Word, Powerpoint, Excel, or PDF document into 
> Solr.
> I am attaching a patch file with the code changes, and if this looks good, 
> will add a page similar to http://wiki.apache.org/solr/UpdateCSV.
>  

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply via email to