[
https://issues.apache.org/jira/browse/SOLR-842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12649904#action_12649904
]
Shalin Shekhar Mangar commented on SOLR-842:
--------------------------------------------
Lance, Transformers can add two special fields to a row "$hasMore" and
"$nextUrl" which tells the XPathEntityProcessor whether to stop now and if not,
what is the nextUrl to be fetched. You can write a transformer which adds these
special fields based on whether you have more results or not. Maybe that can be
used here?
> Better error handling for DIH
> -----------------------------
>
> Key: SOLR-842
> URL: https://issues.apache.org/jira/browse/SOLR-842
> Project: Solr
> Issue Type: Improvement
> Components: contrib - DataImportHandler
> Affects Versions: 1.3
> Reporter: Noble Paul
> Assignee: Shalin Shekhar Mangar
> Fix For: 1.4
>
> Attachments: SOLR-842.patch, SOLR-842.patch, SOLR-842.patch,
> SOLR-842.patch
>
>
> Currently DIH fails completely on any error. We must have better control on
> error behavior
> mail thread: http://markmail.org/message/xvfbfaskfmlj2pnm
> an entity can have an attribute {{onError}} the values can be {{abort,
> continue,skip}}
> abort is the default . It aborts the import. continue or skip does not fail
> the import it continues from there. skip skips all rows in an xml (only if
> stream != true)if there is an error in xml but continues with the next xml.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.