xuanyu huang created SOLR-15411:
-----------------------------------
Summary: "failOnVersionConflicts" doesn't get check in
getUpdatedDocument
Key: SOLR-15411
URL: https://issues.apache.org/jira/browse/SOLR-15411
Project: Solr
Issue Type: Bug
Security Level: Public (Default Security Level. Issues are Public)
Components: UpdateRequestProcessors
Affects Versions: 8.5.1
Reporter: xuanyu huang
I'm using solrj for Java to update 4 docs:
{code:java}
UpdateRequest updateRequest = new UpdateRequest();
updateRequest.setAction( UpdateRequest.ACTION.COMMIT, false, false);
for (Map<String, Object> map : maps) {
if (map.containsKey("record_uuid")) {
SolrInputDocument doc = new SolrInputDocument();
doc.addField("assertionUserId", new HashMap<String, Object>(){{
put("set", map.getOrDefault("assertionUserId", null)); }});
// other doc.addField()
logger.debug("Added solr doc for record: " + doc.get("id"));
updateRequest.add(doc);
}
}
// update only when there are docs to update
if (updateRequest.getDocuments() != null) {
updateRequest.setParam("_version_", "1");
updateRequest.setParam("failOnVersionConflicts", "false");
updateRequest.process(solrClient);
}
{code}
There are 4 docs added into the updateRequest and the {color:#ff0000}2nd doc
has an invalid id{color}.
See that I've set the {color:#0000ff}_version_{color} to 1 and
{color:#0000ff}failOnVersionConflicts{color} to false
When I ran the program I could see this log
{code:java}
- Added solr doc for record: id=2c9b8671-a55a-40ab-940f-06f9cf987880
- Added solr doc for record: id=c0ee1a86-1df6-40b2-950c-bdde40b1c46e_invalid
- Added solr doc for record: id=af56ce03-e664-421a-85ac-fbb839bbb140
- Added solr doc for record: id=6bdc3c1d-d21a-43e3-aa84-baeeda601bb3
ERROR: [ConcurrentUpdateSolrClient] -
errororg.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException:
Error from server at http://localhost:8983/solr/biocache: Conflictrequest:
http://localhost:8983/solr/biocache/update?commit=true&softCommit=false&waitSearcher=false&_version_=1&failOnVersionConflicts=false&wt=javabin&version=2›
Remote error message: Document not found for update.
id=c0ee1a86-1df6-40b2-950c-bdde40b1c46e_invalid at
org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.sendUpdateStream
{code}
The error is *_Document not found for update_* which is as expected. Out of the
4 updates the 2nd one has an invlid id so what I expected is 2nd update failed
but all the other 3 are updated successfully (since I set
failOnVersionConflicts: false).
{color:#FF0000}But the reality is, only 1st update succeeded. All others
failed because an exception was thrown for 2nd update.{color}
{color:#172b4d}I then went on to check the 8.5.1 sourcecode, the exception is
thrown from _*getUpdatedDocument*_ {color}
{code:java}
SolrInputDocument oldRootDocWithChildren =
RealTimeGetComponent.getInputDocument(cmd.getReq().getCore(), idBytes,
RealTimeGetComponent.Resolution.ROOT_WITH_CHILDREN);
if (oldRootDocWithChildren == null) {
if (versionOnUpdate > 0) {
// could just let the optimistic locking throw the error
throw new SolrException(ErrorCode.CONFLICT, "Document not found for update.
id=" + idString);
} else if (req.getParams().get(ShardParams._ROUTE_) != null) {{code}
It tries to find a doc with the specified id (null is found in this case), then
seeing versionOnUpdate == 1, an exception is thrown anyway. But where is the
_*failOnVersionConflicts*_ **used ?
it's in _*doVersionAdd*_(). In this function we call _*getUpdateDocument*_
first in line374, then we compare versionOnUpdate with foundVersion and the
failOnVersionConflitcs flag. In my case there's no chance to check the flag
because an exception is directly thrown before that.
In my opinion, it's an issue.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
