[
https://issues.apache.org/jira/browse/SOLR-7197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15025104#comment-15025104
]
Raveendra Yerraguntl commented on SOLR-7197:
--------------------------------------------
Will be doing a bench mark test soon before and after the fix for a couple of
million records.
> Can solr EntityProcessor implement curosrs
> ------------------------------------------
>
> Key: SOLR-7197
> URL: https://issues.apache.org/jira/browse/SOLR-7197
> Project: Solr
> Issue Type: Wish
> Components: contrib - DataImportHandler
> Affects Versions: 5.0
> Environment: Prod
> Reporter: Raveendra Yerraguntl
> Attachments: DIH_SEP_CURSOR_SOLR_7197.patch, lucene_ant_test_op
>
>
> package org.apache.solr.handler.dataimport;
> class SolrEntityProcessor
> protected SolrDocumentList doQuery(int start) {
> ....
> SolrQuery solrQuery = new SolrQuery(queryString);
> solrQuery.setRows(rows);
> solrQuery.setStart(start);
> if (fields != null) {
> for (String field : fields) {
> solrQuery.addField(field);
> }
> }
> solrQuery.setRequestHandler(requestHandler);
> solrQuery.setFilterQueries(filterQueries);
> solrQuery.setTimeAllowed(timeout * 1000);
>
> QueryResponse response = null;
> try {
> response = solrClient.query(solrQuery);
> } catch (SolrServerException e) {
> if (ABORT.equals(onError)) {
> wrapAndThrow(SEVERE, e);
> } else if (SKIP.equals(onError)) {
> wrapAndThrow(DataImportHandlerException.SKIP_ROW, e);
> }
> }
> -------------------
> If the do Query variant can be implemented with cursor, then it helps with
> any heavy lifting (bulk processing) with entity processor. That really helps.
> If permitted I can contribute the fix. Currently I am using 4.10 and see the
> performance issues and planning the work around. If the cursor is available
> then it really helps.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
