Re: Delete on 8.5.1
Hi All - while I'm still getting the error, it does appear to work (still gives the error - but a search of the data then shows less results - so the delete is working). In some cases, it may be necessary to run the query several times. -Joe On 4/29/2020 9:03 AM, Joe Obernberger wrote: Hi - I also tried deleting from solrj (8.5.1) using CloudSolrClient.deleteByQuery. This results in: Error: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://paradigm8:9100/solr/PROCESSOR_LOGS: Async exception during distributed update: Error from server at http://paradigm7:9100/solr/PROCESSOR_LOGS_shard6_replica_n20/: null request: http://paradigm7:9100/solr/PROCESSOR_LOGS_shard6_replica_n20/ Remote error message: Task queue processing has stalled for 20203 ms with 0 remaining elements to process. org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://paradigm8:9100/solr/PROCESSOR_LOGS: Async exception during distributed update: Error from server at http://paradigm7:9100/solr/PROCESSOR_LOGS_shard6_replica_n20/: null request: http://paradigm7:9100/solr/PROCESSOR_LOGS_shard6_replica_n20/ Remote error message: Task queue processing has stalled for 20203 ms with 0 remaining elements to process. at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:665) at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:265) at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:248) at org.apache.solr.client.solrj.impl.LBSolrClient.doRequest(LBSolrClient.java:368) at org.apache.solr.client.solrj.impl.LBSolrClient.request(LBSolrClient.java:296) at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.sendRequest(BaseCloudSolrClient.java:1143) at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.requestWithRetryOnStaleState(BaseCloudSolrClient.java:906) at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.request(BaseCloudSolrClient.java:838) at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211) at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:940) at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:903) at com.ngc.bigdata.solrsearcher.SearcherThread.doSearch(SearcherThread.java:401) at com.ngc.bigdata.solrsearcher.SearcherThread.run(SearcherThread.java:125) at com.ngc.bigdata.solrsearcher.Worker.doSearchTest(Worker.java:145) at com.ngc.bigdata.solrsearcher.SolrSearcher.main(SolrSearcher.java:60) On 4/28/2020 11:50 AM, Joe Obernberger wrote: Hi all - I'm running this query on solr cloud 8.5.1 with the index on HDFS: curl http://enceladus:9100/solr/PROCESSOR_LOGS/update?commit=true -H "Connect-Type: text/xml" --data-binary 'StartTime:[2020-01-01T01:02:43Z TO 2020-04-25T00:00:00Z]' getting this response: 1 500 54091 name="error-class">org.apache.solr.update.processor.DistributedUpdateProcessor$DistributedUpdatesAsyncException name="root-error-class">org.apache.solr.update.processor.DistributedUpdateProcessor$DistributedUpdatesAsyncException 2 Async exceptions during distributed update: Error from server at http://paradigm8:9100/solr/PROCESSOR_LOGS_shard2_replica_n4/: null request: http://paradigm8:9100/solr/PROCESSOR_LOGS_shard2_replica_n4/ Remote error message: Task queue processing has stalled for 20193 ms with 0 remaining elements to process. Error from server at http://belinda:9100/solr/PROCESSOR_LOGS_shard10_replica_n38/: null request: http://belinda:9100/solr/PROCESSOR_LOGS_shard10_replica_n38/ Remote error message: Task queue processing has stalled for 20021 ms with 0 remaining elements to process. name="trace">org.apache.solr.update.processor.DistributedUpdateProcessor$DistributedUpdatesAsyncException: 2 Async exceptions during distributed update: Error from server at http://paradigm8:9100/solr/PROCESSOR_LOGS_shard2_replica_n4/: null request: http://paradigm8:9100/solr/PROCESSOR_LOGS_shard2_replica_n4/ Remote error message: Task queue processing has stalled for 20193 ms with 0 remaining elements to process. Error from server at http://belinda:9100/solr/PROCESSOR_LOGS_shard10_replica_n38/: null request: http://belinda:9100/solr/PROCESSOR_LOGS_shard10_replica_n38/ Remote error message: Task queue processing has stalled for 20021 ms with 0 remaining elements to process. at org.apache.solr.update.processor.DistributedZkUpdateProcessor.doDistribFinish(DistributedZkUpdateProcessor.java:1189) at org.apache.solr.update.processor.DistributedUpdateProcessor.finish(DistributedUpdateProcessor.java:1096) at org.apache.solr.update.processor.LogUpdateProcessorFactory$LogUpdateProcessor.finish(LogUpdateProcessorFactory.java:182) at
Re: Delete on 8.5.1
Hi - I also tried deleting from solrj (8.5.1) using CloudSolrClient.deleteByQuery. This results in: Error: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://paradigm8:9100/solr/PROCESSOR_LOGS: Async exception during distributed update: Error from server at http://paradigm7:9100/solr/PROCESSOR_LOGS_shard6_replica_n20/: null request: http://paradigm7:9100/solr/PROCESSOR_LOGS_shard6_replica_n20/ Remote error message: Task queue processing has stalled for 20203 ms with 0 remaining elements to process. org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://paradigm8:9100/solr/PROCESSOR_LOGS: Async exception during distributed update: Error from server at http://paradigm7:9100/solr/PROCESSOR_LOGS_shard6_replica_n20/: null request: http://paradigm7:9100/solr/PROCESSOR_LOGS_shard6_replica_n20/ Remote error message: Task queue processing has stalled for 20203 ms with 0 remaining elements to process. at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:665) at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:265) at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:248) at org.apache.solr.client.solrj.impl.LBSolrClient.doRequest(LBSolrClient.java:368) at org.apache.solr.client.solrj.impl.LBSolrClient.request(LBSolrClient.java:296) at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.sendRequest(BaseCloudSolrClient.java:1143) at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.requestWithRetryOnStaleState(BaseCloudSolrClient.java:906) at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.request(BaseCloudSolrClient.java:838) at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211) at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:940) at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:903) at com.ngc.bigdata.solrsearcher.SearcherThread.doSearch(SearcherThread.java:401) at com.ngc.bigdata.solrsearcher.SearcherThread.run(SearcherThread.java:125) at com.ngc.bigdata.solrsearcher.Worker.doSearchTest(Worker.java:145) at com.ngc.bigdata.solrsearcher.SolrSearcher.main(SolrSearcher.java:60) On 4/28/2020 11:50 AM, Joe Obernberger wrote: Hi all - I'm running this query on solr cloud 8.5.1 with the index on HDFS: curl http://enceladus:9100/solr/PROCESSOR_LOGS/update?commit=true -H "Connect-Type: text/xml" --data-binary 'StartTime:[2020-01-01T01:02:43Z TO 2020-04-25T00:00:00Z]' getting this response: 1 500 54091 name="error-class">org.apache.solr.update.processor.DistributedUpdateProcessor$DistributedUpdatesAsyncException name="root-error-class">org.apache.solr.update.processor.DistributedUpdateProcessor$DistributedUpdatesAsyncException 2 Async exceptions during distributed update: Error from server at http://paradigm8:9100/solr/PROCESSOR_LOGS_shard2_replica_n4/: null request: http://paradigm8:9100/solr/PROCESSOR_LOGS_shard2_replica_n4/ Remote error message: Task queue processing has stalled for 20193 ms with 0 remaining elements to process. Error from server at http://belinda:9100/solr/PROCESSOR_LOGS_shard10_replica_n38/: null request: http://belinda:9100/solr/PROCESSOR_LOGS_shard10_replica_n38/ Remote error message: Task queue processing has stalled for 20021 ms with 0 remaining elements to process. name="trace">org.apache.solr.update.processor.DistributedUpdateProcessor$DistributedUpdatesAsyncException: 2 Async exceptions during distributed update: Error from server at http://paradigm8:9100/solr/PROCESSOR_LOGS_shard2_replica_n4/: null request: http://paradigm8:9100/solr/PROCESSOR_LOGS_shard2_replica_n4/ Remote error message: Task queue processing has stalled for 20193 ms with 0 remaining elements to process. Error from server at http://belinda:9100/solr/PROCESSOR_LOGS_shard10_replica_n38/: null request: http://belinda:9100/solr/PROCESSOR_LOGS_shard10_replica_n38/ Remote error message: Task queue processing has stalled for 20021 ms with 0 remaining elements to process. at org.apache.solr.update.processor.DistributedZkUpdateProcessor.doDistribFinish(DistributedZkUpdateProcessor.java:1189) at org.apache.solr.update.processor.DistributedUpdateProcessor.finish(DistributedUpdateProcessor.java:1096) at org.apache.solr.update.processor.LogUpdateProcessorFactory$LogUpdateProcessor.finish(LogUpdateProcessorFactory.java:182) at org.apache.solr.update.processor.UpdateRequestProcessor.finish(UpdateRequestProcessor.java:80) at org.apache.solr.update.processor.UpdateRequestProcessor.finish(UpdateRequestProcessor.java:80) at org.apache.solr.update.processor.UpdateRequestProcessor.finish(UpdateRequestProcessor.java:80)
Delete on 8.5.1
Hi all - I'm running this query on solr cloud 8.5.1 with the index on HDFS: curl http://enceladus:9100/solr/PROCESSOR_LOGS/update?commit=true -H "Connect-Type: text/xml" --data-binary 'StartTime:[2020-01-01T01:02:43Z TO 2020-04-25T00:00:00Z]' getting this response: 1 500 54091 name="error-class">org.apache.solr.update.processor.DistributedUpdateProcessor$DistributedUpdatesAsyncException name="root-error-class">org.apache.solr.update.processor.DistributedUpdateProcessor$DistributedUpdatesAsyncException 2 Async exceptions during distributed update: Error from server at http://paradigm8:9100/solr/PROCESSOR_LOGS_shard2_replica_n4/: null request: http://paradigm8:9100/solr/PROCESSOR_LOGS_shard2_replica_n4/ Remote error message: Task queue processing has stalled for 20193 ms with 0 remaining elements to process. Error from server at http://belinda:9100/solr/PROCESSOR_LOGS_shard10_replica_n38/: null request: http://belinda:9100/solr/PROCESSOR_LOGS_shard10_replica_n38/ Remote error message: Task queue processing has stalled for 20021 ms with 0 remaining elements to process. name="trace">org.apache.solr.update.processor.DistributedUpdateProcessor$DistributedUpdatesAsyncException: 2 Async exceptions during distributed update: Error from server at http://paradigm8:9100/solr/PROCESSOR_LOGS_shard2_replica_n4/: null request: http://paradigm8:9100/solr/PROCESSOR_LOGS_shard2_replica_n4/ Remote error message: Task queue processing has stalled for 20193 ms with 0 remaining elements to process. Error from server at http://belinda:9100/solr/PROCESSOR_LOGS_shard10_replica_n38/: null request: http://belinda:9100/solr/PROCESSOR_LOGS_shard10_replica_n38/ Remote error message: Task queue processing has stalled for 20021 ms with 0 remaining elements to process. at org.apache.solr.update.processor.DistributedZkUpdateProcessor.doDistribFinish(DistributedZkUpdateProcessor.java:1189) at org.apache.solr.update.processor.DistributedUpdateProcessor.finish(DistributedUpdateProcessor.java:1096) at org.apache.solr.update.processor.LogUpdateProcessorFactory$LogUpdateProcessor.finish(LogUpdateProcessorFactory.java:182) at org.apache.solr.update.processor.UpdateRequestProcessor.finish(UpdateRequestProcessor.java:80) at org.apache.solr.update.processor.UpdateRequestProcessor.finish(UpdateRequestProcessor.java:80) at org.apache.solr.update.processor.UpdateRequestProcessor.finish(UpdateRequestProcessor.java:80) at org.apache.solr.update.processor.UpdateRequestProcessor.finish(UpdateRequestProcessor.java:80) at org.apache.solr.update.processor.UpdateRequestProcessor.finish(UpdateRequestProcessor.java:80) at org.apache.solr.update.processor.UpdateRequestProcessor.finish(UpdateRequestProcessor.java:80) at org.apache.solr.update.processor.UpdateRequestProcessor.finish(UpdateRequestProcessor.java:80) at org.apache.solr.update.processor.UpdateRequestProcessor.finish(UpdateRequestProcessor.java:80) at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:78) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:211) at org.apache.solr.core.SolrCore.execute(SolrCore.java:2596) at org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:802) at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:579) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:420) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:352) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1596) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:545) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:590) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1607) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1297) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:485) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1577) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1212) at
