Re: Detect ongoing Solr Import and its Completion
Thank you very much Alvaro and Shawn. The DataImport Status command was what I was looking for. I have tried it a bit, and I feel the output is good enough for me. Thanks again Alvaro Cabrerizo wrote > Maybe you are asking for the status command. Currently this is the url I > invoke for checking whether the import process is running (or has failed) > > From the cwiki: > > The URL is http:// > > : > > /solr/ > > /dataimport?command=status. > It returns statistics on the number of documents created, deleted, queries > run, rows fetched, status, and so on. > > Hope it helps. Shawn Heisey-2 wrote > The actual dataimport API (not the admin UI link that you included > above, which *uses* the dataimport API) is the only way I know of for > sure to detect the import status. The default command is "status". > > http://server:port/solr/corename/dataimport > > Here's a wiki page with info on this API: > > http://wiki.apache.org/solr/DataImportHandler#Commands > > Unfortunately, interpreting the status is not straightforward for a > program. It's pretty easy for a human to interpret it on sight, but a > program must examine several aspects of the status response to determine > the status, success, or failure of an import. There are bug reports > about this, but it's a thorny problem that has not yet been solved. > > https://issues.apache.org/jira/browse/SOLR-3319 > > Thanks, > Shawn -- View this message in context: http://lucene.472066.n3.nabble.com/Detect-ongoing-Solr-Import-and-its-Completion-tp4184273p4184286.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Detect ongoing Solr Import and its Completion
On 2/5/2015 2:48 PM, O. Olson wrote: > My setup is fairly similar to the examples. I start a Solr Import using the > UI i.e. I go to: > http://localhost:8983/solr/#/corename/dataimport//dataimport and click the > Execute button to start the Import. > > First, I'm curious if there is a way of figuring out if there is an import > running. I thought one of the ways to do this look at the core Statistics > page i.e. at http://localhost:8983/solr/#/corename and look at the value of > Current. If it is red – it means an import is running, and if it is green, > the import has either completed or not running. > > My problem is that initially for the first min or two, though the > import is > running, the value of Current on the Statistics page is still green. Is > there a way of definitely determining if a import is currently running in > Solr? > > Second, is there a way of determining if a Solr Import has completed. I > normally wait for the Red value of Current on the Statistics page becomes > Green, and I detect the completion of the Import. The actual dataimport API (not the admin UI link that you included above, which *uses* the dataimport API) is the only way I know of for sure to detect the import status. The default command is "status". http://server:port/solr/corename/dataimport Here's a wiki page with info on this API: http://wiki.apache.org/solr/DataImportHandler#Commands Unfortunately, interpreting the status is not straightforward for a program. It's pretty easy for a human to interpret it on sight, but a program must examine several aspects of the status response to determine the status, success, or failure of an import. There are bug reports about this, but it's a thorny problem that has not yet been solved. https://issues.apache.org/jira/browse/SOLR-3319 Thanks, Shawn
Re: Detect ongoing Solr Import and its Completion
Maybe you are asking for the status command. Currently this is the url I invoke for checking whether the import process is running (or has failed) >From the cwiki: The URL is http://:/solr//dataimport?command=status. It returns statistics on the number of documents created, deleted, queries run, rows fetched, status, and so on. Hope it helps. On Feb 5, 2015 10:49 PM, "O. Olson" wrote: > My setup is fairly similar to the examples. I start a Solr Import using the > UI i.e. I go to: > http://localhost:8983/solr/#/corename/dataimport//dataimport and click > the > Execute button to start the Import. > > First, I'm curious if there is a way of figuring out if there is an import > running. I thought one of the ways to do this look at the core Statistics > page i.e. at http://localhost:8983/solr/#/corename and look at the value > of > Current. If it is red – it means an import is running, and if it is green, > the import has either completed or not running. > > My problem is that initially for the first min or two, though the > import is > running, the value of Current on the Statistics page is still green. Is > there a way of definitely determining if a import is currently running in > Solr? > > Second, is there a way of determining if a Solr Import has completed. I > normally wait for the Red value of Current on the Statistics page becomes > Green, and I detect the completion of the Import. > > Thank you in advance > > > > > -- > View this message in context: > http://lucene.472066.n3.nabble.com/Detect-ongoing-Solr-Import-and-its-Completion-tp4184273.html > Sent from the Solr - User mailing list archive at Nabble.com. >
Detect ongoing Solr Import and its Completion
My setup is fairly similar to the examples. I start a Solr Import using the UI i.e. I go to: http://localhost:8983/solr/#/corename/dataimport//dataimport and click the Execute button to start the Import. First, I'm curious if there is a way of figuring out if there is an import running. I thought one of the ways to do this look at the core Statistics page i.e. at http://localhost:8983/solr/#/corename and look at the value of Current. If it is red – it means an import is running, and if it is green, the import has either completed or not running. My problem is that initially for the first min or two, though the import is running, the value of Current on the Statistics page is still green. Is there a way of definitely determining if a import is currently running in Solr? Second, is there a way of determining if a Solr Import has completed. I normally wait for the Red value of Current on the Statistics page becomes Green, and I detect the completion of the Import. Thank you in advance -- View this message in context: http://lucene.472066.n3.nabble.com/Detect-ongoing-Solr-Import-and-its-Completion-tp4184273.html Sent from the Solr - User mailing list archive at Nabble.com.
