[
https://issues.apache.org/jira/browse/SOLR-8480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15090723#comment-15090723
]
Joel Bernstein commented on SOLR-8480:
--------------------------------------
I think this ticket will be important as we start to make the Streaming API
more robust. I think something like a status bar with %complete would be doable.
As [~caomanhdat] mentioned we can get the count from the JSONTupleStream. From
that we know how many documents there are to process and we can track how many
documents have already been read.
The tricky part will be getting this information back to the client. One
approach to this is to have the JSONTupleStream add the metrics to a JMX Bean
on each worker. Then outside tools could gather up this information from each
worker node and present a dashboard.
[~o...@apache.org], curious if you think this monitoring approach makes sense?
If we use this approach then this ticket would be about instrumenting the
JSONTupleStream to gather the metrics.
> Progress info for TupleStream
> -----------------------------
>
> Key: SOLR-8480
> URL: https://issues.apache.org/jira/browse/SOLR-8480
> Project: Solr
> Issue Type: Improvement
> Components: SolrJ
> Reporter: Cao Manh Dat
>
> I suggest adding progress info for TupleStream. It can be very helpful for
> tracking consuming process
> {code}
> public abstract class TupleStream {
> public abstract long getSize();
> public abstract long getConsumed();
> }
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
