[ https://issues.apache.org/jira/browse/SPARK-17815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15553900#comment-15553900 ]
Michael Armbrust commented on SPARK-17815: ------------------------------------------ The only reason its blocked is because setting it wouldn't mean anything until we actually have the information provided by [SPARK-16963] (or you overclaim and say you had committed things that have not yet been processed). I think we should lift that restriction when we have something useful to say. > Report committed offsets > ------------------------ > > Key: SPARK-17815 > URL: https://issues.apache.org/jira/browse/SPARK-17815 > Project: Spark > Issue Type: Sub-task > Components: SQL > Reporter: Michael Armbrust > > Since we manage our own offsets, we have turned off auto-commit. However, > this means that external tools are not able to report on how far behind a > given streaming job is. When the user manually gives us a group.id, we > should report back to it. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org