Richard Chen created SPARK-40294: ------------------------------------ Summary: Repeat calls to `PartitionIterator.hasNext` can timeout Key: SPARK-40294 URL: https://issues.apache.org/jira/browse/SPARK-40294 Project: Spark Issue Type: Bug Components: SQL Affects Versions: 3.3.0 Reporter: Richard Chen
Repeat calls to {{PartitionIterator.hasNext}} where both calls return {{false}} can result in timeouts. For example, {{{}KafkaBatchPartitionReader.next(){}}}, which calls {{consumer.get}} (which can potentially timeout with repeat calls), is called by {{{}PartitionIterator.hasNext{}}}. Thus, repeat calls to {{PartitionIterator.hasNext}} by its parent could timeout. -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org