Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/19623#discussion_r148240421
--- Diff:
sql/core/src/main/java/org/apache/spark/sql/sources/v2/reader/DataReader.java
---
@@ -34,11 +34,17 @@
/**
* Proceed to next record, returns false if there is no more records.
+ *
+ * If an exception was thrown, the corresponding Spark task would fail
and get retried until
+ * hitting the maximum retry times.
*/
boolean next();
/**
* Return the current record. This method should return same value until
`next` is called.
+ *
--- End diff --
> This method should return same value until `next` is called.
are you talking about this requirement? I think this is a strong
requirement for `next/get` pattern, like `hasNext` should return same value
until `next` is called, for the `hasNext/next` pattern.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
