Github user cloud-fan commented on a diff in the pull request:
    --- Diff: 
    @@ -107,17 +106,24 @@ case class DataSourceV2Relation(
    - * A specialization of DataSourceV2Relation with the streaming bit set to 
true. Otherwise identical
    - * to the non-streaming relation.
    + * A specialization of [[DataSourceV2Relation]] with the streaming bit set 
to true.
    + *
    + * Note that, this plan has a mutable reader, so Spark won't apply 
operator push-down for this plan,
    + * to avoid making the plan mutable. We should consolidate this plan and 
    + * after we figure out how to apply operator push-down for streaming data 
    --- End diff --
    We can also ask the implementations to clear out all the state after 
`createX` is called, then we don't need to add any new APIs. Anyway there 
should be a detailed design doc for data source v2 operator push down, it 
doesn't block this PR.


To unsubscribe, e-mail:
For additional commands, e-mail:

Reply via email to