https://github.com/apache/spark/blob/master/sql/catalyst/src/main/java/org/apache/spark/sql/connector/read/InputPartition.java
See InputPartition which had a preferred location parameter you should override On Sat, Jan 18, 2020, 1:44 PM kineret M <kiner...@gmail.com> wrote: > Hi, > I would like to support data locality in Spark data source v2. How can I > provide Spark the ability to read and process data on the same node? > > I didn't find any interface that supports 'getPreferredLocations' (or > equivalent). > > Thanks! >
