I'm not sure other than retrieving from a hive table that is already
sorted. This sounds cool though, would be interested to know this as well
On Nov 28, 2017 10:40 AM, "Николай Ижиков" wrote:
> Hello, guys!
>
> I work on implementation of custom DataSource for Spark Data Frame API and
> have a
Hello, guys!
I work on implementation of custom DataSource for Spark Data Frame API and have
a question:
If I have a `SELECT * FROM table1 ORDER BY some_column` query I can sort data
inside a partition in my data source.
Do I have a built-in option to tell spark that data from each partition
