Just turn off the JDBC option pushDownPredicate, which was introduced in
Spark 2.4. https://spark.apache.org/docs/latest/sql-data-sources-jdbc.html
Xiao
On Mon, Jun 22, 2020 at 11:36 AM Mohit Durgapal
wrote:
> Hi All,
>
> I am trying to read a table of a relational database using spark 2.x.
>
Hi All,
I am trying to read a table of a relational database using spark 2.x.
I am using code like the following:
sparkContext.read().jdbc(url, table ,
connectionProperties).select('SELECT_COLUMN').where(whereClause);
Now, What's happening is spark is actually the SQL query which spark is
