Tengfei Huang created SPARK-56251:
-------------------------------------
Summary: Avoid loading all data to memory by default for
PostgresSQL jdbc connector
Key: SPARK-56251
URL: https://issues.apache.org/jira/browse/SPARK-56251
Project: Spark
Issue Type: Task
Components: SQL
Affects Versions: 4.1.1
Reporter: Tengfei Huang
Currently by default, when user load data from postgres via jdbc connector,
will load all the data in memory which will provide OOM risks.
We should change the default behavior to avoid such tasks crashing executors.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
