[
https://issues.apache.org/jira/browse/SPARK-51264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-51264:
-----------------------------------
Labels: pull-request-available (was: )
> JDBC write keeps driver connection open unnecessarily
> -----------------------------------------------------
>
> Key: SPARK-51264
> URL: https://issues.apache.org/jira/browse/SPARK-51264
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 2.1.0, 2.2.0, 2.3.0, 2.4.0, 3.0.0, 3.1.0, 3.2.0, 3.3.0,
> 3.4.0, 3.5.0, 4.0.0
> Reporter: Ángel Álvarez Pascua
> Priority: Major
> Labels: pull-request-available
> Original Estimate: 1h
> Remaining Estimate: 1h
>
> A JDBC connection is created in
> {{org.apache.spark.sql.execution.datasources.jdbc.JdbcRelationProvider}} to
> truncate, drop, or create the table. However, this connection remains open
> and idle throughout the entire save process, which can last minutes or hours.
>
> This causes unnecessary resource consumption on both the Spark driver and the
> database. Additionally, the idle connection is at risk of being dropped by
> the database, firewall, or proxy. Best practices recommend releasing
> resources as soon as they are no longer needed.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
