[
https://issues.apache.org/jira/browse/SPARK-28977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-28977:
------------------------------
Fix Version/s: 2.4.5
> JDBC Dataframe Reader Doc Doesn't Match JDBC Data Source Page
> -------------------------------------------------------------
>
> Key: SPARK-28977
> URL: https://issues.apache.org/jira/browse/SPARK-28977
> Project: Spark
> Issue Type: Documentation
> Components: Documentation
> Affects Versions: 2.4.3
> Reporter: Christopher Hoshino-Fish
> Assignee: Sean Owen
> Priority: Minor
> Fix For: 2.4.5, 3.0.0
>
>
> [https://spark.apache.org/docs/2.4.3/sql-data-sources-jdbc.html]
> Specifically in the partitionColumn section, this page says:
> "{{partitionColumn}} must be a numeric, date, or timestamp column from the
> table in question."
>
> But then in this doc:
> [https://spark.apache.org/docs/2.4.3/api/scala/index.html#org.apache.spark.sql.DataFrameReader]
> in def jdbc(url: String, table: String, columnName: String, lowerBound: Long,
> upperBound: Long, numPartitions: Int, connectionProperties: Properties):
> DataFrame
> we have:
> columnName
> the name of a column of integral type that will be used for partitioning.
>
> This appears to go back pretty far, to 1.6.3, but I'm not sure when this was
> accurate.
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
