Jeroen Warmerdam created SPARK-5860:
---------------------------------------
Summary: JdbcRDD: overflow on large range with high number of
partitions
Key: SPARK-5860
URL: https://issues.apache.org/jira/browse/SPARK-5860
Project: Spark
Issue Type: Bug
Components: Spark Core
Affects Versions: 1.2.1
Reporter: Jeroen Warmerdam
Priority: Minor
{code}
val jdbcRDD = new JdbcRDD(sc, () =>
DriverManager.getConnection(url, username, password),
"SELECT id FROM documents WHERE ? <= id AND id <= ?",
lowerBound = 1131544775L,
upperBound = 567279358897692673L,
numPartitions = 20,
mapRow = r => (r.getLong("id"))
)
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
