[
https://issues.apache.org/jira/browse/SPARK-36616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rajkumar Gunasekaran updated SPARK-36616:
-----------------------------------------
Description:
Hi, Here is my spark sql code, where I am trying to read a presto table based
on this guide;
[https://spark.apache.org/docs/latest/sql-data-sources-jdbc.html]
{code:scala}
val df = spark.read
.format("jdbc")
.option("driver", "com.facebook.presto.jdbc.PrestoDriver")
.option("url", "jdbc:presto:localhost:8889/mycatalog")
.option("query", "select * from mydb.mytable limit 1")
.option("user", "myuserid")
.load()
{code}
I am getting the following exception: *_unrecognized connection property
'url'_*
{code:java}
Exception in thread "main" java.sql.SQLException: Unrecognized connection
property 'url'
at
com.facebook.presto.jdbc.PrestoDriverUri.validateConnectionProperties(PrestoDriverUri.java:345)
at com.facebook.presto.jdbc.PrestoDriverUri.<init>(PrestoDriverUri.java:102)
at com.facebook.presto.jdbc.PrestoDriverUri.<init>(PrestoDriverUri.java:92)
at com.facebook.presto.jdbc.PrestoDriver.connect(PrestoDriver.java:87)
at
org.apache.spark.sql.execution.datasources.jdbc.connection.BasicConnectionProvider.getConnection(BasicConnectionProvider.scala:49)
at
org.apache.spark.sql.execution.datasources.jdbc.connection.ConnectionProvider$.create(ConnectionProvider.scala:68)
at
org.apache.spark.sql.execution.datasources.jdbc.JdbcUtils$.$anonfun$createConnectionFactory$1(JdbcUtils.scala:62)
at
org.apache.spark.sql.execution.datasources.jdbc.JDBCRDD$.resolveTable(JDBCRDD.scala:56)
at
org.apache.spark.sql.execution.datasources.jdbc.JDBCRelation$.getSchema(JDBCRelation.scala:226)
at
org.apache.spark.sql.execution.datasources.jdbc.JdbcRelationProvider.createRelation(JdbcRelationProvider.scala:35)
at
org.apache.spark.sql.execution.datasources.DataSource.resolveRelation(DataSource.scala:354)
at org.apache.spark.sql.DataFrameReader.loadV1Source(DataFrameReader.scala:326)
at
org.apache.spark.sql.DataFrameReader.$anonfun$load$3(DataFrameReader.scala:308)
at scala.Option.getOrElse(Option.scala:189)
at org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:308)
at org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:226)
at org.apache.spark.sql.DataFrameReader.jdbc(DataFrameReader.scala:341)
{code}
Seems like this issue is related to
[https://github.com/prestodb/presto/issues/9254] where the property `url` is
not a recognized property in Presto and looks like the fix needs to be done on
the Spark side?
Our development is blocked on this exception and would appreciate any guidance.
Thanks!
was:
Hi, Here is my spark sql code, where I am trying to read a presto table based
on this
[guide|[https://spark.apache.org/docs/latest/sql-data-sources-jdbc.html]]
{code:scala}
val df = spark.read
.format("jdbc")
.option("driver", "com.facebook.presto.jdbc.PrestoDriver")
.option("url", "jdbc:presto:localhost:8889/mycatalog")
.option("query", "select * from mydb.mytable limit 1")
.option("user", "myuserid")
.load()
{code}
I am getting the following exception: *_unrecognized connection property
'url'_*
{code:java}
Exception in thread "main" java.sql.SQLException: Unrecognized connection
property 'url'
at
com.facebook.presto.jdbc.PrestoDriverUri.validateConnectionProperties(PrestoDriverUri.java:345)
at com.facebook.presto.jdbc.PrestoDriverUri.<init>(PrestoDriverUri.java:102)
at com.facebook.presto.jdbc.PrestoDriverUri.<init>(PrestoDriverUri.java:92)
at com.facebook.presto.jdbc.PrestoDriver.connect(PrestoDriver.java:87)
at
org.apache.spark.sql.execution.datasources.jdbc.connection.BasicConnectionProvider.getConnection(BasicConnectionProvider.scala:49)
at
org.apache.spark.sql.execution.datasources.jdbc.connection.ConnectionProvider$.create(ConnectionProvider.scala:68)
at
org.apache.spark.sql.execution.datasources.jdbc.JdbcUtils$.$anonfun$createConnectionFactory$1(JdbcUtils.scala:62)
at
org.apache.spark.sql.execution.datasources.jdbc.JDBCRDD$.resolveTable(JDBCRDD.scala:56)
at
org.apache.spark.sql.execution.datasources.jdbc.JDBCRelation$.getSchema(JDBCRelation.scala:226)
at
org.apache.spark.sql.execution.datasources.jdbc.JdbcRelationProvider.createRelation(JdbcRelationProvider.scala:35)
at
org.apache.spark.sql.execution.datasources.DataSource.resolveRelation(DataSource.scala:354)
at org.apache.spark.sql.DataFrameReader.loadV1Source(DataFrameReader.scala:326)
at
org.apache.spark.sql.DataFrameReader.$anonfun$load$3(DataFrameReader.scala:308)
at scala.Option.getOrElse(Option.scala:189)
at org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:308)
at org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:226)
at org.apache.spark.sql.DataFrameReader.jdbc(DataFrameReader.scala:341)
{code}
Seems like this issue is related to
[https://github.com/prestodb/presto/issues/9254] where the property `url` is
not a recognized property in Presto and looks like the fix needs to be done on
the Spark side?
Our development is blocked on this exception and would appreciate any guidance.
Thanks!
> Unrecognized connection property 'url' when using Presto JDBC
> -------------------------------------------------------------
>
> Key: SPARK-36616
> URL: https://issues.apache.org/jira/browse/SPARK-36616
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 3.1.1
> Reporter: Rajkumar Gunasekaran
> Priority: Blocker
>
> Hi, Here is my spark sql code, where I am trying to read a presto table
> based on this guide;
> [https://spark.apache.org/docs/latest/sql-data-sources-jdbc.html]
> {code:scala}
> val df = spark.read
> .format("jdbc")
> .option("driver", "com.facebook.presto.jdbc.PrestoDriver")
> .option("url", "jdbc:presto:localhost:8889/mycatalog")
> .option("query", "select * from mydb.mytable limit 1")
> .option("user", "myuserid")
> .load()
> {code}
>
> I am getting the following exception: *_unrecognized connection property
> 'url'_*
> {code:java}
> Exception in thread "main" java.sql.SQLException: Unrecognized connection
> property 'url'
> at
> com.facebook.presto.jdbc.PrestoDriverUri.validateConnectionProperties(PrestoDriverUri.java:345)
> at com.facebook.presto.jdbc.PrestoDriverUri.<init>(PrestoDriverUri.java:102)
> at com.facebook.presto.jdbc.PrestoDriverUri.<init>(PrestoDriverUri.java:92)
> at com.facebook.presto.jdbc.PrestoDriver.connect(PrestoDriver.java:87)
> at
> org.apache.spark.sql.execution.datasources.jdbc.connection.BasicConnectionProvider.getConnection(BasicConnectionProvider.scala:49)
> at
> org.apache.spark.sql.execution.datasources.jdbc.connection.ConnectionProvider$.create(ConnectionProvider.scala:68)
> at
> org.apache.spark.sql.execution.datasources.jdbc.JdbcUtils$.$anonfun$createConnectionFactory$1(JdbcUtils.scala:62)
> at
> org.apache.spark.sql.execution.datasources.jdbc.JDBCRDD$.resolveTable(JDBCRDD.scala:56)
> at
> org.apache.spark.sql.execution.datasources.jdbc.JDBCRelation$.getSchema(JDBCRelation.scala:226)
> at
> org.apache.spark.sql.execution.datasources.jdbc.JdbcRelationProvider.createRelation(JdbcRelationProvider.scala:35)
> at
> org.apache.spark.sql.execution.datasources.DataSource.resolveRelation(DataSource.scala:354)
> at
> org.apache.spark.sql.DataFrameReader.loadV1Source(DataFrameReader.scala:326)
> at
> org.apache.spark.sql.DataFrameReader.$anonfun$load$3(DataFrameReader.scala:308)
> at scala.Option.getOrElse(Option.scala:189)
> at org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:308)
> at org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:226)
> at org.apache.spark.sql.DataFrameReader.jdbc(DataFrameReader.scala:341)
>
> {code}
> Seems like this issue is related to
> [https://github.com/prestodb/presto/issues/9254] where the property `url` is
> not a recognized property in Presto and looks like the fix needs to be done
> on the Spark side?
> Our development is blocked on this exception and would appreciate any
> guidance. Thanks!
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
