[
https://issues.apache.org/jira/browse/IMPALA-12470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17778004#comment-17778004
]
Wenzhe Zhou edited comment on IMPALA-12470 at 10/21/23 3:30 AM:
----------------------------------------------------------------
For
query_test.test_ext_data_sources.TestExtDataSources.test_verify_jdbc_table_properties,
expected jdbc jar url on S3 is:
s3a://impala-test-uswest2-2/test-warehouse/data-sources/jdbc-data-source.jar
{code:java}
query_test/test_ext_data_sources.py:70: in test_verify_jdbc_table_properties
assert properties['__IMPALA_DATA_SOURCE_LOCATION'] == \
E assert 's3a://impala...ta-source.jar' == 'hdfs://localh...ta-source.jar'
E -
s3a://impala-test-uswest2-2/test-warehouse/data-sources/jdbc-data-source.jar
E ? -- ^^^ ^^^^ ^^^^^^^ ^^
E + hdfs://localhost:20500/test-warehouse/data-sources/jdbc-data-source.jar
E ? +++ ^^^ ^^ ^ ^^^^
{code}
was (Author: wzhou):
For
query_test.test_ext_data_sources.TestExtDataSources.test_verify_jdbc_table_properties,
expected jdbc jar url on S3 is:
's3a://impala...ta-source.jar' == 'hdfs://localh...ta-source.jar'
{code:java}
query_test/test_ext_data_sources.py:70: in test_verify_jdbc_table_properties
assert properties['__IMPALA_DATA_SOURCE_LOCATION'] == \
E assert 's3a://impala...ta-source.jar' == 'hdfs://localh...ta-source.jar'
E -
s3a://impala-test-uswest2-2/test-warehouse/data-sources/jdbc-data-source.jar
E ? -- ^^^ ^^^^ ^^^^^^^ ^^
E + hdfs://localhost:20500/test-warehouse/data-sources/jdbc-data-source.jar
E ? +++ ^^^ ^^ ^ ^^^^
{code}
> Support different schemes for jdbc driver url when creating external jdbc
> table
> -------------------------------------------------------------------------------
>
> Key: IMPALA-12470
> URL: https://issues.apache.org/jira/browse/IMPALA-12470
> Project: IMPALA
> Issue Type: Sub-task
> Components: Frontend
> Reporter: Wenzhe Zhou
> Priority: Major
> Time Spent: 40m
> Remaining Estimate: 0h
>
> jdbc driver url is specified as table property 'driver.url' when creating a
> external jdbc table, like the sample below:
> {code:java}
> CREATE TABLE test_postgres (
> id INT,
> string_col STRING)
> PRODUCED BY DATA SOURCE JdbcDataSource(
> '{"database.type":"POSTGRES",
> "jdbc.url":"jdbc:postgresql://localhost:5432/functional",
> "jdbc.driver":"org.postgresql.Driver",
> "driver.url":"hdfs://localhost:20500/test-warehouse/data-sources/jdbc-driver/postgresql-jdbc.jar",
> "dbcp.username":"hiveuser",
> "dbcp.password":"password",
> "table":"alltypes"}');
> {code}
> In the initial patch, we only support to download the driver jar files from
> hdfs. We need to support different storage type, like 'file://', 's3a://',
> etc.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
