[
https://issues.apache.org/jira/browse/HIVE-25405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Narayanan Venkateswaran updated HIVE-25405:
-------------------------------------------
Description:
h2. h2. DB Level Federation to Redshift
The work in this Jira helps setup federation to redshift databases at the DB
level, in the following way.
{noformat}
0: jdbc:hive2://> describe connector redshift_test_7;
21/07/30 20:53:53 [343005b1-06f3-4891-81d1-0c6ad8612260 main]: WARN
lazy.LazyStruct: Extra bytes detected at the end of the row! Ignoring similar
problems.
+------------------+-----------+----------------------------------------------------+-------------+-------------+--------------------------+
| name | type | url
| owner_name | owner_type | comment |
+------------------+-----------+----------------------------------------------------+-------------+-------------+--------------------------+
| redshift_test_7 | redshift | jdbc:redshift://<url>
| narayanan | USER | test redshift connector |
+------------------+-----------+----------------------------------------------------+-------------+-------------+--------------------------+
1 row selected (0.054 seconds) {noformat}
{noformat}
0: jdbc:hive2://> describe database db_redshift_7;
21/07/30 20:53:38 [343005b1-06f3-4891-81d1-0c6ad8612260 main]: WARN
lazy.LazyStruct: Extra bytes detected at the end of the row! Ignoring similar
problems.
+----------------+----------+-----------+------------------+-------------+-------------+------------------+----------------+
| db_name | comment | location | managedlocation | owner_name |
owner_type | connector_name | remote_dbname |
+----------------+----------+-----------+------------------+-------------+-------------+------------------+----------------+
| db_redshift_7 | | | | narayanan | USER
| redshift_test_7 | dev |
+----------------+----------+-----------+------------------+-------------+-------------+------------------+----------------+
1 row selected (0.066 seconds) {noformat}
{noformat}
0: jdbc:hive2://> use db_redshift_7;
No rows affected (1.391 seconds) {noformat}
{noformat}
0: jdbc:hive2://> show tables;
+-----------------+
| tab_name |
+-----------------+
| accommodations |
| category |
| date |
| event |
| listing |
| sales |
| sample |
| test_float_4 |
| test_int_2 |
| test_int_4 |
| test_int_8 |
| test_time |
| test_time_2 |
| test_timestamp |
| users |
| venue |
| zipcode |
+-----------------+
17 rows selected (7.773 seconds) {noformat}
{noformat}
0: jdbc:hive2://> select * from test_float_4;
+-----------------+
| test_float_4.i |
+-----------------+
| 1.0 |
+-----------------+
1 row selected (18.214 seconds) {noformat}
{noformat}
0: jdbc:hive2://> select * from test_int_8;
+---------------+
| test_int_8.i |
+---------------+
| 1 |
+---------------+
1 row selected (12.626 seconds) {noformat}
was:
{noformat}
0: jdbc:hive2://> describe connector redshift_test_7;
21/07/30 20:53:53 [343005b1-06f3-4891-81d1-0c6ad8612260 main]: WARN
lazy.LazyStruct: Extra bytes detected at the end of the row! Ignoring similar
problems.
+------------------+-----------+----------------------------------------------------+-------------+-------------+--------------------------+
| name | type | url
| owner_name | owner_type | comment |
+------------------+-----------+----------------------------------------------------+-------------+-------------+--------------------------+
| redshift_test_7 | redshift | jdbc:redshift://<url>
| narayanan | USER | test redshift connector |
+------------------+-----------+----------------------------------------------------+-------------+-------------+--------------------------+
1 row selected (0.054 seconds) {noformat}
{noformat}
0: jdbc:hive2://> describe database db_redshift_7;
21/07/30 20:53:38 [343005b1-06f3-4891-81d1-0c6ad8612260 main]: WARN
lazy.LazyStruct: Extra bytes detected at the end of the row! Ignoring similar
problems.
+----------------+----------+-----------+------------------+-------------+-------------+------------------+----------------+
| db_name | comment | location | managedlocation | owner_name |
owner_type | connector_name | remote_dbname |
+----------------+----------+-----------+------------------+-------------+-------------+------------------+----------------+
| db_redshift_7 | | | | narayanan | USER
| redshift_test_7 | dev |
+----------------+----------+-----------+------------------+-------------+-------------+------------------+----------------+
1 row selected (0.066 seconds) {noformat}
{noformat}
0: jdbc:hive2://> use db_redshift_7;
No rows affected (1.391 seconds) {noformat}
{noformat}
0: jdbc:hive2://> show tables;
+-----------------+
| tab_name |
+-----------------+
| accommodations |
| category |
| date |
| event |
| listing |
| sales |
| sample |
| test_float_4 |
| test_int_2 |
| test_int_4 |
| test_int_8 |
| test_time |
| test_time_2 |
| test_timestamp |
| users |
| venue |
| zipcode |
+-----------------+
17 rows selected (7.773 seconds) {noformat}
{noformat}
0: jdbc:hive2://> select * from test_float_4;
+-----------------+
| test_float_4.i |
+-----------------+
| 1.0 |
+-----------------+
1 row selected (18.214 seconds) {noformat}
{noformat}
0: jdbc:hive2://> select * from test_int_8;
+---------------+
| test_int_8.i |
+---------------+
| 1 |
+---------------+
1 row selected (12.626 seconds) {noformat}
> Implement Connector Provider for Amazon Redshift
> ------------------------------------------------
>
> Key: HIVE-25405
> URL: https://issues.apache.org/jira/browse/HIVE-25405
> Project: Hive
> Issue Type: Sub-task
> Reporter: Narayanan Venkateswaran
> Assignee: Narayanan Venkateswaran
> Priority: Major
> Labels: pull-request-available
> Time Spent: 10m
> Remaining Estimate: 0h
>
> h2. h2. DB Level Federation to Redshift
> The work in this Jira helps setup federation to redshift databases at the DB
> level, in the following way.
> {noformat}
> 0: jdbc:hive2://> describe connector redshift_test_7;
> 21/07/30 20:53:53 [343005b1-06f3-4891-81d1-0c6ad8612260 main]: WARN
> lazy.LazyStruct: Extra bytes detected at the end of the row! Ignoring similar
> problems.
> +------------------+-----------+----------------------------------------------------+-------------+-------------+--------------------------+
> | name | type | url
> | owner_name | owner_type | comment |
> +------------------+-----------+----------------------------------------------------+-------------+-------------+--------------------------+
> | redshift_test_7 | redshift | jdbc:redshift://<url>
> | narayanan | USER | test redshift connector |
> +------------------+-----------+----------------------------------------------------+-------------+-------------+--------------------------+
> 1 row selected (0.054 seconds) {noformat}
> {noformat}
> 0: jdbc:hive2://> describe database db_redshift_7;
> 21/07/30 20:53:38 [343005b1-06f3-4891-81d1-0c6ad8612260 main]: WARN
> lazy.LazyStruct: Extra bytes detected at the end of the row! Ignoring similar
> problems.
> +----------------+----------+-----------+------------------+-------------+-------------+------------------+----------------+
> | db_name | comment | location | managedlocation | owner_name |
> owner_type | connector_name | remote_dbname |
> +----------------+----------+-----------+------------------+-------------+-------------+------------------+----------------+
> | db_redshift_7 | | | | narayanan |
> USER | redshift_test_7 | dev |
> +----------------+----------+-----------+------------------+-------------+-------------+------------------+----------------+
> 1 row selected (0.066 seconds) {noformat}
> {noformat}
> 0: jdbc:hive2://> use db_redshift_7;
> No rows affected (1.391 seconds) {noformat}
> {noformat}
> 0: jdbc:hive2://> show tables;
> +-----------------+
> | tab_name |
> +-----------------+
> | accommodations |
> | category |
> | date |
> | event |
> | listing |
> | sales |
> | sample |
> | test_float_4 |
> | test_int_2 |
> | test_int_4 |
> | test_int_8 |
> | test_time |
> | test_time_2 |
> | test_timestamp |
> | users |
> | venue |
> | zipcode |
> +-----------------+
> 17 rows selected (7.773 seconds) {noformat}
> {noformat}
> 0: jdbc:hive2://> select * from test_float_4;
> +-----------------+
> | test_float_4.i |
> +-----------------+
> | 1.0 |
> +-----------------+
> 1 row selected (18.214 seconds) {noformat}
> {noformat}
> 0: jdbc:hive2://> select * from test_int_8;
> +---------------+
> | test_int_8.i |
> +---------------+
> | 1 |
> +---------------+
> 1 row selected (12.626 seconds) {noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
