Haaris created IMPALA-7712:
------------------------------
Summary: Impala read from and write to GCS
Key: IMPALA-7712
URL: https://issues.apache.org/jira/browse/IMPALA-7712
Project: IMPALA
Issue Type: Question
Reporter: Haaris
Can Impala read from and write to google cloud storage GCS like the way it does
with amazon s3
I have tested the use case with S3, but when talking to GCS impala errors out
with:
Query: create table gcs_impala2 (title string) location
'gs://mybucket-gcs/some_data/' ERROR: AnalysisException: null CAUSED BY:
RuntimeException: java.lang.ClassNotFoundException: Class
com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystem not found CAUSED BY:
ClassNotFoundException: Class
com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystem not found
On the same cluster i have Hive talking to GCS using the GCS connector jar
provided by google form :
[https://cloud.google.com/dataproc/docs/concepts/connectors/install-storage-connector]
Also, HDFS reads and writes from/to GCS.
Made sure java version matches and appropriate values are in classpath.
Appreciate your time and effort.
Thanks
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
