[
https://issues.apache.org/jira/browse/HADOOP-17402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17240972#comment-17240972
]
Rafal Wojdyla edited comment on HADOOP-17402 at 11/30/20, 8:11 PM:
-------------------------------------------------------------------
[[email protected]] thanks for prompt response, GCS connector has
{{hadoop.fs.Filesystem}} service declared like
[here|https://github.com/GoogleCloudDataproc/hadoop-connectors/blob/master/gcs/src/main/resources/META-INF/services/org.apache.hadoop.fs.FileSystem],
is this the _right_ way?
Even with the service declared inside GCS connector, the error is different
between S3 and GCS, when S3 jar is missing the error will say that a class is
missing, but if GCS jar is missing, it would say that there is no such FS
scheme. And AFAIU this is because of the extra S3 config in the
`core-default.xml`.
was (Author: ravwojdyla):
[[email protected]] thanks for prompt response, GCS connector has
{{hadoop.fs.Filesystem}} service declared like
[here|https://github.com/GoogleCloudDataproc/hadoop-connectors/blob/master/gcs/src/main/resources/META-INF/services/org.apache.hadoop.fs.FileSystem],
is this the _right_ way?
Even with the service declared inside GCS connector, the error is different
between S3 and GCS, when S3 jar is missing the error will say that a class is
missing, but if GCS jar is missing, it would say that there is no such FS
scheme.
> Add GCS FS impl reference to core-default.xml
> ---------------------------------------------
>
> Key: HADOOP-17402
> URL: https://issues.apache.org/jira/browse/HADOOP-17402
> Project: Hadoop Common
> Issue Type: Improvement
> Components: fs
> Reporter: Rafal Wojdyla
> Priority: Major
>
> Akin to current S3 default configuration add GCS configuration, specifically
> to declare the GCS implementation. [GCS
> connector|https://cloud.google.com/dataproc/docs/concepts/connectors/cloud-storage].
> Has this not been done since the GCS connector is not part of the hadoop/ASF
> codebase, or is there any other blocker?
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
