James Kim created FLINK-24057: --------------------------------- Summary: Flink SQL client Hadoop is not in the classpath/dependencies error even thugh Hadoop S3 File system plugin was added Key: FLINK-24057 URL: https://issues.apache.org/jira/browse/FLINK-24057 Project: Flink Issue Type: Bug Components: Table SQL / API, Table SQL / Client Affects Versions: 1.13.2 Environment: VirtualBox Ubuntu 18.03 Reporter: James Kim
I'm trying use a CSV file on an S3 compliant object store and query through Flink SQL client. As docs (https://ci.apache.org/projects/flink/flink-docs-release-1.13/docs/deployment/filesystems/s3/#hadooppresto-s3-file-systems-plugins) have stated, I have added the s3.access-key, s3.secret-key, s3.endpoint, and s3.path.style.access to flink-conf.yaml. However, when I ran Flink SQL, created a table with connector as filesystem, path as the s3a path and format as csv. However, when I run select * on the table, it hangs for couple minutes so I checked the logs and it gives me "INFO org.apache.flink.core.fs.FileSystem [] - Hadoop is not in the classpath/dependencies. The extended set of supported File Systems via Hadoop is not available". This should have been taken care of according to the docs by adding the Hadoop S3 File System plugins, however, it does not work as expected. -- This message was sent by Atlassian Jira (v8.3.4#803005)