Hello,
I am a developer trying to use Apache Arrow in my Java code, and I'm having
some issues reading a Parquet file from AWS S3. As per the documentation,
this is what my URI and the connection to the file system looks like:
*String uri =
"s3://{accessKey}:{secretAccessKey}@{bucketName}/{objectKey}?region=us-east-1";BufferAllocator
allocator = new RootAllocator(Long.MAX_VALUE);DatasetFactory
datasetFactory = new FileSystemDatasetFactory(allocator,
NativeMemoryPool.getDefault(), FileFormat.PARQUET, uri)*
However, when I run this code I get the following
error:java.lang.RuntimeException: When getting information for key
'{objectKey}' in bucket '{bucketName}': AWS Error NETWORK_CONNECTION
during HeadObject operation: curlCode: 35, SSL connect error
at
org.apache.arrow.dataset.file.JniWrapper.makeFileSystemDatasetFactory(Native
Method)
at
org.apache.arrow.dataset.file.FileSystemDatasetFactory.createNative(FileSystemDatasetFactory.java:40)
at
org.apache.arrow.dataset.file.FileSystemDatasetFactory.<init>(FileSystemDatasetFactory.java:31)
Could I get some guidance on this? I'm able to connect to S3 just fine
using the Java AWS library in my code, so I know my application can
connect to S3.
Also, if my bucket also needs the AWS session token to connect, how
would I go about implementing that?
Thanks!
Sincerely,
Ramya
______________________________________________________________________
The information contained in this e-mail may be confidential and/or proprietary
to Capital One and/or its affiliates and may only be used solely in performance
of work or services for Capital One. The information transmitted herewith is
intended only for use by the individual or entity to which it is addressed. If
the reader of this message is not the intended recipient, you are hereby
notified that any review, retransmission, dissemination, distribution, copying
or other use of, or taking of any action in reliance upon this information is
strictly prohibited. If you have received this communication in error, please
contact the sender and delete the material from your computer.
