Nick-Nal opened a new issue, #970:
URL: https://github.com/apache/datafusion-python/issues/970

   **Describe the bug**
   Hi
   
   I was trying to create external table from AWS S3 using examples from 
[Datafusion CLI 
docs](https://datafusion.apache.org/user-guide/cli/datasources.html#s3) and 
[SQL DDL 
docs](https://datafusion.apache.org/user-guide/sql/ddl.html#create-external-table),
 see **To Reproduce** section below. But looks like AWS-specific options for 
external tables doesn't work with SQL API in the same way as it described in 
CLI docs
   
   ```Exception: DataFusion error: Configuration("Could not find config 
namespace \"aws\"")```
   
   I can successfully register and read the same parquet with the same 
credentials via register_object_store + register_parquet functions, so there's 
no problem with the data or S3 connection
   
   **To Reproduce**
   ```python
   import datafusion
   
   ctx = datafusion.SessionContext()
   
   raw_data_df = ctx.sql(f"""
       create external table raw_data
       stored as parquet
       options
       (
           'aws.access_key_id' '***',
           'aws.secret_access_key' '***',
           'aws.region' 'eu-central-1'
       ) 
       location 's3://some-bucket/some-folder/'
   """)
   
   raw_data_df.show()
   ```
   
   **Expected behavior**
   ```create external table``` command works with ```aws.xxx``` options
   
   **Additional context**
   v 42.0.0
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to