melin created SPARK-43382:
-----------------------------
Summary: Read and write csv and json files. Archive files such as
zip or gz are supported
Key: SPARK-43382
URL: https://issues.apache.org/jira/browse/SPARK-43382
Project: Spark
Issue Type: Bug
Components: SQL
Affects Versions: 3.5.0
Environment: snowflake data import and export, support fixed files.
For example:
{code:java}
COPY INTO @mystage/data.csv.gz
COPY INTO mytable
FROM @my_ext_stage/tutorials/dataloading/sales.json.gz;
FILE_FORMAT = (TYPE = 'JSON')
MATCH_BY_COLUMN_NAME='CASE_INSENSITIVE';
{code}
Can spark directly read archive files?
{code:java}
spark.read.csv("/tutorials/dataloading/sales.json.gz"){code}
Reporter: melin
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
