Re: [Question] Does Apache SnowflakeIO support Apache Parquet?

2024-03-06 Thread Xinmin
Hello,

The reason why is that Parquet can help user reduce the storage
requirement, please refer to below and here is the link
https://www.databricks.com/glossary/what-is-parquet. Any response would be
appreciated. Thank you.

[image: image.png]

Regards,
Xinmin


On Tue, Mar 5, 2024 at 1:08 PM Wiśniowski Piotr <
contact.wisniowskipi...@gmail.com> wrote:

> Hi Xinmin,
>
> After quick look at the connection in java it seems that the csv format
> was an explicit decision. As this is entirely transparent to user I am just
> curious why would You like to use parquet instead? What do you want to
> achieve?
>
> Regards,
>
> Wiśniowski Piotr
> On 5.03.2024 05:47, Xinmin wrote:
>
> Hello guru,
>
> We would like to write data to Snowflake with S3 bucket, basically, the
> connector uploads the file in the CSV format to S3 bucket before copying
> data into the table. Please refer to below.
>
> [image: image.png]
>
> Do you have any plans to support Apache Parquet? Thanks.
>
> Regards,
> Xinmin
>
>


Re: [Question] Does Apache SnowflakeIO support Apache Parquet?

2024-03-05 Thread Wiśniowski Piotr

Hi Xinmin,

After quick look at the connection in java it seems that the csv format 
was an explicit decision. As this is entirely transparent to user I am 
just curious why would You like to use parquet instead? What do you want 
to achieve?


Regards,

Wiśniowski Piotr

On 5.03.2024 05:47, Xinmin wrote:

Hello guru,

We would like to write data to Snowflake with S3 bucket, basically, 
the connector uploads the file in the CSV format to S3 bucket before 
copying data into the table. Please refer to below.


image.png

Do you have any plans to support Apache Parquet? Thanks.

Regards,
Xinmin