Subject: Re: Write python dataframe to ignite table.
Hello!
Well, COPY command does allow you to do column mapping:
COPY FROM '/path/to/local/file.csv'
INTO tablename (columnName, columnName, ...) FORMAT CSV
If you need to do non-trivial transformations, you can use JDBC driver in SET
STREAMING
t csv files.
>
>
>
>
>
> *Regards,*
>
> *Favas *
>
>
>
> *From:* Stephen Darlington
> *Sent:* Monday, October 28, 2019 5:05 PM
> *To:* user@ignite.apache.org
> *Subject:* Re: Write python dataframe to ignite table.
>
>
>
> What have you tried
o column
> mapping while import csv files.
>
>
> Regards,
> Favas
>
> From: Stephen Darlington
> Sent: Monday, October 28, 2019 5:05 PM
> To: user@ignite.apache.org
> Subject: Re: Write python dataframe to ignite table.
>
> What have you tried? As long as y
load csv files into ignite.
Ignite COPY command I can not use here, because I need an option to do column
mapping while import csv files.
Regards,
Favas
From: Stephen Darlington
Sent: Monday, October 28, 2019 5:05 PM
To: user@ignite.apache.org
Subject: Re: Write python dataframe to ignite
What have you tried? As long as your command-line includes the right JAR files
it seems to more-or-less just work for me:
https://medium.com/@sdarlington/the-trick-to-successfully-integrating-apache-ignite-and-pyspark-890e436d09ba
Andrey, Alexey, Nikolay,
Do we have any solutions for calling Ignite + Spark implementation from
Python?
-
Denis
On Tue, Oct 22, 2019 at 3:41 AM Muhammed Favas <
favas.muham...@expeedsoftware.com> wrote:
> Hi,
>
>
>
> Is there a way to bulk load python dataframe values to ignite table?
>
>
>