RE: Write python dataframe to ignite table.

2019-10-30 Thread Muhammed Favas
Subject: Re: Write python dataframe to ignite table. Hello! Well, COPY command does allow you to do column mapping: COPY FROM '/path/to/local/file.csv' INTO tablename (columnName, columnName, ...) FORMAT CSV If you need to do non-trivial transformations, you can use JDBC driver in SET STREAMING

Re: Write python dataframe to ignite table.

2019-10-29 Thread Ilya Kasnacheev
t csv files. > > > > > > *Regards,* > > *Favas * > > > > *From:* Stephen Darlington > *Sent:* Monday, October 28, 2019 5:05 PM > *To:* user@ignite.apache.org > *Subject:* Re: Write python dataframe to ignite table. > > > > What have you tried

Re: Write python dataframe to ignite table.

2019-10-29 Thread Stephen Darlington
o column > mapping while import csv files. > > > Regards, > Favas > > From: Stephen Darlington > Sent: Monday, October 28, 2019 5:05 PM > To: user@ignite.apache.org > Subject: Re: Write python dataframe to ignite table. > > What have you tried? As long as y

RE: Write python dataframe to ignite table.

2019-10-29 Thread Muhammed Favas
load csv files into ignite. Ignite COPY command I can not use here, because I need an option to do column mapping while import csv files. Regards, Favas From: Stephen Darlington Sent: Monday, October 28, 2019 5:05 PM To: user@ignite.apache.org Subject: Re: Write python dataframe to ignite

Re: Write python dataframe to ignite table.

2019-10-28 Thread Stephen Darlington
What have you tried? As long as your command-line includes the right JAR files it seems to more-or-less just work for me: https://medium.com/@sdarlington/the-trick-to-successfully-integrating-apache-ignite-and-pyspark-890e436d09ba

Re: Write python dataframe to ignite table.

2019-10-24 Thread Denis Magda
Andrey, Alexey, Nikolay, Do we have any solutions for calling Ignite + Spark implementation from Python? - Denis On Tue, Oct 22, 2019 at 3:41 AM Muhammed Favas < favas.muham...@expeedsoftware.com> wrote: > Hi, > > > > Is there a way to bulk load python dataframe values to ignite table? > > >