Re: spark and plot data

gt; >>>>> Plotting, graphing, data visualization, report generation are common >>>>> needs in scientific and enterprise computing. >>>>> >>>>> Can you tell me more about your use case? What is it about the current >>>>> proces

Re: spark and plot data

e case? What is it about the current >> process / workflow do you think could be improved by pushing plotting (I >> assume you mean plotting and graphing) into spark. >> >> >> In my personal work all the graphing is done in the driver on summary stats >> calc

Re: spark and plot data

gt;>>>> Plotting, graphing, data visualization, report generation are common >>>>> needs in scientific and enterprise computing. >>>>> >>>>> Can you tell me more about your use case? What is it about the current >>>>> process /

Re: spark and plot data

Pseudo >>>> >>>> Plotting, graphing, data visualization, report generation are common >>>> needs in scientific and enterprise computing. >>>> >>>> Can you tell me more about your use case? What is it about the current >>>>

Re: spark and plot data

Hi Taotao, that is the way its usually used to visualize data from SPARK. But I do see that people transfer the data to list to feed to Matplot (as in the SPARK course currently running in EDX). Please try using blaze and bokeh and you will be in a new world altogether. Regards, Gourav On Sat,

Re: spark and plot data

hi, pesudo, I've posted a blog before spark-dataframe-introduction , and for me, I use spark dataframe [ or RDD ] to do the logic calculation on all the datasets, and then transform the result into pandas dataframe, and make d

Re: spark and plot data

ell me more about your use case? What is it about the current >>> process / workflow do you think could be improved by pushing plotting (I >>> assume you mean plotting and graphing) into spark. >>> >>> >>> In my personal work all the graphing is done in the

Re: spark and plot data

be improved by pushing plotting (I >> assume you mean plotting and graphing) into spark. >> >> >> In my personal work all the graphing is done in the driver on summary >> stats calculated using spark. So for me using standard python libs has not >> been a pro

Re: running jupyter notebook server Re: spark and plot data

is in the process of being released. The new Juypter lab > alpha was just announced it looks really sweet. > > > > From: pseudo oduesp > Date: Friday, July 22, 2016 at 2:08 AM > To: Andrew Davidson > Subject: Re: spark and plot data > > HI andy , > thanks for reply ,

running jupyter notebook server Re: spark and plot data

e new Juypter lab alpha was just announced it looks really sweet. From: pseudo oduesp Date: Friday, July 22, 2016 at 2:08 AM To: Andrew Davidson Subject: Re: spark and plot data > HI andy , > thanks for reply , > i tell it just hard to each time switch between local concept and

Re: spark and plot data

From: pseudo oduesp Date: Thursday, July 21, 2016 at 8:30 AM To: "user @spark" Subject: spark and plot data Hi ,  i know spark  it s engine  to compute large data set but for me i work with pyspark and it s very wonderful machine  my question  we  don't have tools for ploting da

Re: spark and plot data

e using standard python libs has not > been a problem. > > Andy > > From: pseudo oduesp > > Date: Thursday, July 21, 2016 at 8:30 AM > To: "user @spark" > > Subject: spark and plot data > > Hi , > i know spark it s engine to compute large data set

Re: spark and plot data

and graphing) into spark. In my personal work all the graphing is done in the driver on summary stats calculated using spark. So for me using standard python libs has not been a problem. Andy From: pseudo oduesp Date: Thursday, July 21, 2016 at 8:30 AM To: "user @spark" Subject:

spark and plot data

Hi , i know spark it s engine to compute large data set but for me i work with pyspark and it s very wonderful machine my question we don't have tools for ploting data each time we have to switch and go back to python for using plot. but when you have large result scatter plot or roc curve yo