Re: df.show() to text file

2021-12-25 Thread papadopo 
Sean is right. Use another action like saveAsTextfile or write on a parquet 
file.Happy holidays.ApostolosApostolos N. PapadopoulosAssociate ProfessorSchool 
of InformaticsAristotle University of Thessaloniki54124 Thessaloniki Greece
 Αρχικό μήνυμα Από: Sean Owen  Ημερομηνία: 
25/12/21  03:49  (GMT+02:00) Προς: bit...@bitfox.top Κοιν.: User 
 Θέμα: Re: df.show() to text file You can redirect the 
stdout of your program I guess but show is for display, not saving data. Use 
df.write methods for that. On Fri, Dec 24, 2021, 7:02 PM   
wrote:Hello list,

spark newbie here :0
How can I write the df.show() result to a text file in the system?
I run with pyspark, not the python client programming.

Thanks.

-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org

Re: df.show() to text file

2021-12-24 Thread Sean Owen 
You can redirect the stdout of your program I guess but show is for
display, not saving data. Use df.write methods for that.

On Fri, Dec 24, 2021, 7:02 PM  wrote:

> Hello list,
>
> spark newbie here :0
> How can I write the df.show() result to a text file in the system?
> I run with pyspark, not the python client programming.
>
> Thanks.
>
> -
> To unsubscribe e-mail: user-unsubscr...@spark.apache.org
>
>

df.show() to text file

2021-12-24 Thread bitfox 

Hello list,

spark newbie here :0
How can I write the df.show() result to a text file in the system?
I run with pyspark, not the python client programming.

Thanks.

-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org